Etl Developer

12 hours ago

Hyderabad, Telangana, India Spectrum Talent Management Full time

Job Descrption

The ideal candidate will have experience developing and orchestrating cloud-native ETL pipelines using Python and AWS services (Redshift, EC2, S3, Glue, SSM), including robust logging, error handling, and automation of data migration tasks. They will also possess a strong background and deep understanding of AWS data architecture systems.

This role involves designing, implementing, and testing robust data pipelines, optimizing Redshift database performance, and ensuring the scalability and reliability of our data infrastructure.

Key Responsibilities include, but are not limited to:

  • Design, develop, and orchestrate cloud-native ETL pipelines using Python and AWS services (Redshift, EC2, S3, Glue, SSM).
  • Migrate data from legacy systems (e.g., DB2) to Amazon Redshift, ensuring data quality, integrity, and completeness.
  • Optimize Redshift database performance through effective use of sort keys, distribution keys, and query tuning.
  • Implement robust logging, monitoring, and error handling in accordance with architecture standards.
  • Automate data migration, transformation, and validation processes to support scalable and reliable data workflows.
  • Collaborate with cross-functional teams to gather requirements and deliver data solutions that meet business needs.
  • Maintain and enhance data infrastructure to ensure high availability, scalability, and security.
  • Troubleshoot and resolve issues related to data pipelines, Redshift performance, and AWS infrastructure.
  • Document data flows, pipeline designs, and operational procedures for ongoing support and knowledge sharing.
  • Stay current with AWS best practices and emerging technologies to continuously improve data engineering processes.

Qualifications

  • Bachelors degree in Computer Science, Information Systems, Engineering, or related field.
  • 3+ years of hands-on experience with Amazon Redshift, including table design, data loading, and query optimization.
  • Strong experience with AWS ecosystem: S3, EC2, IAM, Glue, SSM, and related services.
  • Strong proficiency using Git for version control and collaboration on code base.
  • Proficient in Python for ETL, automation, and orchestration (including boto3, PySpark).
  • Solid background in SQL, with expertise in writing, analyzing, and tuning complex queries for large datasets.
  • Experience migrating data from legacy systems (e.g., DB2) to Redshift or other cloud data warehouses.

Desired Skills:

  • Deep understanding of Redshift architecture (columnar storage, MPP, node types, concurrency scaling).
  • Expertise in designing tables with optimal sort keys, distribution keys, and column encoding.
  • Ability to use EXPLAIN plans to diagnose and resolve query performance issues.
  • Experience with Redshift-specific maintenance (VACUUM, ANALYZE, WLM configuration).
  • Experience automating performance monitoring, alerting, and cost optimization in Redshift.
  • Strong troubleshooting skills for slow queries, data skew, and resource contention.
  • Experience with CI/CD for data pipelines and infrastructure-as-code (Terraform) is a plus.
  • Knowledge of serverless architecture and services (e.g AWS Lambda)
  • Excellent communication skills for collaborating with cross-functional teams and documenting solutions.

Immediate and Serving Candidates only.

  • ETL Developer

    1 week ago

    Hyderabad, Telangana, India Bean HR Consulting Full time ₹ 1,00,000 - ₹ 2,00,000 per year

    ETL Developer (Grade: LI) – Hyderabad | 3–5 Years | Up to 20 LPAWe are hiring anETL Developerwith strong hands-on experience in building and optimizing data pipelines using modern ETL and cloud technologies. If you are passionate about data engineering and love solving complex data integration challenges, we'd love to connectWhat You'll DoDesign and...

  • ETL Developer

    11 hours ago

    Hyderabad, Telangana, India 4S Advisory Full time

    ESSENTIAL FUNCTIONS : -Design, develop, test, and maintain ETL processes.Collaborate with data architects, modelers, and IT team members on project goals.Develop and implement ETL routines according to the Data Warehouse design and architecture.Translate business needs into technical specifications.Ensure the performance, quality, and responsiveness of ETL...

  • ETL Developer

    1 week ago

    Hyderabad, Telangana, India Technology Next Full time

    ETL Developer (MSBI + ADF)Experience: 5–7 YearsLocation: Noida, Chennai, Pune, Bangalore, HyderabadWork Mode: HybridWorking Hours: 11 AM – 9 PMJob Description:We are seeking an experienced MSBI ETL Developer with strong expertise in SSIS, SQL Server, Power BI, and Azure Data Factory (ADF). The role involves designing, developing, and maintaining scalable...

  • Etl Developer

    10 hours ago

    Hyderabad, Telangana, India Cloudxtreme Full time

    Expert knowledge and familiarity with ETL toolsExpert in developing solutions and deliver the high quality projects using Azure Data FactoryExpert on data integration tools, such as SQL Server Integration Services (SSIS), Data StageExpertise on Web Service design and development (including SOAP, XML, .Net) - Preferable.Expertise on message queue design and...

  • ETL Developer

    2 weeks ago

    Hyderabad, Telangana, India, Telangana Tata Consultancy Services Full time

    TCS has been a great pioneer in feeding the fire of Young techies like you. We are global leaders in the technology arena and there's nothing that can stop us from growing together. TCS Hiring for skill "Talend ETL Developer". Role: Talend ETL DeveloperExperience: 5-8 yearsWork Location: Noida, Pune, Hyderabad, and Bangalore Job Summary:We are looking for an...

  • Etl Developer

    19 hours ago

    Hyderabad, Telangana, India Saransh Software Solutions Full time

    Lead ETL Developer Data Warehouse | Banking DomainExperience: 812 yearsLocation: HyderabadJob Type: Full-time | HybridNotice: 0-20 Days OnlyAbout the RoleJoin our dynamic Data Warehouse team and help the bank leverage data as a strategic asset. As a Lead ETL Developer, youll lead a team of developers to design, develop, and enhance robust data solutions,...

  • ETL Talend Developer

    6 days ago

    Hyderabad, Telangana, India Sunware Technologies Full time

    Location :PuneMode of Work :Full-time, On-siteExperience required :3 - 10 yearsAbout the Role:We are looking for an experienced ETL Talend Developer to join our team The ideal candidate will be responsible for designing, developing, and maintaining data integration solutions using the Talend platform. You will play a key role in ensuring data is accurate,...

  • Senior ETL Developer

    9 hours ago

    Hyderabad, Telangana, India Evnek Full time

    We are seeking an experienced Senior ETL Developer (Informatica) with 57 years of hands-on experience in developing, maintaining, and optimizing data integration and data warehousing solutionsThe ideal candidate should have strong expertise in Informatica PowerCenter and IDMC, with the ability to design and implement efficient ETL workflows, transformations,...

  • ETL Tester

    6 days ago

    Hyderabad, Telangana, India CALTEK Solutions Inc. Full time

    Job descriptionHere's a job description for an ETL Tester with 8 years of experience:Job Title: ETL TesterExperience: 8 yearsJob Summary:We are seeking an experienced ETL Tester to join our team. The ideal candidate will have a strong background in ETL testing, data validation, and data warehousing. The ETL Tester will be responsible for designing,...

  • ETL Lead

    12 hours ago

    Hyderabad, Telangana, India Caliber Technologies Full time

    ETL Lead/ ETL Manager – Caliber APQRLocation:Hyderabad / On-siteCompany:Caliber TechnologiesAbout Caliber Technologies:Caliber is a leading GxP solution provider for the pharmaceutical industry, delivering innovative and quality-driven digital solutions for laboratories across the globe. Our products enable digital transformation for regulated industries,...