AWS Data Engineer

2 days ago

Hyderabad, Telangana, India Zorba AI Full time

Job Summary
The ideal candidate will have experience developing and orchestrating cloud-native ETL pipelines using Python and AWS services (Redshift, EC2, S3, Glue, SSM), including robust logging, error handling, and automation of data migration tasks. They will also possess a strong background and deep understanding of AWS data architecture systems.

This role involves designing, implementing, and testing robust data pipelines, optimizing Redshift database performance, and ensuring the scalability and reliability of our data infrastructure.

Key Responsibilities Include, But Are Not Limited To

  • Design, develop, and orchestrate cloud-native ETL pipelines using Python and AWS services (Redshift, EC2, S3, Glue, SSM).
  • Migrate data from legacy systems (e.g., DB2) to Amazon Redshift, ensuring data quality, integrity, and completeness.
  • Optimize Redshift database performance through effective use of sort keys, distribution keys, and query tuning.
  • Implement robust logging, monitoring, and error handling in accordance with architecture standards.
  • Automate data migration, transformation, and validation processes to support scalable and reliable data workflows.
  • Collaborate with cross-functional teams to gather requirements and deliver data solutions that meet business needs.
  • Maintain and enhance data infrastructure to ensure high availability, scalability, and security.
  • Troubleshoot and resolve issues related to data pipelines, Redshift performance, and AWS infrastructure.
  • Document data flows, pipeline designs, and operational procedures for ongoing support and knowledge sharing.
  • Stay current with AWS best practices and emerging technologies to continuously improve data engineering processes.

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
  • 3+ years of hands-on experience with Amazon Redshift, including table design, data loading, and query optimization.
  • Strong experience with AWS ecosystem: S3, EC2, IAM, Glue, SSM, and related services.
  • Strong proficiency using Git for version control and collaboration on code base.
  • Proficient in Python for ETL, automation, and orchestration (including boto3, PySpark).
  • Solid background in SQL, with expertise in writing, analyzing, and tuning complex queries for large datasets.
  • Experience migrating data from legacy systems (e.g., DB2) to Redshift or other cloud data warehouses.

Desired Skills

  • Deep understanding of Redshift architecture (columnar storage, MPP, node types, concurrency scaling).
  • Expertise in designing tables with optimal sort keys, distribution keys, and column encoding.
  • Ability to use EXPLAIN plans to diagnose and resolve query performance issues.
  • Experience with Redshift-specific maintenance (VACUUM, ANALYZE, WLM configuration).
  • Experience automating performance monitoring, alerting, and cost optimization in Redshift.
  • Strong troubleshooting skills for slow queries, data skew, and resource contention.
  • Experience with CI/CD for data pipelines and infrastructure-as-code (Terraform) is a plus.
  • Knowledge of serverless architecture and services (e.g AWS Lambda)
  • Excellent communication skills for collaborating with cross-functional teams and documenting solutions.

Skills: aws,etl,python

  • AWS Data Engineer

    3 hours ago

    Hyderabad, Telangana, India Virtusa Full time

    AWS Data EngineerWorkMode \:HybridWork Location \: Chennai / Hyderabad / Bangalore / Pune /Gurgaon / MumbaiWork Timing \: 2 PM to 11 PMPrimary \: AWS Data EngineerAWS Glue, Redshift, Python, ETL.Design and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and S3.Develop efficient ETL processes for data extraction,...

  • AWS Data Engineer

    2 days ago

    Hyderabad, Telangana, India Viraaj HR Solutions Private Limited Full time

    Industry & Sector:Cloud data engineering and analytics services serving enterprise customers. We build scalable ETL pipelines, data lakes and analytics platforms on AWS to enable data-driven decisioning across finance, retail, and SaaS domains.Role:AWS Data Engineer (On-site, India) — responsible for designing, building and operating robust AWS-native data...

  • Aws Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Swarnasky Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Data Engineer AWS | Redshift | Snowflake | AI & AutomationLocation: Madhapur, HyderabadDepartment: Data Engineering / AnalyticsEmployment Type: Full-time About the Role: We are seeking an experienced Data Engineer to join our expanding Data & Analytics team. In this role, you will design and build scalable data pipelines, automate data...

  • Aws Data Engineer

    5 hours ago

    Hyderabad, Telangana, India Mobilution It Systems Full time

    Company Name: EgenJob Title: AWS- Senior Data EngineerExperience: 10+ YearsLocation: Hyderabad / RemoteWork Mode: WFOSalary: CompetitiveEmployment Type: Full-timeRole OverviewThe Senior Data Engineer designs, builds, and optimizes scalable, high-performance data platforms on AWS using Python. The role owns end-to-end data pipelines across batch and...

  • AWS Data Engineer

    2 days ago

    Hyderabad, Telangana, India Uplers Full time

    Experience: yearsSalary: Confidential (based on experience)Expected Notice Period: 7 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: Hybrid (Hyderabad)Placement Type: Full Time Permanent position(Payroll and Compliance to be managed by: Clovertex)**(*Note: This is a requirement for one of Uplers' client - Clovertex)**What do you need for this...

  • AWS Data Engineer

    4 hours ago

    Hyderabad, Telangana, India People Prime Worldwide Full time

    Important Note (Please Read Before Applying)DoNOT applyif:You have less than 6 years or more than 17 years of experienceYou do not have hands-on AWS Data Engineer 5+ experienceYou are on a notice period longer than 15 daysYou are looking for remote onlyYou are a fresher or unrelated background (e.g., support, testing only, non-Java roles) ApplyONLY...

  • Aws Data Engineer

    6 days ago

    Hyderabad, Telangana, India Capgemini Full time

    We are hiring a Data Engineer with strong experience in AWS cloud services, Python, and data pipeline development. The ideal candidate will work on designing scalable data solutions, building ETL pipelines, and collaborating with cross-functional teams to deliver high-quality data products.Key Responsibilities:Design and develop data pipelines using AWS...

  • Software Development Engineer, AWS Fintech

    7 hours ago

    Hyderabad, Telangana, India Amazon Web Services (AWS) Full time

    DescriptionAre you interested in building high-performance, globally scalable AWS Financial systems that drive Amazon's current and future growth? Are you seeking an environment where you can drive innovation leveraging the scalability and innovation with Amazon's AWS cloud services? Do you have a passion for ensuring a positive customer experience? This is...

  • Aws Data Engineer

    12 hours ago

    Hyderabad, Telangana, India Astrosoft Technologies Full time

    Role & responsibilitiesAWS Data EngineerLocation - HyderabadExperience - 5+yearsShift PM PM IST (Flexible)Work Mode - Hybrid (Mon & Fri - WFH)Interview process - 2-3Technical RoundsKey Skills Required.Streaming tools - Kafka/Kinesis/ Spark,.AWS Services - S3, Airflow, Glue, DMS, EMR.Programming: Python.Infrastructure as code - Terraform.Databases - Oracle,...

  • AWS Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India, Telangana iDWTeam Full time

    About the RoleWe are seeking an experienced AWS Data Engineer to design, develop, and optimize cloud-based data solutions. The ideal candidate has strong hands-on experience with AWS data services, scalable ETL/ELT pipelines, and modern data architecture patterns. You will work collaboratively with analytics, engineering, and business teams to support...