AWS Cloud Python Data Engineer
3 days ago
Data Engineer (L3) – Python & AWS
Job Overview:
We are seeking a highly skilled Data Engineer with strong expertise in
AWS cloud services and Python programming
. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines, ensuring data availability, quality, and performance across enterprise systems. You will collaborate closely with data analysts, data scientists, and business stakeholders to deliver reliable, high-quality data solutions.
Total experience : 5 to 8 years
Key Responsibilities
● Design, develop, and maintain ETL/ELT data pipelines using Python and AWS native services (Glue, Lambda, EMR, Step Functions, etc.)
● Build and manage data lakes and data warehouses using Amazon S3, Redshift, Athena, and Lake Formation
● Implement data ingestion from diverse sources (RDBMS, APIs, streaming data, on-premise systems)
● Optimize data workflows for performance, cost, and reliability using AWS tools like Glue Jobs, Athena, and Redshift Spectrum
● Develop reusable, modular Python-based frameworks for data ingestion, transformation, and validation
● Work with stakeholders to understand data requirements, model data structures, and ensure data consistency and governance
● Deploy and manage data infrastructure using Infrastructure as Code (IaC) tools such as Terraform or AWS CloudFormation
● Implement data quality, monitoring, and alerting using CloudWatch, Glue Data Catalog, or third-party tools
● Support data security and compliance (IAM roles, encryption, data masking, GDPR policies, etc.)
● Collaborate with DevOps and ML teams to integrate data pipelines into analytics and AI workflows
Required Skills & Qualifications
● Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
● to 8 years of experience as a Data Engineer or similar role.
● Strong programming experience in Python (pandas, boto3, PySpark, SQLAlchemy, etc.)
● Deep hands-on experience with AWS services, including:
○ AWS Glue, Lambda, EMR, Redshift, Athena, S3, Step Functions
○ IAM, CloudWatch, Kinesis (for streaming), and ECS/EKS (for containerized workloads)
● Experience with SQL and NoSQL databases (e.g., PostgreSQL, DynamoDB, MongoDB)
● Strong knowledge of data modeling, schema design, and ETL orchestration.
● Familiarity with version control (Git) and CI/CD pipelines for data projects.
● Understanding of data governance, lineage, and cataloging principles.
● Excellent problem-solving, debugging, and performance-tuning skills.
Preferred / Nice-to-Have Skills
● Experience with Apache Spark or PySpark on AWS EMR.
● Exposure to Airflow, dbt, or similar workflow orchestration tools.
● Knowledge of containerization (Docker, Kubernetes) and DevOps practices.
● Experience with machine learning data pipelines or real-time streaming (Kafka, Kinesis).
● Familiarity with AWS Glue Studio, AWS DataBrew, or AWS Lake Formation.
Soft Skills
● Strong analytical and communication skills.
● Ability to work independently and in cross-functional teams.
● Passion for automation and continuous improvement.
● Adaptability in fast-paced, evolving cloud environments.
-
AWS Cloud DevOps engineer
6 days ago
Hyderabad, Telangana, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per yearReq ID: 337989NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Cloud DevOps engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Experience with various AWS...
-
AWS Data Engineer
2 weeks ago
Hyderabad, Telangana, India Zorba Consulting Full time ₹ 8,00,000 - ₹ 24,00,000 per yearRole & Responsibilities :Design, develop, and maintain robust AWS-based data pipelines using Python and PySpark.Implement efficient ETL processes, ensuring data integrity and optimal performance across AWS services (S3, Glue, EMR, Redshift).Collaborate with cross-functional teams to integrate data engineering solutions within broader business-critical...
-
Data Engineer AWS
1 week ago
Hyderabad, Telangana, India Click Objects Information Systems Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for Data Engineer for the below requirement.Key Responsibilities:● Collaborate with cloud engineer to migrate and execute AWS DMS replication tasks.● Migrate data in data warehouses across AWS accounts.● Migrate IICS task flows and repoint them in the new AWS account.● Manage and re-deploy Python and Lambda functions.● Migrate ECS...
-
AWS Data Engineer
5 days ago
Hyderabad, Telangana, India Uplers Full time ₹ 12,00,000 - ₹ 36,00,000 per yearExperience: yearsSalary: Confidential (based on experience)Expected Notice Period: 7 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: Hybrid (Hyderabad)Placement Type: Full Time Permanent position(Payroll and Compliance to be managed by: Clovertex)**(*Note: This is a requirement for one of Uplers' client - Clovertex)**What do you need for this...
-
Aws Data Engineer
2 weeks ago
Hyderabad, Telangana, India Swarnasky Full time ₹ 12,00,000 - ₹ 36,00,000 per yearData Engineer AWS | Redshift | Snowflake | AI & AutomationLocation: Madhapur, HyderabadDepartment: Data Engineering / AnalyticsEmployment Type: Full-time About the Role: We are seeking an experienced Data Engineer to join our expanding Data & Analytics team. In this role, you will design and build scalable data pipelines, automate data...
-
Aws Data Engineer
3 days ago
Hyderabad, Telangana, India ea5ea2a2-9527-41f2-bc78-529a5f850f1c Full time ₹ 15,00,000 - ₹ 25,00,000 per yearAbout the RoleWe are seeking an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data platforms on Amazon Web Services. The ideal candidate will have strong experience with big data technologies, data modeling, ETL/ELT development, and cloud-oriented architecture.Key ResponsibilitiesDesign, develop, and...
-
Aws Data Engineer
1 week ago
Hyderabad, Telangana, India Capgemini Full time ₹ 8,00,000 - ₹ 24,00,000 per yearWe are hiring a Data Engineer with strong experience in AWS cloud services, Python, and data pipeline development. The ideal candidate will work on designing scalable data solutions, building ETL pipelines, and collaborating with cross-functional teams to deliver high-quality data products.Key Responsibilities:Design and develop data pipelines using AWS...
-
Engineer(AWS, Python, SQL)
1 week ago
Hyderabad, Telangana, India Techno-Comp Computer Services Pvt. Ltd. Full time ₹ 8,00,000 - ₹ 24,00,000 per yearGreetings from Techno Comp Pvt LtdWe have vacancies for Aws - Bigdata Specialist position.We are looking for a highly skilled Senior AWS Data Engineer to join our growing data engineering team. The ideal candidate will have deep hands-on experience in AWS cloud services, big data processing frameworks, and advanced SQL programming. You will be responsible...
-
AWS Cloud Engineer
1 week ago
Hyderabad, Telangana, India Amgen Inc Full time ₹ 6,00,000 - ₹ 18,00,000 per year*What you will do*The AWS Cloud Engineer will be responsible for maintaining scalable, secure, and reliable AWS cloud infrastructure. This is a hands-on engineering role requiring deep expertise in Infrastructure as Code (IaC), automation, cloud networking, and security . The ideal candidate should have strong AWS knowledge and be capable of writing and...
-
Data Engineer – Python
2 weeks ago
Hyderabad, Telangana, India Egen Full time ₹ 12,00,000 - ₹ 24,00,000 per yearJob Overview:We are seeking a highly skilled Data Engineer with strong expertise in AWS cloud services and Python programming. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines, ensuring data availability, quality, and performance across enterprise systems. You will collaborate closely with data...