Data Engineer with AWS
1 week ago
Project description
We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join a dynamic data team. You will be responsible for building and maintaining scalable data pipelines, orchestrating workflows, and ensuring data quality and availability across platforms.
Responsibilities
- Data Pipeline Development: Design, build, and maintain robust, scalable, and efficient ETL/ELT pipelines for ingesting, transforming, and loading data from various sources into our data lake and data warehouse. AWS Expertise: Develop and manage data solutions using a wide range of AWS services, including but not limited to: Storage: S3 (for data lakes), RDS (PostgreSQL, MySQL), Redshift (data warehousing), DynamoDB. Compute/Processing: Glue, EMR (Spark), Lambda, Athena. Orchestration/Workflow: AWS Step Functions, AWS Data Pipeline. Networking & Security: VPC, IAM, Security Groups. Apache Airflow Orchestration: Develop, deploy, and manage complex Directed Acyclic Graphs (DAGs) in Apache Airflow to schedule, monitor, and automate data workflows. Implement best practices for Airflow DAG design, error handling, logging, and monitoring. Optimize Airflow performance and manage Airflow environments (e.g., using Amazon MWAA or self-hosted).
SKILLS
Must have
- Overall, 8 years of experience as a Data Engineer and over 5 years of relevant experience in AWS. Programming: Strong proficiency in Python for data manipulation, scripting, and automation. SQL: Expert-level SQL skills for querying, manipulating, and optimizing data in relational and analytical databases. AWS Services: Proven hands-on experience designing, building, and operating data solutions on AWS (S3, Glue, Redshift, EMR, Lambda, RDS, Step Functions, etc.). Apache Airflow: In-depth experience with Apache Airflow for data pipeline orchestration, including DAG development, custom operators, sensors, and managing Airflow environments. ETL/ELT: Solid understanding and practical experience with ETL/ELT methodologies and tools.
Nice to have
N/A
-
AWS Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeGreetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:- Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering...
-
AWS Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Acme Services Full timeWe are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...
-
AWS Data Engineer
1 week ago
Bengaluru, Karnataka, India Acme Services Full time US$ 90,000 - US$ 1,20,000 per yearWe are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...
-
AWS Data Engineer
4 days ago
Bengaluru, Karnataka, India Acme Services Full timeWe are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...
-
Aws data engineer
11 hours ago
Bengaluru, Karnataka, India Acme Services Full timeWe are seeking an AWS Data Engineer skilled in AWS, Python, Py Spark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...
-
AWS Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeGreetings from Tata Consultancy Services We are hiring AWS Data Engineer Position: AWS Data Engineer Job Location: Bangalore Experience : 10-14 years Interested professionals kindly apply through the link. Must Have: Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and...
-
AWS Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeGreetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a...
-
AWS Data Engineer
6 days ago
Bengaluru, Karnataka, India Teamware Solutions Full timeAbout the Company Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd About the Role We are hiring an AWS Data Engineer Location: Bangalore Work Model: Hybrid Experience: 5-7 years Notice Period: Immediate- 15 days Open roles: 22 Data Engineer: Data Engineer, DevOps, Data Modeller, QA, Business systems...
-
AWS Data Engineer
6 days ago
Bengaluru, Karnataka, India Teamware Solutions Full timeAbout the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring an AWS Data Engineer- Location: Bangalore- Work Model: Hybrid- Experience: 5-7 years- Notice Period: Immediate- 15 days- Open roles: 22Data Engineer:Data Engineer, DevOps, Data Modeller, QA, Business systems analyst, Data Analyst,...
-
AWS Data Engineer
3 days ago
Bengaluru, Karnataka, India Teamware Solutions Full timeAbout the Company Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd About the Role We are hiring an AWS Data Engineer Location: Bangalore Work Model: Hybrid Experience: 5-7 years Notice Period: Immediate- 15 days Open roles: 22 Data Engineer: Data Engineer, DevOps, Data Modeller, QA, Business systems analyst, Data...
