AWS Data Engineer

11 hours ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,25,000 - US$ 1,75,000
Job Overview

We are seeking a highly skilled AWS Data Engineer to join our team. As a key member of our engineering department, you will be responsible for designing and implementing scalable, high-performance data pipelines using AWS services.

About the Role

The successful candidate will have experience with AWS data services, including Glue, EMR, Lambda, Athena, Redshift, and S3. They will also be proficient in Python and PySpark programming, as well as SQL and PostgreSQL.

Key Responsibilities
  1. Design and implement scalable, high-performance data pipelines using AWS services.
  2. Develop and optimize ETL processes using AWS Glue, EMR, and Lambda.
  3. Build and maintain data lakes using S3 and Delta Lake.
  4. Create and manage analytics solutions using Amazon Athena and Redshift.
  5. Design and implement database solutions using Aurora, RDS, and DynamoDB.
  6. Develop serverless workflows using AWS Step Functions.
  7. Write efficient and maintainable code using Python/PySpark, and SQL/PostgreSQL.
  8. Ensure data quality, security, and compliance with industry standards.
  9. Collaborate with data scientists and analysts to support their data needs.
  10. Optimize data architecture for performance and cost-efficiency.
  11. Troubleshoot and resolve data pipeline and infrastructure issues.
Required Skills and Qualifications
  • Bachelor's degree in computer science, Information Technology, or related field.
  • Relevant years of experience as a Data Engineer, with at least 60% of experience focusing on AWS.
  • Strong proficiency in AWS data services: Glue, EMR, Lambda, Athena, Redshift, S3.
  • Experience with data lake technologies, particularly Delta Lake.
  • Expertise in database systems: Aurora, RDS, DynamoDB, PostgreSQL.
  • Proficiency in Python and PySpark programming.
  • Strong SQL skills and experience with PostgreSQL.
  • Experience with AWS Step Functions for workflow orchestration.
  • Familiarity with data modeling and schema design.
  • Knowledge of data security and compliance requirements.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration abilities.
Preferred Qualifications
  • AWS Certified Data Analytics - Specialty.
  • AWS Certified Solutions Architect - Associate or Professional.
  • Experience with real-time data processing using Kinesis or Kafka.
  • Knowledge of machine learning workflows on AWS (e.g., SageMaker).
  • Familiarity with containerization technologies (Docker, Kubernetes).
  • Experience with CI/CD pipelines and infrastructure-as-code (e.g., CloudFormation, Terraform).
Technical Skills
  • AWS Services: Glue, EMR, Lambda, Athena, Redshift, S3, Aurora, RDS, DynamoDB, Step Functions.
  • Big Data: Hadoop, Spark, Delta Lake.
  • Programming: Python, PySpark.
  • Databases: SQL, PostgreSQL, NoSQL.
  • Data Warehousing and Analytics.
  • ETL/ELT processes.
  • Data Lake architectures.
  • Version control: Git.
  • Agile methodologies.

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:- Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Acme Services Full time US$ 90,000 - US$ 1,20,000 per year

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • Aws data engineer

    1 day ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, Py Spark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services We are hiring AWS Data Engineer Position: AWS Data Engineer Job Location: Bangalore Experience : 10-14 years Interested professionals kindly apply through the link. Must Have: Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a...

  • AWS Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Teamware Solutions Full time

    About the Company Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd About the Role We are hiring an AWS Data Engineer Location: Bangalore Work Model: Hybrid Experience: 5-7 years Notice Period: Immediate- 15 days Open roles: 22 Data Engineer: Data Engineer, DevOps, Data Modeller, QA, Business systems...

  • AWS Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Teamware Solutions Full time

    About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring an AWS Data Engineer- Location: Bangalore- Work Model: Hybrid- Experience: 5-7 years- Notice Period: Immediate- 15 days- Open roles: 22Data Engineer:Data Engineer, DevOps, Data Modeller, QA, Business systems analyst, Data Analyst,...

  • AWS Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Teamware Solutions Full time

    About the Company Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd About the Role We are hiring an AWS Data Engineer Location: Bangalore Work Model: Hybrid Experience: 5-7 years Notice Period: Immediate- 15 days Open roles: 22 Data Engineer: Data Engineer, DevOps, Data Modeller, QA, Business systems analyst, Data...