Lead AWS Data Lake Developer

4 hours ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,25,00,000
Senior AWS Data Engineer Position

We are seeking a Senior AWS Data Engineer to lead the end-to-end design and development of data lake solutions in AWS, including migration from legacy systems like DB2.

The ideal candidate will have experience in designing, building, deploying, and maintaining AWS-based data lake solutions. Additionally, they should be able to lead DB2-to-AWS migration projects with minimal supervision and utilize Python, Spark, Kafka, and advanced SQL for data transformation.

This role requires close collaboration with cross-functional teams using Agile methodologies and contributing to documentation and process improvement using Confluence and Jira.

Key Responsibilities:

  • Data Lake Solution Development: Design, build, deploy, and maintain AWS-based data lake solutions.
  • Migration Project Leadership: Lead DB2-to-AWS migration projects with minimal supervision.
  • ETL Pipeline Creation: Build robust ETL pipelines using Glue, Athena, Lambda, and Kinesis.
  • Data Transformation: Utilize Python, Spark, Kafka, and advanced SQL for data transformation.
  • AWS Database Management: Work with AWS databases like Redshift, Aurora, DynamoDB, RDS, and S3.
  • Security and Compliance: Ensure security and compliance using VPC, IAM, EC2, and network access controls.

Requirements:

  • Bachelor's degree in Computer Science or equivalent.
  • Minimum 6+ years of experience in data engineering.
  • Minimum 2 years of experience building AWS data lakes.
  • Experience in retail banking or other regulated industries is highly desirable.
  • Strong verbal and written communication skills in English.

  • AWS Data Lake Administrator

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role: AWS Data Lake Administrator Location: Bangalore and Hyderabad Years of Experience: 10-14 years (Mandatory) Notice Period: 30 days or lesser. Job Description : We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services...

  • AWS Data Lake Administrator

    1 week ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role: AWS Data Lake Administrator Location: Bangalore and HyderabadYears of Experience: 10-14 years (Mandatory)Notice Period: 30 days or lesser.Job Description:We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3,...

  • AWS Data Lake Manager

    1 week ago

    Bengaluru, Karnataka, India beBeeDataLakeAdministrator Full time ₹ 12,00,000 - ₹ 20,10,000

    AWS Data Lake Administrator Job DescriptionOverview of the RoleThis position is responsible for managing and optimizing our data lake architecture on AWS. We are seeking a highly skilled professional with extensive experience in AWS data services.The ideal candidate will have strong expertise in AWS services like S3, Lake Formation, Glue Catalog, Redshift...

  • AWS Tech Lead

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    TCS presents an excellent Opportunity For "AWS Tech Lead" Role Job Description 1 Role - AWS Tech Lead 2 Location of Requirement - PAN India 3 Experience Range - 10 to 14 Years Desired Competencies Strong knowledge about AWS Data Platform and must have experience of Data Lake, Data Warehouse implementation and migration in/to AWS cloud. strong knowledge on...

  • AWS Tech Lead

    3 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    TCS presents an excellent Opportunity For "AWS Tech Lead" RoleJob Description1 Role - AWS Tech Lead2 Location of Requirement - PAN India3 Experience Range - 10 to 14 YearsDesired CompetenciesStrong knowledge about AWS Data Platform and must have experience of Data Lake, Data Warehouse implementation and migration in/to AWS cloud.strong knowledge on...

  • AWS Tech Lead

    3 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time US$ 1,50,000 - US$ 2,00,000 per year

    TCS presents an excellent Opportunity For "AWS Tech Lead" RoleJob Description1 Role -AWS Tech Lead2 Location of Requirement -PAN India3 Experience Range -10 to 14 YearsDesired CompetenciesStrong knowledge about AWS Data Platform and must have experience of Data Lake, Data Warehouse implementation and migration in/to AWS cloud.strong knowledge on implementing...

  • AWS Tech Lead

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role-Tech. Lead (AWS Data Lake/ETL migration) Relevant Experience Strong knowledge about AWS Data Platform and must have experience of Data Lake, Data Warehouse implementation and migration in/to AWS cloud. Must have strong knowledge on implementing metadata driven re-usable data ingestion and ETL framework, ETL pipeline design, ETL orchestration etc....

  • AWS Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time

    Key Responsibilities:Develop and optimize large-scale data architectures using AWS services.Build and maintain enterprise data lakes using S3, Delta Lake, and Aurora.Create and manage analytics solutions using Amazon Athena and Redshift.Design and implement database systems using RDS, DynamoDB, and PostgreSQL.Develop serverless workflows using AWS Step...

  • AWS Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Senior AWS Data EngineerOverview:We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages.Exp- 3 to 7 years Location- Bangalore, Pune, Hyderabad,...

  • AWS Big Lead Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    About the Role :We are looking for an experienced AWS Big Data Lead Engineer to design, build, and manage scalable data solutions on AWS. The ideal candidate will have extensive hands-on experience in Big Data technologies, cloud-native architecture, and leadership to guide engineering teams in delivering enterprise-grade data pipelines and analytics...