AWS Data Lake Manager

3 days ago

Bengaluru, Karnataka, India beBeeDataLakeAdministrator Full time ₹ 12,00,000 - ₹ 20,10,000
AWS Data Lake Administrator Job Description

Overview of the Role

This position is responsible for managing and optimizing our data lake architecture on AWS. We are seeking a highly skilled professional with extensive experience in AWS data services.

The ideal candidate will have strong expertise in AWS services like S3, Lake Formation, Glue Catalog, Redshift Spectrum, and good knowledge of SQL and query optimization techniques.

  • Key Responsibilities:
  • Administer and manage the AWS Data Lake infrastructure to ensure high availability, security, and performance.
  • Configure and manage AWS S3, Lake Formation, and Glue Data Catalog to organize, secure, and catalog data within the data lake.
  • Set up and manage Redshift Spectrum for querying and analyzing data stored in S3 using SQL and Redshift.
  • Implement and manage data ingestion pipelines to ingest structured and unstructured data from various sources into the data lake using AWS services like Glue ETL, Lambda, and other orchestration tools.
  • Define and enforce data governance policies, access control, and security measures using AWS Lake Formation to ensure compliance with organizational and regulatory requirements.
  • Optimize data storage in S3 through partitioning, compression, and appropriate data formats to improve query performance.
  • Monitor and manage the Glue Catalog for maintaining metadata, table definitions, and data lineage within the data lake.
  • Collaborate with data engineers, architects, and analysts to ensure seamless access to data for analytics and machine learning.
  • Troubleshoot and optimize query performance in Redshift Spectrum, and manage workload performance in the data lake environment.
  • Implement backup, recovery, and disaster recovery strategies for data lake assets to ensure data integrity and availability.

Required Skills and Qualifications

We are looking for professionals with:

  • 4-8 years of experience in managing data lake environments, with a focus on AWS data services.
  • Strong expertise in AWS services like S3, Lake Formation, Glue, Glue Data Catalog, Redshift Spectrum, and Lambda.
  • Good knowledge of SQL and query optimization techniques, particularly in querying data from S3 using Redshift Spectrum and Athena.
  • Experience in data ingestion pipelines using AWS Glue ETL, Lambda, and other AWS orchestration tools.
  • Strong understanding of data governance, access control, and security best practices in AWS environments.
  • Experience with data formats (Parquet, ORC, Avro, JSON) and optimizing data storage for cost and performance.
  • Knowledge of data partitioning, compression, and indexing strategies in S3.
  • Familiarity with monitoring, troubleshooting, and optimizing AWS Data Lake performance.
  • Excellent communication and collaboration skills to work across teams and support business requirements.

Our Ideal Candidate Has:

  • Extensive experience with AWS data services
  • Strong expertise in data governance, access control, and security best practices
  • Excellent communication and collaboration skills

Job Requirements

10-14 years of experience in managing data lake environments

Working Hours Normal working hours

Notice Period 30 days or lesser

Our Company Offers

Opportunities to learn and grow in a dynamic environment

Collaborative team atmosphere

Flexible working arrangements

],

  • AWS Data Lake Administrator

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role: AWS Data Lake AdministratorLocation: Bangalore and HyderabadYears of Experience: 10-14 years (Mandatory)Notice Period: 30 days or lesser.Job Description:We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3,...

  • AWS Data Lake Administrator

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role: AWS Data Lake Administrator Location: Bangalore and Hyderabad Years of Experience: 10-14 years (Mandatory) Notice Period: 30 days or lesser. Job Description : We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services...

  • AWS Data Lake Administrator

    3 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role: AWS Data Lake Administrator Location: Bangalore and HyderabadYears of Experience: 10-14 years (Mandatory)Notice Period: 30 days or lesser.Job Description:We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3,...

  • AWS Data Architect

    6 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time

    Key Responsibilities:Develop and optimize large-scale data architectures using AWS services.Build and maintain enterprise data lakes using S3, Delta Lake, and Aurora.Create and manage analytics solutions using Amazon Athena and Redshift.Design and implement database systems using RDS, DynamoDB, and PostgreSQL.Develop serverless workflows using AWS Step...

  • AWS Data Engineering Leader

    5 days ago

    Bengaluru, Karnataka, India beBeeDataLakeAdministrator Full time ₹ 15,00,000 - ₹ 25,00,000

    AWS Data Lake Administration RoleJob Description:We are seeking an experienced AWS Data Lake Administrator to oversee the management and optimization of our data lake architecture on AWS. The successful candidate will be responsible for ensuring high availability, security, and performance of the AWS Data Lake infrastructure.The ideal candidate will have a...

  • AWS Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Senior AWS Data EngineerOverview:We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages.Exp- 3 to 7 years Location- Bangalore, Pune, Hyderabad,...

  • Senior Data Architect

    5 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time

    Senior Data Engineer (AWS)A key player in our team is needed to design and implement data pipelines using AWS services, focusing on high-performance and scalability. The ideal candidate will be proficient in ETL processes using AWS Glue, EMR, and Lambda, with experience building and maintaining data lakes using S3 and Delta Lake.The role requires strong...

  • AWS Data Engineer

    5 days ago

    Bengaluru, Karnataka, India CareerXperts Consulting Full time

    About the Role:We are seeking a highly skilled AWS Data Engineer to design, build, and optimizelarge-scale data pipelines and analytics platforms. The ideal candidate will havestrong hands-on expertise in AWS Glue, Athena, Redshift, PySpark, and SQL,with a solid understanding of data engineering and data warehousing concepts.You will work on batch and...

  • AWS Data Engineering Specialist

    13 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title:AWS Data Engineering SpecialistJob Description:We are seeking a highly skilled AWS Data Engineer to design, build and optimize large-scale data pipelines and analytics platforms. The ideal candidate will have strong hands-on expertise in AWS Glue, Athena, Redshift, PySpark, and SQL, with a solid understanding of data engineering and data...

  • AWS Data Engineer

    6 days ago

    Bengaluru, Karnataka, India CareerXperts Consulting Full time

    About the Role: We are seeking a highly skilled AWS Data Engineer to design, build, and optimize large-scale data pipelines and analytics platforms. The ideal candidate will have strong hands-on expertise in AWS Glue, Athena, Redshift, PySpark, and SQL, with a solid understanding of data engineering and data warehousing concepts. You will work on batch and...