AWS Data Lake Administrator

3 days ago

Bengaluru Karnataka India, Karnataka Tata Consultancy Services Full time

TCS Hiring for AWS Data Lake Administrator


Role - AWS Data Lake Administrator

Experience - 10 to 14 Years

Location - Bengaluru, Hyderabad


Roles & Responsibilities

Key Responsibilities:

  • Administer and manage the AWS Data Lake infrastructure, ensuring high availability, security, and performance.
  • Configure and manage AWS S3, Lake Formation, and Glue Data Catalog to organize, secure, and catalog data within the data lake.
  • Set up and manage Redshift Spectrum for querying and analyzing data stored in S3 using SQL and Redshift.
  • Implement and manage data ingestion pipelines to ingest structured and unstructured data from various sources into the data lake using AWS services like Glue ETL, Lambda, and other orchestration tools.
  • Define and enforce data governance policies, access control, and security measures using AWS Lake Formation, ensuring compliance with organizational and regulatory requirements.
  • Optimize data storage in S3 through partitioning, compression, and appropriate data formats like Parquet, Avro, or ORC to improve query performance.
  • Monitor and manage the Glue Catalog for maintaining metadata, table definitions, and data lineage within the data lake.
  • Collaborate with data engineers, architects, and analysts to ensure seamless access to data for analytics and machine learning.
  • Troubleshoot and optimize query performance in Redshift Spectrum, and manage workload performance in the data lake environment.
  • Implement backup, recovery, and disaster recovery strategies for data lake assets, ensuring data integrity and availability.
  • Maintain detailed documentation of data lake architecture, security policies, and data governance procedures.


Qualifications:

  • 4-8 years of experience in managing data lake environments, with a focus on AWS data services.
  • Strong expertise in AWS services like S3, Lake Formation, Glue, Glue Data Catalog, Redshift Spectrum, and Lambda.
  • Good knowledge of SQL and query optimization techniques, particularly in querying data from S3 using Redshift Spectrum and Athena.
  • Experience in data ingestion pipelines using AWS Glue ETL, Lambda, and other AWS orchestration tools.
  • Strong understanding of data governance, access control, and security best practices in AWS environments.
  • Experience with data formats (Parquet, ORC, Avro, JSON) and optimizing data storage for cost and performance.
  • Knowledge of data partitioning, compression, and indexing strategies in S3.
  • Familiarity with monitoring, troubleshooting, and optimizing AWS Data Lake performance.
  • Excellent communication and collaboration skills to work across teams and support business requirements.

AWS certifications, such as AWS Certified Big Data – Specialty or AWS Certified Solutions Architect, are a plus.

  • AWS Data Lake Administrator

    5 days ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    AWS Data Lake Administrator LOCATION – BLR / HYD Job Description: We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3, Lake Formation, Glue Catalog, Redshift Spectrum, and extensive SQL knowledge. The role...

  • AWS Data Engineer

    5 days ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Hi,Greetings from TCS Team!Role AWS Data EngineerRequired Technical Skill Set AWS, S3, EC2, EMR, ECS, Lambda, Glue, Data Lake, IAM.Desired Experience Range 5-8 YearsLocation of Requirement TCS - Chennai, Bangalore, Kochi, Pune, BhubaneswarIf you’re interested in the role if the experience, location and skillset match your profile then please share your...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Title: AWS Data Engineer Exp Range: 5-14 YearsJob Location: Bangalore or Bhubaneswar or Hyderabad Job Description: •Bachelor's degree in Engineering , Technology computer science, statistics, biostatistics, mathematics, biology or other health related field or equivalent experience that provides the skills and knowledge necessary to perform the...

  • Data Lake SME

    2 weeks ago

    Bengaluru, Karnataka, India Hewlett Packard Enterprise | HPE Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Data Lake SMEThis role has been designed as ''Onsite' with an expectation that you will primarily work from an HPE partner/customer office.Who We Are:Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live,...

  • Data Lake SME

    2 weeks ago

    Bengaluru, Karnataka, India Hewlett Packard Enterprise Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Data Lake SMEThis role has been designed as ''Onsite' with an expectation that you will primarily work from an HPE partner/customer office Who We Are: Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live,...

  • Data Lake ETL

    2 weeks ago

    Bengaluru, Karnataka, India Hewlett Packard Enterprise | HPE Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Data Lake ETLThis role has been designed as ''Onsite' with an expectation that you will primarily work from an HPE partner/customer office.Who We Are:Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live,...

  • Data Lake ETL

    1 week ago

    Bengaluru, Karnataka, India HPE Juniper Networking Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    LocationBangalore, Karnataka, 560100CategoryEngineering / Information TechnologyJob TypeFull timeJob Id1193153NoData Lake ETLThis role has been designed as ''Onsite' with an expectation that you will primarily work from an HPE partner/customer office.Who We Are:Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and...

  • Data Lake SME

    1 week ago

    Bengaluru, Karnataka, India HPE Juniper Networking Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    LocationBangalore, Karnataka, 560100CategoryEngineering / Information TechnologyJob TypeFull timeJob Id1193155NoData Lake SMEThis role has been designed as ''Onsite' with an expectation that you will primarily work from an HPE partner/customer office.Who We Are:Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and...

  • Data Lake ETL

    2 weeks ago

    Bengaluru, Karnataka, India Hewlett Packard Enterprise Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Data Lake ETLThis role has been designed as ''Onsite' with an expectation that you will primarily work from an HPE partner/customer office Who We Are: Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live,...

  • Data Lake ETL

    2 weeks ago

    Bengaluru, Karnataka, India Hewlett Packard Enterprise Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    This role has been designed as ''Onsite' with an expectation that you will primarily work from an HPE partner/customer office.Who We AreHewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, from edge to...