AWS Data Lake Administrator

22 hours ago

New Delhi, India Tata Consultancy Services Full time

TCS Hiring for AWS Data Lake AdministratorRole - AWS Data Lake AdministratorExperience - 10 to 14 YearsLocation - Bengaluru, HyderabadRoles & ResponsibilitiesKey Responsibilities:- Administer and manage the AWS Data Lake infrastructure, ensuring high availability, security, and performance. - Configure and manage AWS S3, Lake Formation, and Glue Data Catalog to organize, secure, and catalog data within the data lake. - Set up and manage Redshift Spectrum for querying and analyzing data stored in S3 using SQL and Redshift. - Implement and manage data ingestion pipelines to ingest structured and unstructured data from various sources into the data lake using AWS services like Glue ETL, Lambda, and other orchestration tools. - Define and enforce data governance policies, access control, and security measures using AWS Lake Formation, ensuring compliance with organizational and regulatory requirements. - Optimize data storage in S3 through partitioning, compression, and appropriate data formats like Parquet, Avro, or ORC to improve query performance. - Monitor and manage the Glue Catalog for maintaining metadata, table definitions, and data lineage within the data lake. - Collaborate with data engineers, architects, and analysts to ensure seamless access to data for analytics and machine learning. - Troubleshoot and optimize query performance in Redshift Spectrum, and manage workload performance in the data lake environment. - Implement backup, recovery, and disaster recovery strategies for data lake assets, ensuring data integrity and availability. - Maintain detailed documentation of data lake architecture, security policies, and data governance procedures.Qualifications:- 4-8 years of experience in managing data lake environments, with a focus on AWS data services. - Strong expertise in AWS services like S3, Lake Formation, Glue, Glue Data Catalog, Redshift Spectrum, and Lambda. - Good knowledge of SQL and query optimization techniques, particularly in querying data from S3 using Redshift Spectrum and Athena. - Experience in data ingestion pipelines using AWS Glue ETL, Lambda, and other AWS orchestration tools. - Strong understanding of data governance, access control, and security best practices in AWS environments. - Experience with data formats (Parquet, ORC, Avro, JSON) and optimizing data storage for cost and performance. - Knowledge of data partitioning, compression, and indexing strategies in S3. - Familiarity with monitoring, troubleshooting, and optimizing AWS Data Lake performance. - Excellent communication and collaboration skills to work across teams and support business requirements.AWS certifications, such as AWS Certified Big Data – Specialty or AWS Certified Solutions Architect, are a plus.

  • Azure Data Lake

    3 days ago

    New Delhi, India LTIMindtree Full time

    Azure Data Lake ADF Azure data factory, Azure databricks, Delta Lake Exp: 5 to 12 yrs Loc: Pune & Hyderabad Notice period: Immediate to Max 30 daysThanks & Regards, Indumati Nakate indumati.nakate@alphacom.in

  • AWS Data Engineer

    4 days ago

    New Delhi, India Coforge Full time

    We’re Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred.Job Locations: Hyderabad & Greater NoidaExperience Required: 5 to 7 YearsSend your CV to Gaurav.2.Kumar@coforge.comAbout the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and...

  • AWS Data Engineer

    2 weeks ago

    New Delhi, India Talent Worx Full time

    We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages. Exp- 3 to 5 years Location- Bangalore, Coimbatore, Delhi NCR, Mumbai Requirements Key...

  • Data Lake

    21 hours ago

    New Delhi, India Tata Consultancy Services Full time

    Dear Aspirant,Greetings from TCS !TCS presents excellent opportunity for Data Lake - Engineer / Consultant / Solution Architect / Technical ArchitectExp: 7 - 18 YrsJob Location: Chennai / Bangalore / Hyderabad / Mumbai / Pune / Kolkata / Delhi / Noida / Gurgaon- Implementation experience in Data Lake- Experience in architecture definition, design and...

  • Data Lake

    1 week ago

    New Delhi, India Tata Consultancy Services Full time

    DearAspirant ,Greetings fromTCS !TCS presents excellent opportunity for Data Lake - Engineer / Consultant / Solution Architect / Technical ArchitectExp: 7 - 18 YrsJob Location:Chennai / Bangalore / Hyderabad / Mumbai / Pune / Kolkata / Delhi / Noida / GurgaonImplementation experience in Data LakeExperience in architecture definition, design and...

  • AWS Data Engineer

    21 hours ago

    New Delhi, India Coforge Full time

    AWS Data EngineerJob Location: BengaluruExperience Required: 5+ YearsMandatory Skills: AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShellJob Description:We are looking for an experienced AWS Engineer with around 5-8 years of hands-on experience in...

  • Data Engineer

    3 days ago

    New Delhi, India Natlov Technologies Pvt Ltd Full time

    Hiring: Data Engineer (AWS & Azure)Location: Remote | Shift: 6 PM – 3 AM ISTJoin Natlov Technologies Pvt. Ltd. and be part of a dynamic data engineering team working on global projects!What You'll Do- Build and optimize scalable data pipelines and data models across cloud platforms (AWS & Azure). - Ensure data quality, security, and performance in all data...

  • Head – Data Lake

    21 hours ago

    New Delhi, India Larsen & Toubro Full time

    About Larsen & Toubro :Larsen & Toubro Ltd (L&T) is a leading Indian multinational conglomerate with operations spanning engineering, construction, manufacturing, technology, IT, and financial services. Headquartered in Mumbai, L&T is recognized among the top five construction companies globally, renowned for its commitment to excellence and...

  • Head – Data Lake

    1 week ago

    New Delhi, India Larsen & Toubro Full time

    About Larsen & Toubro : Larsen & Toubro Ltd (L&T) is a leading Indian multinational conglomerate with operations spanning engineering, construction, manufacturing, technology, IT, and financial services. Headquartered in Mumbai, L&T is recognized among the top five construction companies globally, renowned for its commitment to excellence and...

  • AWS Data Architect

    4 days ago

    New Delhi, India HCLTech Full time

    Dear Candidate,Greetings from HCL Tech!!We are hiring AWS requirementKinldy share your availabilityIf your resume is shortlisted we will schedule your interview accordingly.Senior AWS Data EngineerWe are seeking a highly skilled Senior AWS Data Engineer to join our data engineering team. The ideal candidate will have deep expertise in building scalable data...