AWS Data Lake Administrator

4 days ago

Bengaluru India Tata Consultancy Services Full time

Job Description Role: AWS Data Lake Administrator Location: Bangalore and Hyderabad Years of Experience: 10-14 years (Mandatory) Notice Period: 30 days or lesser. Job Description: We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3, Lake Formation, Glue Catalog, Redshift Spectrum, and extensive SQL knowledge. The role involves managing data ingestion, security, and performance of the data lake, ensuring efficient and secure access to data for analytics and reporting. Key Responsibilities: - Administer and manage the AWS Data Lake infrastructure, ensuring high availability, security, and performance. - Configure and manage AWS S3, Lake Formation, and Glue Data Catalog to organize, secure, and catalog data within the data lake. - Set up and manage Redshift Spectrum for querying and analyzing data stored in S3 using SQL and Redshift. - Implement and manage data ingestion pipelines to ingest structured and unstructured data from various sources into the data lake using AWS services like Glue ETL, Lambda, and other orchestration tools. - Define and enforce data governance policies, access control, and security measures using AWS Lake Formation, ensuring compliance with organizational and regulatory requirements. - Optimize data storage in S3 through partitioning, compression, and appropriate data formats like Parquet, Avro, or ORC to improve query performance. - Monitor and manage the Glue Catalog for maintaining metadata, table definitions, and data lineage within the data lake. - Collaborate with data engineers, architects, and analysts to ensure seamless access to data for analytics and machine learning. - Troubleshoot and optimize query performance in Redshift Spectrum, and manage workload performance in the data lake environment. - Implement backup, recovery, and disaster recovery strategies for data lake assets, ensuring data integrity and availability. - Maintain detailed documentation of data lake architecture, security policies, and data governance procedures. Qualifications: - 4-8 years of experience in managing data lake environments, with a focus on AWS data services. - Strong expertise in AWS services like S3, Lake Formation, Glue, Glue Data Catalog, Redshift Spectrum, and Lambda. - Good knowledge of SQL and query optimization techniques, particularly in querying data from S3 using Redshift Spectrum and Athena. - Experience in data ingestion pipelines using AWS Glue ETL, Lambda, and other AWS orchestration tools. - Strong understanding of data governance, access control, and security best practices in AWS environments. - Experience with data formats (Parquet, ORC, Avro, JSON) and optimizing data storage for cost and performance. - Knowledge of data partitioning, compression, and indexing strategies in S3. - Familiarity with monitoring, troubleshooting, and optimizing AWS Data Lake performance. - Excellent communication and collaboration skills to work across teams and support business requirements. AWS certifications, such as AWS Certified Big Data Specialty or AWS Certified Solutions Architect, are a plus.

  • Data Lake Administrator

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!!TCS has been a great pioneer in feeding the fire of Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Make sure you have a valid EP number before the interview. To create an EP...

  • Aws Data lake Admin

    3 weeks ago

    Hyderabad, Bengaluru, India Tata Consultancy Services Limited Full time

    Job Description - We are seeking a highly skilledAWS Data Lake Administratorto manage and optimize our data lake architecture on AWS. - The ideal candidate will have strong experience with AWS data services such as S3, Lake Formation, Glue Catalog, Redshift Spectrum, and extensive SQL knowledge. - The role involves managing data ingestion, security, and...

  • AWS Architect

    1 week ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Architect to join our team in Bangalore, Karntaka (IN-KA), India (IN). ob Duties: Job Summary: We are looking for...

  • AWS Architect

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 3,50,000 - ₹ 12,50,000 per year

    Architect and implement cloud-native data platforms on AWS, supporting both operational and analytical workloads. Design and implement Data Mesh frameworks to enable domain-oriented data ownership and decentralized data management. Build robust Data Lake and Data Warehouse solutions using AWS services like S3, Glue, lambda, Redshift, and Athena. Define data...

  • Designing and Operating Data Lakes

    4 days ago

    india beBeeDataEngineering Full time

    Senior Data EngineerWe're seeking a seasoned expert in designing and operating data lakes or Lakehouse architectures on AWS.To succeed, you'll build scalable ETL pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow.You'll maintain the data lake/lakehouse on AWS, ensuring quality, governance, scalability, and accessibility.Your...

  • AWS Architect

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 25,00,000 per year

    Req ID: 349745NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). ob Duties: Job Summary:We are looking for...

  • Infometry - Splunk Administrator - Siem/data

    7 days ago

    Bengaluru, India Splunk Administrator Full time

    **Splunk Administrator**: Role: Splunk Administrator Location: Hyderabad ***: - Install, configure, and update Splunk Enterprise and Splunk Enterprise Security environments in a multi-site environment, following best practices from Splunk Professional Services. - Configure multi-site Search Head clustering and advanced Splunk options like Indexer. -...

  • AWS Data

    3 weeks ago

    Chennai, India Virtusa Full time

    Job Description AWS Data Engineer Design and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and QS/SNS/Cloudwatch/Step function/CDK. Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes. Create and manage applications using Python, Pyspark, SQL, Databricks, and...

  • AWS Data Engineer

    2 weeks ago

    Noida, India Coforge Full time

    Job Description We are seeking a highly skilled and experienced AWS Data Engineer with strong expertise in Streaming Data and Big Data Technologies, AWS, Python, & Spark. The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: - Architect...

  • AWS Data Architect

    4 weeks ago

    India ACL Digital Full time

    • 8–12 years designing and implementing cloud data architectures on AWS (S3, Redshift, Glue, Lake Formation, IAM). Proficient in data modeling, performance tuning, and security best practices; AWS Certified Solutions Architect preferred.