Staff Data Lake Engineer

3 weeks ago

Bengaluru India BairesDev Full time

Job Description

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Staff Data Lake Engineer at BairesDev

We are seeking a Staff Data Lake Engineer with deep expertise in data lake architecture, schema-on-read, data governance, and metadata management. The technology stack includes popular open source data lake technologies - Apache Iceberg, Delta Lake, Apache Hudi, and related storage platforms. Thus, there is ample scope for collaboration and contribution to open source. The ideal candidate will lead the design and optimization of scalable data lake systems, drive architectural decisions, and collaborate with engineering teams while delivering cutting-edge solutions for complex data storage and management challenges.

What You'll Do:

- Contribute actively to data lake and related open source projects as a core contributor.

- Design and optimize data lake architectures for large-scale data storage and processing.

- Architect advanced schema-on-read solutions to enable flexible and efficient data access.

- Lead data governance initiatives to ensure enterprise-level data quality and compliance.

- Drive metadata management system development for comprehensive data discovery and lineage.

- Collaborate with engineering teams on technical solutions and system integration.

What we are looking for:

- 10+ years of experience in software development.

- Strong expertise in data lake architectures and large-scale data storage systems.

- Deep understanding of advanced schema-on-read concepts and flexible data modeling.

- Proficiency in enterprise data governance frameworks and compliance management.

- Proven experience with metadata management and large-scale data cataloging systems.

- Core contributions to Apache open source projects (Iceberg, Delta Lake, Hudi, or similar).

- Advanced level of English.

How we make your work (and your life) easier:

- Excellent compensation in USD or your local currency if preferred.

- Paid parental leave, vacation, & national holidays.

- Innovative and multicultural work environment.

- Collaborate and learn from the global Top 1% of talent in each area.

- Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact

Apply now

  • ▷ Apply Now! Data Lake Engineer

    3 weeks ago

    Bengaluru, India BairesDev Full time

    Job Description At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this...

  • AWS Data Lake Administrator

    5 days ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    AWS Data Lake Administrator LOCATION – BLR / HYD Job Description: We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3, Lake Formation, Glue Catalog, Redshift Spectrum, and extensive SQL knowledge. The role...

  • Senior Manager, Data Lake Engineering

    7 days ago

    Bengaluru, Karnataka, India WEX Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About The Team/RoleAs the Senior Manager of Data Lake Engineering, this leader will be responsible for the execution of the Data Lake platform (supporting both GenAI and traditional AI/ML technology and applications), DataLake, and related technology, systems, and tools. This leader will execute the technology development and architecture in these areas to...

  • AWS Data Lake Administrator

    3 days ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    TCS Hiring for AWS Data Lake AdministratorRole - AWS Data Lake AdministratorExperience - 10 to 14 YearsLocation - Bengaluru, HyderabadRoles & ResponsibilitiesKey Responsibilities:Administer and manage the AWS Data Lake infrastructure, ensuring high availability, security, and performance.Configure and manage AWS S3, Lake Formation, and Glue Data Catalog to...

  • ▷ [Urgent Search] Senior Data Lake Engineer - Remote Work

    1 week ago

    Bengaluru, India BairesDev Full time

    Job Description At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this...

  • AWS Data Lake Administrator

    3 days ago

    Bengaluru, India Tata Consultancy Services Full time

    AWS Data Lake Administrator LOCATION – BLR / HYD Job Description : We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3, Lake Formation, Glue Catalog, Redshift Spectrum, and extensive SQL knowledge. The role...

  • AWS Data Lake Administrator

    3 days ago

    Bengaluru, India Tata Consultancy Services Full time

    AWS Data Lake Administrator LOCATION – BLR / HYD Job Description: We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3, Lake Formation, Glue Catalog, Redshift Spectrum, and extensive SQL knowledge. The role...

  • AWS Data Lake Administrator

    4 days ago

    Bengaluru, India Tata Consultancy Services Full time

    AWS Data Lake AdministratorLOCATION – BLR / HYDJob Description:We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3, Lake Formation, Glue Catalog, Redshift Spectrum, and extensive SQL knowledge. The role...

  • AWS Data Lake Administrator

    5 days ago

    Bengaluru, India Tata Consultancy Services Full time

    AWS Data Lake AdministratorLOCATION – BLR / HYDJob Description :We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3, Lake Formation, Glue Catalog, Redshift Spectrum, and extensive SQL knowledge. The role...

  • AWS Data Lake Administrator

    2 days ago

    Bengaluru, India Tata Consultancy Services Full time

    AWS Data Lake AdministratorLOCATION – BLR / HYDJob Description :We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3, Lake Formation, Glue Catalog, Redshift Spectrum, and extensive SQL knowledge. The role...