Data Engineering Lead

15 hours ago


Nellore, Andhra Pradesh, India beBeeBigData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Job Title: Data Engineering Lead

Role Overview

We seek an experienced data engineering professional to lead our team's technical endeavors.

Key Responsibilities
  • Manage distributed teams across multiple geographies and time zones.
  • Collaborate with architects, product managers, and operations teams to drive business outcomes.
  • Design and implement scalable data pipelines using Scala and Python.
  • Develop and maintain Apache Spark applications for batch and streaming data processing.
  • Migrate HDFS clusters and develop strategies for schema evolution and ACID transactions.
  • Implement table formats like Apache Iceberg, Delta Lake, or Apache Hudi for efficient data storage.
  • Run Spark and/or Flink jobs on Kubernetes for efficient resource utilization.
  • Design and implement ingestion, transformation, and enrichment pipelines for large-scale datasets.
  • Provision data infrastructure using Infrastructure-as-Code (Terraform, Helm).
Requirements
  • 7+ years of experience in big data engineering.
  • Strong knowledge of distributed blob storages like Ceph or AWS S3.
  • Experience with Apache Spark, Scala, and Python.
  • Deep understanding of HDFS internals and migration strategies.
  • Excellent communication skills and ability to work with cross-functional teams.
Benefits

This role offers a unique opportunity to leverage your expertise and drive impactful solutions.

Other Considerations

Please note that only immediate joiners will be considered for this position.



  • Nellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering Agile LeadWe are seeking a seasoned professional to fill the role of Data Engineering Agile Lead. This is an exciting opportunity for someone with a strong background in data engineering and agile methodology to drive project success.Key Responsibilities:Develop and implement agile frameworks to enhance team collaboration and...

  • Data Engineer

    7 days ago


    Nellore, Andhra Pradesh, India beBeeData Full time ₹ 16,00,000 - ₹ 2,01,60,000

    Job Title: Senior Data EngineerWe are seeking a skilled Senior Data Engineer to design, develop and maintain large-scale data platforms using Databricks.The ideal candidate will have experience with Databricks architecture, data engineering and analytics. They will be responsible for implementing scalable, secure and efficient data solutions that meet client...

  • Data Architect Lead

    4 days ago


    Nellore, Andhra Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Job Title:Data Architect Lead About the RoleWe are seeking an experienced Data Architect to lead our team's data engineering efforts. As a trusted advisor, you will provide thought leadership on process and technical matters, championing the best interests of our clients.Your responsibilities will include designing, developing, deploying, and supporting the...


  • Nellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 30,00,000

    We are seeking an experienced data professional to play a key role in driving our projects forward.As a senior data engineer, you will lead team best practices in design, development, and implementation, mentoring team members, and fostering a culture of continuous learning and innovation.You will have extensive experience in software architecture and...


  • Nellore, Andhra Pradesh, India beBeeAzureSupport Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewThe role of Azure Data Support Lead involves leading a team of engineers in handling support activities efficiently.You will manage the support operations for applications and pipelines built on Azure Databricks, PySpark, Azure Data Factory, and Azure Function Apps.This position requires strong collaboration and stakeholder management skills to...

  • Data Engineer Leader

    15 hours ago


    Nellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a highly skilled data engineer to lead our team's data solutions. The ideal candidate will have expertise in Python development and cloud-based data migration.Core RequirementsMust Have:Strong hands-on experience with object-oriented programming, reusable code design, and Python-based data workflows.Proven experience in cloud data...


  • Nellore, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Join us as a Data Engineer to drive business growth through data-driven decision making. We are seeking a highly skilled and experienced professional to lead our data engineering efforts.In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines using PySpark. You will work closely with cross-functional teams to...


  • Nellore, Andhra Pradesh, India beBeeMachineLearning Full time ₹ 20,00,000 - ₹ 25,00,000

    Artificial Intelligence Engineering LeadWe are seeking a highly skilled Artificial Intelligence Engineering Lead to drive the development and implementation of AI/ML solutions on the Google Cloud Platform.Main Responsibilities:Design and develop innovative AI/ML solutions on the Google Cloud PlatformCollaborate with cross-functional teams to leverage AI/ML...

  • Data Engineer

    3 days ago


    Nellore, Andhra Pradesh, India aQb Solutions Pvt Ltd Full time

    We are looking for a highly skilled Data Engineer with strong expertise in PostgreSQL and hands-on experience in building data warehouses and data lakes. In this role, you will design and implement a scalable PostgreSQL-based data warehouse and manage a data lake on AWS infrastructure, leveraging primarily open-source technologies.The ideal candidate has a...

  • Data Engineer

    7 days ago


    Nellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking an expert in data analysis and engineering to play a key role in our organization.The ideal candidate will have strong expertise in SQL, Python, and Java, along with experience in GenAI tools and techniques.Key ResponsibilitiesDesign, develop, and optimize SQL queries for data extraction, manipulation, and reporting.Build and maintain ETL...