Lead Data Engineer

3 days ago

Mumbai, Maharashtra, India Burns Mcdonnell Full time
Job Description

We are seeking a seasoned Lead Data Engineer to design, develop, and implement scalable data pipelines. This role is perfect for a professional with 10+ years of experience in data engineering and architecture, with a strong focus on big data technologies. You'll play a critical role in strengthening our data infrastructure, mentoring junior engineers, and ensuring our data solutions are reliable, high-quality, and performant.

Key Responsibilities

- Data Pipeline Leadership: Lead the design, development, and implementation of scalable data pipelines and ELT processes using tools like Databricks, DLT, dbt, and Airflow. You'll optimize and maintain these pipelines to ensure data quality and reliability.
- Best Practices & Mentorship: Develop and enforce data engineering best practices, including coding standards, testing, and documentation. You will mentor junior data engineers, providing technical leadership and fostering a culture of continuous learning.
- Collaboration & Optimization: Work closely with stakeholders to understand data requirements and deliver high-quality data solutions. You will also proactively monitor and troubleshoot data pipeline issues to ensure minimal disruption to business operations.
- Continuous Improvement: Stay up to date with the latest industry trends and technologies to recommend improvements to our data engineering practices.

Required Qualifications

- Experience: A minimum of 10 years of experience in data engineering and/or architecture, with extensive production experience with Databricks and Apache Spark.
- Technical Skills:
- Expert knowledge of SQL.
- Proficiency in programming languages such as Python, Scala, or Java.
- Strong understanding of data warehousing concepts.
- Familiarity with orchestration and ELT tools like Airflow and dbt.
- Experience with cloud platforms like Azure, AWS, and Google Cloud.
- Knowledge of data governance and security best practices.
- Personal Attributes: Excellent problem-solving, communication, and leadership skills. You must be able to work in a fast-paced, collaborative environment and effectively mentor and guide team members.
- Certifications: A certification in Databricks, Azure, Google Cloud, or related technologies is a plus.

  • Electrical Engineering Lead

    19 hours ago

    Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    To lead the development of all aspects of research in Electrical Power Systems Engineering specifically in the space of software defined power ie managing stranded power in a DC. # Collaborate with Design and Engineering (D&E) core teams to develop, implement, and manage the DC electrical designs for new development, infrastructure upgrades and...

  • Leading Data Engineer

    1 day ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878

    Senior Data EngineerAs a Senior Data Engineer, you will be responsible for designing and developing scalable data pipelines that integrate with our cloud-based infrastructure. You will work closely with cross-functional teams to identify business requirements and develop technical solutions that meet those needs.Job Responsibilities:Design and develop...

  • Lead Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Jobtravia Pvt. Ltd. Full time

    Job Title : Lead Data Engineer. Location : Navi Mumbai / Mumbai. Reporting To : Project Manager. Education : Bachelor's degree in Engineering (CS, IT, EXTC, or equivalent). Experience Required : 6-8 years. Key Responsibilities : - Design, develop, and maintain scalable data pipelines and analytical solutions using PySpark and Spark SQL.- Write efficient,...

  • Electrical Engineering Innovation Lead

    4 weeks ago

    Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Key Deliverables To lead the development of all aspects of research in Electrical Power Systems Engineering specifically in the space of software defined power ie managing stranded power in a DC. Collaborate with Design and Engineering (D&E) core teams to develop, implement, and manage the DC electrical designs for new development, infrastructure upgrades...

  • Electrical Engineering Innovation Lead

    2 weeks ago

    Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Key Deliverables To lead the development of all aspects of research in Electrical Power Systems Engineering specifically in the space of software defined power ie managing stranded power in a DC. Collaborate with Design and Engineering (D&E) core teams to develop, implement, and manage the DC electrical designs for new development, infrastructure upgrades...

  • Lead Data Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India JobTravia Pvt. Ltd. Full time

    Job Title Lead Data Engineer Education Bachelor's degree in engineering (CS, IT, EXTC or equivalent) Experience: 6-8 years In depth understanding of spark framework and experience working with Spark SQL and Pyspark. Expert in Python programming language and common python libraries Strong analytical experience with database in writing complex queries,...

  • Senior Data Engineering Lead

    7 hours ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Are you a seasoned leader in data engineering seeking a new challenge? Do you have the expertise to drive innovation and deliver complex projects on time? We are looking for an exceptional Data Engineering Director to join our team.Key Responsibilities:Lead and manage a high-performing team of data engineers, providing mentorship and technical guidance to...

  • Data Engineer Lead Specialist

    2 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,25,000 - US$ 1,75,000

    Job Title: Data Engineer Lead SpecialistOverview of the Position:The company is seeking a highly skilled Data Engineer Lead Specialist to join its Knowledge Services team. This role will focus on driving analytics for impactful business outcomes by gathering, analyzing, and modeling data.Key Responsibilities:Collaborate with international stakeholders to...

  • Lead Data Engineer

    4 weeks ago

    Mumbai, Maharashtra, India Novo Tree Minds Consulting Full time

    Job Description :- Advanced Data Pipeline Development : Develop, and optimize complex ETL/ELT processes and real-time data streaming solutions to ingest, cleanse, transform, and deliver large-scale datasets from diverse on-premise and cloud sources into data warehouses, data lakes, and analytical platforms.- Performance Engineering : Proactively identify and...

  • Data Engineering Systems Lead

    3 days ago

    Mumbai, Maharashtra, India beBeeTechnicalLead Full time ₹ 19,50,000 - ₹ 25,50,000

    Job Opportunity:This role requires a highly skilled professional to lead and implement large-scale data processing systems, ensuring seamless integration with existing infrastructure.About the Position:We are seeking an experienced technical expert to develop and implement ETL processes using T-SQL scripting and queryingThe ideal candidate will design and...