Lead Data Engineer

3 weeks ago

Jaipur, Rajasthan, India Khushi Baby Full time

Khushi Baby, a nonprofit organization in India, serves as a technical partner to health departments. Established in 2016 from a Yale University classroom, it has grown into a 90+ member team with offices in Jaipur, Udaipur, Delhi, and Bengaluru.

Khushi Baby focuses on digital health solutions, health program strengthening, and R&D. Its flagship platform, the Community Health Integrated Platform (CHIP), supports over 70,000 community health workers across 40,000 villages, reaching 45 million beneficiaries. The platform has identified and monitored 5+ million high-risk individuals, with the Ministry of Health allocating ₹160 crore ($20M) for its scale-up.

CHIP has enabled initiatives like Rajasthan's digital health census, TB case finding, vector-borne disease surveillance, labor room monitoring, and immunization drives, co-designed with extensive field input.

In R&D, Khushi Baby advances community-level geospatial analysis and individual health diagnostics, including smartphone-based tools and low-literacy models. Programmatically, it focuses on maternal health, child malnutrition, and zero-dose children.

Backed by donors like GAVI, Skoll Foundation, and CSR funding, Khushi Baby partners with IITs, AIIMS Jodhpur, JPAL South Asia, MIT, Microsoft Research, WHO, and multiple state governments.

Khushi Baby seeks skilled, creative, and driven candidates eager to make a large-scale public health impact by joining its interdisciplinary team in policy, design, development, implementation, and data science.

Job Overview

We are looking for a Lead Data Engineer to design, build, and optimize scalable data systems for public health analytics. You will define data workflows, layer architecture, and pipelines, ensuring data quality, security, and efficiency while leading a team of engineers. 

Key Responsibilities

  • Plan and define data architecture, modelling & workflows for efficient data processing.
  • Build and optimize ETL/ELT pipelines for structured & unstructured health data.
  • Ensure data quality, security, and compliance (FHIR, HL7, etc.).
  • Develop real-time & batch processing systems (Kafka, Flink, RisingWave, etc.).
  • Monitor & optimize performance, scalability, and cloud costs (AWS, GCP, Azure).
  • Manage & mentor data engineers, fostering technical growth.
  • Performance tuning of databases, queries, and pipelines.
  • Handle large-scale data efficiently while ensuring cost-effectiveness.
  • Implement access control, encryption, and compliance measures.
  • Works closely with data scientists, analysts, and business teams to define data requirements.
  • Strong documentation for maintaining pipeline workflows and architecture.
  • Ability to translate technical concepts into business-friendly insights.
  • Stays updated with the latest trends in data engineering and cloud technologies .
  • Adapt and set up new tools, frameworks, and evolving business needs .
Required Qualifications
  • Master's in Computer Science, Data Engineering, or related field.
  • 7+ years in data engineering, 2+ years in leadership.
  • Expertise in SQL, Python, Data Modeling, and pipeline orchestration (Mage AI, Airflow, etc.) 
  • Knowledge of partitioning, indexing, caching, and compression techniques, data lineage, cataloging, and metadata management is required.
  • Experience with cloud data services
  • Proficiency in big data processing (Iceberg/Delta).
  • Knowledge of real-time streaming & CDC tools (Kafka, Debezium, Redpanda, etc.).
  • Familiarity with public health standards (FHIR, HL7, ICD-10) is a plus.
  • Strong problem-solving, logical thinking, communication, and leadership skills.
Good to have
  • Experience in public health data projects and key health metrics.
  • Knowledge of data lakehouse architecture and federated learning.

Remuneration 

The remuneration offered will be depending on the candidate's experience, skill set, and evaluation based on our internal parameters

  • Medical Insurance
  • Paid sick leave, paid parental leave and menstrual leave
  • Learning stipend policy  
  • A flexible, enabling environment workplace with the opportunity to grow into leadership roles.
  • Opportunities to attend and actively participate in prestigious International conferences and workshops

Note : The candidate will be on a probationary period for the first 90 days of the contract

  • Data Engineering Team Lead

    7 days ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    About the PositionWe're looking for an experienced Data Engineering Team Lead to join our team at Celebal Technologies. The successful candidate will have a strong background in data engineering and leadership.Key ResponsibilitiesLead a team of data engineers to design and implement scalable data solutions on Microsoft AzureCollaborate with cross-functional...

  • Lead Data Engineer

    2 days ago

    Jaipur, Rajasthan, India Hakkoda Full time

    About Hakkoda Hakkoda is a modern data consultancy that empowers data-driven organizations to realize the full value of the Snowflake Data Cloud. We provide consulting and managed services in data architecture, data engineering, analytics and data science. We are renowned for bringing our clients deep expertise, being easy to work with, and being an amazing...

  • Lead Data Engineer

    2 weeks ago

    Jaipur, Rajasthan, India Bot Consulting Full time

    Role Description:As a Senior Consultant, Data Engineer at BOT, you are more than just a builder—you are a trusted advisor, leading technical teams in designing and developing cutting-edge cloud data solutions, including Snowflake. You will partner with clients to architect and optimize data pipelines, ensuring scalable, secure, and high-performing data...

  • Lead Data Engineer

    4 weeks ago

    Jaipur, Rajasthan, India Bot Consulting Full time

    Role Description:As a Senior Consultant, Data Engineer at BOT, you are more than just a builder—you are a trusted advisor, leading technical teams in designing and developing cutting-edge cloud data solutions, including Snowflake. You will partner with clients to architect and optimize data pipelines, ensuring scalable, secure, and high-performing data...

  • Lead Data Scientist and Engineer

    6 days ago

    Jaipur, Rajasthan, India Kadel Labs Private Limited Full time

    Kadel Labs Private Limited Overview: We offer a flexible working environment that encourages in-person collaboration while supporting remote work when necessary. Our culture supports growth, learning, and personal development. Job Description: As a Lead Data Engineer at Kadel Labs Private Limited, you will be responsible for designing, developing, and...

  • Lead Data Pipeline Engineer

    1 day ago

    Jaipur, Rajasthan, India Marktine Technology Solutions Pvt Ltd Full time

    Job Description:We are seeking a Lead Data Pipeline Engineer to join our team at Marktine Technology Solutions Pvt Ltd. The successful candidate will have over 6 years of experience in data integration and ETL processes, with strong expertise in SAP BODS, PL/SQL, SQL, Azure Data Factory, and Azure Data Bricks.About the Role:This role involves leading the...

  • Lead Data Migration Engineer

    5 days ago

    Jaipur, Rajasthan, India Marktine Technology Solutions Pvt Ltd Full time

    Marktine Technology Solutions Pvt Ltd is looking for a talented Lead Data Migration Engineer to join our team.Job DescriptionThe successful candidate will be responsible for designing, developing, and implementing data migration solutions using SAP BODS, as well as managing and maintaining data pipelines using Azure Data Factory and Azure Data Bricks.Key...

  • Data Engineer Leader

    2 days ago

    Jaipur, Rajasthan, India Kadel Labs Full time

    Data Engineering at Kadel LabsWe're seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will design, develop, and optimize data pipelines and architectures to support our growing data and analytics needs.About UsKadel Labs is a leading Venture Studio in India, offering a unique blend of IT...

  • Data Science Lead

    6 days ago

    Jaipur, Rajasthan, India VAYUZ Technologies Full time

    About VAYUZ TechnologiesVAYUZ Technologies is a leading technology company that leverages cutting-edge AI and machine learning techniques to drive business growth and innovation.We are seeking a highly skilled Data Science Lead to join our team and contribute to the development of advanced AI-driven applications.Key ResponsibilitiesDevelop and implement...

  • Data Engineer

    3 weeks ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data Engineer We're seeking a talented Azure Data Engineer to address complex data challenges for our clients using Microsoft Fabric. Responsibilities:  • Design, develop, and optimize ETL/ELT pipelines leveraging Microsoft Fabric (Azure Data Factory, Synapse, Power BI).  • Proficiency in Python (PySpark, NumPy, Pandas etc.) is essential....

  • Data Engineer

    1 week ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data EngineerJob Location – JaipurJob Type – PermanentExperience Required- (2 - 6 years)Job Summary: We're looking for a talented Azure Data Engineer to solve complex data challenges for our clients using Microsoft Fabric. You will collaborate with project teams to deliver innovative data solutions that drive business...

  • Data engineer

    7 days ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data EngineerJob Location – JaipurJob Type – PermanentExperience Required years)Job Summary: We're looking for a talented Azure Data Engineer to solve complex data challenges for our clients using Microsoft Fabric. You will collaborate with project teams to deliver innovative data solutions that drive business value.Responsibilities:•...

  • Lead AI Engineer

    2 days ago

    Jaipur, Rajasthan, India Catalyst IQ Full time

    Job Summary :We are seeking a highly motivated and talented Lead AI Engineer to join our growing team. In this role, you will be responsible for leading the development and implementation of AI/ML solutions, from concept to deployment. You will work closely with cross-functional teams to understand business needs, design innovative AI models, and drive the...

  • Data Engineer

    1 week ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data EngineerJob Location – JaipurJob Type – PermanentExperience Required- (2 - 6 years)Job Summary:We're looking for a talented Azure Data Engineer to solve complex data challenges for our clients using Microsoft Fabric. You will collaborate with project teams to deliver innovative data solutions that drive business...

  • Data Engineer

    2 weeks ago

    Jaipur, Rajasthan, India NexionPro Services Full time

    Job Title : Data Engineer with Power BI DevelopmentExperience for Data Engineer : 3 years to 9 yearsLocation : Bengaluru, Pune, Hyderabad, Chennai, Jaipur, GurugramWork Mode : HybridKey Responsibilities :Develop and maintain scalable data pipelines and ETL processes to support data integration and analytics.Design and create interactive Power BI dashboards...

  • Data Engineer

    4 weeks ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data EngineerJob Location – JaipurJob Type – PermanentExperience Required- (2 - 6 years)Job Summary: We're looking for a talented Azure Data Engineer to solve complex data challenges for our clients using Microsoft Fabric. You will collaborate with project teams to deliver innovative data solutions that drive business...

  • Data Engineer

    3 weeks ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data Engineer Job Location – Jaipur Job Type – Permanent Experience Required- (2 - 6 years) Job Summary: We're looking for a talented Azure Data Engineer to solve complex data challenges for our clients using Microsoft Fabric. You will collaborate with project teams to deliver innovative data solutions that drive business value....

  • Data Engineer

    5 days ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data EngineerJob Location – JaipurJob Type – PermanentExperience Required- (2 - 6 years)Job Summary:We're looking for a talented Azure Data Engineer to solve complex data challenges for our clients using Microsoft Fabric. You will collaborate with project teams to deliver innovative data solutions that drive business...

  • Data Engineer

    2 days ago

    Jaipur, Rajasthan, India Hakkoda Full time

    ABOUT HAKKODA Hakkoda is a modern data consultancy that empowers data driven organizations to realize the full value of the Snowflake Data Cloud. We provide consulting and managed services in data architecture, data engineering, analytics and data science. We are renowned for bringing our clients deep expertise, being easy to work with, and being an...

  • GCP Cloud Data Architect Lead

    5 days ago

    Jaipur, Rajasthan, India Xebia Full time

    About the RoleWe are seeking an experienced Senior Data Engineer to lead our team in designing and implementing a scalable GCP Cloud Native Data Processing Framework.Key ResponsibilitiesDesign and implement a GCP Native Data Processing Framework leveraging Spark and GCP Cloud Services.Develop and maintain data pipelines using Databricks and Airflow for...