Lead Data Engineer

6 days ago

Jaipur, Rajasthan, India Khushi Baby Full time
Khushi Baby, a nonprofit organization in India, serves as a technical partner to health departments. Established in 2016 from a Yale University classroom, it has grown into a 90+ member team with offices in Jaipur, Udaipur, Delhi, and Bengaluru.

Khushi Baby focuses on digital health solutions, health program strengthening, and R&D. Its flagship platform, the Community Health Integrated Platform (CHIP), supports over 70,000 community health workers across 40,000 villages, reaching 45 million beneficiaries. The platform has identified and monitored 5+ million high-risk individuals, with the Ministry of Health allocating ₹160 crore ($20M) for its scale-up.

CHIP has enabled initiatives like Rajasthan's digital health census, TB case finding, vector-borne disease surveillance, labor room monitoring, and immunization drives, co-designed with extensive field input.

In R&D, Khushi Baby advances community-level geospatial analysis and individual health diagnostics, including smartphone-based tools and low-literacy models. Programmatically, it focuses on maternal health, child malnutrition, and zero-dose children.

Backed by donors like GAVI, Skoll Foundation, and CSR funding, Khushi Baby partners with IITs, AIIMS Jodhpur, JPAL South Asia, MIT, Microsoft Research, WHO, and multiple state governments.

Khushi Baby seeks skilled, creative, and driven candidates eager to make a large-scale public health impact by joining its interdisciplinary team in policy, design, development, implementation, and data science.

Job Overview

We are looking for a Lead Data Engineer to design, build, and optimize scalable data systems for public health analytics. You will define data workflows, layer architecture, and pipelines, ensuring data quality, security, and efficiency while leading a team of engineers.

Key Responsibilities

- Plan and define data architecture, modelling & workflows for efficient data processing.
- Build and optimize ETL/ELT pipelines for structured & unstructured health data.
- Ensure data quality, security, and compliance (FHIR, HL7, etc.).
- Develop real-time & batch processing systems (Kafka, Flink, RisingWave, etc.).
- Monitor & optimize performance, scalability, and cloud costs (AWS, GCP, Azure).
- Manage & mentor data engineers, fostering technical growth.
- Performance tuning of databases, queries, and pipelines.
- Handle large-scale data efficiently while ensuring cost-effectiveness.
- Implement access control, encryption, and compliance measures.
- Works closely with data scientists, analysts, and business teams to define data requirements.
- Strong documentation for maintaining pipeline workflows and architecture.
- Ability to translate technical concepts into business-friendly insights.
- Stays updated with the latest trends in data engineering and cloud technologies.
- Adapt and set up new tools, frameworks, and evolving business needs.

Required Qualifications

- Master's in Computer Science, Data Engineering, or related field.
- 7+ years in data engineering, 2+ years in leadership.
- Expertise in SQL, Python, Data Modeling, and pipeline orchestration (Mage AI, Airflow, etc.)
- Knowledge of partitioning, indexing, caching, and compression techniques, data lineage, cataloging, and metadata management is required.
- Experience with cloud data services
- Proficiency in big data processing (Iceberg/Delta).
- Knowledge of real-time streaming & CDC tools (Kafka, Debezium, Redpanda, etc.).
- Familiarity with public health standards (FHIR, HL7, ICD-10) is a plus.
- Strong problem-solving, logical thinking, communication, and leadership skills.

Good to have

- Experience in public health data projects and key health metrics.
- Knowledge of data lakehouse architecture and federated learning.

Remuneration

The remuneration offered will be depending on the candidate's experience, skill set, and evaluation based on our internal parameters

- Medical Insurance
- Paid sick leave, paid parental leave and menstrual leave
- Learning stipend policy
- A flexible, enabling environment workplace with the opportunity to grow into leadership roles.
- Opportunities to attend and actively participate in prestigious International conferences and workshops

Note: The candidate will be on a probationary period for the first 90 days of the contract

  • Lead Data Engineer

    3 weeks ago

    Jaipur, Rajasthan, India Hakkoda Full time

    About Hakkoda Hakkoda is a modern data consultancy that empowers data-driven organizations to realize the full value of the Snowflake Data Cloud. We provide consulting and managed services in data architecture, data engineering, analytics and data science. We are renowned for bringing our clients deep expertise, being easy to work with, and being an amazing...

  • Lead Data Engineer

    6 days ago

    Jaipur, Rajasthan, India Bot Consulting Full time

    Role Description:As a Senior Consultant, Data Engineer at BOT, you are more than just a builder—you are a trusted advisor, leading technical teams in designing and developing cutting-edge cloud data solutions, including Snowflake. You will partner with clients to architect and optimize data pipelines, ensuring scalable, secure, and high-performing data...

  • Public Health Data Engineering Lead

    2 days ago

    Jaipur, Rajasthan, India Khushi Baby Full time

    Job DescriptionWe're seeking a skilled Data Engineering Lead to design and build scalable data systems for public health analytics. As a key member of our team, you will lead the development of data workflows, layer architecture, and pipelines, ensuring data quality, security, and efficiency.Main ResponsibilitiesPlan and define data architecture, modeling &...

  • Cloud Data Engineer Lead

    6 days ago

    Jaipur, Rajasthan, India Bot Consulting Full time

    Job OverviewBOT Consulting is a global leader in cloud data solutions. We help organizations unlock the full potential of their data by architecting and optimizing their data pipelines.About the RoleWe are seeking a highly skilled Senior Consultant, Data Engineer to join our team in Jaipur, Rajasthan. As a key member of our team, you will lead technical...

  • Azure Data Engineering Lead

    3 days ago

    Jaipur, Rajasthan, India Dotsquares Technologies Full time

    About the Role:As an Azure Data Engineer at Dotsquares Technologies, you will play a key role in shaping our data strategy and building scalable data solutions on the Azure cloud platform. You will have the opportunity to work with cutting-edge technologies and collaborate with cross-functional teams to deliver effective solutions. Our ideal candidate is a...

  • Data Systems Engineer Lead

    3 days ago

    Jaipur, Rajasthan, India ThoughtsWin Systems Full time

    Job OverviewWe are looking for a seasoned Data Architect to join our team at ThoughtsWin Systems. As a key member of our organization, you will play a vital role in designing and delivering innovative data solutions that power our business. With a focus on scalability, reliability, and performance, you will ensure that our data systems meet the evolving...

  • Data Engineer

    3 weeks ago

    Jaipur, Rajasthan, India Kadel Labs Full time

    Role : SSE-Data EngineeringKadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergistic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180+ employees and expanding) and served 200+ Customers. At the core, KL is a people's company. We serve...

  • Data Engineer

    4 weeks ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data EngineerJob Location – JaipurJob Type – PermanentExperience Required- (2-4) YearsJob Summary: We're looking for a talented Azure Data Engineer to solve complex data challenges for our clients using Microsoft Fabric. You will collaborate with project teams to deliver innovative data solutions that drive business...

  • Data Engineer

    4 weeks ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data EngineerJob Location – JaipurJob Type – PermanentExperience Required- (2-4) YearsJob Summary: We're looking for a talented Azure Data Engineer to solve complex data challenges for our clients using Microsoft Fabric. You will collaborate with project teams to deliver innovative data solutions that drive business...

  • Data Engineer

    4 days ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data Engineer We're seeking a talented Azure Data Engineer to address complex data challenges for our clients using Microsoft Fabric. Responsibilities:  • Design, develop, and optimize ETL/ELT pipelines leveraging Microsoft Fabric (Azure Data Factory, Synapse, Power BI).  • Proficiency in Python (PySpark, NumPy, Pandas etc.) is essential....

  • Lead AI Engineer

    3 weeks ago

    Jaipur, Rajasthan, India Catalyst IQ Full time

    Job Summary :We are seeking a highly motivated and talented Lead AI Engineer to join our growing team. In this role, you will be responsible for leading the development and implementation of AI/ML solutions, from concept to deployment. You will work closely with cross-functional teams to understand business needs, design innovative AI models, and drive the...

  • Data Engineer

    6 days ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data EngineerJob Location – JaipurJob Type – PermanentExperience Required- (2 - 6 years)Job Summary: We're looking for a talented Azure Data Engineer to solve complex data challenges for our clients using Microsoft Fabric. You will collaborate with project teams to deliver innovative data solutions that drive business...

  • Data Engineer

    5 days ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data Engineer Job Location – Jaipur Job Type – Permanent Experience Required- (2 - 6 years) Job Summary: We're looking for a talented Azure Data Engineer to solve complex data challenges for our clients using Microsoft Fabric. You will collaborate with project teams to deliver innovative data solutions that drive business value....

  • Data Engineer

    3 weeks ago

    Jaipur, Rajasthan, India Hakkoda Full time

    ABOUT HAKKODA Hakkoda is a modern data consultancy that empowers data driven organizations to realize the full value of the Snowflake Data Cloud. We provide consulting and managed services in data architecture, data engineering, analytics and data science. We are renowned for bringing our clients deep expertise, being easy to work with, and being an...

  • Data Systems Engineer

    5 days ago

    Jaipur, Rajasthan, India ThoughtsWin Systems Full time

    Job OverviewWe are seeking a highly skilled Data Architect to lead the design and delivery of innovative, scalable data solutions that power our business.As a key member of our team at ThoughtsWin Systems, you will be responsible for architecting high-performance data systems and driving impactful analytics.About You8+ years in data architecture,...

  • Technical Lead Frontend Engineer

    2 days ago

    Jaipur, Rajasthan, India Auriga IT Consulting Pvt Ltd Full time

    We are looking for a talented Technical Lead Frontend Engineer to join our team at Auriga IT Consulting Pvt Ltd. As a leader in front-end development, you will be responsible for driving the adoption of modern front-end frameworks and technologies, ensuring best practices in React.js and Next.js.Responsibilities:Define and maintain scalable component...

  • Data Engineer

    3 weeks ago

    Jaipur, Rajasthan, India Ollosoft Technologies Private Limited Full time

    Company Description Ollosoft Technologies Private Limited is a technology company that focuses on creating software solutions in the educational and supply-chain management domains. The company prides itself on delivering high-quality solutions using the latest technologies to meet new challenges. About the Role We are seeking a Data Engineer with 3–4...

  • Senior Data Engineer

    1 week ago

    Jaipur, Rajasthan, India r3 Consultant Full time

    Job Description: Senior Data Engineer Role Overview: We are seeking an experienced Senior Data Engineer to design, develop, and optimize our data pipeline architecture. This role involves creating scalable and efficient systems to process and manage large datasets across the organization. As a Senior Data Engineer...

  • Data Engineer Expert

    5 days ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Celebal Technologies is seeking a talented Data Engineer Expert to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL/ELT pipelines using Microsoft Fabric.About the Role:We are looking for an experienced data engineer with expertise in Azure data solutions to collaborate with...

  • Senior Data Engineer

    3 days ago

    Jaipur, Rajasthan, India Dotsquares Technologies Full time

    Technical Experience and Expertise : - When working as a Senior Data Engineer you will leverage azure stack tools based on requirements for developing data integration workflows. - Familiarity with these tools and an understanding of when to use each one is crucial for optimizing data processing, movement, and transformation in a cloud-based environment. 1....