Lead Data Pipeline Engineer

4 days ago


Hyderabad, India Foodsmart Full time

| About us:


Foodsmart is the leading telenutrition and foodcare solution, backed by a robust network of Registered Dietitians. Our platform is designed to foster healthier food choices, drive lasting behavior change, and deliver long-term health outcomes. Through our highly personalized, digital platform, we guide our 2.2 million members—including those in employer-sponsored health plans, regional and national Medicaid managed care organizations, Medicare Advantage plans, and commercial insurers—on a tailored journey to eating well while saving time and money.


Foodsmart seamlessly integrates dietary assessments and nutrition counseling with online food ordering and cost-effective meal planning for the entire family, optimizing ingredients both at home and on the go. We partner with national and regional retailers across the U.S., many of whom accept SNAP/EBT, making healthier food more accessible. Additionally, we assist members with SNAP enrollment and management, providing tangible access to nutritious food. In 2024, Foodsmart secured a $200 million investment from TPG’s Rise Fund, which supports entrepreneurs dedicated to achieving the United Nations’ Sustainable Development Goals. This investment will help us expand our reach, particularly to low-income workers who are disproportionately affected by diet-related diseases.


At Foodsmart, our mission is to make nutritious food accessible and affordable for everyone, regardless of economic status. We are committed to a set of core values that shape our culture and work environment:


⚖️ Measured: We make data-driven, truth-seeking decisions.

💥 Impactful: We are fueled by achieving our mission and vision.

🙏 Collaborative: We help each other be better and create a positive environment.

📈 Hungry: We maintain a healthy growth mindset, seeking to overcome challenges with courage.

😊 Joyful: We take joy in each other, our work, and the privilege of doing this work.


Whether you're a dietitian, a commercial leader, or a technologist, working at Foodsmart means being part of a team that is passionate, supportive, and driven by a shared purpose. Join us in transforming the way people access and enjoy healthy food.


| About the role:


The Senior Data Engineering is a critical role responsible for constructing and optimizing our data pipeline architecture, collaborating closely with data scientists and analysts to facilitate data-related functionalities. The Senior Data Engineer will be pivotal in designing, building, and maintaining highly scalable data pipelines, optimizing data delivery, and automating data processes. They will work closely with cross-functional teams to ensure efficient data flow and contribute to the success of our data-driven initiatives.


You will:

  • Lead the optimization and scalability of data delivery pipelines, ensuring performance and reliability for cross-functional stakeholders.
  • Architect, build, and maintain robust, high-throughput data pipelines and infrastructure to support advanced analytics and machine learning.
  • Partner with data architects, data scientists, and analysts to design solutions that meet evolving data requirements and business objectives.
  • Establish best practices for data quality, governance, security, and compliance;
    implement automated frameworks for cleaning, validation, correction, and enrichment.
  • Drive continuous improvement in data engineering processes by identifying bottlenecks, reducing manual effort through automation, and advancing scalability standards.
  • Mentor junior engineers, provide technical guidance, and influence broader data platform strategy.


You are:

  • A proactive leader who drives efficient data delivery, infrastructure evolution, and technical excellence.
  • Quality-oriented, with a strong sense of ownership over data reliability and accessibility.
  • Experienced in applying secure, compliant data handling practices in regulated environments.
  • Collaborative and skilled at bridging business needs with technical solutions, supporting stakeholders at all levels.
  • An expert in data warehouse architecture, dimensional modeling, and automated data engineering at scale.


You have:

  • 6+ years of professional experience in data engineering, with a proven track record of leading large-scale, complex projects.
  • Deep expertise in modern cloud data warehouses (Snowflake, Redshift, or BigQuery).
  • Advanced SQL skills and strong experience with relational and columnar database systems.
  • Proficiency in data pipeline/workflow orchestration tools (e.G., Apache Airflow, Dagster, Luigi).
  • Solid programming background (Python, Scala, or Java) for data processing and automation.
  • Experience in backend development, with strong proficiency in TypeScript, Java, Python, Node.Js, and SQL-based RDBMS such as PostgreSQL or MySQL
  • Experience designing data models and schemas for both operational and analytical use cases.
  • Strong analytical and problem-solving skills, thriving in fast-paced, high-growth environments.
  • Familiarity with healthcare data standards (FHIR, HL7) or other regulated data domains is a plus.
  • Experience in backend development, with strong proficiency in TypeScript, Java, Python, Node.Js, and SQL-based RDBMS such as PostgreSQL or MySQL
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field (Master’s degree preferred).


  • Hyderabad, India Data Economy Full time

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...


  • Hyderabad, Telangana, India Data Economy Full time ₹ 20,00,000 - ₹ 35,00,000 per year

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...


  • Hyderabad, India Data Economy Full time

    Key Responsibilities:Engage directly with clients to understand requirements, provide solution design, and drive successful project delivery.Lead cloud migration initiatives, specifically moving on-premise applications and databases to AWS cloud platforms.Design, develop, and maintain scalable, reliable, and secure data applications in a cloud...


  • Hyderabad, Telangana, India Data Economy Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities:Engage directly with clients to understand requirements, provide solution design, and drive successful project delivery.Lead cloud migration initiatives, specifically moving on-premise applications and databases to AWS cloud platforms.Design, develop, and maintain scalable, reliable, and secure data applications in a cloud...


  • Hyderabad, India People Tech Group Inc Full time

    Job Title: Data EngineerLocation: Hyderabad Experience: 5+Years Job Summary:We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects. The ideal candidate should possess strong expertise in SQL, Python, data modeling, data warehousing, and ETL pipeline development. Experience...

  • Data Engineer

    6 days ago


    Hyderabad, India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%)  Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Lead Engineer

    1 week ago


    Hyderabad, India NTT DATA Full time

    Job Description – Support Engineer (Data Practice) – Snowflake, Airflow, IICSRole: Support EngineerJob Summary:We are looking for a Support Engineer in Data Practice with expertise in Snowflake, Apache Airflow, and Informatica IICS (Intelligent Cloud Services). The ideal candidate will be responsible for monitoring, troubleshooting, and optimizing...

  • Lead Engineer

    1 week ago


    Hyderabad, India NTT DATA Full time

    Job Description – Support Engineer (Data Practice) – Snowflake, Airflow, IICSRole: Support EngineerJob Summary:We are looking for a Support Engineer in Data Practice with expertise in Snowflake, Apache Airflow, and Informatica IICS (Intelligent Cloud Services). The ideal candidate will be responsible for monitoring, troubleshooting, and optimizing...


  • Hyderabad, India Data Economy Full time

    We are seeking a skilled ETL Data Engineer to design, build, and maintain efficient and reliable ETL pipelines, ensuring seamless data integration, transformation, and delivery to support business intelligence and analytics. The ideal candidate should have hands-on experience with ETL tools like Talend, strong database knowledge, and familiarity with AWS...


  • Hyderabad, Telangana, India Data Economy Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking a skilled ETL Data Engineer to design, build, and maintain efficient and reliable ETL pipelines, ensuring seamless data integration, transformation, and delivery to support business intelligence and analytics. The ideal candidate should have hands-on experience with ETL tools like Talend, strong database knowledge, and familiarity with AWS...