Senior Data Engineer

2 weeks ago

Kanpur, India SAIVA AI Full time

We are building the future of healthcare analytics. Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems. Our goal: pipelines that are reliable, observable, and continuously improving in production.

This is a fully remote role, open to candidates based in Europe or India, with periodic team gatherings in Mountain View, California.


What You’ll Do
  • Design, build, and maintain scalable ETL pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow (MWAA).
  • Develop and maintain the SAIVA Data Lake/Lakehouse on AWS, ensuring quality, governance, scalability, and accessibility.
  • Run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS.
  • Implement batch and streaming ingestion frameworks (APIs, databases, files, event streams).
  • Enforce validation and quality checks to ensure reliable analytics and ML readiness.
  • Monitor and troubleshoot pipelines with CloudWatch, integrating observability tools like Grafana, Prometheus, or Datadog.
  • Automate infrastructure provisioning with Terraform, following AWS best practices.
  • Manage SQL Server, PostgreSQL, and Snowflake integrations into the Lakehouse.
  • Participate in an on-call rotation to support pipeline health and resolve incidents quickly.
  • Write production-grade code, and contribute to design/code reviews and engineering best practices.


What We’re Looking For
  • 5+ years in data engineering, ETL pipeline development, or data platform roles (flexible for exceptional candidates).
  • Experience designing and operating data lakes or Lakehouse architectures on AWS (S3, Glue, Lake Formation, Delta Lake, Iceberg).
  • Strong SQL skills with PostgreSQL, SQL Server, and at least one AWS cloud warehouse (Snowflake or Redshift).
  • Proficiency in Python (Pandas, PySpark); Scala or Java a plus.
  • Hands-on with Spark on AWS EMR and/or EKS for distributed processing.
  • Strong background in Airflow (MWAA) for workflow orchestration.
  • Expertise with AWS services: S3, Glue, Lambda, Athena, Step Functions, ECS, CloudWatch.
  • Proficiency with Terraform for IaC; familiarity with Docker, ECS, and CI/CD pipelines.
  • Experience building monitoring, validation, and alerting into pipelines with CloudWatch, Grafana, Prometheus, or Datadog.
  • Strong communication skills and ability to collaborate with data scientists, analysts, and product teams.
  • A track record of delivering production-ready, scalable AWS pipelines, not just prototypes.


  • Senior Azure Stack Engineer

    1 day ago

    Kanpur, Uttar Pradesh, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 336844NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Azure Stack Engineer to join our team in Remote, Uttar Pradesh (IN-UP), India (IN). Job Title: Senior Azure...

  • Junior ai

    5 days ago

    Kanpur, India Omni Reach Full time

    Job DescriptionThis is a remote position.Role OverviewWe are hiring smart, analytical freshers and early-career engineers passionate about data, mathematics, problem-solving, and building systems. This is a developmental role aimed at nurturing strong fundamentals in Data Science, Machine Learning, and Data Engineering over time. You will work on real-world...

  • Professional Services Engineer

    3 weeks ago

    Kanpur, Uttar Pradesh, India Data Dynamics Full time

    Company DescriptionData Dynamics is a global leader in enterprise data management, focusing on Digital Trust and Data Democratisation. With flagship AI-powered self-service data management software, the company empowers individuals across organisations to manage, secure, and optimise their data. Trusted by over 300 organisations, including 25% of the Fortune...

  • Data Engineer

    3 weeks ago

    Kanpur, Uttar Pradesh, India iXceed Solutions Full time

    Role - Data EngineerLocation - Chennai (Hybrid)Type - PermanentJob Description:Key Responsibilities:Lead the design, development, and deployment of scalable data pipelines and ETL processes using Scala and Apache Spark (Databricks).Develop and maintain data processing workflows using PySpark and Python.Collaborate with data scientists, analysts, and business...

  • Senior Data Architect

    2 weeks ago

    Kanpur, India Alight Solutions Full time

    Our story At Alight, we believe a company's success starts with its people. At our core, we Champion People, help our colleagues Grow with Purpose and true to our name we encourage colleagues to "Be Alight." Our Values: Champion People – be empathetic and help create a place where everyone belongs. Grow with purpose – Be inspired by our higher calling of...

  • Senior Data Architect

    5 days ago

    Kanpur, Uttar Pradesh, India Alight Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Our storyAt Alight, we believe a company's success starts with its people. At our core, we Champion People, help our colleagues Grow with Purpose and true to our name we encourage colleagues to "Be Alight."Our Values:Champion People – be empathetic and help create a place where everyone belongs.Grow with purpose – Be inspired by our higher calling of...

  • Data Engineer

    1 week ago

    Kanpur, India Quess Corp Limited Full time

    🚨 Urgent Hiring: Data Engineer | Gurgaon | Immediate JoinerWe’re actively looking for a skilled Data Engineer to join our team. If you thrive in fast-paced environments and have a strong foundation in cloud and data pipelines, this role is for you!📌 Job Details:Role: Data EngineerExperience: 5 to 8 YearsLocation: Gurgaon (On-site or Hybrid as...

  • Data Engineer

    3 weeks ago

    Kanpur, Uttar Pradesh, India Sapaad Full time

    WHO WE ARESapaad is a global leader in unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering thousands of F&B businesses across 40+ countries—with many more coming onboard each day.Driven by a...

  • Senior Data Analyst

    4 weeks ago

    Kanpur, Uttar Pradesh, India Launch Consulting Group Full time

    Senior Data Analyst Description: Be a part of our success story. Launch offers talented and motivated people the opportunity to do the best work of their lives in a dynamic and growing company. Through competitive salaries, outstanding benefits, internal advancement opportunities, and recognized community involvement, you will have the chance to create a...

  • Senior Electrical Engineer – Brisbane

    5 days ago

    Kanpur, Uttar Pradesh, India Planned Resources Full time ₹ 16,00,000 - ₹ 16,80,000 per year

    About the business This outstanding National Engineering Group just keep winning quality projects and delivering for their clients.. With ongoing work across Commercial, Data Centres, Hospitals, Retail, New & Old Build and community around Brisbane, Sydney & Melbourne the future is bright for this business who have a great culture and low turnover. With a...