Senior Data Engineer

9 hours ago

india, IN SAIVA AI Full time

We are building the future of healthcare analytics. Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems. Our goal: pipelines that are reliable, observable, and continuously improving in production.

This is a fully remote role, open to candidates based in Europe or India, with periodic team gatherings in Mountain View, California.


What You’ll Do
  • Design, build, and maintain scalable ETL pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow (MWAA).
  • Develop and maintain the SAIVA Data Lake/Lakehouse on AWS, ensuring quality, governance, scalability, and accessibility.
  • Run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS.
  • Implement batch and streaming ingestion frameworks (APIs, databases, files, event streams).
  • Enforce validation and quality checks to ensure reliable analytics and ML readiness.
  • Monitor and troubleshoot pipelines with CloudWatch, integrating observability tools like Grafana, Prometheus, or Datadog.
  • Automate infrastructure provisioning with Terraform, following AWS best practices.
  • Manage SQL Server, PostgreSQL, and Snowflake integrations into the Lakehouse.
  • Participate in an on-call rotation to support pipeline health and resolve incidents quickly.
  • Write production-grade code, and contribute to design/code reviews and engineering best practices.


What We’re Looking For
  • 5+ years in data engineering, ETL pipeline development, or data platform roles (flexible for exceptional candidates).
  • Experience designing and operating data lakes or Lakehouse architectures on AWS (S3, Glue, Lake Formation, Delta Lake, Iceberg).
  • Strong SQL skills with PostgreSQL, SQL Server, and at least one AWS cloud warehouse (Snowflake or Redshift).
  • Proficiency in Python (Pandas, PySpark); Scala or Java a plus.
  • Hands-on with Spark on AWS EMR and/or EKS for distributed processing.
  • Strong background in Airflow (MWAA) for workflow orchestration.
  • Expertise with AWS services: S3, Glue, Lambda, Athena, Step Functions, ECS, CloudWatch.
  • Proficiency with Terraform for IaC; familiarity with Docker, ECS, and CI/CD pipelines.
  • Experience building monitoring, validation, and alerting into pipelines with CloudWatch, Grafana, Prometheus, or Datadog.
  • Strong communication skills and ability to collaborate with data scientists, analysts, and product teams.
  • A track record of delivering production-ready, scalable AWS pipelines, not just prototypes.


  • Data Engineer

    8 hours ago

    india, IN Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Senior Data Engineer

    9 hours ago

    india, IN CareerXperts Consulting Full time

    We are looking for a highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines and infrastructure. The ideal candidate will have strong expertise in modern data engineering tools and frameworks, along with the ability to collaborate closely with data scientists, analysts, and product teams to deliver reliable and efficient...

  • Senior Data Engineer

    9 hours ago

    india, IN The Mastermind Group Full time

    Senior Data Engineer Location: Remote (India) – Occasional travel to Riyadh, KSAContract Type: 12-Month ContractWork Week: Sunday–Thursday preferred (9 AM – 5 PM IST)Start Date: As soon as possibleAbout The Mastermind Group (TMG)TMG is a global leader in IT Spend Optimisation, helping enterprises take control of their tech investments across software,...

  • Senior Data Engineer

    8 hours ago

    india, IN HealthyMe AI Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...

  • Senior Data Engineer

    8 hours ago

    india, IN CES Full time

    We are looking for an enthusiastic and highly skilled Senior Data Engineer to join our growing team and play a key role in shaping complex data-centric solutions that power smarter decisions for our clients and internal teams.As part of our data engineering team, you’ll build and maintain scalable data systems and pipelines managing acquisition, storage,...

  • Senior Data Analyst

    8 hours ago

    india, IN Milestone Technologies, Inc. Full time

    We are seeking a Senior Data Analyst / Engineer with strong experience in manufacturing control systems data, data authentication, and readiness engineering. This role will ensure data ingested from manufacturing systems into Client's data lake and downstream applications (e.g., PI) is fit-for-purpose, reliable, and trustworthy. The successful candidate will...

  • Senior Big Data Engineer

    8 hours ago

    india, IN Veltris Full time

    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-generation solutions for sectors including healthcare, technology, communications, manufacturing, and finance. With a focus on innovation and acceleration, Veltris...

  • Senior Data Engineer

    8 hours ago

    Bangalore Urban, Karnataka, India, IN USEReady Full time

    Job Title: Senior Databricks EngineerExperience Level: 5-8 YearsJob SummaryAs a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and...

  • Senior Data Engineer

    8 hours ago

    india, IN Infogain Full time

    Job Summary:Big Data Engineer (Lead): As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their requirements and develop architectures that meet their needs. You will also be responsible for providing technical leadership and guidance to your...

  • Data Engineer

    8 hours ago

    india, IN Randstad Enterprise Full time

    Role : Data EngineerLocation : RemoteShift Timing : 2:00 Pm - 11:00 PmExperience : 2- 4 years relevant only ( this is a Junior position with us )Must have skillset :GCP - 2 years minimum working Experience Python and Pyspark - 2 yearsSQL - 2 yearsExcellent communicationWorked with global stakeholdersWho we are:Randstad Sourceright’s global talent solutions...