Senior engineer, data engineering
2 weeks ago
We are building the future of healthcare analytics. Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems. Our goal: pipelines that are reliable, observable, and continuously improving in production. This is a fully remote role, open to candidates based in Europe or India, with periodic team gatherings in Mountain View, California. What You’ll Do Design, build, and maintain scalable ETL pipelines using Python (Pandas, Py Spark) and SQL, orchestrated with Airflow (MWAA). Develop and maintain the SAIVA Data Lake/Lakehouse on AWS, ensuring quality, governance, scalability, and accessibility. Run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS. Implement batch and streaming ingestion frameworks (APIs, databases, files, event streams). Enforce validation and quality checks to ensure reliable analytics and ML readiness. Monitor and troubleshoot pipelines with Cloud Watch, integrating observability tools like Grafana, Prometheus, or Datadog. Automate infrastructure provisioning with Terraform, following AWS best practices. Manage SQL Server, Postgre SQL, and Snowflake integrations into the Lakehouse. Participate in an on-call rotation to support pipeline health and resolve incidents quickly. Write production-grade code, and contribute to design/code reviews and engineering best practices. What We’re Looking For ~5+ years in data engineering, ETL pipeline development, or data platform roles (flexible for exceptional candidates). ~ Experience designing and operating data lakes or Lakehouse architectures on AWS (S3, Glue, Lake Formation, Delta Lake, Iceberg). ~ Strong SQL skills with Postgre SQL, SQL Server, and at least one AWS cloud warehouse (Snowflake or Redshift). ~ Proficiency in Python (Pandas, Py Spark); Scala or Java a plus. ~ Hands-on with Spark on AWS EMR and/or EKS for distributed processing. ~ Strong background in Airflow (MWAA) for workflow orchestration. ~ Expertise with AWS services: S3, Glue, Lambda, Athena, Step Functions, ECS, Cloud Watch. ~ Proficiency with Terraform for Ia C; familiarity with Docker, ECS, and CI/CD pipelines. ~ Experience building monitoring, validation, and alerting into pipelines with Cloud Watch, Grafana, Prometheus, or Datadog. ~ Strong communication skills and ability to collaborate with data scientists, analysts, and product teams. ~ A track record of delivering production-ready, scalable AWS pipelines, not just prototypes.
-
Senior/Lead Data Engineer
3 weeks ago
India Eucloid Data Solutions Full timeAbout The Role: Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to...
-
Senior/lead data engineer
3 weeks ago
India Eucloid Data Solutions Full timeAbout The Role: Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to...
-
Data engineer
3 weeks ago
India Data-Hat AI Full timeDepartment: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+...
-
Senior/Lead Data Engineer
3 weeks ago
India Eucloid Data Solutions Full timeAbout The Role: Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to...
-
Senior/Lead Data Engineer
3 weeks ago
India Eucloid Data Solutions Full timeAbout The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...
-
Data Engineer
3 weeks ago
India Data-Hat AI Full timeDepartment: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+...
-
Data Engineer
3 weeks ago
India Data-Hat AI Full timeDepartment: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...
-
Data Engineer
2 weeks ago
india, IN Data-Hat AI Full timeDepartment: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...
-
Senior Data Engineer
7 days ago
India PASO Co Full timeJob description We’re Hiring: Senior Data Engineer | Remote (Pan India) | Full-Time About the Role One of our client l is looking for a Senior Data Engineer to design and optimize data pipelines, ensure smooth data flow, and support multiple teams with reliable, scalable data solutions. If you love building data systems from the ground up and have hands-on...
-
Senior data engineer
3 weeks ago
India CareerXperts Consulting Full timeWe are looking for a highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines and infrastructure. The ideal candidate will have strong expertise in modern data engineering tools and frameworks, along with the ability to collaborate closely with data scientists, analysts, and product teams to deliver reliable and efficient...
