Senior data engineer
22 hours ago
We are building the future of healthcare analytics. Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems. Our goal: pipelines that are reliable, observable, and continuously improving in production.This is a fully remote role, open to candidates based in Europe or India, with periodic team gatherings in Mountain View, California.What You’ll DoDesign, build, and maintain scalable ETL pipelines using Python (Pandas, Py Spark) and SQL, orchestrated with Airflow (MWAA).Develop and maintain the SAIVA Data Lake/Lakehouse on AWS, ensuring quality, governance, scalability, and accessibility.Run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS.Implement batch and streaming ingestion frameworks (APIs, databases, files, event streams).Enforce validation and quality checks to ensure reliable analytics and ML readiness.Monitor and troubleshoot pipelines with Cloud Watch, integrating observability tools like Grafana, Prometheus, or Datadog.Automate infrastructure provisioning with Terraform, following AWS best practices.Manage SQL Server, Postgre SQL, and Snowflake integrations into the Lakehouse.Participate in an on-call rotation to support pipeline health and resolve incidents quickly.Write production-grade code, and contribute to design/code reviews and engineering best practices.What We’re Looking For5+ years in data engineering, ETL pipeline development, or data platform roles (flexible for exceptional candidates).Experience designing and operating data lakes or Lakehouse architectures on AWS (S3, Glue, Lake Formation, Delta Lake, Iceberg).Strong SQL skills with Postgre SQL, SQL Server, and at least one AWS cloud warehouse (Snowflake or Redshift).Proficiency in Python (Pandas, Py Spark); Scala or Java a plus.Hands-on with Spark on AWS EMR and/or EKS for distributed processing.Strong background in Airflow (MWAA) for workflow orchestration.Expertise with AWS services: S3, Glue, Lambda, Athena, Step Functions, ECS, Cloud Watch.Proficiency with Terraform for Ia C; familiarity with Docker, ECS, and CI/CD pipelines.Experience building monitoring, validation, and alerting into pipelines with Cloud Watch, Grafana, Prometheus, or Datadog.Strong communication skills and ability to collaborate with data scientists, analysts, and product teams.A track record of delivering production-ready, scalable AWS pipelines, not just prototypes.
-
Data Engineer
3 weeks ago
Solapur, India IntraEdge Full timeWebsite-https://intraedge.com/ Job Title: Data Engineer Experience: 5+Years Location: [Remote] Senior Data Engineer The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders Responsibilities...
-
15h Left! Senior Azure Data Engineer
1 week ago
Solapur, India Programmers.io Full timeJob Title: Senior Azure Data Engineer Job Location: Remote Skills Required: Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range: 5 Years - 12 years Job Summary: We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have deep...
-
Data Engineer
6 days ago
Solapur, India Insight Global Full timePosition: GCP Data Engineer Location: 100% Remote in IndiaDuration: 12 month contract + extensions + conversionsPackage: 10 LPA- 26 LPAInterview Process: 2 RoundsREQUIRED SKILLS AND EXPERIENCE6+ Years of experience as a Data Engineer Experience with GCP Data ie. Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow Strong SQL experience (NoSQL,...
-
Data Engineer
6 days ago
Solapur, India Insight Global Full timePosition: GCP Data Engineer Location: 100% Remote in IndiaDuration: 12 month contract + extensions + conversionsPackage: 10 LPA- 26 LPAInterview Process: 2 RoundsREQUIRED SKILLS AND EXPERIENCE6+ Years of experience as a Data Engineer Experience with GCP Data ie. Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow Strong SQL experience (NoSQL,...
-
Senior Data Engineer
7 hours ago
Solapur, India Deutsche Börse Full timeAbout Deutsche Börse Group: Headquartered in Frankfurt, Germany, Deutsche Börse Group is a leading international exchange organization and market infrastructure provider. They empower investors, financial institutions, and companies by facilitating access to global capital markets. Their India centre is located in Hyderabad, serves as a key strategic hub...
-
Data Engineer
17 hours ago
Solapur, India Veraxion Full timeWe’re looking for a Data Engineer to design, build, and scale modern data platforms on AWS. You’ll work with Python, Spark, DBT, and AWS-native services in an Agile environment to deliver scalable, secure, and high-performance data solutions.What you’ll doDevelop and optimize ETL/ELT pipelines with Python, DBT, and AWS services (Data Ops Live).Build...
-
Data Engineer
10 hours ago
Solapur, India Veraxion Full timeWe’re looking for a Data Engineer to design, build, and scale modern data platforms on AWS. You’ll work with Python, Spark, DBT, and AWS-native services in an Agile environment to deliver scalable, secure, and high-performance data solutions.What you’ll doDevelop and optimize ETL/ELT pipelines with Python, DBT, and AWS services (Data Ops Live).Build...
-
Senior Data Engineer
7 hours ago
Solapur, India Manuh Technologies Full timeKey Responsibilities - Strong in AWS - Develop automation scripts and tools using Python for data integration, validation, and transformation. - Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability. - Implement best practices for data governance, security, and monitoring. - Optimize data...
-
Data Engineer
6 days ago
Solapur, India Jaipur Rugs Full timeOrganization Description: Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-knotted and hand-woven rugs made using 2500 years old traditional art forms. The founder, Mr. Nand Kishore Chaudhary created a unique...
-
Data Engineer
6 days ago
Solapur, India Jaipur Rugs Full timeOrganization Description: Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-knotted and hand-woven rugs made using 2500 years old traditional art forms. The founder, Mr. Nand Kishore Chaudhary created a unique...
