Senior data engineer

1 week ago

Malappuram, India SAIVA AI Full time

We are building the future of healthcare analytics. Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems. Our goal: pipelines that are reliable, observable, and continuously improving in production.This is a fully remote role, open to candidates based in Europe or India, with periodic team gatherings in Mountain View, California.What You’ll DoDesign, build, and maintain scalable ETL pipelines using Python (Pandas, Py Spark) and SQL, orchestrated with Airflow (MWAA).Develop and maintain the SAIVA Data Lake/Lakehouse on AWS, ensuring quality, governance, scalability, and accessibility.Run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS.Implement batch and streaming ingestion frameworks (APIs, databases, files, event streams).Enforce validation and quality checks to ensure reliable analytics and ML readiness.Monitor and troubleshoot pipelines with Cloud Watch, integrating observability tools like Grafana, Prometheus, or Datadog.Automate infrastructure provisioning with Terraform, following AWS best practices.Manage SQL Server, Postgre SQL, and Snowflake integrations into the Lakehouse.Participate in an on-call rotation to support pipeline health and resolve incidents quickly.Write production-grade code, and contribute to design/code reviews and engineering best practices.What We’re Looking For5+ years in data engineering, ETL pipeline development, or data platform roles (flexible for exceptional candidates).Experience designing and operating data lakes or Lakehouse architectures on AWS (S3, Glue, Lake Formation, Delta Lake, Iceberg).Strong SQL skills with Postgre SQL, SQL Server, and at least one AWS cloud warehouse (Snowflake or Redshift).Proficiency in Python (Pandas, Py Spark); Scala or Java a plus.Hands-on with Spark on AWS EMR and/or EKS for distributed processing.Strong background in Airflow (MWAA) for workflow orchestration.Expertise with AWS services: S3, Glue, Lambda, Athena, Step Functions, ECS, Cloud Watch.Proficiency with Terraform for Ia C; familiarity with Docker, ECS, and CI/CD pipelines.Experience building monitoring, validation, and alerting into pipelines with Cloud Watch, Grafana, Prometheus, or Datadog.Strong communication skills and ability to collaborate with data scientists, analysts, and product teams.A track record of delivering production-ready, scalable AWS pipelines, not just prototypes.

  • Senior Data Scientist

    2 weeks ago

    Malappuram, India Recro Full time

    Role : Senior Data Scientist (AI & Data) Location: Remote (Work from Home) We’re hiring a Senior Data Scientist to build the next generation of intelligent decision systems that power pricing, supply optimization, ranking, and personalization in our global B2B hotel marketplace. This is a high-impact role at the intersection of machine learning,...

  • Senior data scientist

    5 days ago

    Malappuram, India Recro Full time

    About the job Role : Senior Data Scientist (AI & Data) Location: Remote (Work from Home) We’re hiring a Senior Data Scientist to build the next generation of intelligent decision systems that power pricing, supply optimization, ranking, and personalization in our global B2 B hotel marketplace. This is a high-impact role at the intersection of machine...

  • Data Engineer

    4 weeks ago

    Malappuram, India AAA Global Full time

    Data Engineer | MumbaiLocation: IndiaIndustry: Proprietary Trading / Financial MarketsExperience: 4+ yearsEmployment Terms: Full-time, PermanentCompensation: Competitive, market-alignedIntroductionWe are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficient...

  • Senior Data Engineer

    3 weeks ago

    Malappuram, India Deutsche Börse Full time

    About Deutsche Börse Group:Headquartered in Frankfurt, Germany, Deutsche Börse Group is a leading international exchange organization and market infrastructure provider. They empower investors, financial institutions, and companies by facilitating access to global capital markets.Their India centre is located in Hyderabad, serves as a key strategic hub and...

  • Senior Data Engineer

    3 weeks ago

    Malappuram, India Deutsche Börse Full time

    About Deutsche Börse Group:Headquartered in Frankfurt, Germany, Deutsche Börse Group is a leading international exchange organization and market infrastructure provider. They empower investors, financial institutions, and companies by facilitating access to global capital markets.Their India centre is located in Hyderabad, serves as a key strategic hub and...

  • Data engineer

    4 weeks ago

    Malappuram, India Sapaad Full time

    WHO WE ARESapaad is a global leader in unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering thousands of F&B businesses across 40+ countries—with many more coming onboard each day.Driven by a...

  • Senior Cost Optimization Engineer

    3 weeks ago

    Malappuram, India Whatjobs IN C2 Full time

    Position Overview Are you passionate about technology and excited by the challenge of turning complex cloud billing data into strategic cost savings? Do you thrive on solving puzzles with AWS and Azure platforms while delivering measurable Engineering impact? We're looking for a self-driven technology enthusiast who sees cost optimization not just as expense...

  • Senior data engineer – etl

    4 days ago

    Malappuram, India AIMLEAP Full time

    Senior Data Engineer – ETL & Pipeline Development Experience: 7 to 12 Years Location: Remote (Work from Home) / Bangalore / India Mode of Engagement: Full-time No. of Positions: 2 Educational Qualification: B. E / B. Tech / M. Tech / MCA / Computer Science / IT Industry: IT / Data / AI / Legal Tech / Enterprise Solutions Notice Period: Immediate Joiners...

  • Data Engineer

    5 days ago

    Malappuram, India Blend Full time

    We’re looking for a skilledSenior Data Engineers/Data Engineerswith strong experience in distributed systems, Python/Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client. This role is part of a strategic initiative to enable robust analytics, BI, and operational workflows...

  • Senior Associate, Data Management

    5 days ago

    Malappuram, India Whatjobs IN C2 Full time

    KMK is a global data analytics and technology consulting company empowering leaders across the Life Sciences industries to make better data-driven decisions. Our data analytics and software platforms support data science, commercial operations, real-world evidence, and cloud information management. We help to optimize business strategy and operations by...