Senior data engineer

4 weeks ago

Malappuram, India SAIVA AI Full time

We are building the future of healthcare analytics. Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems. Our goal: pipelines that are reliable, observable, and continuously improving in production.This is a fully remote role, open to candidates based in Europe or India, with periodic team gatherings in Mountain View, California.What You’ll DoDesign, build, and maintain scalable ETL pipelines using Python (Pandas, Py Spark) and SQL, orchestrated with Airflow (MWAA).Develop and maintain the SAIVA Data Lake/Lakehouse on AWS, ensuring quality, governance, scalability, and accessibility.Run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS.Implement batch and streaming ingestion frameworks (APIs, databases, files, event streams).Enforce validation and quality checks to ensure reliable analytics and ML readiness.Monitor and troubleshoot pipelines with Cloud Watch, integrating observability tools like Grafana, Prometheus, or Datadog.Automate infrastructure provisioning with Terraform, following AWS best practices.Manage SQL Server, Postgre SQL, and Snowflake integrations into the Lakehouse.Participate in an on-call rotation to support pipeline health and resolve incidents quickly.Write production-grade code, and contribute to design/code reviews and engineering best practices.What We’re Looking For5+ years in data engineering, ETL pipeline development, or data platform roles (flexible for exceptional candidates).Experience designing and operating data lakes or Lakehouse architectures on AWS (S3, Glue, Lake Formation, Delta Lake, Iceberg).Strong SQL skills with Postgre SQL, SQL Server, and at least one AWS cloud warehouse (Snowflake or Redshift).Proficiency in Python (Pandas, Py Spark); Scala or Java a plus.Hands-on with Spark on AWS EMR and/or EKS for distributed processing.Strong background in Airflow (MWAA) for workflow orchestration.Expertise with AWS services: S3, Glue, Lambda, Athena, Step Functions, ECS, Cloud Watch.Proficiency with Terraform for Ia C; familiarity with Docker, ECS, and CI/CD pipelines.Experience building monitoring, validation, and alerting into pipelines with Cloud Watch, Grafana, Prometheus, or Datadog.Strong communication skills and ability to collaborate with data scientists, analysts, and product teams.A track record of delivering production-ready, scalable AWS pipelines, not just prototypes.

  • Senior Data Engineer

    7 days ago

    Malappuram, India DataOrbit AI Full time

    Company Description DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, we enable organizations to adopt AI solutions that unlock growth opportunities and operational efficiencies. With expertise in AI strategy,...

  • Senior data scientist

    4 weeks ago

    Malappuram, India Recro Full time

    About the job Role : Senior Data Scientist (AI & Data) Location: Remote (Work from Home) We’re hiring a Senior Data Scientist to build the next generation of intelligent decision systems that power pricing, supply optimization, ranking, and personalization in our global B2 B hotel marketplace. This is a high-impact role at the intersection of machine...

  • Data Engineer

    16 hours ago

    Malappuram, India AS Technology Corporation Full time

    We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and data infrastructure solutions. This role involves working with cloud platforms, big data frameworks, and streaming technologies to enable both batch and real-time data processing for business insights and analytics.Key Responsibilities:Design, implement,...

  • Data Engineer

    21 hours ago

    Malappuram, India AS Technology Corporation Full time

    We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and data infrastructure solutions. This role involves working with cloud platforms, big data frameworks, and streaming technologies to enable both batch and real-time data processing for business insights and analytics.Key Responsibilities:Design, implement,...

  • Principal Cloud Data Architect

    2 weeks ago

    Malappuram, India beBeeData Full time

    Senior Data Engineer Job OpportunityWe're seeking a highly skilled and hands-on Senior Data Engineer to drive client conversations, collaborate with Subject Matter Experts (SMEs), and deliver high-quality data solutions in a cloud-native environment.Job Title:Sr. Data Engineer (Databricks + DBT)Engagement:Full-time remote position available.Required...

  • Senior Quality Engineer

    7 days ago

    Malappuram, India HiroJet Full time

    Job Title: Quality Assurance Engineer (SIEM / SaaS experience preferred)Location: Remote (India)About CompanyIt is an early-stage cybersecurity startup building a next-generation platform for security data analytics. We process and query large-scale event and log data, leveraging modern open-source technologies and a hybrid SaaS model. Our team is small,...

  • Senior Data Analytics Faculty

    1 day ago

    Malappuram, Kerala, India BEAT Educations Full time ₹ 12,00,000 - ₹ 15,00,000 per year

    Job Title:Senior Data Analytics FacultyLocation:PerinthalmannaOrganization:BEAT Edu Center of ExcellenceJob OverviewBEAT Edu Center of Excellence is looking for an experiencedSenior Data Analytics Facultyto join our team in Perinthalmanna. The ideal candidate will have strong expertise in data analytics, hands-on experience with industry tools, and a passion...

  • Data Engineer

    4 weeks ago

    Malappuram, India Blend Full time

    We’re looking for a skilledSenior Data Engineers/Data Engineerswith strong experience in distributed systems, Python/Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client. This role is part of a strategic initiative to enable robust analytics, BI, and operational workflows...

  • Senior Associate, Data Management

    4 weeks ago

    Malappuram, India Whatjobs IN C2 Full time

    KMK is a global data analytics and technology consulting company empowering leaders across the Life Sciences industries to make better data-driven decisions. Our data analytics and software platforms support data science, commercial operations, real-world evidence, and cloud information management. We help to optimize business strategy and operations by...

  • Full Stack Engineer

    3 weeks ago

    Malappuram, India Pristine Data AI Full time

    At Pristine Data AI, we’re building an AI-powered sales and marketing platform that connects data, insights, and automation — all in one place.We’re looking for a mid-level Full Stack Engineer who’s passionate about API integrations, scalable architecture, and building seamless connections between systems.Responsibilities : Integrating...