Senior Data Engineer

4 days ago

Bikaner, India SAIVA AI Full time

We are building the future of healthcare analytics. Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems. Our goal: pipelines that are reliable, observable, and continuously improving in production. This is a fully remote role, open to candidates based in Europe or India, with periodic team gatherings in Mountain View, California. What You’ll Do - Design, build, and maintain scalable ETL pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow (MWAA). - Develop and maintain the SAIVA Data Lake/Lakehouse on AWS, ensuring quality, governance, scalability, and accessibility. - Run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS. - Implement batch and streaming ingestion frameworks (APIs, databases, files, event streams). - Enforce validation and quality checks to ensure reliable analytics and ML readiness. - Monitor and troubleshoot pipelines with CloudWatch, integrating observability tools like Grafana, Prometheus, or Datadog. - Automate infrastructure provisioning with Terraform, following AWS best practices. - Manage SQL Server, PostgreSQL, and Snowflake integrations into the Lakehouse. - Participate in an on-call rotation to support pipeline health and resolve incidents quickly. - Write production-grade code, and contribute to design/code reviews and engineering best practices. What We’re Looking For - 5+ years in data engineering, ETL pipeline development, or data platform roles (flexible for exceptional candidates). - Experience designing and operating data lakes or Lakehouse architectures on AWS (S3, Glue, Lake Formation, Delta Lake, Iceberg). - Strong SQL skills with PostgreSQL, SQL Server, and at least one AWS cloud warehouse (Snowflake or Redshift). - Proficiency in Python (Pandas, PySpark); Scala or Java a plus. - Hands-on with Spark on AWS EMR and/or EKS for distributed processing. - Strong background in Airflow (MWAA) for workflow orchestration. - Expertise with AWS services: S3, Glue, Lambda, Athena, Step Functions, ECS, CloudWatch. - Proficiency with Terraform for IaC; familiarity with Docker, ECS, and CI/CD pipelines. - Experience building monitoring, validation, and alerting into pipelines with CloudWatch, Grafana, Prometheus, or Datadog. - Strong communication skills and ability to collaborate with data scientists, analysts, and product teams. - A track record of delivering production-ready, scalable AWS pipelines, not just prototypes.

  • Data Engineer

    3 weeks ago

    Bikaner, India Aceolution Full time

    Job Title: Data Engineer – Python Expert(Freelance Role)Location: Remote / HybridEmployment Type: Contract/ FreelanceRole Summary We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) development. As a senior Individual Contributor (IC), you will be the team's expert on...

  • Data Engineer

    3 weeks ago

    Bikaner, India YO HR Consultancy Full time

    Data Engineer/Senior Data EngineerLocation: ChennaiExperience: 2 - 8 YearsRole DescriptionThe Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large...

  • Senior Oracle Data Engineer

    3 weeks ago

    Bikaner, India Strattek Consulting Full time

    Role SummaryWe are seeking an experienced Senior Data Engineer with hands-on mastery in Oracle Data Integrator (ODI) and deep understanding of ETL and ELT frameworks. This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data...

  • Senior Oracle Data Engineer

    3 weeks ago

    Bikaner, India Strattek Consulting Full time

    Role SummaryWe are seeking an experienced Senior Data Engineer with hands-on mastery in Oracle Data Integrator (ODI) and deep understanding of ETL and ELT frameworks. This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data...

  • Senior Data Architect

    4 days ago

    bikaner, India beBeeData Full time

    Job Title: Senior Data ArchitectWe are seeking a seasoned Senior Data Architect to lead our data platform, designing and implementing scalable, reliable architectures from the ground up. This is an exceptional opportunity for a highly skilled professional to drive innovation and excellence in data engineering.About the Role:This key position involves owning...

  • Senior Data Engineer

    2 days ago

    bikaner, India beBeeData Full time

    Job Title: Data AnalystJob Overview:We are seeking a highly skilled professional to join our analytics team. The ideal candidate will design, build, and deploy data-driven solutions leveraging machine learning and cloud-based AI platforms.Main Responsibilities:Develop and optimize machine learning models using Vertex AI tools.Build scalable data pipelines...

  • Senior Data Engineer

    3 days ago

    bikaner, India beBeeDataScience Full time

    Data Science SpecialistBayone Solutions is seeking a highly experienced Data Scientist to drive innovation within our microservices architecture.We are looking for someone who can lead the development, optimization, and maintenance of data pipelines and back-end services, ensuring seamless integration within a microservices environment.Design, develop, and...

  • Senior Data Systems Developer

    5 days ago

    bikaner, India beBeeDataEngineer Full time

    About the RoleWe are seeking a seasoned Data Engineer to join our team. As a key member of our data products team, you will be responsible for designing and developing data systems, including pipelines, APIs, analytics, AI, and machine learning at scale.The ideal candidate will have a strong background in software development, with experience working with...

  • Senior Data Platform Specialist

    3 days ago

    bikaner, India beBeeData Full time

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our analytics team. As a key member of our team, you will play a vital role in designing, building, and scaling robust data pipelines that power nationwide analytics and support our machine learning systems.This is a fully remote position, open to candidates worldwide,...

  • Senior Data Architecture Specialist

    4 days ago

    bikaner, India beBeeDataArchitect Full time

    Job OverviewWe are seeking an experienced Senior Solutions Architect – Data to lead our data, analytics, and AI programs across Clinical, Commercial, and Medical Affairs domains.The successful candidate will provide architectural leadership, guide engineering teams, and ensure high-quality, compliant delivery for pharma clients.Data Platform...