Building Scalable Clinical Data Pipelines

1 day ago

Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Senior Data Engineer - Clinical Data Pipeline Lead

About the Role

We're seeking a highly experienced Senior Data Engineer to lead the design and operation of our AI-powered applications' backbone. This critical role involves creating scalable pipelines that process clinical data, retrieve medical documents, and deliver validated information to machine learning systems.

  • Design and operate event-driven data pipelines supporting real-time clinical workflows.
  • Integrate with EHR/EMR systems using standards like FHIR and HL7.
  • Develop reliable systems to ingest, track, and update clinical events in real-time.
  • Ensure downstream ML systems receive high-quality, structured data for inference and decision support.
  • Establish observability, monitoring, and error handling for robust pipeline performance.
  • Collaborate with ML engineers to align data flows with model needs.
  • Continuously improve pipeline design to maximize scalability, resilience, and automation.

Key Requirements

  • 5+ years of experience building production-grade data pipelines.
  • Strong background in workflow orchestration and event-driven systems.
  • Proficiency with relational databases and SQL.
  • Experience operating in cloud environments and working with distributed systems.
  • Track record of delivering data infrastructure supporting ML or analytics applications.
  • Excellent communication and collaboration skills.

Bonus Skills

  • Knowledge of HIPAA and healthcare data security/privacy requirements.
  • Familiarity with FHIR/HL7 data modeling in production settings.
  • Experience supporting machine learning inference pipelines in real-world applications.

  • Data Pipeline Architect

    18 hours ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Job OverviewThis role focuses on designing, developing and maintaining data pipelines using Python and AWS services. The ideal candidate will have experience in building scalable and efficient data systems.Developing and implementing data processing solutions using AWS services (S3, Redshift, Lambda, Glue)Ensuring data quality and integrity throughout the...

  • Chief Data Pipeline Architect

    3 days ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 25,00,000

    Job OverviewAs a data engineer, you will be responsible for designing and building scalable data pipelines to ingest, process, and store data.The ideal candidate will have expertise in data integration, processing, and storage, as well as knowledge of data optimization architecture, data processes, and data flow.You will work closely with cross-functional...

  • Data Pipeline Specialist

    18 hours ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Overview">The role of a Data Engineer involves designing and developing scalable data pipelines to support the organization's growing data needs. This will involve collaborating with analytics and business teams to improve data models, making data more accessible and driving informed decision-making across the organization.Key Responsibilities">Develops...

  • Senior Data Pipeline Architect

    22 hours ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Data Engineer to join our team. This role involves designing, developing, and optimizing large-scale data pipelines and distributed data processing systems.Key Responsibilities:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark (PySpark), and...

  • Senior Data Pipeline Specialist

    1 day ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    ETL Developer Job DescriptionWe are seeking a talented ETL Developer to join our data engineering team. As an ETL Developer, you will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities:Design, develop, and maintain ETL...

  • Software Engineer

    6 days ago

    Belgaum, Karnataka, India beBeeDevelopment Full time ₹ 9,00,000 - ₹ 12,00,000

    We are seeking a skilled Software Engineer to join our team in building scalable and secure solutions for the higher education industry.Developing custom websites, web and mobile apps, and CRMsWorking with PHP, MySQL/MongoDB, and modern JavaScript frameworksCollaborating with designers and project managers to bring ideas to lifeIntegrating third-party APIs...

  • Chief Pharmaceutical Supply Chain Data Architect

    3 days ago

    Belgaum, Karnataka, India beBeeData Full time US$ 1,20,000 - US$ 1,40,000

    Unlocking Pharmaceutical Supply Chain DataBoston Insights is transforming the pharmaceutical industry by unlocking clinical supply chain data and enabling end-to-end visibility. We augment risk resiliency and agility to ensure uninterrupted supply of investigational drugs to patients on-time. Our mission is to revolutionize how pharmaceutical companies...

  • Visionary Data Engineer

    1 day ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Azure Data Engineer PositionWe are seeking an experienced Azure Data Engineer to design and develop end-to-end data pipelines that deliver business value. Your expertise in building complex data solutions on Azure will drive innovation and growth within the organization.Key Responsibilities:Design, Develop, and Run Complete E2E Data PipelinesHandle Data...

  • Financial Data Specialist

    41 minutes ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a highly skilled Big Data Engineer to join our team. In this role, you will be responsible for designing, building and maintaining robust data pipelines that handle high volume financial data.Key Responsibilities:Design, develop and manage end-to-end data pipelines for stocks, crypto and other financial datasets.Integrate third-party APIs and...

  • Data Architecture Lead

    3 days ago

    Belgaum, Karnataka, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Architect OpportunityWe are seeking a skilled professional to lead our data architecture and pipeline development. The ideal candidate will have experience with designing scalable and robust data architectures, developing and optimizing data pipelines, and collaborating with cross-functional teams.Key ResponsibilitiesDesign and Implement Scalable Data...