Data Pipeline Architect

9 hours ago

Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title: Senior Data Engineer

About the Role:

We are seeking a skilled professional to lead the development and operation of data pipelines that support AI-powered applications. As a Senior Data Engineer, you will work closely with software engineers, ML specialists, and clinical partners to design, build, and scale data infrastructure that meets the needs of our organization.

  • Design and operate scalable, event-driven data pipelines that support real-time clinical workflows.
  • Integrate with EHR/EMR systems (e.g., Epic) using standards such as FHIR and HL7.
  • Develop reliable systems to ingest, track, and update clinical events in real-time.
  • Ensure downstream ML systems receive high-quality, structured data for inference and decision support.
  • Establish observability, monitoring, and error handling for robust pipeline performance.
  • Collaborate with ML engineers to align data flows with model needs (e.g., document ingestion, embedding storage, inference triggers).
  • Continuously improve pipeline design to maximize scalability, resilience, and automation.

Requirements:

  • 5+ years of experience building and maintaining production-grade data pipelines.
  • Strong background in workflow orchestration and event-driven systems.
  • Proficiency with relational databases and SQL (e.g., Postgres) as well as handling unstructured data.
  • Experience operating in cloud environments and working with distributed, highly available systems.
  • Track record of delivering data infrastructure that supports ML or analytics applications.
  • Excellent communication and collaboration skills; able to drive projects independently while working as part of a cross-functional team.

Bonus Requirements:

  • Knowledge of HIPAA and healthcare data security/privacy requirements.
  • Familiarity with FHIR/HL7 data modeling in production settings.
  • Experience supporting machine learning inference pipelines in real-world applications.
  • Expertise with image data.
  • Exposure to vector databases, embedding stores, or document retrieval systems.
  • Background in healthcare IT, clinical workflows, or health data analytics.

  • Data Pipeline Architect

    2 weeks ago

    Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 18,00,000

    Job Title: Data Engineering SpecialistWe are seeking an accomplished professional to lead the design, development, and maintenance of scalable data pipelines.About the Role:As a key member of our team, you will collaborate with cross-functional stakeholders to deliver high-quality data assets that support business-critical analytics and AI/ML...

  • Data Architect

    2 weeks ago

    Bhavnagar, Gujarat, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerSikich India is seeking an experienced Data Architect to join our team in designing and building end-to-end data solutions using Microsoft's data platforms, including Fabric, Azure Synapse Analytics, Databricks, and Power BI.This role involves implementing contemporary data architecture patterns, creating robust data pipelines, and...

  • Chief Data Pipeline Architect

    1 week ago

    Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 12,00,000

    Data Engineering ExpertWe are seeking a seasoned Data Engineering Expert to join our team. As a key member of our data engineering team, you will design, build, and maintain complex systems that store, process, and retrieve data.Develop real-time and close-to-real-time data integrations using Kafka, MS Event Hubs, etc.Create Business Intelligence Dashboards...

  • Data Architect

    1 week ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time US$ 2,00,000 - US$ 2,50,000

    About us:We are a healthcare technology company that aims to make nutritious food accessible and affordable for everyone.We have a robust network of Registered Dietitians who provide personalized nutrition counseling and guidance to our members. Our platform integrates dietary assessments, nutrition counseling, online food ordering, and cost-effective meal...

  • Senior Data Architect

    2 weeks ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data ArchitectWe are seeking a skilled Big Data Architect to design, build, and optimize scalable data architectures using Snowflake, AWS, and DBT. The ideal candidate will enable seamless data integration, transformation, and analytics to support business intelligence and advanced analytics initiatives.Design, build, and maintain ETL/ELT pipelines using...

  • Enterprise Data Architect Specialist

    2 weeks ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 19,50,000 - ₹ 24,12,000

    Data Architect OpportunityWe are seeking an experienced Data Architect to design, develop and govern our data architecture and pipelines. Ideally someone who has worked on multiple projects with GCP-Big Query, Data Proc technologies.

  • Data Architect Specialist

    2 days ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title:Data Architect SpecialistAs a Data Architect Specialist, you will be responsible for designing and implementing scalable data pipelines and architectures.Key Responsibilities:Developing client-ready dashboards using Bold BI, Power BI, Superset, or similar Business Intelligence tools.Designing and optimizing data integration and analytics solutions...

  • Data And Solutions Architect

    4 weeks ago

    Bhavnagar, Gujarat, India CoffeeBeans Full time

    Coffee Beans Consulting is a tech consulting firm focused on making organizations AI-ready by structuring their data efficiently across various sources and enabling AI-driven solutions.We specialize in data architecture, pipelines, governance, MLOps, and Gen AI solutions, helping clients achieve faster go-to-market and cost efficiency.We are looking for a...

  • Cloud Data Pipeline Specialist

    4 days ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data EngineerAs a Cloud Data Engineer, you will play a key role in developing and maintaining large-scale data pipelines on the cloud.Key Responsibilities:Design and develop complex data pipelines using Python, Data Flow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, and Cloud Storage.Utilize DevOps and CI/CD practices to ensure the...

  • Data Solutions Architect

    4 days ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,10,00,000

    Job Title: Databricks EngineerWe are seeking a seasoned Data Solutions Architect to design, build and optimize scalable data solutions.The ideal candidate has hands-on experience in Databrick production environments and a deep understanding of modern data architecture. You will work with cross-functional teams to create robust data pipelines and ensure the...