Data Pipeline Architect

3 days ago

Thrissur, Kerala, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000

Unlock the Power of Data Engineering

As a Senior Data Engineer, you will play a vital role in building and maintaining scalable data pipelines that integrate healthcare data. This is a critical position where you will create high-performance pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated information to machine learning systems for inference.

Key Responsibilities:
  • Design, build, and operate robust event-driven data pipelines that support real-time clinical workflows.
  • Integrate with Electronic Health Record (EHR) systems using standards such as Fast Healthcare Interoperability Resources (FHIR) and Health Level Seven International (HL7).
  • Develop reliable systems to ingest, track, and update clinical events in real-time.
  • Ensure downstream Machine Learning (ML) systems receive high-quality, structured data for inference and decision support.
  • Establish observability, monitoring, and error handling for robust pipeline performance.
  • Collaborate with ML engineers to align data flows with model needs.
  • Continuously improve pipeline design to maximize scalability, resilience, and automation.
Requirements:
  • At least 5 years of experience building and maintaining production-grade data pipelines.
  • Strong background in workflow orchestration and event-driven systems.
  • Proficiency with relational databases and SQL, as well as handling unstructured data.
  • Experience operating in cloud environments and working with distributed, highly available systems.
  • Track record of delivering data infrastructure that supports ML or analytics applications.
  • Excellent communication and collaboration skills.

  • Data Engineer

    4 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Job Title:Data Engineer - Pipeline Architect\About the Role:\We are seeking a highly skilled Data Engineer to design, implement and manage data pipelines. Key responsibilities include building CI/CD pipelines using GitHub Actions or equivalent tools, configuring and maintaining branch protection rules and workflows, automating Databricks deployments using...

  • Chief Data Pipeline Architect

    1 week ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our growing team of consultants.Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.Architect and implement data warehouses, data lakes, and other storage solutions that support...

  • Data Pipeline Architect

    2 days ago

    Thrissur, Kerala, India beBeeETL Full time ₹ 15,00,000 - ₹ 25,00,000

    As a highly skilled ETL specialist, you will be responsible for designing and deploying efficient data pipelines that drive business growth.The ideal candidate will have hands-on experience with ETL development using Informatica and a strong understanding of data warehousing concepts. Additionally, proficiency in Python programming for data processing and...

  • Data Pipeline Specialist

    2 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Opportunity: Data EngineerWe are seeking a skilled professional to join our team as a Data Engineer.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Integrate data from various sources, ensuring data quality and consistency.Optimize data processing workflows for...

  • Expert Data Pipeline Architect

    7 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Freelance Data EngineerWe are seeking a Freelance Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines using Python, SQL, Linux/Bash, PySpark, AWS, and Databricks.Job Description:Data Engineering is a key component of our organization's ability to drive business outcomes through data-driven decision making. We are...

  • Chief Data Pipeline Architect

    2 weeks ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000

    Key Data Engineer PositionWe are seeking a highly skilled data professional with 4+ years of experience in designing, building, and optimizing ETL pipelines for large-scale data processing workflows. The ideal candidate will have hands-on experience working with Azure Cloud services including Azure Data Factory, Databricks, and related...

  • Chief Data Pipeline Architect

    4 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Description:We are seeking an experienced Data Engineer to design, build and maintain scalable data pipelines in a cloud environment. The ideal candidate will have hands-on experience with AWS services, including EMR, Glue, PySpark, Airflow and Python.Requirements:A minimum of 5 years of experience in data engineering or related roles.Strong proficiency...

  • Data Architect

    23 hours ago

    Thrissur, Kerala, India beBeeCloud Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectDomain: Cloud EngineeringOverview:We are seeking highly skilled data architects to design and develop robust cloud-based data architectures that power business intelligence solutions. The role focuses on developing efficient data pipelines, ensuring data quality, security, and scalability to support AI/ML model training, inference,...

  • Senior Data Architect

    4 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Role – Data Engineer With FabricJob Location – JaipurJob Type – PermanentExperience Required: 2-4 YearsWe are seeking a skilled Data Engineer to join our team. As a key member of the team, you will play a critical role in designing, developing, and maintaining our data pipelines and infrastructure.Main Responsibilities:Data Pipeline Development:...

  • Senior Data Pipeline Architect

    2 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,00,000

    Data Engineer Role SummaryWe are seeking a highly skilled data engineer to spearhead our ETL development and data warehousing initiatives. The ideal candidate will have hands-on experience in designing, building, and optimizing data pipelines using IBM DataStage, coupled with strong SQL skills (Teradata).The successful candidate will collaborate with data...