Data Pipeline Architect

1 day ago

Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Title:

Data Pipeline Architect

  • Create and implement scalable, event-driven data pipelines that support real-time clinical workflows.
  • Design and integrate systems with EHR/EMR platforms (e.g., Epic) using FHIR and HL7 standards.
  • Develop high-quality systems to ingest, track, and update clinical events in real-time
  • Ensure downstream analytics systems receive reliable, structured data for decision-making and inference.
  • Establish robust monitoring and error handling for efficient pipeline performance.
  • Collaborate with analysts to align data flows with model needs (e.g., document ingestion, embedding storage, inference triggers).
  • Continuously improve pipeline design to maximize scalability, resilience, and automation.

About the Role:

This is a critical position where you will be responsible for creating and implementing scalable, event-driven data pipelines. You will work closely with software developers, data scientists, and clinical partners to bring our vision to life.

Key Responsibilities:

Requirements:

  • 5+ years of experience designing and maintaining production-grade data pipelines.
  • Strong background in workflow orchestration and event-driven systems.
  • Proficiency with relational databases and SQL (e.g., Postgres) as well as handling unstructured data.
  • Experience operating in cloud environments and working with distributed, highly available systems.
  • Track record of delivering data infrastructure that supports analytics applications.
  • Excellent communication and collaboration skills; able to drive projects independently while working as part of a cross-functional team.

Bonus Requirements:

  • Familiarity with HIPAA and healthcare data security/privacy requirements.
  • Knowledge of FHIR/HL7 data modeling in production settings.
  • Experience supporting machine learning inference pipelines in real-world applications.

Benefits:

This role offers excellent opportunities for professional growth and development in a fast-paced and innovative environment.

Ongoing Support:

We provide ongoing support and training to ensure your continued success in this role.

  • Senior Data Infrastructure Specialist

    1 day ago

    Varanasi, Uttar Pradesh, India beBeeData Architect Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a skilled data architect to design and develop robust data systems for our slot games. This role will involve creating scalable data infrastructure ensuring high-quality reliable data for player behavior analysis game performance and optimization.Key ResponsibilitiesCreate maintain and optimize large-scale data pipelines for slot game and...

  • Chief Data Pipeline Architect

    5 days ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Key Role in Data EngineeringWe are seeking a highly skilled Data Engineer to play a key role in designing, building, and maintaining scalable data pipelines and infrastructure.Our ideal candidate will have expertise in big data technologies and be able to design robust data pipelines and ETL workflows.The successful candidate will work closely with analytics...

  • Data Architect Specialist

    6 days ago

    Varanasi, Uttar Pradesh, India beBeeDataArchitect Full time US$ 80,000 - US$ 1,40,000

    Data Architect SpecialistAre you a data expert looking for a challenging role in the field of data engineering? Do you have experience with designing and developing scalable data pipelines using Python and AWS services such as S3, Redshift, Lambda, and Glue? If so, we want to hear from you!Key Responsibilities:Data Pipeline Development: Develop and maintain...

  • Data Architect

    2 hours ago

    Varanasi, Uttar Pradesh, India Tata Consultancy Services Full time

    Greetings from TCSTCS is Hiring for Data Architect (Azure/AWS)Interview Mode: VirtualExperience: 10-16 yearsWork location: PAN INDIAMust-HaveProficiency in SQL, data modeling tools, and pipeline orchestration tools.Familiar with modern data stacks (Snowflake, Databricks, Apache Spark, Kafka).Hands-on experience with at least one major cloud provider:AWS: S3,...

  • High-Performance Data Pipeline Architect

    6 days ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking an experienced Senior Data Engineer to lead the design, development, and maintenance of scalable data pipelines using Databricks and PySpark.The ideal candidate will have a strong background in cloud architecture and data engineering, with expertise in AWS services such as S3, Glue, Lambda, EMR, and Redshift.Key Responsibilities:Design and...

  • Data Pipeline Specialist

    6 days ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 1,50,000

    Job Description:As a skilled data engineer, you will be responsible for designing and implementing robust data pipelines using Python and SQL. You will work with modern DevOps/configuration management tools to manage multi-environment deployments.Design, implement, and manage CI/CD pipelines using Github Actions or equivalent tools.Configure and maintain...

  • Data Pipelines Expert

    6 days ago

    Varanasi, Uttar Pradesh, India beBeedataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleA Data Engineer is needed to design, build and maintain high-quality, secure and scalable data pipelines using various technologies.

  • Cloud Data Architect

    6 days ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 1,00,00,000

    Job Title: Cloud Data ArchitectOverview:The ideal candidate will design and implement cloud-based data architectures to support business growth. This includes developing scalable data pipelines, integrating with various systems, and ensuring data quality.Key Responsibilities:Design and implement cloud-based data architectures using Azure Databricks and Azure...

  • Chief Data Architect

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    As a seasoned Data Engineer, you will play a pivotal role in designing and implementing scalable data solutions that drive business growth. A strong background in PostgreSQL, cloud data architectures, and modern data pipelines is essential for success in this position.Key ResponsibilitiesDesign and build a PostgreSQL-based data warehouse for analytics and...

  • Principal Data Pipeline Specialist

    7 days ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking an experienced Data Engineer to design, develop, and maintain large-scale data pipelines using Azure Databricks and PySpark. This role involves collaboration with cross-functional teams to integrate data engineering solutions with business requirements, ensuring data quality, security, and compliance throughout the data...