Chief Data Pipeline Architect

4 days ago

Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 10,00,000
Job Description

As a skilled Data Engineer, you will be responsible for designing and implementing data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.

Key Responsibilities:

  • Develop and manage continuous integration/continuous deployment (CI/CD) pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Design, implement, and debug Spark jobs in Databricks for large-scale data processing.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Build robust data pipelines using Python and SQL.
  • Implement unit testing, validation, and quality checks for data workflows.
  • Manage multi-environment deployments ensuring reliability and consistency.
  • Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
Required Skills & Qualifications

Strong skills in SQL, Databricks (Spark), and Python/R are required. Additionally, experience in implementing unit tests and quality checks in data workflows is essential. Knowledge of Databricks Asset Bundles (DABs) or similar automation tools is also necessary. Familiarity with YAML configuration management, debugging, and error resolution is preferred. Strong problem-solving and debugging skills in data engineering workflows are also required.

What We're Looking For

We are looking for a candidate with strong problem-solving skills and hands-on experience with Tableau/Power BI dashboards. A good sense of usability and the ability to work with cross-functional teams are also essential.

  • Chief Data Architect

    1 week ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    Job Title: Chief Data ArchitectKey ResponsibilitiesSpearhead advanced AI/ML research and development across domains.Architect end-to-end ML pipelines leveraging state-of-the-art techniques.Design scalable, maintainable AI/ML platforms delivering robustness, reliability, and alignment with enterprise objectives.Partner with engineering, design, and product...

  • Senior Data Pipeline Architect

    2 days ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a highly skilled professional to lead the design and optimization of our distributed data pipelines, infrastructure, and tools that power insights across our business.You will collaborate closely with software developers, architects, analysts, and data scientists to ensure smooth, secure, and efficient data delivery across multiple...

  • Chief Data Pipeline Architect

    1 week ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job SummaryWe seek a skilled Data Engineer to develop and maintain ETL pipelines utilizing cutting-edge technologies.This role involves transforming data, supporting ingestion and quality checks during client onboarding, optimizing Snowflake queries, and collaborating with the QC team.Key Responsibilities:Develop data transformations for HighTouch...

  • Chief Data Pipeline Specialist

    1 week ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Data ArchitectWe are seeking a skilled and motivated Data Engineer to design, develop and maintain scalable data pipelines that process large volumes of structured and unstructured data.Key Responsibilities:Design and implement data architectures for processing structured and unstructured data.Build and maintain ETL/ELT workflows for data...

  • Senior Enterprise Data Solutions Architect

    5 days ago

    Kolkata, West Bengal, India beBeeData Architect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a seasoned data architect to lead the design and implementation of robust data solutions for our clients.Main Responsibilities:Develop and maintain complex data models for large-scale enterprise applications.Collaborate with cross-functional teams, including data architects, business analysts, and IT professionals, to deliver...

  • Chief Data Architect

    2 days ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    High-Performance Data Engineering RoleJob Title: Data Engineer (Snowflake + dbt)We are seeking an accomplished Data Engineer to contribute to the growth of our data engineering team. As a key member, you will be responsible for designing and implementing scalable ELT pipelines using Snowflake and dbt.Key Responsibilities:Data Ingestion and Processing: Build...

  • Data Pipeline Architect

    1 week ago

    Kolkata, West Bengal, India beBeeDataSpecialist Full time ₹ 18,00,000 - ₹ 25,00,000

    We are seeking a Data Specialist to join our organization, responsible for designing and developing robust data pipelines in Databricks PySpark. The ideal candidate will possess exceptional skills in ETL processes and the ability to collaborate with cross-functional teams.About This RoleThe Data Specialist will play a crucial role in ensuring efficient data...

  • Chief AI Solutions Architect

    4 days ago

    Kolkata, West Bengal, India beBeeArtificialIntelligence Full time ₹ 80,00,000 - ₹ 1,20,00,000

    About the Role: We are seeking a skilled Chief AI Solutions Architect to lead the design, development, and optimisation of AI-driven solutions for the healthcare and life sciences domain.The ideal candidate will possess:Expertise in agentic AI workflows and LLM-powered applications.Strong programming skills in Python and/or TypeScript.Familiarity with AWS...

  • Chief Data Infrastructure Architect

    1 week ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Summary:As a senior data engineer, you will be responsible for leading the optimization and scalability of data delivery pipelines to ensure performance and reliability for cross-functional stakeholders.You will architect, build, and maintain robust, high-throughput data pipelines and infrastructure to support advanced analytics and machine learning...

  • Chief Architect for Scalable Data Pipelines

    1 week ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 20,25,000 - ₹ 25,27,500

    Job Title: Senior Data EngineerAt a leading organization, we seek a highly skilled individual with expertise in Microsoft Azure to lead the design, build, and optimization of scalable data pipelines and architectures.Key Responsibilities:Design and develop robust, secure, and high-performance data solutions using Azure Data Factory and Azure Synapse...