Chief Data Pipeline Architect

5 days ago

Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000
Job Description

We are seeking a skilled Data Engineer with extensive experience in CI/CD practices, Databricks (Spark), Python, GitHub, and SQL. The ideal candidate should possess hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.

  • Design, implement, and manage CI/CD pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Build, optimize, and debug Spark jobs in Databricks for large-scale data processing.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop, test, and maintain robust data pipelines using Python and SQL.
  • Implement unit testing, validation, and quality checks for data workflows.
  • Manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
  • Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Keep critical Databricks notebooks running reliably to ensure business continuity.
Required Skills and Qualifications
  • Strong skills in SQL, Databricks (Spark), and Python/R.
  • Strong knowledge of GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
  • Experience in implementing unit tests and quality checks in data workflows.
  • Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
  • Familiarity with YAML configuration management, debugging, and error resolution.
  • Strong problem-solving and debugging skills in data engineering workflows.
  • Experience with Snowflake or another cloud data warehouse.
  • Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.
Benefits

The successful candidate will have the opportunity to work with a talented team, contribute to the development of cutting-edge data engineering solutions, and grow professionally in a dynamic and supportive environment.

  • Chief Data Architect with ETL Experience

    6 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Exciting Opportunity for a Chief Data ArchitectJob OverviewWe are seeking a highly skilled Chief Data Architect with extensive experience in designing and implementing data pipelines using Extract, Transform, Load (ETL) technologies.The successful candidate will be responsible for building large-scale data architectures that meet business requirements,...

  • Data Architect Lead

    1 week ago

    Gandhinagar, Gujarat, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 19,99,999

    **Chief Data Architect Position Available**Overview:We are seeking a highly skilled Chief Data Architect to lead the development of scalable, high-performance data platforms and advanced analytics capabilities across our enterprise.This role will be responsible for building a robust data practice, establishing engineering and modeling standards, and...

  • Chief Data Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeDataScience Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Chief Data ArchitectJob Description:We are seeking a highly skilled data scientist to lead our team of experts and drive innovation in machine learning and AI technologies.The successful candidate will be responsible for designing, developing, and implementing advanced data models to solve complex business problems.Collaboration with stakeholders...

  • Chief Data Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,10,000

    Job Summary:We're seeking a highly skilled Senior Data Engineer to spearhead the development of our data infrastructure.Main Responsibilities:Data Pipeline Design:Design and optimize data pipelines using ETL/ELT workflows, cloud-based platforms, and big data ecosystems.Data Platform Architecture:Architect scalable data platforms using AWS services such as...

  • Chief Financial Data Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Lead Data Architect in Finance TechnologyThe Lead Data Architect within the Finance & Accounting domain plays a pivotal role in shaping next-generation financial data architecture.This role is focused on leveraging Snowflake, dbt, and modern data engineering practices to build scalable, trusted, and cost-optimized financial data solutions.Architect & Lead...

  • AWS Data Pipeline Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 25,00,000 - ₹ 40,00,000

    Key to our success lies in leveraging the power of data. We are seeking a highly skilled and experienced Senior AWS Data Engineer to join our data engineering team.The ideal candidate will have deep expertise in building scalable data pipelines using Apache Spark, PySpark, SQL, and Python, along with hands-on experience in the AWS...

  • Chief Data Architect

    5 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data ArchitectAbout this role:We are seeking an experienced data architect to help our clients build scalable data platforms and AI solutions.Key Responsibilities:Design and implement secure, efficient, and highly available data architecture.Develop data pipelines, design data lakes, and implement data warehousing solutions using cloud-based...

  • Senior Data Pipeline Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking an experienced Data Engineer to join our team. As a key member of our organization, you will play a critical role in designing and implementing data pipeline architectures that meet the needs of our business.Responsibilities:Create and maintain optimal data pipeline architectures using big data technologies such as Spark and...

  • Expert Data Pipeline Architect

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Mid-Level Data EngineerAs a data engineer, you will design and build efficient data pipelines to move data from multiple sources into data stores or warehouses. This role is ideal for someone who has worked on end-to-end data engineering projects and wants to grow with a company that values ownership, innovation, and resourcefulness.">Design and build data...

  • Chief Data Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking an expert data architect to design and implement scalable data solutions using cutting-edge technologies.The ideal candidate will have a strong background in data engineering and be proficient in PySpark, Python, and SQL.Responsibilities include building and maintaining ETL pipelines, ensuring data quality and availability, writing and...