Pipeline Architect and Automation Expert

2 days ago

Kota, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000
Lead Data Engineer

We are seeking a highly skilled and experienced Lead Data Engineer to oversee the design, implementation, and management of our data pipeline architecture.

The successful candidate will have expertise in CI/CD practices, Databricks (Spark), Python, GitHub, and SQL. They will be responsible for building and automating data pipelines, managing multi-environment deployments, and collaborating with cross-functional teams.

  • Design and implement efficient CI/CD pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows for seamless code integration and deployment.
  • Develop and optimize Spark jobs in Databricks for large-scale data processing, ensuring reliability and consistency across environments.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop, test, and maintain robust data pipelines using Python and SQL, incorporating unit testing, validation, and quality checks.
  • Manage multi-environment deployments (Dev, Stage, Prod) while ensuring business continuity and long-term reliability.
  • Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
Requirements
  • Strong skills in SQL, Databricks (Spark), and Python/R.
  • Deep knowledge of GitHub and CI/CD practices, including branch protection and GitHub Actions workflows.
  • Experience in implementing unit tests and quality checks in data workflows.
  • Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
  • Familiarity with YAML configuration management, debugging, and error resolution.

  • CV Pipeline Architect

    3 hours ago

    Kota, Rajasthan, India beBeeComputerVision Full time ₹ 25,00,000 - ₹ 30,00,000

    We are seeking a seasoned expert in Computer Vision to lead the design and implementation of cutting-edge CV pipelines. The ideal candidate will have a strong background in computer vision, object detection, and instance segmentation.The responsibilities of this role include designing and implementing complex CV pipelines for object detection and instance...

  • Data Pipeline Architect

    4 days ago

    Kota, Rajasthan, India beBeeDatabase Full time ₹ 18,90,000 - ₹ 25,20,000

    Job SummaryWe are seeking an experienced Data Engineer to design, develop and test complex data pipelines using ETL tools.We aim to hire a highly skilled individual with a strong understanding of ETL concepts, data warehouse testing methodologies, and manual testing. If you have a passion for delivering high-quality database scripts and collaborating with...

  • Automic Automation Expert

    2 days ago

    Kota, Rajasthan, India beBeeAutomic Full time ₹ 50,00,000 - ₹ 1,00,00,000

    Job Title: Automic Automation ExpertWe are seeking a highly skilled and experienced Automic automation expert to join our team. As an Automic automation expert, you will be responsible for maintaining and enhancing the Automation Engine (AE) infrastructure.This role requires strong expertise in Automic tools, scripting, and troubleshooting, along with the...

  • Cloud Infrastructure Architect and Reliability Expert

    4 days ago

    Kota, Rajasthan, India beBeeExpert Full time ₹ 14,46,070 - ₹ 21,11,758

    Job OverviewWe are seeking an experienced Cloud Infrastructure Architect and Reliability Expert to join our Platform Engineering Practice.This role will involve designing, managing, and scaling large-scale observability infrastructure ingesting 2–3+ TB/day. You will also enhance reliability across distributed systems, drive automation within cloud...

  • Automation Solutions Expert

    3 days ago

    Kota, Rajasthan, India beBeeAutomation Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a highly skilled Automation Architect to join our team. As an Automation Architect, you will be responsible for designing and implementing automation frameworks, tools, and processes.Main Responsibilities:Design and implement automation frameworks, tools, and processesContribute to the design architecture of automation...

  • Data Search Expert

    5 days ago

    Kota, Rajasthan, India beBeeArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Search Solutions ArchitectTransforming search experiences requires a deep understanding of designing and implementing search solutions using OpenSearch/Elasticsearch. As a Search Solutions Architect, you will be responsible for crafting custom analysers, tokenisers, and scoring algorithms to deliver exceptional search relevance.Responsibilities:Design and...

  • Process Automation Expert

    2 days ago

    Kota, Rajasthan, India beBeeAutomation Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Automation Engineer - Process Automation ExpertWe are seeking an experienced Automation Engineer to join our team as a Process Automation Expert. In this role, you will be responsible for designing, developing, and implementing automation solutions for various industrial processes.Key Responsibilities:Design and develop automation solutions using PLC...

  • Cloud Automation Specialist

    4 days ago

    Kota, Rajasthan, India beBeeAutomation Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    We are seeking a highly skilled Cloud Engineer to design, build and optimise infrastructure automation solutions across cloud-based environments.The ideal candidate should have expertise in Infrastructure as Code (IaC) tools, strong experience with Continuous Integration/Continuous Deployment (CI/CD) pipelines, and hands-on skills in VMware automation, Aria...

  • Automated Testing Specialist

    3 days ago

    Kota, Rajasthan, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 25,00,000

    We're seeking a seasoned automation expert to help us redefine the future of software testing and development.Key ResponsibilitiesTest Suite Development: Design, develop, and maintain end-to-end automated test suites using Playwright (TypeScript/JavaScript/Node.js) to ensure seamless integration with CI/CD pipelines.Automation Framework Optimization: Extend...

  • Senior Automation Specialist

    3 days ago

    Kota, Rajasthan, India beBeeDevops Full time ₹ 80,00,000 - ₹ 1,20,00,000

    DevOps Engineer Job DescriptionWe are seeking a skilled DevOps Engineer to join our organization in Ajmer, India.This role requires an expert in designing and implementing Salesforce DevOps pipelines (CI/CD). The ideal candidate will work extensively with Git-based version control and automate deployments across multiple Salesforce orgs.Design and implement...