Data Pipeline Architect

4 days ago

Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 18,00,000
Job Title: Data Engineer

We are seeking a skilled Data Engineer to design and implement robust data pipelines using Python and SQL.

Key responsibilities include designing, implementing, and managing CI/CD pipelines using GitHub Actions or equivalent tools.

  • Key Responsibilities:
  • Design and implement efficient CI/CD pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Build, optimize, and debug Spark jobs in Databricks for large-scale data processing.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop, test, and maintain robust data pipelines using Python and SQL.
  • Implement unit testing, validation, and quality checks for data workflows.
  • Manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
  • Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Keep critical Databricks notebooks running reliably to ensure business continuity.
  • Migrate legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI).
  • Partner with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust.
  • Put guardrails in place with data contracts, quality checks, and documentation to ensure long-term reliability.

  • Data Pipeline Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,10,000

    Role Summary:Developing data pipelines with StreamSets is crucial for integrating AI tools and hybrid cloud environments. Data analytics professionals must bridge the technical and business gaps, effectively communicating complex ideas and results.We are seeking an experienced leader to spearhead our data efforts in this area.Key Responsibilities:Create...

  • Chief Data Pipeline Architect

    2 weeks ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a highly skilled Data Engineer with expertise in Microsoft Fabric and Azure Synapse to design, implement, and manage scalable data pipelines.The ideal candidate will have hands-on experience with Azure Synapse, Microsoft Fabric, Azure Data Factory, PySpark, SQL, and Azure Key Vault.About the Role:Design and implement scalable data...

  • Chief Data Pipeline Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a seasoned data engineer to design, develop, and manage scalable data pipelines and transformation frameworks. The ideal candidate will play a critical role in enabling analytics, reporting, and business intelligence capabilities across the enterprise.The successful applicant will work closely with cross-functional teams to...

  • Lead Data Pipeline Architect

    2 weeks ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,60,00,000

    About the RoleWe are seeking an experienced Data Engineer to lead our data pipeline architecture and collaborate with data scientists and analysts.

  • Data Architect

    2 weeks ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Architect">The Data Architect will design, build and maintain large-scale data systems to support real-time and batch data processing. This includes designing scalable data pipelines and infrastructure.">Key Responsibilities:Data Pipeline Design and DevelopmentCloud Infrastructure ManagementBig Data ProcessingDatabase...

  • Data Engineer

    2 weeks ago

    Gulbarga, Karnataka, India beBeeDatastage Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: ETL Lead with IBM DataStageAbout the RoleWe are seeking a motivated and talented ETL developer to join our data engineering team. As an ETL lead, you will work on building scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities:Design, develop, and maintain ETL pipelines using...

  • Data Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,20,00,000

    We are seeking a skilled Information Architect to join our organization in solving complex business challenges.This is an exciting opportunity for someone who thrives on early-stage projects, loves building innovative scalable solutions from day zero, and is eager to own the entire technology stack.Key Responsibilities:Data Extraction & Processing: Design...

  • Data Pipeline Specialist

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Developing and Implementing Data PipelinesWe are seeking a skilled professional with proficient knowledge in Spark and SQL to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our platform.Key responsibilities include designing, developing, and maintaining scalable data pipelines...

  • Data Pipeline Tester

    1 week ago

    Gulbarga, Karnataka, India beBeeDataPipeline Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Pipeline TesterData Pipeline Tester Job DescriptionWe are seeking a skilled data pipeline tester to fill this position. As a data pipeline tester, you will be responsible for ensuring the accuracy, consistency, and high throughput of event-driven systems.Key Responsibilities:Test ETL processes and perform data reconciliation across...

  • IoT Data Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 9,00,000 - ₹ 12,12,500

    Job Title: IoT Data ArchitectAbout the RoleWe are seeking an experienced IoT data architect with a strong background in AWS IoT and Python to design and implement scalable IoT data solutions.The ideal candidate will have hands-on experience in data transformation and ingestion, as well as knowledge of GCP BQ Dataflow Airflow and Python.Key...