Chief Data Pipeline Architect

1 week ago

Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000
Job Description

We are seeking a seasoned data engineer to design, develop, and manage scalable data pipelines and transformation frameworks. The ideal candidate will play a critical role in enabling analytics, reporting, and business intelligence capabilities across the enterprise.

The successful applicant will work closely with cross-functional teams to build efficient data engineering solutions using modern Azure tools and best practices.

Key Responsibilities
  • Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks (Spark), and Azure Synapse Analytics.
  • Develop and optimize PySpark/Spark SQL jobs for large-scale batch and streaming data transformations.
  • Ingest data from various sources including Apache Kafka, REST APIs, and RDBMS, ensuring real-time or near-real-time availability.
  • Implement data modeling strategies (star schema, snowflake schema) for analytics consumption layers in Synapse or ADLS.
  • Collaborate with DevOps teams to automate deployment using CI/CD pipelines (Azure DevOps, GitHub Actions, etc.).
  • Monitor, troubleshoot, and optimize data workflows for performance, cost-efficiency, and reliability.
Required Skills and Qualifications
  • 5+ years of experience in data engineering roles.
  • Hands-on experience with:
    • Azure Data Factory (ADF) – building pipelines, triggers, linked services.
    • Azure Databricks – building and managing Spark jobs in PySpark.
    • Azure Synapse Analytics – data warehousing, SQL queries, workspace orchestration.
    • Apache Kafka – consuming and processing real-time data streams.
  • Strong skills in SQL, Python, and Spark for data manipulation and transformation.
  • Exposure to CI/CD practices (Azure DevOps, Git workflows, build/release pipelines).
Benefits
  • Opportunity to work on cutting-edge data engineering projects.
  • Collaborative and dynamic work environment.

  • Chief Data Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeDataArchitect Full time US$ 1,25,000 - US$ 1,75,000

    Role: Chief Data ArchitectWe are seeking a highly skilled and experienced data architect to lead our organization's data strategy. The successful candidate will have expertise in designing and implementing large-scale data systems, including data warehousing, ETL processes, and data governance.Key Responsibilities:• Design and implement scalable and...

  • Chief Data Pipeline Architect

    2 weeks ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a highly skilled Data Engineer with expertise in Microsoft Fabric and Azure Synapse to design, implement, and manage scalable data pipelines.The ideal candidate will have hands-on experience with Azure Synapse, Microsoft Fabric, Azure Data Factory, PySpark, SQL, and Azure Key Vault.About the Role:Design and implement scalable data...

  • Senior Chief Data Architect Position

    2 weeks ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title:Chief Data Pipeline ArchitectWe are seeking a skilled and experienced data engineer to join our team. In this role, you will design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP). You will play a critical role in ensuring the seamless flow of data across systems, enabling data-driven decision-making for our...

  • Data Pipeline Architect

    4 days ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 18,00,000

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to design and implement robust data pipelines using Python and SQL.Key responsibilities include designing, implementing, and managing CI/CD pipelines using GitHub Actions or equivalent tools.Key Responsibilities:Design and implement efficient CI/CD pipelines using GitHub Actions or equivalent...

  • Data Pipeline Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,10,000

    Role Summary:Developing data pipelines with StreamSets is crucial for integrating AI tools and hybrid cloud environments. Data analytics professionals must bridge the technical and business gaps, effectively communicating complex ideas and results.We are seeking an experienced leader to spearhead our data efforts in this area.Key Responsibilities:Create...

  • Chief Data Systems Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,00,000

    **Job Title:** Senior Data Engineer**Job Overview**The role of a Senior Data Engineer involves leading the design, implementation, and optimization of large-scale data pipelines and systems. Key Responsibilities:Design & Optimize Data Pipelines: Create efficient ETL/ELT workflows using AWS Glue, Airflow, Databricks, StreamSets, and Snowflake.Cloud & Big Data...

  • Lead Data Pipeline Architect

    2 weeks ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,60,00,000

    About the RoleWe are seeking an experienced Data Engineer to lead our data pipeline architecture and collaborate with data scientists and analysts.

  • Data Architect

    2 weeks ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Architect">The Data Architect will design, build and maintain large-scale data systems to support real-time and batch data processing. This includes designing scalable data pipelines and infrastructure.">Key Responsibilities:Data Pipeline Design and DevelopmentCloud Infrastructure ManagementBig Data ProcessingDatabase...

  • Chief Cloud Data Architect

    2 weeks ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 1,90,000

    Cloud Data Engineer RoleWe are seeking an experienced professional to join our team as a Cloud Data Engineer. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc.Key Responsibilities:Design and...

  • Data Engineer

    2 weeks ago

    Gulbarga, Karnataka, India beBeeDatastage Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: ETL Lead with IBM DataStageAbout the RoleWe are seeking a motivated and talented ETL developer to join our data engineering team. As an ETL lead, you will work on building scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities:Design, develop, and maintain ETL pipelines using...