Chief Data Pipeline Architect

2 days ago

Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Job Overview:

We are seeking a highly skilled Data Engineer with expertise in Microsoft Fabric and Azure Synapse to design, implement, and manage scalable data pipelines.

The ideal candidate will have hands-on experience with Azure Synapse, Microsoft Fabric, Azure Data Factory, PySpark, SQL, and Azure Key Vault.

About the Role:

  • Design and implement scalable data pipelines using Microsoft Fabric, including Dataflows Gen2, Lakehouse, Notebooks, and SQL endpoints.
  • Develop ETL/ELT solutions using PySpark, T-SQL, and Spark Notebooks within Fabric and Azure Synapse.
  • Manage and optimize data storage and compute in OneLake supporting Lakehouse and Warehouse use cases.
  • Implement and manage Azure Key Vault for secure handling of secrets, credentials, and connection strings.
  • Configure and manage CI/CD pipelines for Data engineering projects using Azure Devops including automated deployment of Fabric assets.
  • Integrate data from diverse sources including SQL server, Azure Blob, REST API's, and on-prem systems.
  • Monitor and troubleshoot data pipeline performance, data quality, and failure recovery.
  • Contribute to architecture design, governance processes, and performance tuning.

Responsibilities:

  • Develop ETL/ELT solutions using Apache Spark, Transact-SQL, and Spark Notebooks within Fabric and Azure Synapse.
  • Configure and manage Continuous Integration/Continuous Deployment pipelines for Data engineering projects using Azure DevOps.

About Us:

A US-based company specializes in providing comprehensive data solutions, including Data Strategy, Data Governance, Advanced Analytics, Business Applications, and Data Visualization.

  • Senior Chief Data Architect Position

    5 days ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title:Chief Data Pipeline ArchitectWe are seeking a skilled and experienced data engineer to join our team. In this role, you will design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP). You will play a critical role in ensuring the seamless flow of data across systems, enabling data-driven decision-making for our...

  • Chief Data Pipeline Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a candidate who is comfortable working on shifts that align with our global operations.Data Engineering OpportunitiesDevelop and maintain data pipelines using advanced frameworks to ensure seamless data flow.Critical Data TransformationsImplement high-touch data transformations for integration to meet client needs.Data Ingestion and...

  • Chief Data Architect

    7 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectRole Overview:We are seeking a skilled and motivated data architect to design, develop, and maintain scalable data systems that process and transform large volumes of structured and unstructured data. The ideal candidate will have a strong background in data architecture, cloud technologies, and big data, and will collaborate closely...

  • Chief Data Systems Architect

    7 hours ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,00,000

    **Job Title:** Senior Data Engineer**Job Overview**The role of a Senior Data Engineer involves leading the design, implementation, and optimization of large-scale data pipelines and systems. Key Responsibilities:Design & Optimize Data Pipelines: Create efficient ETL/ELT workflows using AWS Glue, Airflow, Databricks, StreamSets, and Snowflake.Cloud & Big Data...

  • Lead Data Pipeline Architect

    7 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,60,00,000

    About the RoleWe are seeking an experienced Data Engineer to lead our data pipeline architecture and collaborate with data scientists and analysts.

  • Senior Data Pipeline Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Unlock the Power of Data EngineeringWe're seeking an accomplished Data Engineer to champion data-driven initiatives and deliver high-quality solutions.This pivotal role involves designing, building, and optimizing scalable pipelines using Spark, PySpark, and SQL, collaborating with data scientists and business stakeholders to drive business value.Design and...

  • Data Architect

    6 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Architect">The Data Architect will design, build and maintain large-scale data systems to support real-time and batch data processing. This includes designing scalable data pipelines and infrastructure.">Key Responsibilities:Data Pipeline Design and DevelopmentCloud Infrastructure ManagementBig Data ProcessingDatabase...

  • Data Engineer

    6 days ago

    Gulbarga, Karnataka, India beBeeDatastage Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: ETL Lead with IBM DataStageAbout the RoleWe are seeking a motivated and talented ETL developer to join our data engineering team. As an ETL lead, you will work on building scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities:Design, develop, and maintain ETL pipelines using...

  • Chief Cloud Data Architect

    3 days ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 1,90,000

    Cloud Data Engineer RoleWe are seeking an experienced professional to join our team as a Cloud Data Engineer. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc.Key Responsibilities:Design and...

  • Chief Data Strategist

    7 days ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Data ArchitectAs a Technical Lead - Data Engineering, you will be responsible for designing and implementing end-to-end data pipelines and integration solutions.