Mastering Azure Data Pipeline Architectures

1 day ago

Amrāvati, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000
Azure Data Factory Specialist

We seek an experienced professional to support data integration and ETL needs. The ideal candidate will have expertise in ADF pipelines, data orchestration, and transformations for smooth, scalable, and secure data flows.

  • Design, build, and maintain Azure Data Factory pipelines for ETL and ELT processes.
  • Integrate data from multiple sources.
  • Optimize pipelines for performance, scalability, and cost efficiency.
  • Implement data transformations, mapping, and workflow orchestration.
  • Configure triggers, parameters, and dynamic pipelines in ADF.
  • Collaborate with data engineers, analysts, and business stakeholders.
  • Ensure security, compliance, and monitoring of pipelines using Azure best practices.
  • Provide documentation and knowledge transfer.

Key Requirements:

  • Proven experience with Azure Data Factory (ADF).
  • Strong knowledge of ETL/ELT processes, data integration, and pipeline design.
  • Familiarity with Azure services such as Data Lake, Synapse Analytics, SQL Database, and Key Vault.
  • Experience in parameterization, linked services, datasets, and integration runtimes.
  • Strong troubleshooting and optimization skills.
  • Excellent communication and problem-solving abilities.

Desirable Skills:

  • Experience with Azure DevOps (CI/CD for ADF pipelines).
  • Knowledge of Azure Monitor / Log Analytics for pipeline monitoring.
  • Familiarity with JSON-based ADF configurations.
  • Understanding of data governance and security in Azure.

  • Principal Software Developer

    2 days ago

    Amrāvati, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking an experienced Lead Python Engineer to lead the development of a shared component library for data pipelines.The successful candidate will have hands-on experience with Apache Beam and Databricks, as well as strong expertise in performance and concurrency.Key ResponsibilitiesDesign and build a shared component library/SDK for...

  • Senior Data Pipeline Architect

    2 days ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 10,54,290 - ₹ 20,28,578

    Job OverviewOur organization seeks a highly skilled Data Engineer with 4–7 years of experience to build and optimize scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.The role involves collaborating with cross-functional teams to develop innovative data solutions, ensure robust data governance, and support real-time and batch...

  • Data Architectural Specialist

    4 hours ago

    Amrāvati, Maharashtra, India beBeeAnalytics Full time ₹ 1,20,00,000 - ₹ 2,20,00,000

    Next-Generation Analytics Platform DesignerWe are seeking an experienced designer to lead the development of next-generation analytics platforms in the Microsoft ecosystem. This role involves designing and scaling data architectures, building data pipelines, and driving ingestion-to-insight workflows.Key Responsibilities:Design scalable data solutions using...

  • Data Pipeline Architect

    4 days ago

    Amrāvati, Maharashtra, India beBeeAzure Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:">Lead Azure Data Engineer"> ">Job Description">">As a highly skilled and experienced Lead Data Engineer, you will be responsible for designing, developing, and optimizing data pipelines using Azure and Databricks.">Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management is also required.">Additionally, you will...

  • Azure Data Solutions Developer

    4 days ago

    Amrāvati, Maharashtra, India beBeeData Full time US$ 1,00,000 - US$ 1,25,000

    Job Title: Azure Data Engineer We are seeking an accomplished data professional to assume the role of Azure Data Engineer. The successful candidate will be responsible for creating, maintaining, and supporting data and analytics solutions using Azure Data Engineering technologies with a strong emphasis on performance, scalability, and reliability. The...

  • Senior Data Pipeline Specialist

    2 days ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Title: Data EngineerRole Overview:We are seeking a skilled professional to design, develop, and maintain scalable data pipelines that process large volumes of structured and unstructured data.The ideal candidate will have a strong background in data engineering, cloud technologies, and data architecture, collaborating closely with cross-functional teams...

  • Unlock Your Potential as a Master Data Architect

    3 days ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    As a Data Engineer, you will design and develop data systems that drive business value. Our team works closely with analysts and scientists to deliver high-quality, scalable solutions.Key Responsibilities:We are looking for a skilled engineer to design and implement ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks for batch and real-time data...

  • Chief Data Architect

    3 days ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking an accomplished data expert with in-depth knowledge of Microsoft Azure to design, build, and optimize scalable data pipelines and lakehouse architectures.Design, develop, and maintain large-scale data pipelines using Azure Data Factory and Azure Synapse Analytics for complex data processing and analysis.Become proficient in...

  • Unlock Your Career with a Leading Data Architecture Role

    2 days ago

    Amrāvati, Maharashtra, India beBeeDataArchitecture Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data ArchitectAbout the Role:We are seeking a highly skilled data architect to design and implement efficient and scalable data pipelines using distributed computing frameworks and large-scale data systems.Key Responsibilities:Create data architectures that enable data-driven decision-making, utilizing technologies such as Trino, Hive Metastore,...

  • Enterprise Data Architect

    1 day ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 1,75,000

    Are you a data engineering expert seeking a challenging role in a dynamic environment?We are looking for a talented professional with deep expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and lakehouse architectures.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure...