Current jobs related to Azure Data Pipeline Architect - Ghaziabad, Uttar Pradesh - beBeeDataEngineer

  • Data Pipeline Architect

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Title: Data Pipeline ArchitectWe are seeking an experienced professional to design, develop, and optimize data ingestion pipelines.About the Role:Design and implement data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain CI/CD pipelines for data workflows.Deploy and manage containerized applications using...

  • ML Pipeline Architect

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeePipeline Full time ₹ 17,50,000 - ₹ 25,19,999

    Job Title: ML Pipeline ArchitectDescription:We are seeking an experienced ML pipeline architect to join our team. The successful candidate will have a strong background in designing and implementing robust machine learning pipelines using Azure Machine Learning services.Key Responsibilities:Pipeline Development: Design and implement efficient ML pipelines...

  • Data Pipeline Architect

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeExpertise Full time ₹ 90,00,000 - ₹ 1,50,00,000

    Integration Engineer OpportunityWe are seeking an experienced Integration Engineer to join our team. The ideal candidate will have strong expertise in Azure Data Services, including Synapse, ADF, SQL, and Power BI.Key Responsibilities:Troubleshoot and resolve issues related to Azure Synapse Analytics, Power BI, and SQL Server.Optimize performance and query...

  • Azure Cloud Solutions Architect

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 30,00,000

    Job Title: Azure Data ArchitectAs a skilled Azure Data Architect, you will lead the migration of large-scale SQL workloads from on-premise environments to Azure, ensuring high data integrity and performance optimization.The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with experience in designing,...

  • Azure Data Engineer

    6 days ago

    Ghaziabad, Uttar Pradesh, India LTIMindtree Full time

    About the job Are you looking for a new career challenge? With LTIMindtree, are you ready to embark on a data-driven career? Working for global leading manufacturing client for providing an engaging product experience through best-in-class PIM implementation and building rich, relevant, and trusted product information across channels and digital touchpoints...

  • Chief Data Architect

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDataStrategy Full time ₹ 20,00,000 - ₹ 32,00,000

    About This RoleOur organization is seeking an experienced professional to serve as a Data Architect. The successful candidate will be responsible for designing and implementing scalable, secure, and high-performance data architectures.Key Responsibilities:Design and implement data pipelines using Azure Data Factory (ADF).Collaborate with cross-functional...

  • Azure Data Solutions Architect

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeesqldeveloper Full time ₹ 20,00,000 - ₹ 25,00,000

    About the JobWe are seeking a highly skilled SQL Developer to design and implement cutting-edge data solutions using Azure Data Engineer.Develop and optimize T-SQL queries, stored procedures, views, and functions to support data processing and reporting.Design and implement ETL/ELT pipelines using SSIS or Azure Data Factory (ADF).In this role, you will have...

  • Chief Data Pipeline Architect

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDatabricks Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Databricks Engineer Job DescriptionThe primary objective of this role is to design, develop, and maintain scalable, secure, and high-performance data pipelines and ETL processes on Databricks.Key Responsibilities:Develop and implement data workflows that ensure performance, cost-efficiency, and reliability.Collaborate with cross-functional teams to gather...

  • Azure Data Expert

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDataExpert Full time

    Job DescriptionWe are seeking an accomplished data expert to design, develop, and maintain scalable ETL pipelines for batch data ingestion and egress using Azure Data Factory, Databricks, and Spark. The ideal candidate will have hands-on experience working with large-scale data processing workflows and ensuring seamless integration with Azure Cloud...

  • Azure Data Factory Specialist

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeDataIntegration Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Description">We are seeking an experienced Data Integration Specialist to support our data integration and ETL needs. The ideal candidate will have strong hands-on expertise in designing, building, and maintaining scalable and secure data pipelines using Azure Data Factory (ADF).Key Responsibilities:Design, build, and maintain ADF pipelines for ETL and...

Azure Data Pipeline Architect

2 weeks ago

Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000
Azure Data Engineer Role

Seeking a skilled data engineer to design, build and maintain automated data pipelines supporting business intelligence and analytics initiatives.

We're looking for an expert who can leverage their knowledge of Azure Databricks, PySpark, SQL and ETL/ELT pipeline design to develop robust data pipelines that ingest, transform and curate metadata from multiple sources landed in Databricks.

Key Responsibilities
  • Pipeline Development: Design, build, and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational metadata from multiple sources landed in Databricks.
  • Granular Data Quality Capture: Implement profiling logic to capture issue-level metadata (source table, column, timestamp, severity, rule type) to support drill-down from dashboards into specific records and enable targeted remediation.
  • Governance Metrics Automation: Develop data pipelines to generate metrics for dashboards covering data quality, lineage, job monitoring, access & permissions, query cost, usage & consumption, retention & lifecycle, policy enforcement, sensitive data mapping, and governance KPIs.
  • Microsoft Purview Integration: Automate asset onboarding, metadata enrichment, classification tagging, and lineage extraction for integration into governance reporting.
  • Data Retention & Policy Enforcement: Implement logic for retention tracking and policy compliance monitoring (masking, RLS, exceptions).
  • Job & Query Monitoring: Build pipelines to track job performance, SLA adherence, and query costs for cost and performance optimization.
  • Metadata Storage & Optimization: Maintain curated Delta tables for governance metrics, structured for efficient dashboard consumption.
  • Testing & Troubleshooting: Monitor pipeline execution, optimize performance, and resolve issues quickly.
  • Collaboration: Work closely with the lead engineer, QA, and reporting teams to validate metrics and resolve data quality issues.
  • Security & Compliance: Ensure all pipelines meet organizational governance, privacy, and security standards.

Required Qualifications:

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
  • 4+ years of hands-on data engineering experience, with Azure Databricks and Azure Data Lake.
  • Proficiency in PySpark, SQL, and ETL/ELT pipeline design.
  • Demonstrated experience building granular data quality checks and integrating governance logic into pipelines.
  • Working knowledge of Microsoft Purview for metadata management, lineage capture, and classification.
  • Experience with Azure Data Factory or equivalent orchestration tools.
  • Understanding of data modeling, metadata structures, and data cataloging concepts.
  • Strong debugging, performance tuning, and problem-solving skills.
  • Ability to document pipeline logic and collaborate with cross-functional teams.

Preferred Qualifications:

  • Microsoft certification in Azure Data Engineering.
  • Experience in governance-heavy or regulated environments (e.g., finance, healthcare, hospitality).
  • Exposure to Power BI or other BI tools as a data source consumer.
  • Familiarity with DevOps/CI-CD for data pipelines in Azure.
  • Experience integrating both cloud and on-premises data sources into Azure.