Azure Data Engineer Opportunity

4 days ago

Bikaner, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000
Data Engineer Position

We are seeking a skilled Data Engineer to join our team and design, develop, and maintain automated data pipelines that support data governance and analytics initiatives.

The ideal candidate will have hands-on experience with Azure Databricks and Azure Data Lake, as well as proficiency in PySpark, SQL, and ETL/ELT pipeline design. Experience building granular data quality checks and integrating governance logic into pipelines is also required.

This role focuses on building production-ready workflows for data ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention tracking, and metadata integration using Azure Databricks, Azure Data Lake, and Microsoft Purview.

Key Responsibilities:
  • Pipeline Development: Design, build, and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational metadata from multiple sources landed in Databricks.
  • Granular Data Quality Capture: Implement profiling logic to capture issue-level metadata (source table, column, timestamp, severity, rule type) to support drill-down from dashboards into specific records and enable targeted remediation.
  • Governance Metrics Automation: Develop data pipelines to generate metrics for dashboards covering data quality, lineage, job monitoring, access & permissions, query cost, usage & consumption, retention & lifecycle, policy enforcement, sensitive data mapping, and governance KPIs.
  • Microsoft Purview Integration: Automate asset onboarding, metadata enrichment, classification tagging, and lineage extraction for integration into governance reporting.
  • Data Retention & Policy Enforcement: Implement logic for retention tracking and policy compliance monitoring (masking, RLS, exceptions).
  • Job & Query Monitoring: Build pipelines to track job performance, SLA adherence, and query costs for cost and performance optimization.
  • Metadata Storage & Optimization: Maintain curated Delta tables for governance metrics, structured for efficient dashboard consumption.
  • Testing & Troubleshooting: Monitor pipeline execution, optimize performance, and resolve issues quickly.
Required Skills and Qualifications:
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
  • 4+ years of hands-on data engineering experience, with Azure Databricks and Azure Data Lake.
  • Proficiency in PySpark, SQL, and ETL/ELT pipeline design.
  • Demonstrated experience building granular data quality checks and integrating governance logic into pipelines.
  • Working knowledge of Microsoft Purview for metadata management, lineage capture, and classification.
  • Experience with Azure Data Factory or equivalent orchestration tools.

  • Data Engineer in Azure Environment

    5 days ago

    Bikaner, Rajasthan, India beBeeAzure Full time ₹ 20,00,000 - ₹ 25,00,000

    Azure Data Engineer Job DescriptionJob Title: Azure Data EngineerLocation: RemoteNotice Period: Immediate StartWe are seeking a skilled Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining data pipelines using Azure Data Factory, Databricks, and Synapse.About the...

  • Azure data engineer

    1 day ago

    Bikaner, Rajasthan, India Techolution Full time

    We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem. The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.Job Title: Sr. Azure Data EngineerLocation:...

  • Azure Data Engineering Specialist

    15 hours ago

    Bikaner, Rajasthan, India beBeedata Full time ₹ 1,46,41,965 - ₹ 2,01,63,811

    About the RoleWe are seeking a skilled Azure Data Engineer to lead large-scale SQL workload migration from on-premise environments to Azure, ensuring high data integrity and performance optimization. The ideal candidate will have expertise in modern data engineering tools and platforms within the Azure ecosystem.

  • Data Scientist/ml Engineer

    4 days ago

    Bikaner, Rajasthan, India Quant-data Full time

    ???? We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team.In this role, you'll design and deploy scalable ML solutions that power...

  • Azure Cloud Data Specialist

    4 days ago

    Bikaner, Rajasthan, India beBeeCloudData Full time ₹ 15,00,000 - ₹ 20,00,000

    Azure Data Engineer JobAt our organization, we are seeking a seasoned Azure Data Engineer to collaborate on designing, developing, and executing end-to-end data pipelines on Azure.About the Role:We require an experienced professional with a strong background in Azure to join our team. The successful candidate will work closely with stakeholders to deliver...

  • Senior Azure Data Architect

    5 days ago

    Bikaner, Rajasthan, India beBeeData Full time ₹ 22,50,000 - ₹ 25,80,000

    Job Title: Lead Data EngineerWork Description:A highly motivated and experienced Lead Data Engineer is required to join a growing team.The successful candidate will design, develop, and optimize data pipelines using Azure and Databricks.Strong expertise in Databricks, Azure Data Services, Python, SQL, Spark, and modern data architectures is required.Key...

  • Data Engineering Professional

    5 days ago

    Bikaner, Rajasthan, India beBeeDatabricksEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Azure Databricks Engineer Job DescriptionWe are seeking an experienced Azure Databricks engineer to join our team on a short-term contract basis. As a key member of our team, you will be responsible for creating and modifying Azure Data Factory pipelines, developing and optimizing Databricks notebooks using SQL and Python.Key Responsibilities:Create and...

  • Azure Data Factory Data Integration Specialist

    2 days ago

    Bikaner, Rajasthan, India beBeeDataIntegration Full time ₹ 7,50,000 - ₹ 12,50,000

    Data Integration SpecialistWe are seeking a skilled Data Integration Specialist to join our team. As a Freelance Azure Data Factory (ADF) expert, you will be responsible for designing, building, and maintaining data pipelines that ensure smooth, scalable, and secure data flows across multiple sources and destinations.Design and implement data pipelines using...

  • Azure Databricks Data Ingestion Specialist

    5 days ago

    Bikaner, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title:Azure Databricks Engineer with Injection ExpertiseJob Summary:We are seeking a seasoned Azure Databricks professional to drive data ingestion strategies.The ideal candidate will possess hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.Key...

  • Transformation Expert

    3 days ago

    Bikaner, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Azure Data Engineer - Transformation Specialist">About Our Organization:We are pioneering a transformation of the insurance industry by developing innovative solutions for benefits management. We focus on modernizing complex back-office systems to create scalable, secure, and high-performing platforms that streamline operations.Position Overview:We...