Azure Data Lead

7 hours ago

Pune, Maharashtra, India Bridgenext Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Azure Data Lead

Job ID: Azu-ETP-Pun-1198

Location: Pune,Other

The Role: As a Lead Data Engineer specializing in Databricks & Master Data Management, you will be a key player in designing, developing, and optimizing our next-generation data platform. You will lead a team of data engineers, providing technical guidance, mentorship, and ensuring the scalable, and high-performance data solutions.

Key Responsibilities:

  • Technical Leadership:
  • Lead the design, development, and implementation of scalable and reliable data pipelines using Databricks, Spark, and other relevant technologies.
  • Define and enforce data engineering best practices, coding standards, and architectural patterns.
  • Provide technical guidance and mentorship to junior and mid-level data engineers.
  • Conduct code reviews and ensure the quality, performance, and maintainability of data solutions.
  • Databricks Expertise:
  • Architect and implement data solutions on the Databricks platform, including Databricks Lakehouse, Delta Lake, and Unity Catalog.
  • Optimize Spark workloads for performance and cost efficiency on Databricks.
  • Develop and manage Databricks notebooks, jobs, and workflows.
  • Proficiently use Databricks features such as Delta Live Tables (DLT), Photon, and SQL Analytics.
  • Master Data Management:
  • Lead the technical design and implementation of the MDM solution (either using a dedicated tool or custom MDM on Databricks) for critical domains (e.g., Customer, Product, Vendor).
  • Define and implement data quality rules, entity resolution, matching, and survivorship logic to create and maintain 'Golden Records.'
  • Partner with Data Governance and Data Stewardship teams to define and enforce organizational policies, standards, and data definitions for master data assets.
  • Ensure seamless and timely provisioning of high-quality master data from the MDM/Lakehouse platform to downstream consuming systems (ERP, CRM, BI).
  • Pipeline Development & Operations:
  • Develop, test, and deploy robust ETL/ELT pipelines for data ingestion, transformation, and loading from various sources (e.g., relational databases, APIs, streaming data).
  • Implement monitoring, alerting, and logging for data pipelines to ensure operational excellence.
  • Troubleshoot and resolve complex data-related issues.
  • Collaboration & Communication:
  • Work closely with cross-functional teams including product managers, data scientists, and software engineers.
  • Communicate complex technical concepts clearly to both technical and non-technical stakeholders.
  • Stay updated with industry trends and emerging technologies in data engineering and Databricks

Primary Skills :

  • Extensive hands-on experience with Databricks platform, including Databricks Workspace, Spark on Databricks, Delta Lake, and Unity Catalog.
  • Strong proficiency in optimizing Spark jobs and understanding Spark architecture.
  • Experience with Databricks features like Delta Live Tables (DLT), Photon, and Databricks SQL Analytics.
  • Deep understanding of data warehousing concepts, dimensional modeling, and data lake architectures.
  • Familiarity with data governance and cataloging tools (e.g., Purview, Profisee).

  • Lead Data Engineer –Azure

    4 days ago

    Pune, Maharashtra, India Admin Looks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Urgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent...

  • Azure Data Platform Lead

    11 hours ago

    Pune, Maharashtra, India Codvo Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Description: Azure Data Platform LeadPosition OverviewLead the design, implementation, and optimization of enterprise-scale Azure data platform solutions, driving modern data architecture initiatives and establishing best practices for data engineering and analytics.Key ResponsibilitiesPlatform Architecture & Strategy:Design and implement scalable data...

  • Azure Data Lead Engineer

    2 weeks ago

    Pune, Maharashtra, India Persistent Systems Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Position:We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team.Role: Azure Data Lead EngineerLocation: Pune/ BangaloreExperience: 8 to 10 yearsJob Type: Full Time EmploymentWhat You'll Do:Design and implement complex, scalable data pipelines for ingestion, processing, and...

  • Azure Data Platform Lead(India)

    2 days ago

    Pune, Maharashtra, India Codvo Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Description: Azure Data Platform Lead Position OverviewLead the design, implementation, and optimization of enterprise-scale Azure data platform solutions, driving modern data architecture initiatives and establishing best practices for data engineering and analytics. Key ResponsibilitiesPlatform Architecture & Strategy:• Design and implement...

  • Azure Data Architect

    5 hours ago

    Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Brief DescriptionWe are looking for a highly experienced and innovative Azure Data Architect / Consultant to lead the design,development, and deployment of enterprise-scale data platforms and AI-driven solutions. This role is critical in deliveringmission-critical data science, engineering, and analytics projects that support business transformation,...

  • Lead Azure Big Data Engineer

    4 days ago

    Pune, Maharashtra, India VidPro Consultancy Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Azure Data EngineerLocation: Hyderabad, Bangalore and PuneExperience: 3-7 YearsWork Mode: HybridMandatory Skills: Python, Spark, SQL, Hadoop, Hive, Spark, Azure Databricks, Azure DataFactory, Azure Synapse, DLTs, Unity Catalog, Workflows, Infrastructure as Code (IaC), Orchestration-Airflow, ETL & Data Pipelines.Role Overview:We are looking for a...

  • Azure Tech Lead

    6 days ago

    Pune, Maharashtra, India Orbia Pune Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    MAIN PURPOSEThe Azure Tech Lead plays a pivotal role in driving technical strategy, agile delivery, and platform excellence across enterprise data initiatives. This role is accountable for leading the end-to-end design, development, and deployment of scalable data engineering and analytics solutions on Azure—spanning domains such as Supply Chain, Finance,...

  • Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Cloudesign Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Azure Data EngineerExperience: 8-10 YearsLocation: Pune (Hybrid)Project contextWe are seeking an experienced Data Engineer (7+ Years) to lead the design and implementation of scalable data solutions on the Azure Data Platform. The primary focus will be on integrating financial data from SAP BW and SAP BFC into Azure, establishing a reliable and...

  • Azure Data Engineer

    1 week ago

    Pune, Maharashtra, India Quess IT Staffing Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Dear All,We are Hiring Azure Data Engineer for one of our Leading Banking clientPayroll : QuessDuration :1 YearLocation : PuneWork Mode : HybridInterview Mode: 1st round - F2F (face to face ), 2nd round - VirualExp Level : 8+YearsRel Exp : 6.5 YearsNotice period :Immediate or Currently serving or 15 daysJD :Must have skills:Minimum of 6 years of Data...

  • Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Mancer Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    NOTE - Only candidates currently based in Pune will be consideredExperience Range - 4-8 Years.We are hiring an experienced Azure Data Engineer to design and deliver scalable data engineering solutions on Microsoft Azure. Youll work on large-scale data platform projects using ADF, Databricks, and Azure Data Lake in a secure and collaborative environment.Roles...