Azure Data Lead

18 hours ago

Pune, Maharashtra, India Bridgenext Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Azure Data Lead

Job ID: Azu-ETP-Pun-1198

Location: Pune,Other

The Role: As a Lead Data Engineer specializing in Databricks & Master Data Management, you will be a key player in designing, developing, and optimizing our next-generation data platform. You will lead a team of data engineers, providing technical guidance, mentorship, and ensuring the scalable, and high-performance data solutions.

Key Responsibilities:

  • Technical Leadership:
  • Lead the design, development, and implementation of scalable and reliable data pipelines using Databricks, Spark, and other relevant technologies.
  • Define and enforce data engineering best practices, coding standards, and architectural patterns.
  • Provide technical guidance and mentorship to junior and mid-level data engineers.
  • Conduct code reviews and ensure the quality, performance, and maintainability of data solutions.
  • Databricks Expertise:
  • Architect and implement data solutions on the Databricks platform, including Databricks Lakehouse, Delta Lake, and Unity Catalog.
  • Optimize Spark workloads for performance and cost efficiency on Databricks.
  • Develop and manage Databricks notebooks, jobs, and workflows.
  • Proficiently use Databricks features such as Delta Live Tables (DLT), Photon, and SQL Analytics.
  • Master Data Management:
  • Lead the technical design and implementation of the MDM solution (either using a dedicated tool or custom MDM on Databricks) for critical domains (e.g., Customer, Product, Vendor).
  • Define and implement data quality rules, entity resolution, matching, and survivorship logic to create and maintain 'Golden Records.'
  • Partner with Data Governance and Data Stewardship teams to define and enforce organizational policies, standards, and data definitions for master data assets.
  • Ensure seamless and timely provisioning of high-quality master data from the MDM/Lakehouse platform to downstream consuming systems (ERP, CRM, BI).
  • Pipeline Development & Operations:
  • Develop, test, and deploy robust ETL/ELT pipelines for data ingestion, transformation, and loading from various sources (e.g., relational databases, APIs, streaming data).
  • Implement monitoring, alerting, and logging for data pipelines to ensure operational excellence.
  • Troubleshoot and resolve complex data-related issues.
  • Collaboration & Communication:
  • Work closely with cross-functional teams including product managers, data scientists, and software engineers.
  • Communicate complex technical concepts clearly to both technical and non-technical stakeholders.
  • Stay updated with industry trends and emerging technologies in data engineering and Databricks

Primary Skills :

  • Extensive hands-on experience with Databricks platform, including Databricks Workspace, Spark on Databricks, Delta Lake, and Unity Catalog.
  • Strong proficiency in optimizing Spark jobs and understanding Spark architecture.
  • Experience with Databricks features like Delta Live Tables (DLT), Photon, and Databricks SQL Analytics.
  • Deep understanding of data warehousing concepts, dimensional modeling, and data lake architectures.
  • Familiarity with data governance and cataloging tools (e.g., Purview, Profisee).

  • Lead Data Engineer –Azure

    4 days ago

    Pune, Maharashtra, India Admin Looks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Urgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent...

  • Azure Data Platform Lead

    22 hours ago

    Pune, Maharashtra, India Codvo Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Description: Azure Data Platform LeadPosition OverviewLead the design, implementation, and optimization of enterprise-scale Azure data platform solutions, driving modern data architecture initiatives and establishing best practices for data engineering and analytics.Key ResponsibilitiesPlatform Architecture & Strategy:Design and implement scalable data...

  • Azure Data Platform Lead

    2 days ago

    Pune, Maharashtra, India Codvo Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Description: Azure Data Platform Lead Position OverviewLead the design, implementation, and optimization of enterprise-scale Azure data platform solutions, driving modern data architecture initiatives and establishing best practices for data engineering and analytics. Key ResponsibilitiesPlatform Architecture & Strategy:• Design and implement scalable...

  • Azure Support Engineer

    6 days ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Req ID: 338755NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure Support Engineer - Digital Solution Consultant Sr. Analyst to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Azure Data Architect

    18 hours ago

    Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Brief DescriptionWe are looking for a highly experienced and innovative Azure Data Architect / Consultant to lead the design,development, and deployment of enterprise-scale data platforms and AI-driven solutions. This role is critical in deliveringmission-critical data science, engineering, and analytics projects that support business transformation,...

  • Azure Data Engineer Lead

    6 days ago

    Pune, Maharashtra, India Lorvet Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Responsibilities:Design, develop & optimize data pipelines using Azure Data Factory, Databricks & Synapse.Collaborate with cross-functional teams on project delivery within Azure DevOps.UK Shift

  • Lead Azure Big Data Engineer

    5 days ago

    Pune, Maharashtra, India VidPro Consultancy Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Azure Data EngineerLocation: Hyderabad, Bangalore and PuneExperience: 3-7 YearsWork Mode: HybridMandatory Skills: Python, Spark, SQL, Hadoop, Hive, Spark, Azure Databricks, Azure DataFactory, Azure Synapse, DLTs, Unity Catalog, Workflows, Infrastructure as Code (IaC), Orchestration-Airflow, ETL & Data Pipelines.Role Overview:We are looking for a...

  • Azure Tech Lead

    7 days ago

    Pune, Maharashtra, India Orbia Pune Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    MAIN PURPOSEThe Azure Tech Lead plays a pivotal role in driving technical strategy, agile delivery, and platform excellence across enterprise data initiatives. This role is accountable for leading the end-to-end design, development, and deployment of scalable data engineering and analytics solutions on Azure—spanning domains such as Supply Chain, Finance,...

  • Azure Data Engineer

    6 days ago

    Pune, Maharashtra, India TEKIT SOFTWARE SOLUTIONS PRIVATE LIMITED Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Title : Azure Data EngineerLocation : Pune, India (On-site only)Experience Required : 7-8 YearsJob Description : We are looking for an experienced Azure Data Engineer with strong proficiency in Azure Data Ingestion Services and Data Engineering to join our dynamic team. As a key member of our data engineering team, you will play a crucial role in...

  • Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Quess IT Staffing Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Dear All,We are Hiring Azure Data Engineer for one of our Leading Banking clientPayroll : QuessDuration :1 YearLocation : PuneWork Mode : HybridInterview Mode: 1st round - F2F (face to face ), 2nd round - VirualExp Level : 8+YearsRel Exp : 6.5 YearsNotice period :Immediate or Currently serving or 15 daysJD :Must have skills:Minimum of 6 years of Data...