Azure Data Lead

3 days ago

Pune, Maharashtra, India Bridgenext Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Job ID:
Azu-ETP-Pun-1090

Location:
Pune,Other

The Role:
As a Lead Data Engineer specializing in Databricks, you will be a key player in designing, developing, and optimizing our next-generation data platform. You will lead a team of data engineers, providing technical guidance, mentorship, and ensuring the scalable, and high-performance data solutions.

Key Responsibilities

  • Technical Leadership:
  • Lead the design, development, and implementation of scalable and reliable data pipelines using Databricks, Spark, and other relevant technologies.
  • Define and enforce data engineering best practices, coding standards, and architectural patterns.
  • Provide technical guidance and mentorship to junior and mid-level data engineers.
  • Conduct code reviews and ensure the quality, performance, and maintainability of data solutions.
  • Databricks Expertise:
  • Architect and implement data solutions on the Databricks platform, including Databricks Lakehouse, Delta Lake, and Unity Catalog.
  • Optimize Spark workloads for performance and cost efficiency on Databricks.
  • Develop and manage Databricks notebooks, jobs, and workflows.
  • Proficiently use Databricks features such as Delta Live Tables (DLT), Photon, and SQL Analytics.
  • Pipeline Development & Operations:
  • Develop, test, and deploy robust ETL/ELT pipelines for data ingestion, transformation, and loading from various sources (e.g., relational databases, APIs, streaming data).
  • Implement monitoring, alerting, and logging for data pipelines to ensure operational excellence.
  • Troubleshoot and resolve complex data-related issues.
  • Collaboration & Communication:
  • Work closely with cross-functional teams including product managers, data scientists, and software engineers.
  • Communicate complex technical concepts clearly to both technical and non-technical stakeholders.
  • Stay updated with industry trends and emerging technologies in data engineering and Databricks

Primary Skills

  • Extensive hands-on experience with Databricks platform, including Databricks Workspace, Spark on Databricks, Delta Lake, and Unity Catalog.
  • Strong proficiency in optimizing Spark jobs and understanding Spark architecture.
  • Experience with Databricks features like Delta Live Tables (DLT), Photon, and Databricks SQL Analytics.
  • Deep understanding of data warehousing concepts, dimensional modeling, and data lake architectures.

  • Azure Support Engineer

    6 days ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Req ID: 338755NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure Support Engineer - Digital Solution Consultant Sr. Analyst to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Azure API Integration Developer

    4 weeks ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Azure API Integration Developer - Digital Solution Cnslt. Sr. Consultant to join our team in Pune, Mahrshtra (IN-MH),...

  • Azure Data Architect

    3 weeks ago

    Pune, Maharashtra, India MNR Solutions Full time

    Key Responsibilities :- Architect, design, implement and maintain end-to-end data platforms using Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.- Design and lead data science and analytics projects using Azure Machine Learning, Python, and ML frameworks.- Build and optimize high-volume data pipelines with a focus on...

  • Azure Data Engineer Lead

    6 days ago

    Pune, Maharashtra, India Lorvet Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Responsibilities:Design, develop & optimize data pipelines using Azure Data Factory, Databricks & Synapse.Collaborate with cross-functional teams on project delivery within Azure DevOps.UK Shift

  • Azure Data Engineer

    6 days ago

    Pune, Maharashtra, India TEKIT SOFTWARE SOLUTIONS PRIVATE LIMITED Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Title : Azure Data EngineerLocation : Pune, India (On-site only)Experience Required : 7-8 YearsJob Description : We are looking for an experienced Azure Data Engineer with strong proficiency in Azure Data Ingestion Services and Data Engineering to join our dynamic team. As a key member of our data engineering team, you will play a crucial role in...

  • Azure Data Engineer

    1 day ago

    Pune, Maharashtra, India Nam Info Full time US$ 1,50,000 - US$ 2,00,000 per year

    Greetings from NAM InfoPlease go through the job description. If you are interested in this opportunity, please reply with the following information to -Full Name (as in Adhar):Current Location:Expected CTC:Present CTC:Least Notice Period(Last Working Day If any):PAN Number:Job Title: Azure Data EngineerCompany: Thermax LimitedLocation: Pune Job Type:...

  • Azure Data Architect

    3 weeks ago

    Pune, Maharashtra, India Synapse Tech Services Inc Full time

    Role : Azure Data Engineer - Technical : 10+ Yrs.Job Type : Full Time.Location : Pune( Local to Pune only).Work Mode : WFO.Technical & Architectural Skills :- Extensive experience in designing and building Azure Data Warehouses using :1. Azure Synapse Analytics (formerly SQL Data Warehouse).2. Azure Data Factory (ADF) for ETL/ELT pipelines.3. Azure Data...

  • Azure Support Engineer

    1 day ago

    Pune, Maharashtra, India NTT DATA North America Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Azure Support Engineer - Digital Solution Consultant Sr. Analyst to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Azure Data Engineer

    3 days ago

    Pune, Maharashtra, India People Prime Worldwide Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About Company : Our Client is a leading Indian multinational IT services and consulting firm. It provides digital transformation, cloud computing, data analytics, enterprise application integration, infrastructure management, and application development services. The company caters to over 700 clients across industries such as banking and financial services,...

  • Azure Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Lumiq Full time

    Location Pune 5 Days WFO Who we are LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance FSI industry We are trusted by the world s largest FSIs including insurers banks AMCs and NBFCs to address their data challenges Our clients include 40 enterprises with over 10B in deposits AUM collectively representing...