Azure Data Engineering Lead

6 days ago

Pune, India NewVision Software Full time

Position Summary:

We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.

Responsibilities:

  • Design, develop, and implement data pipelines using Azure Data Factory (ADF) or other orchestration tools.
  • Write efficient SQL queries to extract, transform, and load (ETL) data from various sources into Azure Synapse Analytics.
  • Utilize PySpark and Python for complex data processing tasks on large datasets within Azure Databricks.
  • Collaborate with data analysts to understand data requirements and ensure data quality.
  • Implement data governance practices to ensure data security and compliance.
  • Monitor and maintain data pipelines for optimal performance and troubleshoot any issues.
  • Develop and maintain unit tests for data pipeline code.
  • Work collaboratively with other engineers and data professionals in an Agile development environment.
  • Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
  • Coding complex Spark (Scala or Python) and T-SQL
  • Proficient in a source code control system such as GIT
  • Ability to design the solutions using Azure data services.
  • Manage the governance within the team- track the productivity and quality of team members and report the overall progress to customer periodically.
  • Provide technology leadership to team, provide them technical guidance and support, solve the blockers.
  • Define work breakdown structure and estimates for big work items.

Preferred Skills & Experience:

  • Good knowledge of PySpark & working knowledge of Python
  • Full stack Azure Data Engineering skills (Azure Data Factory, DataBricks and Synapse Analytics)
  • Experience with large dataset handling
  • Exposure to DevOps Basics.
  • Exposure to Basics of Release Engineering.

  • Lead Data Engineer –Azure

    1 day ago

    Pune, Maharashtra, India Admin Looks Full time

    Urgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent...

  • Lead Data Engineer –Azure

    1 day ago

    Pune, India Admin Looks Full time

    Urgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent...

  • Azure Data Engineering Lead

    6 days ago

    Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineering Lead

    4 days ago

    pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineering Lead

    4 days ago

    Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineering Lead

    5 days ago

    Pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: - Design, develop, and implement data pipelines using...

  • Azure Data Engineering Lead

    2 days ago

    Pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities: Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineering Lead

    5 days ago

    Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:- Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineering Lead

    6 days ago

    Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:- Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineering Lead

    13 hours ago

    Pune, Maharashtra, India Luxoft Full time

    About the Role:Luxoft is seeking a highly skilled Big Data Lead Engineer to join their team. The successful candidate will be responsible for designing and implementing cloud-based data processing platforms using Azure technologies.Responsibilities:Engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different...

  • Azure Data Engineering Lead

    7 days ago

    Pune, Maharashtra, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineering Lead

    5 days ago

    Pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: Design, develop, and implement data pipelines using...

  • Azure Data Engineering Lead

    6 days ago

    Pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: Design, develop, and implement data pipelines using...

  • Azure Data Engineering Lead

    6 days ago

    Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineering Lead

    4 days ago

    pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: Design, develop, and implement data pipelines using...

  • AWS/Azure Cloud Services Lead Engineer

    1 day ago

    Pune, India NTT DATA Full time

    Job Description Req ID: 309478 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a AWS/Azure Cloud Services Lead Engineer to join our team in Pune, Mahārāshtra (IN-MH), India...

  • AWS/Azure Cloud Services Lead Engineer

    1 day ago

    Pune, Maharashtra, India NTT DATA Full time

    Job Description Req ID: 309478 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a AWS/Azure Cloud Services Lead Engineer to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Azure Data Engineer

    1 day ago

    Pune, India MICHELIN Full time

    Azure Data Engineer - Technical Lead - - - - - - - - - - - - Skills required:- Total IT Experience of around 8 Years. Excellent knowledge and hands on experience of Data Warehousing, ETL & Visualization tools Good hands on experience on Azure Data Engineering tools - Azure Databricks, Azure DataFactory, Azure Data lake store, Power BI Excellent...

  • Azure data engineer

    7 days ago

    Pune, India Tata Consultancy Services Full time

    Summary of the Role:This role will design, develop, and maintain the data processing platform on Azure. The purpose of the data platform is to integrate data across the organization to empower and provide business partners, vendors, and customers with actionable insights. The right candidate will implement best practices using expertise in Azure Data...

  • Azure Data Engineer

    7 days ago

    Pune, India SR analytics Full time

    Job Title : Azure Data EngineerLocation:  PuneCompany:  SR AnalyticsNumber of positions:  2Experience:  2-5 yearsJob Location...