Azure Data Engineering Lead

6 months ago


Pune, India NewVision Software Full time

Position Summary:

We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.

Responsibilities:

  • Design, develop, and implement data pipelines using Azure Data Factory (ADF) or other orchestration tools.
  • Write efficient SQL queries to extract, transform, and load (ETL) data from various sources into Azure Synapse Analytics.
  • Utilize PySpark and Python for complex data processing tasks on large datasets within Azure Databricks.
  • Collaborate with data analysts to understand data requirements and ensure data quality.
  • Implement data governance practices to ensure data security and compliance.
  • Monitor and maintain data pipelines for optimal performance and troubleshoot any issues.
  • Develop and maintain unit tests for data pipeline code.
  • Work collaboratively with other engineers and data professionals in an Agile development environment.
  • Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
  • Coding complex Spark (Scala or Python) and T-SQL
  • Proficient in a source code control system such as GIT
  • Ability to design the solutions using Azure data services.
  • Manage the governance within the team- track the productivity and quality of team members and report the overall progress to customer periodically.
  • Provide technology leadership to team, provide them technical guidance and support, solve the blockers.
  • Define work breakdown structure and estimates for big work items.

Preferred Skills & Experience:

  • Good knowledge of PySpark & working knowledge of Python
  • Full stack Azure Data Engineering skills (Azure Data Factory, DataBricks and Synapse Analytics)
  • Experience with large dataset handling
  • Exposure to DevOps Basics.
  • Exposure to Basics of Release Engineering.



  • Pune, Maharashtra, India Amk technologies Full time

    About Amk Technologies: As a leading technology company, we provide innovative solutions to our clients.Job Title: Azure Data Engineering LeadThe successful candidate will lead the migration of traditional ETL processes from on-premise systems to the Azure cloud landscape. The ideal candidate will have strong experience with ETL processes, including...


  • Pune, Maharashtra, India Foundit Full time

    **About Foundit**Foundit is a leading organization in the field of data engineering, and we're seeking an experienced Azure Data Engineering Lead to join our team.**Job Summary**We're looking for a highly skilled professional with expertise in Azure development and data solutions. The ideal candidate will have a strong background in cloud data technologies,...


  • pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: Design, develop, and implement data pipelines using...


  • Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...


  • Pune, Maharashtra, India Hoonar Tekwurks Private Limited Full time

    Job Title: Lead Data Engineer for Azure DatabricksWe are seeking an experienced Lead Data Engineer to join our team at Hoonar Tekwurks Private Limited. The ideal candidate will have a strong background in designing and implementing data solutions using Azure Databricks and a minimum of 5 years of experience working with data platforms on Azure.Our estimated...


  • Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...


  • pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...


  • pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: Design, develop, and implement data pipelines using...


  • Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities:Design, develop, and implement data pipelines using Azure...


  • pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities:Design, develop, and implement data pipelines using Azure...


  • Pune, India DFCS Technologies Full time

    Lead Data EngineerPosition Summary :As an Azure Data Engineering Lead, who will play a pivotal role in designing, developing, and managing our data engineering solutions on the Microsoft Azure platform. You will lead a team of data engineers to deliver scalable, reliable, and secure data pipelines that enable data-driven decision-making across the...

  • Azure Data Lead

    12 hours ago


    Pune, India Birlasoft Full time

    About Birlasoft:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...

  • Azure Data Lead

    5 hours ago


    Pune, India Birlasoft Full time

    About Birlasoft:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...

  • Azure Data Engineer

    3 months ago


    Pune, India MICHELIN Full time

    Azure Data Engineer - Technical Lead - - - - - - - - - - - - Skills required:- Total IT Experience of around 8 Years. Excellent knowledge and hands on experience of Data Warehousing, ETL & Visualization tools Good hands on experience on Azure Data Engineering tools - Azure Databricks, Azure DataFactory, Azure Data lake store, Power BI Excellent...


  • Pune, Maharashtra, India MICHELIN Full time

    We are seeking an exceptional Azure Data Engineering Leader to join our team at MICHELIN.About the RoleThis is a challenging and rewarding opportunity for an experienced professional with expertise in Azure data engineering, technical leadership, and stakeholder management.Job DescriptionThe successful candidate will lead the design, development, and...

  • Azure Data Engineer

    1 month ago


    Pune, India Tata Consultancy Services Full time

    *******Greetings From The TCS *******Job Role: Azure Data EngineerJob Location: PuneExperience Range: 5 - 10 yrsDesired Competencies (Technical/Behavioral Competency):Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for on-cloud...

  • Azure data engineer

    1 month ago


    Pune, India Tata Consultancy Services Full time

    *******Greetings From The TCS *******Job Role: Azure Data EngineerJob Location: PuneExperience Range: 5 - 10 yrsDesired Competencies (Technical/Behavioral Competency):Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for on-cloud...

  • Azure Data Engineer

    2 months ago


    Pune, India Tata Consultancy Services Full time

    Role : Azure Data Engineer Desired Experience Range : 4 - 7 Years Location of Requirement : Pune Mandatory Technical Skill Set : Azure Data Bricks, Python scripting, PySpark, Structured Streaming, Azure Storage, Azure Data Factory, ARM templates, DevOps CI/CD. Must-Have : Microsoft Azure covering - designing, building, testing, and maintaining cloud...


  • pune, India Birlasoft Full time

    About Birlasoft:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...

  • Azure Data Engineer

    4 weeks ago


    pune, India Birlasoft Full time

    Location: Pune Tower B 9th floor , Hybrid 3 days onsite S Shift timings : 12.30pm to 8,30pm Interview : 2 rounds virtual , 12. 30 pm -8 pm IST 1st round is technical and 2 nd round is management round Notice period – immediate - 30days 3.Experience Level 2 (5-7 yrs) 5 years is relevant 4.Qualifications: - Bachelor's/Master’s degree in Computer...