Azure Data Engineering Lead

3 months ago

pune, India NewVision Software Full time

Position Summary:

We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.

Responsibilities:

  • Design, develop, and implement data pipelines using Azure Data Factory (ADF) or other orchestration tools.
  • Write efficient SQL queries to extract, transform, and load (ETL) data from various sources into Azure Synapse Analytics.
  • Utilize PySpark and Python for complex data processing tasks on large datasets within Azure Databricks.
  • Collaborate with data analysts to understand data requirements and ensure data quality.
  • Implement data governance practices to ensure data security and compliance.
  • Monitor and maintain data pipelines for optimal performance and troubleshoot any issues.
  • Develop and maintain unit tests for data pipeline code.
  • Work collaboratively with other engineers and data professionals in an Agile development environment.
  • Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
  • Coding complex Spark (Scala or Python) and T-SQL
  • Proficient in a source code control system such as GIT
  • Ability to design the solutions using Azure data services.
  • Manage the governance within the team- track the productivity and quality of team members and report the overall progress to customer periodically.
  • Provide technology leadership to team, provide them technical guidance and support, solve the blockers.
  • Define work breakdown structure and estimates for big work items.

Preferred Skills & Experience:

  • Good knowledge of PySpark & working knowledge of Python
  • Full stack Azure Data Engineering skills (Azure Data Factory, DataBricks and Synapse Analytics)
  • Experience with large dataset handling
  • Exposure to DevOps Basics.
  • Exposure to Basics of Release Engineering.

  • Azure Data Engineering Lead

    30 minutes ago

    Pune, Maharashtra, India Amk technologies Full time

    About Amk Technologies: As a leading technology company, we provide innovative solutions to our clients.Job Title: Azure Data Engineering LeadThe successful candidate will lead the migration of traditional ETL processes from on-premise systems to the Azure cloud landscape. The ideal candidate will have strong experience with ETL processes, including...

  • Strategic Azure Data Engineering Lead

    4 weeks ago

    Pune, Maharashtra, India MICHELIN Full time

    About this RoleWe are seeking a highly experienced and skilled Strategic Azure Data Engineering Lead to join our team at MICHELIN.Job DescriptionThis is an exciting opportunity for a seasoned professional to lead our data engineering efforts, leveraging their expertise in Azure Data Engineering tools, such as Azure Databricks, Azure DataFactory, and Power...

  • Azure Data Engineering Lead

    3 months ago

    pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: Design, develop, and implement data pipelines using...

  • Azure Data Engineering Lead

    6 months ago

    Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Azure data engineering lead

    4 weeks ago

    Pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: Design, develop, and implement data pipelines...

  • Azure data engineering lead

    4 weeks ago

    Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineer

    2 months ago

    Pune, India KPI Partners Full time

    KPI is hiring Azure Data Engineers in all categories;Data Engineers (2 - 4 years)Senior Data Engineers (4 - 6 years)Lead Data Engineers (6+ years)•    Hands-on experience implementing data migration and data processing using Azure services, Serverless Architecture, Azure Storage, Data Factory, Azure Stream Analytics, Databricks Azure Data Catalog, Azure...

  • Azure Data Engineering Lead

    4 weeks ago

    pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineering Lead

    6 months ago

    Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineering Lead

    6 months ago

    Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineering Lead

    6 months ago

    pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: Design, develop, and implement data pipelines using...

  • Azure Data Engineering Lead

    2 weeks ago

    Pune, India DFCS Technologies Full time

    Lead Data EngineerPosition Summary :As an Azure Data Engineering Lead, who will play a pivotal role in designing, developing, and managing our data engineering solutions on the Microsoft Azure platform. You will lead a team of data engineers to deliver scalable, reliable, and secure data pipelines that enable data-driven decision-making across the...

  • Azure Data Engineer

    3 months ago

    Pune, India MICHELIN Full time

    Azure Data Engineer - Technical Lead - - - - - - - - - - - - Skills required:- Total IT Experience of around 8 Years. Excellent knowledge and hands on experience of Data Warehousing, ETL & Visualization tools Good hands on experience on Azure Data Engineering tools - Azure Databricks, Azure DataFactory, Azure Data lake store, Power BI Excellent...

  • Azure Data Engineering Leader

    4 weeks ago

    Pune, Maharashtra, India MICHELIN Full time

    We are seeking an exceptional Azure Data Engineering Leader to join our team at MICHELIN.About the RoleThis is a challenging and rewarding opportunity for an experienced professional with expertise in Azure data engineering, technical leadership, and stakeholder management.Job DescriptionThe successful candidate will lead the design, development, and...

  • Azure Data Engineer

    1 month ago

    Pune, India Tata Consultancy Services Full time

    *******Greetings From The TCS *******Job Role: Azure Data EngineerJob Location: PuneExperience Range: 5 - 10 yrsDesired Competencies (Technical/Behavioral Competency):Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for on-cloud...

  • Azure Data Engineer

    4 weeks ago

    Pune, India Tata Consultancy Services Full time

    *******Greetings From The TCS *******Job Role: Azure Data EngineerJob Location: PuneExperience Range: 5 - 10 yrsDesired Competencies (Technical/Behavioral Competency):- Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage Explorer- Proficient in creating Data Factory pipelines for...

  • Azure data engineer

    1 month ago

    Pune, India Tata Consultancy Services Full time

    *******Greetings From The TCS *******Job Role: Azure Data EngineerJob Location: PuneExperience Range: 5 - 10 yrsDesired Competencies (Technical/Behavioral Competency):Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for on-cloud...

  • Azure Data Engineer

    2 months ago

    Pune, India Tata Consultancy Services Full time

    Role : Azure Data Engineer Desired Experience Range : 4 - 7 Years Location of Requirement : Pune Mandatory Technical Skill Set : Azure Data Bricks, Python scripting, PySpark, Structured Streaming, Azure Storage, Azure Data Factory, ARM templates, DevOps CI/CD. Must-Have : Microsoft Azure covering - designing, building, testing, and maintaining cloud...

  • Azure Data Engineer

    4 weeks ago

    pune, India Birlasoft Full time

    Location: Pune Tower B 9th floor , Hybrid 3 days onsite S Shift timings : 12.30pm to 8,30pm Interview : 2 rounds virtual , 12. 30 pm -8 pm IST 1st round is technical and 2 nd round is management round Notice period – immediate - 30days 3.Experience Level 2 (5-7 yrs) 5 years is relevant 4.Qualifications: - Bachelor's/Master’s degree in Computer...

  • Azure data engineer

    4 weeks ago

    Pune, India Birlasoft Full time

    Location: Pune Tower B 9th floor , Hybrid 3 days onsite S Shift timings : 12.30pm to 8,30pm Interview : 2 rounds virtual , 12. 30 pm -8 pm IST 1st round is technical and 2 nd round is management round Notice period – immediate - 30days 3. Experience Level 2 (5-7 yrs) 5 years is relevant 4. Qualifications: - Bachelor's/Master’s degree in...