Lead Azure Data Engineer

3 weeks ago

Pune, India Persistent Systems Full time

About Position


As a Lead Azure Data Engineer, you will oversee the design and implementation of data solutions on Microsoft Azure, ensuring they meet scalability, performance, and security standards. Your role involves leading a team of data engineers, managing data integration projects, optimizing data architectures, and guiding strategic decisions to align with business objectives and technological advancements.

Role: Lead Azure Data Engineer

Location: All PSL Locations

Experience: 9-14years

Job Type: FTE

What You'll Do


  • Strong experience developing data solutions using Azure Data services including ADF, ADLS, Azure SQL, Azure Databricks, Microsoft Fabric, Azure Data Lake, AAS, Azure Storage, Power BI, ABS, Synapse, and other services within the Azure data framework.
  • Lead workshops with many teams to define data ingestion, validation, mining, engineering, modelling, visualization, AI, and analytics.
  • Strong understanding on Azure data services security practices
  • Develop architectural solutions/designs to project execution teams for implementation.
  • Experience with on-prem Microsoft technologies like SQL Server, SSIS, SSAS is a plus.
  • Own and aggressively drive forward specific areas of Azure technology development & architecture.
  • Lead the technical planning & requirements gathering phases including estimate, develop, test, manage projects, architect, and deliver complex projects.
  • Determine Project and solution estimation and participate/recommend team structure definition.
  • Participate in design sessions, demos and prototype sessions, testing and training workshops with business users and other IT associates.
  • Support multiple Agile Scrum teams with planning, scoping, and creation of technical solutions for the new product capabilities, through to continuous delivery to production.
  • Provide end to end vision and hands on experience with Azure Cloud Platform

Expertise You'll Bring

  • 8-12 years’ experience in one of the deep technical specializations in SQL DW, Azure Data Factory, Azure Databricks & Microsoft Fabric.
  • Strong Hand-on experience in Azure Data Factory, Azure DevOps CI/CD, Azure Logic Apps flow, Azure Data Lake, Azure Synapse, Azure Databricks, Microsoft Fabric, PySpark, GitHub.
  • Experience in ETL/Pipeline Development using tools such as Azure Databricks/Apache Spark and Azure Data Factory with development expertise on batch and Realtime data integration.
  • Design and Develop Data Processing
  • Advanced Analytics including Azure Synapse Analytics, Azure Data Bricks, data visualization tools.
  • Experience in programming using Scala or Python
  • Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL
  • Enterprise-scale technical experience with cloud and hybrid infrastructures, architecture designs, database migrations, and technology management.
  • Hands-on experience on the Application migration from on premises to Azure cloud
  • Azure Professional Data Engineering Certification
  • Bachelors’ or Maters’ Degree in computer science

Benefits


  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Our company fosters a values-driven and people-centric work environment that enables our employees to:

  • Accelerate growth, both professionally and personally
  • Impact the world in powerful, positive ways, using the latest technologies
  • Enjoy collaborative innovation, with diversity and work-life wellbeing at the core
  • Unlock global opportunities to work and learn with the industry’s best

Let’s unleash your full potential at Persistent

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

  • Azure Lead Data Engineer

    2 weeks ago

    Pune, India IntraEdge Full time

    As Azure Lead Data Engineer, you will have to take over the key activities of designing, coding, and implementing data solutions in the platform. With a focus on leveraging DBT for data transformation and modelling, as well as expertise in MDM tools, you will play a pivotal role in architecting scalable and performant data pipelines and warehouses. You will...

  • Azure Lead Data Engineer

    2 weeks ago

    Pune, India IntraEdge Full time

    As Azure Lead Data Engineer, you will have to take over the key activities of designing, coding, and implementing data solutions in the platform. With a focus on leveraging DBT for data transformation and modelling, as well as expertise in MDM tools, you will play a pivotal role in architecting scalable and performant data pipelines and warehouses. You will...

  • Lead Azure Data Engineer

    3 weeks ago

    pune, India Persistent Systems Full time

    About PositionAs a Lead Azure Data Engineer, you will oversee the design and implementation of data solutions on Microsoft Azure, ensuring they meet scalability, performance, and security standards. Your role involves leading a team of data engineers, managing data integration projects, optimizing data architectures, and guiding strategic decisions to align...

  • Lead Azure Data Engineer

    3 weeks ago

    Pune, India Persistent Systems Full time

    About PositionAs a Lead Azure Data Engineer, you will oversee the design and implementation of data solutions on Microsoft Azure, ensuring they meet scalability, performance, and security standards. Your role involves leading a team of data engineers, managing data integration projects, optimizing data architectures, and guiding strategic decisions to align...

  • Lead Azure Data Engineer

    3 weeks ago

    pune, India Persistent Systems Full time

    About Position As a Lead Azure Data Engineer, you will oversee the design and implementation of data solutions on Microsoft Azure, ensuring they meet scalability, performance, and security standards. Your role involves leading a team of data engineers, managing data integration projects, optimizing data architectures, and guiding strategic decisions to...

  • Azure Data Integration lead

    4 weeks ago

    Pune, India CGI Full time

    Position Description:Experience - 6+ years.Location - Bangalore / PuneWe are seeking a highly motivated Azure Integration Lead to join our growing team. In this role, you will be responsible for leading and delivering complex integration solutions using Microsoft Azure technologies. You will work closely with stakeholders to understand business needs, design...

  • Azure Data Integration lead

    1 month ago

    Pune, India CGI Full time

    Position Description: Experience - 6+ years. Location - Bangalore / Pune We are seeking a highly motivated Azure Integration Lead to join our growing team. In this role, you will be responsible for leading and delivering complex integration solutions using Microsoft Azure technologies. You will work closely with stakeholders to understand business...

  • Azure Data Integration lead

    1 month ago

    pune, India CGI Full time

    Position Description: Experience - 6+ years.Location - Bangalore / PuneWe are seeking a highly motivated Azure Integration Lead to join our growing team. In this role, you will be responsible for leading and delivering complex integration solutions using Microsoft Azure technologies. You will work closely with stakeholders to understand business...

  • Lead Data Engineer

    1 week ago

    Pune, India Persistent Systems Full time

    About Position As a Lead Azure Data Engineer, you will oversee the design and implementation of data solutions on Microsoft Azure, ensuring they meet scalability, performance, and security standards. Your role involves leading a team of data engineers, managing data integration projects, optimizing data architectures, and guiding strategic decisions to...

  • Lead Data Architect

    2 weeks ago

    Pune, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing!Role Overview:If you are an extraordinary developer and who loves to push the boundaries to solve complex business problems using creative solutions, then we wish to talk with you. As a Data Architect - Azure, you will work in the Technology team that helps deliver our Data...

  • Senior Azure Data Engineer

    3 weeks ago

    pune, India Persistent Systems Full time

    About PositionAs a Senior Azure Data Engineer, you'll be responsible for designing and implementing scalable data storage solutions, integrating data from various sources using tools like Azure Data Factory, and ensuring optimal performance and security compliance within Microsoft Azure environments. Your role will also involve tuning data systems, managing...

  • Senior Azure Data Engineer

    3 weeks ago

    Pune, India Persistent Systems Full time

    About PositionAs a Senior Azure Data Engineer, you'll be responsible for designing and implementing scalable data storage solutions, integrating data from various sources using tools like Azure Data Factory, and ensuring optimal performance and security compliance within Microsoft Azure environments. Your role will also involve tuning data systems, managing...

  • Senior Azure Data Engineer

    3 weeks ago

    Pune, India Persistent Systems Full time

    About PositionAs a Senior Azure Data Engineer, you'll be responsible for designing and implementing scalable data storage solutions, integrating data from various sources using tools like Azure Data Factory, and ensuring optimal performance and security compliance within Microsoft Azure environments. Your role will also involve tuning data systems, managing...

  • Senior Azure Data Engineer

    3 weeks ago

    pune, India Persistent Systems Full time

    About Position As a Senior Azure Data Engineer, you'll be responsible for designing and implementing scalable data storage solutions, integrating data from various sources using tools like Azure Data Factory, and ensuring optimal performance and security compliance within Microsoft Azure environments. Your role will also involve tuning data systems,...

  • Senior Azure Data Engineer

    1 month ago

    Pune, India YASH Technologies Full time

    Sr. Software Engineer - Azure Experience: 4 - 7 years of Experience What you should have? Azure Data Factory, Azure DevOps CI/CD, Azure Data Lake, Azure Synapse, Azure Databricks, PySpark, GitHub. Need 4+ Years of experience Good analytical skills with excellent knowledge of SQL. Well versed with Azure Services Must have experience and knowledge on ADF,...

  • Senior Azure Data Engineer

    1 month ago

    Pune, India YASH Technologies Full time

    Sr. Software Engineer - Azure Experience: 4 - 7 years of Experience What you should have? Azure Data Factory, Azure DevOps CI/CD, Azure Data Lake, Azure Synapse, Azure Databricks, PySpark, GitHub. Need 4+ Years of experience Good analytical skills with excellent knowledge of SQL. Well versed with Azure Services Must have experience and knowledge on ADF,...

  • Azure Data Engineer

    5 days ago

    Pune, India Unify Dots Full time

    Job DescriptionDesign, construct, install, test, and maintain highly scalable data management systems. Implement complex data warehousing projects with a focus on collecting, parsing, managing, analyzing, and visualizing large datasets to turn information into insights using Power BI. Ensure systems meet business requirements and industry practices by...

  • Azure Data Engineer

    4 days ago

    pune, India Unify Dots Full time

    Job DescriptionDesign, construct, install, test, and maintain highly scalable data management systems.  Implement complex data warehousing projects with a focus on collecting, parsing, managing, analyzing, and visualizing large datasets to turn information into insights using Power BI.  Ensure systems meet business requirements and industry practices by...

  • Azure Data Engineer

    1 week ago

    Pune, India Manvision Technologies Full time

    Key ResponsibilitiesDeveloping, managing and optimizing robust and reliable data pipelines using azure native capabilities.Implement ADF workflows that perform data ingestion, data integration/ETL, statistical model executions etc.Creating architecture for data solutions with high performance characteristicsBringing data and analytics products to...

  • Azure Data Engineer

    2 weeks ago

    pune, India Manvision Technologies Full time

    Key Responsibilities Developing, managing and optimizing robust and reliable data pipelines using azure native capabilities. Implement ADF workflows that perform data ingestion, data integration/ETL, statistical model executions etc. Creating architecture for data solutions with high performance characteristics Bringing data and analytics...