Azure Data Engineering Lead

4 days ago

Hyderabad, Telangana, India Vertex Offshore Services Pvt Ltd Full time
Job Title: Azure Data Engineering Lead

We are seeking a highly skilled and experienced Azure Data Engineering Lead to join our team at Vertex Offshore Services Pvt Ltd.



Job Summary:

Vertex Offshore Services Pvt Ltd is looking for a seasoned Azure Data Engineering Lead to design, build, and maintain scalable data solutions on the Azure platform. As an Azure Data Engineering Lead, you will be responsible for developing and maintaining data pipelines using Azure Data Factory (ADF) for data ingestion, transformation, and loading. You will also implement data processing workflows & Delta Lakehouses using Azure Databricks (ADB), DataBricks SQL, SQL and PySpark for large-scale data processing and analysis. Additionally, you will write complex SQL queries and scripts for data manipulation and transformation. You will collaborate with data architects and business analysts to understand data requirements and translate them into technical solutions. You will also optimize data pipelines for performance, scalability, and reliability, and implement data security and privacy measures to ensure compliance with industry standards and regulations. You will monitor and troubleshoot data pipelines to ensure data integrity and availability, and stay abreast of Azure data engineering tools and technologies to enhance data solutions. Finally, you will mentor, lead & assign tasks to the junior team members in the team and provide technical guidance and support.

Responsibilities:


  2. Develop and maintain data pipelines using Azure Data Factory (ADF) for data ingestion, transformation, and loading.
  3. Implement data processing workflows & Delta Lakehouses using Azure Databricks (ADB), DataBricks SQL, SQL and PySpark for large-scale data processing and analysis.
  4. Write complex SQL queries and scripts for data manipulation and transformation.
  5. Collaborate with data architects and business analysts to understand data requirements and translate them into technical solutions.
  6. Optimize data pipelines for performance, scalability, and reliability.
  7. Implement data security and privacy measures to ensure compliance with industry standards and regulations.
  8. Monitor and troubleshoot data pipelines to ensure data integrity and availability.
  9. Stay abreast of Azure data engineering tools and technologies to enhance data solutions.
  10. Mentor, lead & assign tasks to the junior team members in the team and provide technical guidance and support.


Requirements:


  2. Overall 8+ years of IT Experience & minimum 6 years in building data solutions on the Azure platform.
  3. Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks (ADB), SQL, PySpark, and other Azure data tools.
  4. Solid understanding of data engineering principles, data modelling, ETL processes and best practices.
  5. Strong problem-solving and analytical skills.
  6. Excellent Communication & Leadership skills.
  7. Experience working with large-scale, distributed data systems and architectures.
  8. Ability to work independently & work effectively in a collaborative team environment.
  9. Eagerness to learn and adapt to new technologies and methodologies.
  10. Azure certification (e.g., Azure Data Engineer Associate) or Data Bricks certification is a plus.


What We Offer:


  • Opportunity to work with a dynamic team.
  • Chance to enhance your skills and knowledge.
  • Competitive salary and benefits package.
  • Opportunity to work on challenging projects.


This job description is intended to convey information essential to understanding the scope of the position and is not an exhaustive list of skills, efforts, duties, responsibilities, or working conditions associated with it. Responsibilities may change based on organizational need.

  • Azure Data Engineering Lead

    2 weeks ago

    Hyderabad, Telangana, India Vertex Offshore Services Pvt Ltd Full time

    Job Title: Azure Data Engineering LeadWe are seeking a highly skilled and experienced Azure Data Engineering Lead to join our dynamic team at Vertex Offshore Services Pvt Ltd.Key Responsibilities:Design, build, and maintain scalable data solutions on the Azure platform.Develop and maintain data pipelines using Azure Data Factory (ADF) for data ingestion,...

  • Azure Data Engineer Lead

    2 weeks ago

    Hyderabad, Telangana, India Syren Cloud Inc Full time

    Job Title: Lead Azure Data EngineerWe are seeking a highly skilled Lead Azure Data Engineer to join our team at Syren Cloud Inc. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing distributed applications and systems on the Azure Cloud platform.Key Responsibilities:Design and develop databases,...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enviri Corporation Full time

    {"title": "Azure Data Engineer", "description": "Job SummaryWe are seeking an experienced Azure Data Engineer to join our team at Enviri Corporation. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures on the Azure platform.Key ResponsibilitiesDesign and...

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Job Title: Data EngineerNTT DATA Services is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and testing scalable Big Data ecosystems for our clients.Key Responsibilities:Analyze and understand data sources and APIsDesign and develop methods to connect and collect data from...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Azure Data EngineerWe are seeking a highly skilled Azure Data Engineer to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines using Azure Data Factory.Key Responsibilities:Develop and maintain end-to-end data pipelines using Azure...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title: Azure Data EngineerTata Consultancy Services is seeking a highly skilled Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Azure Data Factory.Key Responsibilities:Develop and maintain end-to-end data pipelines using Azure Data...

  • Azure Data Engineer

    1 week ago

    Hyderabad, Telangana, India Arting Digital Full time

    Job Title: Azure Data EngineerExperience: 5+ yearsLocations: HyderabadPrimary Skills: Azure Cloud services, CI/CD pipelines, Data Model, Azure Data Factory, Azure Data bricks, Synapse, Power BIBudget: 25LPANotice Period: 15-30 daysAs a seasoned Azure Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India HTC Global Services Full time

    Azure Data Bricks ETL Developer OpportunityWe are seeking an experienced Azure Data Bricks ETL Developer to join our team at HTC Global Services.Key Responsibilities:Design and develop ETL processes using Azure Data BricksDevelop and maintain data pipelines to ensure data quality and integrityCollaborate with cross-functional teams to identify and prioritize...

  • Data Engineering Lead

    2 days ago

    Hyderabad, Telangana, India UnitedHealth Group Full time

    At UnitedHealth Group, we're committed to helping people live healthier lives and making the health system work better for everyone. As a Data Engineering Lead - Power BI and Azure, you'll play a critical role in delivering end-to-end data solutions that drive business insights and improve health outcomes.Key Responsibilities:Design, develop, and maintain...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at Vidpro Consultancy Services. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement data pipelines using Azure Data...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India 2coms Full time

    Job Title: Azure Data EngineerWe are seeking a highly skilled Azure Data Engineer to join our team at 2coms. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures on Microsoft Azure.Key Responsibilities:Design and implement data ingestion pipelines using Azure...

  • Azure Data Lead

    4 weeks ago

    Hyderabad, Telangana, India TalentBook solutions Ind Pvt Ltd Full time

    Job Responsibilities :- Deliver high-quality modern data solutions through collaboration with team members and customers.- Manage projects ranging from short-term client assessments to multi-year delivery engagements with large, blended teams.Requirements :- Experience: Hands-on experience as a Data Engineer or a similar role.Azure Skills : - Provisioning,...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Clean Harbors Full time

    Job Title: Azure Data EngineerAt Clean Harbors, we are seeking a skilled Azure Data Engineer to join our team. The ideal candidate will have a strong background in designing, implementing, and managing data solutions on the Microsoft Azure cloud platform.Key Responsibilities:Design and implement scalable data storage systems that meet the organization's...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Azure Data Engineer RoleWe are seeking a highly skilled Azure Data Engineer to join our team at Anblicks. As a key member of our data engineering team, you will be responsible for designing, building, and implementing robust data pipelines using the Microsoft Stack.Key ResponsibilitiesDesign and implement data pipelines using Azure Data Factory, Azure Data...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India ValueMomentum Full time

    Job Title: Azure Data EngineerJob Summary:We are seeking an experienced Azure Data Engineer to join our team at ValueMomentum. As a key member of our DataLeverage team, you will be responsible for designing and developing data-driven solutions using Azure Data Factory, Azure Databricks, and other modern data and analytics technologies.Responsibilities:Design...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India HTC Global Services Full time

    Azure Data Bricks ETL Developer PositionWe are seeking an experienced Azure Data Bricks ETL developer to join our team at HTC Global Services.Key Responsibilities:Design and develop ETL processes using Azure Data BricksDevelop and maintain data pipelines to ingest and transform dataEnsure data quality and integrity through data validation and...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India 2coms Full time

    Job Title: Azure Data EngineerWe are seeking a highly skilled Azure Data Engineer to join our team at 2coms. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Microsoft Azure.Key Responsibilities:Design and implement scalable data ingestion pipelines using...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India 2coms Full time

    Job DescriptionJob Title: Azure Data EngineerJob Summary:We are seeking an experienced Azure Data Engineer to join our team at 2coms. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines using Azure technologies.Key Responsibilities:Design and implement data...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Azure Data Engineer RoleWe are seeking a skilled Azure Data Engineer to join our team at Anblicks. The ideal candidate will have hands-on experience with Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse, and Azure Analysis Services.Key ResponsibilitiesDesign and implement robust data pipelines using Microsoft Stack.Develop and implement...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Madhees Techno Consulting Pvt. Ltd Full time

    Job Title: Azure Data EngineerJob Summary:Madhees Techno Consulting Pvt. Ltd is seeking an experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, cloud computing, and Azure services.Key Responsibilities:Design and implement data pipelines and engineering infrastructure for machine learning...