Azure Data Engineer

3 days ago


New Delhi, India TriGem Solutions Full time
Job Description

This is a remote position.

We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will have a robust background in designing, developing, and managing ETL processes and data pipelines on the Microsoft Azure platform. Proficiency in Azure Data Factory (ADF), PySpark, and CI/CD pipelines is crucial. This role demands a hands-on approach to design, modeling, development, and delivery, with an emphasis on creating scalable and reliable enterprise solutions.

Key Responsibilities:

Development:

- Design, model, develop, and deliver data solutions with a hands-on approach.
- Possess strong working knowledge of Azure services and components, and integrate these into scalable, reliable, and sustainable enterprise solutions.
- Develop and maintain ETL processes and data pipelines using Azure Data Factory (ADF).
- Optimize data transformation processes utilizing PySpark.
- Implement and manage CI/CD pipelines across Azure and other vendor products.
- Contribute to the design and development of enterprise standards.
- Apply key knowledge of architectural patterns in both code and infrastructure development.

Requirements Technical Skills and Experience

- Bachelor’s or master’s degree in computer science, engineering, data science, or equivalent experience, with a preference for experience and a proven track record in advanced, innovative environments.
- 7-8 years of professional experience in data engineering.
- Strong expertise in Microsoft Azure data services, particularly Azure Data Factory (ADF) and PySpark.
- Experience with data pipeline design, development, and maintenance.
- Proficiency in SQL and experience with NoSQL databases.
- Knowledge of ETL/ELT processes and tools.
- Familiarity with big data technologies such as Hadoop and Spark.
- Experience with Azure Databricks, Data Lake, SQL Database, and other Azure data services.
- Production experience delivering CI/CD pipelines across Azure and vendor products.
- Knowledge of architectural patterns across code and infrastructure development.
- Fully conversant with big-data processing approaches and “schema-on-read” methodologies, with a preference for a deep understanding of Spark, Databricks, and Delta Lake.
- Experience with Agile delivery frameworks and tools (SAFe, Jira, Confluence, Azure DevOps).
- Experience with visualization tools (Power BI, developing reports, dashboards, KPI scorecards).

Preferred Qualifications

- Azure Data Engineer certification.
- Experience with data warehousing concepts and technologies.
- Understanding of data security and compliance requirements.

Requirements
Required Skill Set - Bachelor's or master’s degree in computer science, engineering, data science, or equivalent experience - 7-8 years of professional experience in data engineering - Microsoft Azure data services expertise (Azure Data Factory, PySpark) - Data pipeline design, development, and maintenance - SQL and NoSQL database proficiency - ETL/ELT processes and tools knowledge - Familiarity with Hadoop and Spark - Experience with Azure Databricks, Data Lake, SQL Database, and other Azure data services - CI/CD pipeline delivery experience - Architectural patterns knowledge - Big-data processing approaches and “schema-on-read” methodologies - Agile delivery frameworks and tools experience (SAFe, Jira, Confluence, Azure DevOps) - Visualization tools experience (Power BI, developing reports, dashboards, KPI scorecards) ### Preferred Qualifications - Azure Data Engineer certification - Data warehousing concepts and technologies experience - Understanding of data security and compliance requirements
  • Azure Data Engineer

    4 weeks ago


    new delhi, India EXL Full time

    Work Location – All EXL Locations (Hybrid)Experience - 5+ YearsMust have Skills:Minimum 4Y+ on Azure cloud services.Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.Strong understanding of metadata-driven approaches and data governance principles.Excellent problem-solving skills and ability to work in...

  • Azure Data Engineer

    3 days ago


    New Delhi, India TriGem Solutions Full time

    This is a remote position. We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will have a robust background in designing, developing, and managing ETL processes and data pipelines on the Microsoft Azure platform. Proficiency in Azure Data Factory (ADF), PySpark, and CI/CD pipelines is crucial. This role...

  • Azure Data Engineer

    1 month ago


    new delhi, India HTC Global Services Full time

    Experience: 6.5 to 10 YearsJob Locations: Chennai/Bangalore/HyderabadNotice period: Immediate to 15 DaysJob Description:Expertise on Azure platforms including Azure Synapse Analytics and its various components, including Delta LakeIn-dept knowledge and hands-on experience in Microsoft Azure data stack i.e., Azure Data Factory, Azure Synapse, Azure SQL...

  • Azure Data Engineer

    1 week ago


    delhi, India YALLO Retail Full time

    Role Type: ContractLocation: RemoteDuration: 6 monthsStart: ASAPAs an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the...

  • Azure Data Engineer

    2 days ago


    Delhi, India Test Triangle Full time

    Job DescriptionSkill Set:Cloud - Azure DWH,Data Bricks,AzureSkill to Evaluate:Cloud - Azure DWH,Data Bricks,Azure,Azure Data,PySpark,Scala,ADF,Databricks,SQLLocation:DublinJob Description:Role: Ireland Data Engineer Role: Azure Data Engineer with Skills PySpark/Scala, ADF, Databricks and SQL. Handle activities such as Creating pipilines, orchestration, data...

  • Azure Data Engineer

    1 week ago


    Delhi, Delhi, India YALLO Retail Full time

    Role Type:ContractLocation:RemoteDuration:6monthsStart:ASAPAs an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the integrity and...

  • Azure Data Engineer

    4 weeks ago


    delhi, India EXL Full time

    Position - Senior Data EngineerWork Location – Pune/ Hyderabad / Gurgaon / HybridExperience - 5+ YearsMust have Skills:Minimum 4Y+ on Azure cloud services.Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.Strong understanding of metadata-driven approaches and data governance principles.Excellent...

  • Azure Data Engineer

    4 weeks ago


    Delhi, India EXL Full time

    Position- Senior Data EngineerWork Location– Pune/ Hyderabad / Gurgaon / HybridExperience- 5+ YearsMust have Skills:Minimum 4Y+ on Azure cloud services.Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.Strong understanding of metadata-driven approaches and data governance principles.Excellent...

  • Azure Data Engineer

    1 week ago


    Delhi, Delhi, India Ztek Consulting Full time

    Location:Hyderabad Telangana (Onsite)Job Description:Must have: Azure, ADF, Pyspark, SQLAt least three years of professional experience in designing and engineering/architecting Data platform (Entity based).Expertise in Data Architecture, Data Strategy and implemented large scale end-to-end Data management.Expertise in Data Quality, Data profiling.Deep...

  • Azure Data Engineer

    2 weeks ago


    Delhi, Delhi, India EXL Full time

    Work Location – All EXL Locations (Hybrid)Experience - 5+ YearsMust have Skills:Minimum 4Y+ on Azure cloud services.Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.Strong understanding of metadata-driven approaches and data governance principles.Excellent problem-solving skills and ability to work in a...

  • Azure Data Engineer

    2 days ago


    delhi, India Arcadis Full time

    ARCADIS is looking for Azure Data Engineer with a passion to drive and execute Digital to the core of everything we do. We firmly believe in “Everything Digital, Digital Everything”. We are transforming, we are reimagining the industry and we are reimagining how communities and nations can help becoming more sustainable places to live for today and...

  • Azure Data Engineer

    1 week ago


    Delhi, Delhi, India Ztek Consulting Full time

    Hi,I would like to share an excellent opening Full time"Azure Data Engineer"do go through the details and kindly send me your updated resume.Location : Hyderabad Telangana (Onsite)Job Description :Must have : Azure, ADF, Pyspark, SQL At least three years of professional experience in designing and engineering/architecting Data platform (Entity based)....

  • Azure Data Engineer

    2 days ago


    Delhi, India Arcadis Full time

    ARCADISis looking for Azure Data Engineer with a passion to drive and execute Digital to the core of everything we do. We firmly believe in “Everything Digital, Digital Everything”. We are transforming, we are reimagining the industry and we are reimagining how communities and nations can help becoming more sustainable places to live for today and future...

  • Azure Data Engineer

    1 month ago


    delhi, India Amicus Technology Full time

    This position is responsible for designing, implementing, and managing Azure-based solutions for medium-sized global enterprises.ROLES AND RESPONSIBILITIES:Designing, developing, and testing Azure-based applications and services that meet business and technical requirements.To work in capacity of Azure Databricks, ADF and .net developer.Should have...

  • Azure Data Engineer

    1 week ago


    Delhi, Delhi, India Amicus Technology Full time

    This position is responsible for designing, implementing, and managing Azure-based solutions for medium-sized global enterprises.ROLES AND RESPONSIBILITIES:Designing, developing, and testing Azure-based applications and services that meet business and technical requirements.To work in capacity of Azure Databricks, ADF and .net developer.Should have...

  • Azure Data Engineer

    1 week ago


    delhi, India Quadrant Technologies Full time

    We are hiring Azure Data Engineer for Pan India locations.Are you ready to take the leap? Share your resume with , and let's craft your next career chapter together. Spread the word and tag your friends who might be interested. Your support would be greatly appreciated, Thank you!Below is the Job Description:Position: Azure Data EngineerExperience: 2 - 8...

  • Azure Data Engineer

    2 weeks ago


    Delhi, Delhi, India Quadrant Technologies Full time

    Title: Azure Data EngineerEducational Qualification: or equivalentExperience : yearsExcellent communication and problem-solving skillsStrong analytical skills in understanding business requirementsJob Description for an Immediate Requirement:This is a full-time role for a Data Engineer located in Hyderabad with Quadrant Technologies.Proficient in robust...

  • Azure Data Engineer

    2 weeks ago


    Delhi, Delhi, India Antz Full time

    As a Data Engineer - Support & Enhancements, you will play a critical role in maintaining and improving our data infrastructure to ensure seamless operations and enhanced performance.You will work independently, leveraging your expertise in Azure Data bricks, Data Factory, Power BI, SQL, and Py Spark to support our data pipelines, optimize processes, and...


  • Delhi, India IntraEdge Full time

    As Azure Lead Data Engineer, you will have to take over the key activities of designing, coding, and implementing data solutions in the platform. With a focus on leveraging DBT for data transformation and modelling, as well as expertise in MDM tools, you will play a pivotal role in architecting scalable and performant data pipelines and warehouses. You will...

  • Azure Data Engineer

    2 months ago


    delhi, India LTIMindtree Full time

    Position: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...