Azure Data Engineer

2 days ago

india TriGem Solutions Full time
Job Description

This is a remote position.

We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will have a robust background in designing, developing, and managing ETL processes and data pipelines on the Microsoft Azure platform. Proficiency in Azure Data Factory (ADF), PySpark, and CI/CD pipelines is crucial. This role demands a hands-on approach to design, modeling, development, and delivery, with an emphasis on creating scalable and reliable enterprise solutions.
Key Responsibilities:

Development:

- Design, model, develop, and deliver data solutions with a hands-on approach.
- Possess strong working knowledge of Azure services and components, and integrate these into scalable, reliable, and sustainable enterprise solutions.
- Develop and maintain ETL processes and data pipelines using Azure Data Factory (ADF).
- Optimize data transformation processes utilizing PySpark.
- Implement and manage CI/CD pipelines across Azure and other vendor products.
- Contribute to the design and development of enterprise standards.
- Apply key knowledge of architectural patterns in both code and infrastructure development.
Requirements Technical Skills and Experience

- Bachelor’s or master’s degree in computer science, engineering, data science, or equivalent experience, with a preference for experience and a proven track record in advanced, innovative environments.
- 7-8 years of professional experience in data engineering.
- Strong expertise in Microsoft Azure data services, particularly Azure Data Factory (ADF) and PySpark.
- Experience with data pipeline design, development, and maintenance.
- Proficiency in SQL and experience with NoSQL databases.
- Knowledge of ETL/ELT processes and tools.
- Familiarity with big data technologies such as Hadoop and Spark.
- Experience with Azure Databricks, Data Lake, SQL Database, and other Azure data services.
- Production experience delivering CI/CD pipelines across Azure and vendor products.
- Knowledge of architectural patterns across code and infrastructure development.
- Fully conversant with big-data processing approaches and “schema-on-read” methodologies, with a preference for a deep understanding of Spark, Databricks, and Delta Lake.
- Experience with Agile delivery frameworks and tools (SAFe, Jira, Confluence, Azure DevOps).
- Experience with visualization tools (Power BI, developing reports, dashboards, KPI scorecards).
Preferred Qualifications

- Azure Data Engineer certification.
- Experience with data warehousing concepts and technologies.
- Understanding of data security and compliance requirements.
Requirements
Required Skill Set - Bachelor's or master’s degree in computer science, engineering, data science, or equivalent experience - 7-8 years of professional experience in data engineering - Microsoft Azure data services expertise (Azure Data Factory, PySpark) - Data pipeline design, development, and maintenance - SQL and NoSQL database proficiency - ETL/ELT processes and tools knowledge - Familiarity with Hadoop and Spark - Experience with Azure Databricks, Data Lake, SQL Database, and other Azure data services - CI/CD pipeline delivery experience - Architectural patterns knowledge - Big-data processing approaches and “schema-on-read” methodologies - Agile delivery frameworks and tools experience (SAFe, Jira, Confluence, Azure DevOps) - Visualization tools experience (Power BI, developing reports, dashboards, KPI scorecards) ### Preferred Qualifications - Azure Data Engineer certification - Data warehousing concepts and technologies experience - Understanding of data security and compliance requirements

  • Azure Data Engineer

    2 weeks ago

    india YALLO Retail Full time

    Role Type: Contract Location: Remote Duration: 6 months Start: ASAP As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the...

  • Azure Data Engineer

    2 weeks ago

    India YALLO Retail Full time

    Role Type: ContractLocation: RemoteDuration: 6 monthsStart: ASAPAs an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the integrity...

  • Azure Data Engineer

    2 weeks ago

    India YALLO Retail Full time

    Role Type: Contract Location: Remote Duration: 6 months Start: ASAP As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the...

  • Azure Data Engineer

    5 days ago

    India YALLO Retail Full time

    Job Role:As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the integrity and reliability of our client's data infrastructure....

  • Azure Data Engineer

    4 days ago

    india YALLO Retail Full time

    Job Role: As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the integrity and reliability of our client's data infrastructure....

  • Azure Data Engineer

    2 weeks ago

    India DEVENIR SOFTWARE PRIVATE LIMITED Full time

    Job Title: Azure Data EngineerCompany: Confidential Design, develop, and maintain data pipelines and ETL processes on Azure cloud platform Create data solutions using Azure data services like Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse Analytics Collaborate with different teams to understand data requirements and offer...

  • Azure Data Engineer

    2 weeks ago

    India TRIDENT SERVICES Full time

    Job Summary : We are seeking a skilled Azure Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud computing, and experience with Microsoft Azure services. The Azure Data Engineer will be responsible for designing, implementing, and managing data solutions on Azure to support our business...

  • Azure Data Engineer

    3 days ago

    india Test Triangle Full time

    Job Description Skill Set: Cloud - Azure DWH,Data Bricks,AzureSkill to Evaluate: Cloud - Azure DWH,Data Bricks,Azure,Azure Data,PySpark,Scala,ADF,Databricks,SQLLocation: DublinJob Description:  Role: Ireland Data Engineer Role: Azure Data Engineer with Skills PySpark/Scala, ADF, Databricks and SQL. Handle activities such as Creating pipilines,...

  • MLOps Engineer

    1 month ago

    india GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    2 days ago

    india GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Azure Data Engineer

    2 weeks ago

    India Visionyle Full time

    Position Name: Azure Data Engineer Position Mode: PermanentExperience: 6 YearsJoining Location: Remote Notice: ImmediateMode of Interview : 2-3 roundsSUMMARY:Azure Data Engineer should have experience on Azure data lake, Azure SQL database, Databricks, Azure Data Factory, and Azure SQL data warehouse and controlling and granting database access and migrating...

  • Azure Data Engineer

    4 weeks ago

    india EXL Full time

    Position - Senior Data Engineer Work Location – Pune/ Hyderabad / Gurgaon / Hybrid Experience - 5+ Years Must have Skills: Minimum 4Y+ on Azure cloud services. Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions. Strong understanding of metadata-driven approaches and data governance principles....

  • Azure Data Engineer

    2 weeks ago

    India Ztek Consulting Full time

    Hi, I would like to share an excellent opening Full time "Azure Data Engineer" do go through the details and kindly send me your updated resume. Location : Hyderabad Telangana (Onsite) Job Description : Must have : Azure, ADF, Pyspark, SQL • At least three years of professional experience in designing and engineering/architecting Data platform (Entity...

  • Azure Data Engineer

    2 weeks ago

    India Xcel Hire Management Solutions Full time

    Position : Azure Senior Data EngineerLocation : Any location within IndiaJob Type : D&A Competency RoleJob Summary :We are seeking a highly motivated and experienced Azure Senior Data Engineer to join our team. The ideal candidate will be responsible for Researching, designing, building, maintaining, and supporting data pipelines and data lakes in Azure...

  • Azure Data Engineer

    2 days ago

    india Arcadis Full time

    ARCADIS is looking for Azure Data Engineer with a passion to drive and execute Digital to the core of everything we do. We firmly believe in “Everything Digital, Digital Everything”. We are transforming, we are reimagining the industry and we are reimagining how communities and nations can help becoming more sustainable places to live for today and...

  • Azure Data Engineer

    2 weeks ago

    India Amicus Technology Full time

    This position is responsible for designing, implementing, and managing Azure-based solutions for medium-sized global enterprises. ROLES AND RESPONSIBILITIES: Designing, developing, and testing Azure-based applications and services that meet business and technical requirements. To work in capacity of Azure Databricks, ADF and .net developer. Should have...

  • Azure Data Engineer

    2 weeks ago

    India Quadrant Technologies Full time

    We are hiring Azure Data Engineer for Pan India locations.Are you ready to take the leap? Share your resume with , and let's craft your next career chapter together.Spread the word and tag your friends who might be interested.Your support would be greatly appreciated, Thank you Below is the Job Description: Position: Azure Data Engineer Experience: - 8...

  • Azure Data Engineer

    1 month ago

    India Amicus Technology Full time

    This position is responsible for designing, implementing, and managing Azure-based solutions for medium-sized global enterprises. ROLES AND RESPONSIBILITIES: Designing, developing, and testing Azure-based applications and services that meet business and technical requirements. To work in capacity of Azure Databricks, ADF and .net developer. Should have...

  • Azure Data Engineer

    2 weeks ago

    India Quadrant Technologies Full time

    We are hiring Azure Data Engineer for Pan India locations. Are you ready to take the leap? Share your resume with , and let's craft your next career chapter together. Spread the word and tag your friends who might be interested. Your support would be greatly appreciated, Thank youBelow is the Job Description:Position: Azure Data EngineerExperience: 2 - 8...

  • Azure Data Engineer

    2 weeks ago

    india Quadrant Technologies Full time

    We are hiring Azure Data Engineer for Pan India locations. Are you ready to take the leap? Share your resume with , and let's craft your next career chapter together. Spread the word and tag your friends who might be interested. Your support would be greatly appreciated, Thank you! Below is the Job Description: Position: Azure Data Engineer Experience: 2...