Azure Data Engineer

Azure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data Fabric

Azure Data Factory (Must Have)

Azure Data Bricks (Must Have)

Azure fabric (Good to have)

Knowledge of Data Processing Flow with Gen AI application

Experience working with Unstructured data (Must Have)

Worked on production with more than 10000 file injection (Must Have)

Experience in multi model injection (Must Have)

OCR capabilities

Detailed JD

We are seeking an experienced Azure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data Fabric to lead the migration of our existing data pipeline and processing infrastructure. The ideal candidate will have a strong background in Azure cloud data services, big data analytics, and data engineering, with specific experience in Azure Data Fabric. We are looking for someone who has at least 6 months of hands-on experience with Azure Data Fabric or has successfully completed at least one migration to Azure Data Fabric.

Key Responsibilities:

Assess the current data architecture using Azure Data Factory and Databricks and develop a detailed migration plan to Azure Data Fabric.

Design and implement end-to-end data pipelines within Azure Data Fabric, including data

ingestion, transformation, storage, and analytics.

Optimize data workflows to leverage Azure Data Fabric's unified platform for data integration,big data processing, and real-time analytics.

Ensure seamless integration of data from SharePoint and other sources into Azure Data Fabric,maintaining data quality and integrity.

Collaborate with business analysts and business stakeholders to align data strategies and

optimize the data environment for machine learning and AI workloads.

Implement security best practices, including data governance, access control, and monitoring within Azure Data Fabric.

Conduct performance tuning and optimization for data storage and processing within Azure Data Fabric to ensure high availability and cost efficiency.

Key Requirements:

Proven experience (5+ years) in Azure data engineering with a strong focus on Azure Data

Factory and Azure Databricks.

At least 6 months of hands-on experience with Azure Data Fabric or completion of one

migration to Azure Data Fabric.

Hands-on experience in designing, building, and managing data pipelines, data lakes, and data warehouses on Azure.

Expertise in Spark, SQL, and data transformation techniques within Azure environments.

Strong understanding of data governance, security, and compliance in cloud environments.

Experience with migrating data architectures and optimizing workflows on cloud platforms.Skills and Highlights:

Azure Data Factory (Must Have)

Azure Data Bricks (Must Have)

Azure fabric (Good to have)

Knowledge of Data Processing Flow with Gen AI application

Experience working with Unstructured data (Must Have)

Worked on production with more than 10000 file injection (Must Have)

Experience in multi model injection (Must Have)

OCR capabilities

Detailed JD

We are seeking an experienced Azure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data Fabric to lead the migration of our existing data pipeline and processing infrastructure. The ideal candidate will have a strong background in Azure cloud data services, big data analytics, and data engineering, with specific experience in Azure Data Fabric. We are looking for someone who has at least 6 months of hands-on experience with Azure Data Fabric or has successfully completed at least one migration to Azure Data Fabric.

Key Responsibilities:

Assess the current data architecture using Azure Data Factory and Databricks and develop a detailed migration plan to Azure Data Fabric.

Design and implement end-to-end data pipelines within

Locations : Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune,Remote