Zensar Technologies

MS Fabric Data Engineer

Experience : 10+ Years (Overall), 3+ Years (MS Fabric Solution Architect)

Employment Type : Full-time

Job Overview :

We are seeking a highly experienced MS Fabric Data Engineer with over 10 years of experience in the software industry, including at least 3 years as an end-to-end MS Fabric solution architect. The ideal candidate will be proficient in designing and implementing scalable data solutions using modern cloud architectures, with a specialization in Microsoft Fabric, Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.

You'll work closely with client architects to understand and develop complex MS Fabric solutions, ensuring high-quality deliverables and driving functional and non-functional requirements.

Key Responsibilities :

Platform and Infrastructure Setup :

- Work closely with the MS Fabric Infrastructure architecture team to perform comprehensive setup and development activities.

- Lead the design and implementation of scalable data solutions using modern cloud architectures, specializing in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Microsoft Fabric, and PySpark.

- Drive Fabric Landing Zone Setup and Fabric Tenant Configuration, including Security Group Assignment and Entra ID Setup.

- Manage VNET and Data Gateway Installations and DNS Integration.

- Oversee Workspace Creation and Configuration and Domain Creation.

- Implement Purview Governance Fabric Integration.

Design, Development, and Quality Assurance :

- Work on all Functional and Non-Functional Requirements in alignment with customer objectives.

- Participate in all Infra workshops (end-to-end) to ensure alignment and comprehensive understanding.

- Develop reusable and dynamic ADF/Fabric pipelines, enhancing efficiency in data transformation and ingestion.

- Review code to ensure quality and adherence to design principles.

- Must have handled end-to-end MS Fabric setup and design/development responsibilities, from solution design, data migration planning, capacity planning, application security, process orchestration, and application and data integration.

Architecture and Governance :

- Understand and contribute to architecture and design documents for Fabric, covering Governance, Security, Administration, DevOps, Usability, Performance, Scale, Billing, and Cost Management.

- Define Workspace and capacity configurations as part of the design.

Infrastructure as Code (IaC) :

- Lead the creation of Fabric Landing Zone Infrastructure as Code using Terraform templates.

- Lead the creation of Purview Governance Infrastructure as Code using Terraform templates.

- Implement Fabric Tenant Settings Configuration via API where possible.

- Create Terraform templates for templated Workspace provision, including defined Fabric Items and an Extract Transform Load Framework.

Networking and Security :

- Implement Fabric Access Control through Entra ID Security Group Creation and Entra ID Conditional Access Policy

Creation.

- Configure Fabric Tenant Settings per the design, with Security Groups associated.

- Establish Logging & SIEM Integrations for both Microsoft Sentinel and ServiceNow.

- Manage Fabric Networking, including Outbound Networking (Deployment of Self Hosted Integration Runtimes, VNET Data Gateways, Managed Private Endpoints) and Client Networking (Private Link, Private DNS).

- Provide support for broader networking requirements and enhancements.

Testing and Methodologies :

- Conduct Internal QA & Testing.

- Ensure Fabric Landing Zone Deployment and provision of target Microsoft Fabric Landing Zones, including Fabric Capacities.

- Well versed with Waterfall, Agile, Scrum, and similar project delivery methodologies.

Technical Skills Required :

- Specializing in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Microsoft Fabric, and PySpark on Azure cloud.

- Developed reusable and dynamic ADF/Fabric pipelines.

- Strong understanding of architecture and design documents for Fabric.

- Expertise in Microsoft Fabric Design areas including Governance, Security, Administration, DevOps, Usability, Performance and scale, and Billing and cost management.

- Experience with Workspace and capacity configuration.

- Hands-on experience with Fabric Landing Zone Setup, Fabric Tenant Configuration, Security Group Assignment, Entra ID Setup, VNET and Data Gateway Installations, DNS Integration, Workspace Creation and Configuration, Domain Creation, Purview Governance Fabric Integration.

- Experience with Terraform for creating Infrastructure as Code templates (Fabric Landing Zone, Purview Governance Landing Zone, Workspace Templates).

- Experience with Fabric Access Control (Entra ID Security Group Creation, Entra ID Conditional Access Policy Creation).

- Knowledge of Logging & SIEM Integrations (Microsoft Sentinel, ServiceNow).

- Strong understanding of Fabric Networking (Outbound: Self Hosted Integration Runtimes, VNET Data Gateways, Managed Private Endpoints; Client: Private Link, Private DNS).

Professional Qualifications :

- A minimum Bachelor's Degree in Science or Engineering.

Communication Skills :

- Strong communication skills and the ability to interact with clients' architects, other technical decision makers, and offshore technical teams.