ADF (Fabric)

Skill: ADF + SQL + MS Fabric
Exp: 5 - 12
Work Location: Bengaluru, Chennai Kochin
Notice Period: Immediate

Overview : We are seeking a highly experienced Tech Lead to lead the design, development, and deployment of cutting-edge data solutions using Azure Data Factory (ADF), SQL Server, and other Azure services. The Tech Lead will play a pivotal role in driving the technical vision, ensuring data architecture scalability, and overseeing the team’s technical delivery. In addition to being a hands-on expert, the Tech Lead will collaborate with stakeholders, manage technical teams, and implement advanced data solutions. Familiarity with Microsoft Fabric, Medallion Architecture, and DevOps CI/CD pipelines is essential for success in this role.

Key Responsibilities :
Technical Leadership & Team Guidance : Lead the data engineering team, providing technical direction and overseeing all aspects of the data solutions’ lifecycle.
Ensure adherence to best practices, set coding standards, and mentor junior engineers on data engineering methodologies.
ADF Pipeline Development & Optimization: Architect and develop Azure Data Factory (ADF) pipelines to support complex data integrations and transformations.
Lead the optimization and troubleshooting of ADF pipelines, ensuring high availability and performance.
Implement strategies to monitor pipelines and quickly resolve job failures, including workarounds for high-priority incidents.
SQL & SSMS Mastery: Lead the design, implementation, and optimization of complex SQL queries, stored procedures, and functions to support the organization’s data needs.
Utilize SQL Server Management Studio (SSMS) for comprehensive database administration and tuning.
Data Architecture & Warehousing : Own the design and implementation of scalable data warehousing solutions, leveraging Medallion Architecture to drive data quality and efficiency. Ensure the data architecture supports both current and future needs, with a focus on performance, scalability, and security.
Microsoft Fabric & Azure Storage Solutions : Guide the implementation of Microsoft Fabric to enhance analytics and reporting across the organization. Oversee the use of Azure Blob Storage and Azure Data Lake for efficient data storage, ensuring optimal data flow and processing capabilities.
Power BI & Advanced Analytics: Collaborate with business stakeholders to define reporting requirements and lead the development of Power BI dashboards that deliver actionable insights. Integrate and automate data pipelines to ensure Power BI reports are accurate and up-to-date in real-time.
DevOps & CI/CD Pipeline Management : Drive the adoption of DevOps principles and manage the CI/CD pipelines for data solutions, ensuring seamless deployments and version control. Collaborate with DevOps teams to automate processes, implement monitoring solutions, and ensure high system reliability.
Stakeholder Collaboration & Communication: Work closely with senior leadership and cross-functional teams to align data solutions with business needs. Communicate complex technical concepts to non-technical stakeholders, ensuring transparency in project progress, risks, and outcomes.