577211 _ DNAHL _ Senior Developer\/Technology Lead _ India

7 to 12+ Years

Job Summary

The Senior Developer will lead the design, development, optimization, and modernization of large-scale Azure-based data platforms. This role requires deep expertise in Azure Databricks, PySpark, Azure Data Factory, and migration of on-premises data ecosystems to cloud-native architectures. The individual will provide technical leadership and mentor junior team members.

Key Responsibilities

Design and develop enterprise-scale data platforms using Azure Databricks and ADF.

Lead on-premises to Azure cloud migration initiatives.

Architect scalable, high-performance data pipelines using PySpark and Spark SQL.

Implement Medallion Architecture (Bronze, Silver, Gold) and Delta Lake solutions.

Optimize Spark workloads through partitioning, caching, broadcast joins, and performance tuning.

Define technical standards, coding guidelines, and best practices.

Mentor developers and conduct code reviews.

Design CI/CD deployment strategies using Azure DevOps and Git.

Collaborate with architects, client stakeholders, and business teams.

Drive production support, RCA, performance tuning, and SLA adherence.

Ensure data governance, security, lineage, and compliance requirements.

Required Technical Skills

Must Have

Azure Databricks (Advanced)

PySpark (Advanced)

Azure Data Factory (ADF)

Azure Data Lake Storage (ADLS Gen2)

Delta Lake

Spark SQL

Advanced SQL

Data Modeling

ETL/ELT Architecture

On-Prem to Azure Migration Experience

Good to Have

Unity Catalog

Synapse Analytics

Control-M

Azure Functions

Azure Key Vault

CI/CD using Azure DevOps