Azure Tech lead

Date Opened

09/08/2025

City

Saidapet

Country

India

Job Role

Data Engineering

State/Province

Tamil Nadu

Industry

IT Services

Job Type

Full time

Zip/Postal Code

600096

Introduction to the Role

We are seeking a Technical Lead – Data Engineering with strong expertise in Azure ADF and Databricks. The role involves leading the design, development, and optimization of ETL/ELT pipelines for clinical, genomics, and research datasets, while guiding technical delivery and ensuring best practices in scalability, governance, and cloud deployment.

Accountabilities

• Act as the technical lead for the project, providing guidance and direction to the engineering team.
• Design and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources.
• Optimize the performance and scalability of data flows using Apache Spark, Databricks, or AWS Glue.
• Collaborate with domain experts in genomics, clinical trials, and lab science to implement robust data solutions.
• Develop and maintain data models, schemas, and governance practices for structured and unstructured biomedical data.
• Implement data quality checks, lineage, logging, and alerts to ensure reliability and reproducibility.
• Work with cloud infrastructure teams to deploy pipelines on AWS, GCP, or Azure.
• Contribute to data lake/warehouse solutions such as Snowflake, Redshift, or Synapse.

Essential Skills / Experience

• Strong expertise in Azure ADF and Databricks.
• Proven track record in leading technical delivery for data engineering projects.
• Experience designing and optimizing ETL/ELT pipelines at scale.
• Proficiency in Apache Spark and modern cloud platforms (AWS, Azure, GCP).
• Solid knowledge of data modelling, governance, and schema management.
• Hands-on experience with data lakes and warehouses (Snowflake, Redshift, Synapse).
• Strong understanding of data quality, lineage, and reproducibility practices.

Desirable Skills / Experience

• Experience working with clinical, genomics, or biomedical datasets.
• Exposure to workflow orchestration tools (Airflow, Prefect, dbt).
• Familiarity with compliance and security frameworks in healthcare and research data.
• Strong leadership, mentoring, and cross-functional collaboration skills.