Data Engineer Lead

19 hours ago

Pune City, Maharashtra, India EduRun Group Full-time


Job Description
– Data Engineer Lead

Location:
Pune Work Mode: Onsite Employment Type: Contract-to-Hire (C2H)

Experience:
7+ Years Job Summary We are looking for an experienced Data Engineer Lead with strong expertise in Azure data engineering, data pipeline architecture, ETL/ELT, and team leadership to build and manage scalable, secure, and efficient data solutions.

Key Responsibilities
Lead, mentor, and manage the technical data engineering team. Design, develop, and optimize data pipelines, data lakes, and data warehouses. Implement data integration, data modelling, and data quality frameworks. Ensure data governance, security, and compliance. Manage CI/CD pipelines, automation, and Azure infrastructure. Collaborate with business stakeholders to deliver scalable data solutions. Required Skills Azure: Azure Data Factory, Azure Databricks, Unity Catalog, Azure Functions, Azure DevOps. Programming: PySpark, Python, T-SQL, MS SQL, Stored Procedures. Data Engineering: dbt, ETL/ELT, SSIS, Data Modelling, Data Warehousing. Streaming: Kafka, Spark Streaming, or Flink. DevOps & Security: Terraform, CI/CD, Entra ID, RBAC, Data Governance. Leadership: Team management, mentoring, stakeholder communication, and problem-solving. Preferred Certifications AZ-104, DP-700, DP-600, AZ-400.