Technical Lead

3 weeks ago

Pune, Maharashtra, India Applycup Hiring Solutions Full-time $9,000 - $25,000/year

Experience: 7 to 10 Years

Location: Pune / Chennai (Hybrid Mode)

Job Type: Full-Time / Permanent

Job Summary:

We are looking for a highly skilled and experienced Senior Data Engineer with expertise in Python, PySpark, Azure Data Factory (ADF), Azure Databricks, and Power BI. The ideal candidate will play a key role in designing, building, and maintaining scalable data solutions and pipelines on Azure cloud platform, enabling effective business intelligence and analytics.


Key Responsibilities:

  • Design and develop data ingestion and transformation pipelines using Azure Data Factory and Azure Databricks.
  • Implement complex ETL/ELT workflows using PySpark and Python to support analytical and reporting requirements.
  • Collaborate with business analysts, data scientists, and BI developers to understand data requirements and deliver scalable solutions.
  • Develop, manage, and optimize data models and datasets for Power BI reporting.
  • Work on data cleansing, data integration, and performance optimization tasks.
  • Ensure data quality, security, and governance in compliance with enterprise standards.
  • Troubleshoot and debug production issues and provide timely resolutions.
  • Follow best practices in coding, testing, and deployment within a CI/CD framework.
  • Mentor junior team members and guide best practices in data engineering and cloud technologies.

Required Skills & Qualifications:

  • 7–10 years of professional experience in data engineering or data platform development.
  • Strong proficiency in Python and PySpark.
  • Hands-on experience in Azure Data Factory for orchestrating data pipelines.
  • Proficient in Azure Databricks for large-scale data processing and transformations.
  • Strong experience with Power BI for data visualization and reporting.
  • Solid understanding of data warehousing concepts, data lakes, and lakehouse architecture.
  • Familiarity with DevOps tools, Git, and CI/CD pipelines for data projects.
  • Strong SQL skills and experience working with structured and semi-structured data.
  • Excellent communication and stakeholder management skills.