Lead Data Engineer

4 days ago

Chennai Coimbatore Kochi, India Anlage Infotech Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Role & responsibilities

Mandate skills - Pyspark + Azure DataBricks + Azure Data Factory

Experience- 8+ years

We are looking for an experienced and hands-on Data Engineering Lead to guide and mentor a team of data

engineers in delivering scalable and reliable data solutions. This role demands strong technical expertise in Azure

Databricks, Azure Data Factory, and PySpark, along with proven experience in leading data projects, managing

stakeholders, and driving data platform best practices.

As a Data Lead, you will play a critical role in architecting and executing the organizations data strategy while

fostering a high-performance team culture.

Key Responsibilities:

  • Lead the design and implementation of robust data pipelines and architectures using Azure Databricks,

ADF, and PySpark.

  • Provide technical leadership and mentoring to a team of data engineers.
  • Drive the adoption of best practices in data engineering, coding standards, and data quality assurance.
  • Collaborate with cross-functional teams including data science, product, business, and analytics to define

and deliver data-driven solutions.

  • Own end-to-end delivery of data initiatives, ensuring projects are delivered on time and within scope.
  • Architect scalable solutions using Azure cloud-native services, ensuring performance, security, and cost

optimization.

  • Establish and monitor SLAs for data pipelines, orchestrate job schedules, and ensure high availability.
  • Act as a key stakeholder in data governance, data cataloging, and metadata management efforts.
  • Drive continuous improvement in development processes, automation, and CI/CD pipelines.

Required Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related discipline.
  • 5+ years of experience in data engineering, with 2+ years in a leadership or team lead capacity.
  • Proven expertise in:
  • Azure Databricks (including Delta Lake, Spark optimizations)
  • Azure Data Factory
  • PySpark
  • Hands-on experience with Azure Data Lake, SQL, and distributed data processing.
  • Solid understanding of data architecture patterns, data modeling, and performance tuning.
  • Strong experience in stakeholder management and cross-functional collaboration.
  • Experience with CI/CD tools (Azure DevOps, GitHub Actions, etc.) and DevOps practices.
  • Knowledge of cloud cost optimization, security, and compliance in Azure.

Preferred Qualifications:

  • Experience with Azure Synapse Analytics, Azure Functions, Event Hubs, or Stream Analytics.
  • Familiarity with Agile/Scrum methodologies.
  • Exposure to data governance frameworks and tools like Purview.
  • Understanding of business KPIs and ability to translate business needs into technical solutions.
  • Excellent communication, leadership, and people management skills.

  • Data Lead

    6 days ago

    Chennai, Coimbatore, Kochi, India Anlage Infotech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Notice Period-Immediate Joiner or Max 10 days (Do not share long notice period profile.)Permanent Payroll - Anlage InfotechClient - Orion InnovationLocation- Kochi - Chennai - Coimbatore - HYBRID (2/3 days in a week)Role & responsibilities -Key Responsibilities:Lead the design and implementation of robust data pipelines and architectures using Azure...

  • Lead Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    About the RoleWe are seeking a Lead Data Engineer to join our team. In this role, you will be crucial in designing, building, and maintaining our data infrastructure. This is a hands-on position requiring a strong foundation in data warehousing, ETL processes, and database management. The ideal candidate will have a keen eye for detail and the ability to...

  • Data Engineer

    7 days ago

    Chennai, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Job Duties: As a data...

  • Lead data engineer

    4 weeks ago

    Kochi, India Cozzera Full time

    Job Title: Lead Data EngineerExperience: 8–10 YearsLocation: Remote ( 1 week from noida office then remote)Job Overview:We are looking for an accomplished Lead Data Engineer with 8–10 years of experience inarchitecting, building, and managing complex data ecosystems using Python, Databricks(Delta Lake, Spark, MLflow), and modern orchestration frameworks....

  • Lead DevOps Engineer

    4 days ago

    Coimbatore, Tamil Nadu, India Data caliper Full time ₹ 3,41,000 - ₹ 15,85,694 per year

    Immediate openings for IndiaIf you are looking for an opportunity, share your resume or refer your friends.Only candidates located in India are eligible to apply for this position.Position: Lead DevOps EngineerExperience: 7+ aboveLocation: Remote (located in India are eligible)Job description:Coaches, guides and mentors' team of DevOps EngineersA lead DevOps...

  • Engineer (L1) - Titus Data Classification

    7 days ago

    Chennai, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at NTT...

  • Data Engineer

    6 days ago

    Chennai, Coimbatore, Kochi, India Anlage Infotech Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Notice Period-Immediate Joiner or Max 10 days (Do not share long notice period profile.)Permanent Payroll - Anlage InfotechClient - Orion InnovationLocation- Kochi - Chennai - Coimbatore - HYBRID (2/3 days in a week)Role & responsibilitiesBachelors or Masters degree in Computer Science, Engineering, Information Systems, or a related field.5+ years of...

  • Lead Data Engineer

    3 days ago

    Chennai, India Alans Group Full time

    The Role :As a Lead Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures. You will lead a team of data engineers and collaborate with data scientists and analysts to ensure data is accessible and usable across the organization. Design and implement robust data pipelines for data ingestion...

  • Lead Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India Alans Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    The Role:As a Lead Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures. You will lead a team of data engineers and collaborate with data scientists and analysts to ensure data is accessible and usable across the organization.Design and implement robust data pipelines for data ingestion and...

  • Lead Data Engineer

    1 day ago

    chennai, India Alans Group Full time

    The Role:As a Lead Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures. You will lead a team of data engineers and collaborate with data scientists and analysts to ensure data is accessible and usable across the organization.Design and implement robust data pipelines for data ingestion and...