Lead Data Engineer

7 days ago


Bengaluru Karnataka India, Karnataka Zyoin Group Full time

Lead Data Engineer

Experience: 10+ Years

Location: Bangalore / Hyderabad / Noida

Mandatory Skills: Databricks, AWS, PySpark, Airflow


Role Overview

We are seeking a Lead Data Engineer to design, build, and maintain scalable data platforms and pipelines. This role requires strong hands-on expertise in cloud-based data engineering, distributed data processing, and workflow orchestration, along with the ability to guide teams and deliver high-quality data solutions in a fast-paced environment.


Core Responsibilities

  • Design, develop, and manage scalable and reliable data pipelines using PySpark and Databricks.
  • Build and maintain data orchestration workflows using Apache Airflow.
  • Architect, implement, and optimize cloud-based data solutions on AWS.
  • Work extensively with AWS services including S3, Glue, Redshift, EMR, Lambda, and IAM.
  • Ensure high performance, reliability, and scalability of large-scale data processing systems.
  • Perform data modeling, SQL optimization, and performance tuning.
  • Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
  • Lead technical discussions, mentor junior engineers, and provide technical guidance.
  • Implement best practices for data quality, security, and governance.
  • Support CI/CD pipelines and follow version control best practices using Git and automated deployments.
  • Contribute to containerized deployments using Docker/Kubernetes where applicable.


Skills & Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • 4+ years of hands-on experience in Data Engineering.
  • Strong expertise in PySpark, Databricks, and Apache Airflow.
  • Solid hands-on experience with AWS cloud services.
  • Strong proficiency in SQL and data performance tuning.
  • Experience with CI/CD pipelines, version control (Git).
  • Exposure to Docker and Kubernetes is an added advantage.
  • Strong analytical, problem-solving, and communication skills.
  • Ability to work effectively in a fast-paced, collaborative environment.



  • Bengaluru, Karnataka, India Data Engineer Academy Full time US$ 4,80,000 - US$ 12,00,000 per year

    We're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & DatabricksRemote | Part Time | Flexible Timings | Pay: $600 – $1000/MonthlyAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 9-15 years of experience in cloud...


  • Bengaluru, Karnataka, India Data Engineer Academy Full time US$ 60,000 - US$ 1,20,000 per year

    We're Hiring:Cloud/Snowflake Support Engineer( SME Coach)Remote | Full Time | 7AM EST to 3PM EST| Pay: $ /MonthlyAbout the OpportunityThis role is a blend of a Subject Matter Expert (SME) and support engineer. The primary responsibility is to clear project issues for students while working on multiple projects involving AWS, Snowflake, and dbt. The engineer...

  • Lead Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India, Karnataka Dr. Martens plc Full time

    SO, WHAT'S THE STORY? As a Lead Data Engineer, you will play a key role in the development and maintenance of the organization's data infrastructure. Working within a multi-disciplined team led by the Senior Manager - Data Engineer, you will focus on building and optimizing scalable data pipelines and supporting the delivery of high-quality, reliable data...

  • Lead Data Engineer

    5 days ago


    Bengaluru, Karnataka, India, Karnataka Movate Full time

    Job title: Lead Data EngineerLocation: BangaloreExperience: 6+ YearsSummary: We are seeking an experienced Data Lead to own and drive the design, development, and optimization of modern data platform using Snowflake & DBT. The candidate needs to have hands-on expertise with Snowflake, DBT, and PySpark, combined with strong data architecture, team leadership,...

  • Lead Data Engineer

    5 days ago


    Bengaluru, Karnataka, India, Karnataka KPI Partners Full time

    KPI Partners is seeking a highly skilled Lead Data Engineer with 6 to 8 years of experience to join our dynamic team. The ideal candidate will play a pivotal role in designing and implementing data solutions that meet our clients' needs, leveraging cutting-edge technologies.Key Responsibilities:Design, develop, and maintain ETL pipelines using Snowflake,...

  • Lead Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India, Karnataka SPIRO Full time

    Position: Lead Data EngineerLocation: BengaluruExperience: 10+ yearsJob Summary:We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.Key...


  • Bengaluru, Karnataka, India, Karnataka Impetus Full time

    Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)Location: BengaluruExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesAbout the Role:You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...


  • Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Summary: In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable data infrastructure and processes using...


  • Bengaluru, Karnataka, India, Karnataka Aptus Data Labs Full time

    Enterprise Data Architect – Job DescriptionLocation: Bangalore (Hybrid)Experience: 15+ years in Data Engineering & Data PlatformsEmployment Type: Full-time About Aptus Data LabsAptus Data Labs is a global Data Engineering and AI solutions partner helping enterprises build modern, scalable, and intelligence-driven organizations. With deep expertise across...

  • Data Delivery Lead

    7 days ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Duties: The Data Delivery Lead is responsible for overseeing the entire lifecycle of our data projects, from initial stakeholder engagement, through data collection and transformation to final delivery, ensuring accurate, timely, and compliant data and insight is provided to stakeholders while managing project timelines, risks, and dependencies across a...