Lead Data Engineer

6 days ago

Bengaluru Karnataka India, Karnataka Movate Full time

Job title: Lead Data Engineer

Location: Bangalore

Experience: 6+ Years


Summary:

We are seeking an experienced Data Lead to own and drive the design, development, and optimization of modern data platform using Snowflake & DBT. The candidate needs to have hands-on expertise with Snowflake, DBT, and PySpark, combined with strong data architecture, team leadership, and stakeholder management skills.


Key Responsibilities:


1. Data Architecture & Strategy: Drive the design and implementation of the enterprise data platform, leveraging Snowflake as the core data infrastructure.

2. Pipeline Development: Architect and deliver robust ETL/ELT pipelines in Snowflake and DBT to integrate data from diverse source systems. Expert in Snowflake internals (warehouse sizing, RBAC, partitioning, query tuning). Well aware of DWH schema design and hands on exp on SCD-2 implementation.

3. Full Development Lifecycle: Participate in all phases of solution delivery, including development, testing, deployment, and optimization.

4. Quality Assurance: Perform code reviews, ensure adherence to engineering best practices, and continuously improve code quality and ETL performance.

5. Issue Resolution: Diagnose, troubleshoot, and resolve complex ETL/ELT issues with efficiency and precision.

6. Cross-Functional Collaboration: Work closely with product, engineering, analytics, and business teams to solve complex data challenges and align solutions with organizational goals.


Required Skills:

1. At least 6 years of professional experience, including hands-on work as a Data Lead with strong expertise in Snowflake and dbt.

2. Bachelor’s degree in Computer Science, Software Engineering, or a related discipline.

3. Solid working knowledge of SQL, PySpark, and Python data libraries such as NumPy, SciPy, Pandas, Dask, and SQLAlchemy.

4. Strong proficiency in Snowflake data warehousing, including schema design and implementation. Hands on exp in SCD-2 implementation.

5. Good exp in Data quality frameworks such as Great Expectations, Deequ to address data quality issues.

6. Experience with the AWS/Azure cloud services ecosystem, supported by relevant cloud certifications.

7. Demonstrated ability to lead and mentor small engineering or data development teams.

8. Excellent problem-solving abilities, with strong communication and collaboration skills.

9. Working knowledge of agile methodologies, especially sprint-driven development processes.


Desired Skills:


1. Experience with big data technologies (e.g., PySpark, Hadoop, Kafka).

2. Understanding of data science and machine learning concepts, tools, and workflows.

  • Data Engineering Subject Matter Expert

    2 weeks ago

    Bengaluru, Karnataka, India Data Engineer Academy Full time US$ 4,80,000 - US$ 12,00,000 per year

    We're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & DatabricksRemote | Part Time | Flexible Timings | Pay: $600 – $1000/MonthlyAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 9-15 years of experience in cloud...

  • Cloud/Snowflake Support Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Data Engineer Academy Full time US$ 60,000 - US$ 1,20,000 per year

    We're Hiring:Cloud/Snowflake Support Engineer( SME Coach)Remote | Full Time | 7AM EST to 3PM EST| Pay: $ /MonthlyAbout the OpportunityThis role is a blend of a Subject Matter Expert (SME) and support engineer. The primary responsibility is to clear project issues for students while working on multiple projects involving AWS, Snowflake, and dbt. The engineer...

  • Lead Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Dr. Martens plc Full time

    SO, WHAT'S THE STORY? As a Lead Data Engineer, you will play a key role in the development and maintenance of the organization's data infrastructure. Working within a multi-disciplined team led by the Senior Manager - Data Engineer, you will focus on building and optimizing scalable data pipelines and supporting the delivery of high-quality, reliable data...

  • Lead Data Engineer

    1 week ago

    Bengaluru, Karnataka, India, Karnataka Zyoin Group Full time

    Lead Data EngineerExperience: 10+ YearsLocation: Bangalore / Hyderabad / NoidaMandatory Skills: Databricks, AWS, PySpark, AirflowRole OverviewWe are seeking a Lead Data Engineer to design, build, and maintain scalable data platforms and pipelines. This role requires strong hands-on expertise in cloud-based data engineering, distributed data processing, and...

  • Lead Data Engineer

    6 days ago

    Bengaluru, Karnataka, India, Karnataka KPI Partners Full time

    KPI Partners is seeking a highly skilled Lead Data Engineer with 6 to 8 years of experience to join our dynamic team. The ideal candidate will play a pivotal role in designing and implementing data solutions that meet our clients' needs, leveraging cutting-edge technologies.Key Responsibilities:Design, develop, and maintain ETL pipelines using Snowflake,...

  • Lead Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka SPIRO Full time

    Position: Lead Data EngineerLocation: BengaluruExperience: 10+ yearsJob Summary:We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.Key...

  • Lead GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Impetus Full time

    Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)Location: BengaluruExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesAbout the Role:You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...

  • AWS Lead Data engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Summary: In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable data infrastructure and processes using...

  • Enterprise Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Aptus Data Labs Full time

    Enterprise Data Architect – Job DescriptionLocation: Bangalore (Hybrid)Experience: 15+ years in Data Engineering & Data PlatformsEmployment Type: Full-time About Aptus Data LabsAptus Data Labs is a global Data Engineering and AI solutions partner helping enterprises build modern, scalable, and intelligence-driven organizations. With deep expertise across...

  • Data Delivery Lead

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Duties: The Data Delivery Lead is responsible for overseeing the entire lifecycle of our data projects, from initial stakeholder engagement, through data collection and transformation to final delivery, ensuring accurate, timely, and compliant data and insight is provided to stakeholders while managing project timelines, risks, and dependencies across a...