Lead GCP Data Engineer

3 days ago

Bengaluru, Karnataka, India 76403e62-3b51-4f2c-ad83-cbbabd4c261d Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Title:
Lead Data Engineer – GCP (BigQuery
• Composer
• Python
• PySpark)

Location:
Bengaluru

Experience:
8+ years (data engineering / analytics engineering), with previous lead responsibilities

About the Role:

You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.

Key Responsibilities:

  • Architect and implement end-to-end data pipelines using BigQuery, PySpark/Spark, Python.
  • Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring.
  • Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning).
  • Develop and manage large-scale Spark/PySpark jobs for batch and potentially streaming data.
  • Ensure cloud-native architecture on GCP: storage (Cloud Storage), compute (Dataproc/Dataflow), orchestration (Composer), security/iam.
  • Lead and mentor a team of data engineers: code reviews, best practices, architecture decisions.

Required Skills & Qualifications:

  • Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities.
  • Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration.
  • Strong experience with PySpark/Spark for large-scale data processing.
  • Excellent proficiency in Python (scripting, automation, building frameworks).
  • Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation.
  • Experience designing data models, data warehouses/lakes, ingestion pipelines, transformations.
  • Experience building/operating CI/CD pipelines, version control (Git), test/monitoring practices.
  • Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders.

Why Join Us:

  • Lead a talented team and influence data engineering architecture & tooling.
  • Work on high-impact data platforms that enable business growth.
  • Use cutting-edge GCP services and modern data engineering practices.

  • GCP Lead Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA North America Full time US$ 1,20,000 - US$ 1,80,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a GCP Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).At NTT DATA, we know that with the right people...

  • GCP Data Engineer

    3 days ago

    Bengaluru, Karnataka, India InfoVision Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Role: GCP Data Engineer (Mid-Level)Position Overview:We are seeking a mid-level GCP Data Engineer with 4+ years of experience in ETL, Data Warehousing, and Data Engineering. The ideal candidate will have hands-on experience with GCP tools, solid data analysis skills, and a strong understanding of Data Warehousing principles.Qualifications:· years of...

  • GCP Data Engineer

    3 minutes ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Job descriptionDesign & Develop data pipelines, ETL & data integration workflows using GCP services like Dataflow, Pub/Sub, BigQuery, Cloud StorageBuild and manage data storage systems, including databases, data lakes, and data warehouses, leveraging GCP servicesRequired Candidate profile3+ yrs exp. in GCP, ETL, & DWH concepts.Exp. with version control...

  • GCP Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Capgemini Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • GCP Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Capgemini Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • GCP Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Capgemini Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Gcp Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Ortseam Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: GCP Data EngineerWork Mode: OnsiteBase Location: BangaloreExperience Required: 3+ YearsEmployment Type: Direct Payroll with ClientJob Summary:We are seeking a skilled GCP Data Engineer with strong expertise in Python and hands-on experience in designing and developing scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate...

  • GCP Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Infogain Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ROLES & RESPONSIBILITIESJob Description:Core SkillsAdvanced knowledge of Google Cloud Platform (GCP) data services such as BigQuery, Cloud Storage, and Dataflow.Expertise in ETL (Extract, Transform, Load) processes and data integration on GCP.Strong SQL and database querying optimization skills on GCP.Experience with data warehousing and data architecture on...

  • GCP Lead Engineer

    1 week ago

    Bengaluru, Karnataka, India Impetus Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Qualifications8-11 years of IT experience range is preferred.BE/B.Tech/MCA/MS-IT/M.Tech or any other Engineering degrees in related fieldsThe candidate should have extensive production experience (5 Years) with GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 4-5 Years of exp in Big Data technologies including,...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Capgemini Engineering Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...