Lead GCP Data Engineer

2 hours ago

Gurugram Haryana India, IN Impetus Full time

Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)


Location: Gurgaon

Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities


About the Role:

You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.


Key Responsibilities:

  • Architect and implement end-to-end data pipelines using BigQuery, PySpark/Spark, Python.
  • Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring.
  • Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning).
  • Develop and manage large-scale Spark/PySpark jobs for batch and potentially streaming data.
  • Ensure cloud-native architecture on GCP: storage (Cloud Storage), compute (Dataproc/Dataflow), orchestration (Composer), security/iam.
  • Lead and mentor a team of data engineers: code reviews, best practices, architecture decisions.


Required Skills & Qualifications:

  • Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities.
  • Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration.
  • Strong experience with PySpark/Spark for large-scale data processing.
  • Excellent proficiency in Python (scripting, automation, building frameworks).
  • Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation.
  • Experience designing data models, data warehouses/lakes, ingestion pipelines, transformations.
  • Experience building/operating CI/CD pipelines, version control (Git), test/monitoring practices.
  • Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders.


Why Join Us:

  • Lead a talented team and influence data engineering architecture & tooling.
  • Work on high-impact data platforms that enable business growth.
  • Use cutting-edge GCP services and modern data engineering practices.

  • GCP data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Impetus Full time

    Location: Gurgaon and BangaloreExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesJob Descriptions for Big data or Cloud EngineerWe are looking for candidates with hands on experience in pyspark with GCP cloud.Qualifications3-10 years of IT experience range is preferred.Able to effectively use GCP managed...

  • Senior Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Pacific Data Integrators Full time

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST) Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • GCP Lead Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Impetus Full time

    Qualifications8-11 years of IT experience range is preferred.BE/B.Tech/MCA/MS-IT/M.Tech or any other Engineering degrees in related fieldsThe candidate should have extensive production experience (5 Years) with GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 4-5 Years of exp in Big Data technologies including,...

  • GCP Data Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Impetus Full time

    Job Title: GCP Data EngineerLocation: BengaluruExperience: 3-8 yearsAbout the Role:Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.Use Python and PySpark/Spark to transform, clean, aggregate and prepare data for analytics/ML.Orchestrate workflows using Cloud Composer (Airflow) to schedule,...

  • Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Sirius AI Full time

    Data Engineer Job Description About Sirius AI Sirius AI is a US headquartered AI Consulting services and products company with operations in India. Sirius AI focuses on Financial Services enterprises and solutions / services delivered across multiple geographies. We are an innovation-driven AI and data driven consulting services firm with a high focus on...

  • Senior Data Engineer

    2 hours ago

    Bangalore Urban district, India, IN AuxoAI Full time

    AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP). This role is ideal for someone with deep experience building scalable batch and streaming data workflows, strong hands-on engineering skills, and a drive to mentor junior...

  • GCP Data Engineer

    2 hours ago

    , India, IN HCLTech Full time

    Looking for 5+ Years of experiencenotice period- immediate to 60 daysSkill required - GCP - Data Side, Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow

  • Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Terra Technology Circle Consulting Private Limited Full time

    Job Title: Data EngineerExperience: 4–8 yearsLocation: GurugramEmployment Type: ContractualAbout the RoleWe are seeking a highly skilled and motivated Data Engineer to join our growing data and analytics team. In this role, you will design, build, and optimize scalable data pipelines and architectures to support analytics, machine learning, and business...

  • GCP data Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Impetus Full time

    Provides technical leadership in Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies.ResponsibilitiesMust have: Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer services).Should be...

  • Senior Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN dunnhumby Full time

    Retail Media is transforming how advertisers connect with consumers through personalized and targeted campaigns across retailers' digital and physical touchpoints. Retail Media Measurement plays a pivotal role in ensuring the effectiveness of these campaigns, driving value for advertisers, retailers, and consumers alike.This role focuses on designing,...