Lead GCP Data Engineer

7 days ago

Gurgaon, Haryana, India Impetus Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Job Title:
Lead Data Engineer – GCP (BigQuery
• Composer
• Python
• PySpark)

Location:
Gurgaon

Experience:
8+ years (data engineering / analytics engineering), with previous lead responsibilities

About the Role:

You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.

Key Responsibilities:

  • Architect and implement end-to-end data pipelines using BigQuery, PySpark/Spark, Python.
  • Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring.
  • Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning).
  • Develop and manage large-scale Spark/PySpark jobs for batch and potentially streaming data.
  • Ensure cloud-native architecture on GCP: storage (Cloud Storage), compute (Dataproc/Dataflow), orchestration (Composer), security/iam.
  • Lead and mentor a team of data engineers: code reviews, best practices, architecture decisions.

Required Skills & Qualifications:

  • Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities.
  • Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration.
  • Strong experience with PySpark/Spark for large-scale data processing.
  • Excellent proficiency in Python (scripting, automation, building frameworks).
  • Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation.
  • Experience designing data models, data warehouses/lakes, ingestion pipelines, transformations.
  • Experience building/operating CI/CD pipelines, version control (Git), test/monitoring practices.
  • Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders.

Why Join Us:

  • Lead a talented team and influence data engineering architecture & tooling.
  • Work on high-impact data platforms that enable business growth.
  • Use cutting-edge GCP services and modern data engineering practices.

  • GCP data engineer

    2 weeks ago

    Gurgaon, Haryana, India Impetus Full time

    Qualifications3-11 years of IT experience range is preferred.Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies – Hadoop, Sqoop, Hive and Spark...

  • Senior/Lead Data Engineer

    4 days ago

    Gurgaon, Haryana, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Lead Data EngineerAbout The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • Lead Consultant, GCP Senior Engineer

    5 days ago

    Gurgaon, Haryana, India Genpact Full time US$ 55,000 - US$ 68,500 per year

    Genpact (NYSE\: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Senior Data Engineer

    6 days ago

    Gurgaon, Haryana, India Pacific Data Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST)Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Leapwork Full time

    Company OverviewAt Leapwork, our vision is to break down the barriers between humans and computers through the world's most accessible automation platform. We are the leading global AI-powered visual test automation solution, enabling some of the world's largest enterprises to adopt, scale, and maintain automation – in under 30 days.In today's...

  • Data Engineer Tech Lead

    2 weeks ago

    Gurgaon, Haryana, India Acenet consulting Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience: 7 to 9 yearsLocation: GurgaonJob code: 101318Posted on: Sep 04, 2025About Us:AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking &...

  • Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Leapwork Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company overview:At Leapwork, our vision is to break down the barriers between humans and computers through the world's most accessible automation platform. We are the leading global AI-powered visual test automation solution, enabling some of the world's largest enterprises to adopt, scale, and maintain automation – in under 30 days.  In...

  • Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Incedo Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job OverviewWe are seeking an experienced Senior Data Platform Developer to join our team. The ideal candidate will have strong hands-on expertise in AlloyDB (or PostgreSQL) for transactional (OLTP) systems, BigQuery for large-scale analytics (OLAP), and exposure to Snowflake or similar cloud data warehouses.This role is ideal for someone passionate about...

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India Institutional Shareholder Services Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Let's be #BrilliantTogetherISS STOXX is actively hiring a Lead Data Engineer for Gurugram location.Overview:In this role, you collaborate with Principal Engineers to interpret our data architecture and product needs, requirements and enterprise policies and integrate your expertise to develop solutions that provide a step-change in business efficiency and...

  • GCP infrastructure Engineer

    2 weeks ago

    Gurgaon, Haryana, India Rosemallow technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About the RoleWe are looking for an experienced Google Cloud Infrastructure Engineer to design, implement, and manage scalable, secure, and resilient cloud infrastructure solutions on Google Cloud Platform (GCP). The ideal candidate will collaborate closely with cross-functional teams to support cloud-native applications, infrastructure automation, and...