Lead GCP Data Engineer

4 days ago


Bangalore, India Impetus Full time

Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark) Location: Bengaluru Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities About the Role: You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products. Key Responsibilities: Architect and implement end-to-end data pipelines using BigQuery, PySpark/Spark, Python. Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring. Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning). Develop and manage large-scale Spark/PySpark jobs for batch and potentially streaming data. Ensure cloud-native architecture on GCP: storage (Cloud Storage), compute (Dataproc/Dataflow), orchestration (Composer), security/iam. Lead and mentor a team of data engineers: code reviews, best practices, architecture decisions. Required Skills & Qualifications: Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities. Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration. Strong experience with PySpark/Spark for large-scale data processing. Excellent proficiency in Python (scripting, automation, building frameworks). Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation. Experience designing data models, data warehouses/lakes, ingestion pipelines, transformations. Experience building/operating CI/CD pipelines, version control (Git), test/monitoring practices. Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders. Why Join Us: Lead a talented team and influence data engineering architecture & tooling. Work on high-impact data platforms that enable business growth. Use cutting-edge GCP services and modern data engineering practices.



  • bangalore, India Impetus Full time

    Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)Location: BengaluruExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesAbout the Role:You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...


  • bangalore, India People Prime Worldwide Full time

    Lead Data Engineer – Python & GCPLocation - 10+ YearsJob Overview:We are seeking an experienced Lead Data Engineer with strong expertise in Python and Google Cloud Platform (GCP). The ideal candidate will lead the end-to-end data engineering lifecycle—from requirement gathering and solution design to development, deployment, and post-delivery support....


  • bangalore district, India Impetus Full time

    Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark) Location: Bengaluru Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities About the Role: You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...


  • bangalore, India Egen Full time

    Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract,...


  • bangalore, India People Prime Worldwide Full time

    Important Note (Please Read Before Applying)🚫 Do NOT apply if: • You have less than 10 years of relevant IT experience • You lack hands-on Python + GCP project experience • You have no real-time experience with Dataflow, BigQuery, Airflow, or Spark • You are not experienced in architecting or designing data pipelines • You cannot work in the...


  • bangalore, India People Prime Worldwide Full time

    Job Title: Lead Data Engineer – Python & GCPExperience: 10+ YearsLocation: HyderabadInterview Mode: Face-to-FaceAbout the RoleWe are seeking an experienced Lead Data Engineer with deep expertise in Python and Google Cloud Platform (GCP). This role involves designing and building scalable data solutions, developing ETL/ELT pipelines, and leading the...

  • GCP Data Engineer

    3 days ago


    bangalore, India Adastra Full time

    Job DescriptionWe are looking for a proactive and solution-oriented GCP Data Engineer to join our team. This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, alongside strong SQL and Python skills. The ideal candidate is a self-starter who thrives in solving problems independently, communicates...

  • GCP Data Engineer

    3 days ago


    bangalore, India Adastra Full time

    Job Description We are looking for a proactive and solution-oriented GCP Data Engineer to join our team. This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, alongside strong SQL and Python skills. The ideal candidate is a self-starter who thrives in solving problems independently, communicates...

  • GCP Data engineer

    1 week ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from Tata Consulting Services TCS is Hiring for GCP Data engineer Experience : 5-10 years Location: PAN INDIA Please find the JD below Required Technical Skill - GCP Data engineer, Pyspark, Data proc, Data flow

  • GCP Lead Engineer

    2 days ago


    bangalore, India Impetus Full time

    Qualifications8-11 years of IT experience range is preferred.BE/B.Tech/MCA/MS-IT/M.Tech or any other Engineering degrees in related fieldsThe candidate should have extensive production experience (5 Years) with GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 4-5 Years of exp in Big Data technologies including,...