Lead GCP Data Engineer

2 hours ago

Bengaluru Karnataka India, Karnataka Impetus Full time

Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)


Location: Bengaluru

Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities


About the Role:

You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.


Key Responsibilities:

  • Architect and implement end-to-end data pipelines using BigQuery, PySpark/Spark, Python.
  • Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring.
  • Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning).
  • Develop and manage large-scale Spark/PySpark jobs for batch and potentially streaming data.
  • Ensure cloud-native architecture on GCP: storage (Cloud Storage), compute (Dataproc/Dataflow), orchestration (Composer), security/iam.
  • Lead and mentor a team of data engineers: code reviews, best practices, architecture decisions.


Required Skills & Qualifications:

  • Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities.
  • Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration.
  • Strong experience with PySpark/Spark for large-scale data processing.
  • Excellent proficiency in Python (scripting, automation, building frameworks).
  • Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation.
  • Experience designing data models, data warehouses/lakes, ingestion pipelines, transformations.
  • Experience building/operating CI/CD pipelines, version control (Git), test/monitoring practices.
  • Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders.


Why Join Us:

  • Lead a talented team and influence data engineering architecture & tooling.
  • Work on high-impact data platforms that enable business growth.
  • Use cutting-edge GCP services and modern data engineering practices.

  • GCP Data Engineer

    2 hours ago

    Bengaluru, Karnataka, India, Karnataka IntraEdge Full time

    Role: GCP Data Engineer with Big Data experience Location: Bengaluru, KA (Hybrid)Type: FulltimeWe are looking for energetic, high-performing and highly skilled Big Data + GCP Engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial Enterprise Personalization portfolio focused on delivering the next...

  • GCP Data Engineer

    2 hours ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Title: GCP Data EngineerExperience: 5 years - 10 YearsLocation: Bangalore/ Hyderabad/Delhi/Chennai/PuneExperience Required:Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and ETL processesSkills: GCP, Big Query, Dataflow, Data Proc, Cloud SQL, Cloud Spanner, Pub/Sub, ETL, Apache airflow, Python, Pandas and...

  • GCP Lead Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA North America Full time US$ 1,20,000 - US$ 1,80,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a GCP Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).At NTT DATA, we know that with the right people...

  • GCP Data Engineer

    2 hours ago

    Bengaluru, Karnataka, India, Karnataka Brillio Full time

    We’re Hiring: GCP Senior Data Engineer!Do you love building scalable data pipelines and working with cutting‑edge cloud technologies? Join our team and make an impact by designing solutions that power data‑driven decisions.Key ResponsibilitiesDesign and develop robust, scalable data pipelines and solutionsCollaborate with cross‑functional teams to...

  • Lead GCP Data Engineer

    6 days ago

    Bengaluru, Karnataka, India 76403e62-3b51-4f2c-ad83-cbbabd4c261d Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)Location:BengaluruExperience:8+ years (data engineering / analytics engineering), with previous lead responsibilitiesAbout the Role:You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...

  • GCP Data Engineer

    2 hours ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Greetings from TCS!!! Job Title: GCP Data EngineerLocation: PAN INDIAExperience Range: 6+ YearsQualification : 15 years of full time educationRequired Skills: GCP Big Query, Dataproc, Pub Sub, Airflow Must-Have:Expertise in Google Data Engineering services – Big Query, Dataproc etcStrong experience in programming languages such as Python, PySpark data...

  • GCP Data Engineer

    2 hours ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Greetings from TCS!!! Job Title: GCP Data EngineerLocation: PAN INDIAExperience Range: 6+ YearsQualification : 15 years of full time educationRequired Skills: GCP Big Query, Dataproc, Pub Sub, Airflow Job DescriptionTCS has always been in the spotlight for being adept in the next big technologies. What we an offer you is a space to explore varied...

  • GCP Data Engineer

    2 hours ago

    Bengaluru, Karnataka, India, Karnataka RB Consultancy Services Full time

    Job Title: GCP Data EngineerLocation: TCS - Chennai, Hyderabad, Bangalore, Pune, DelhiType: Full-timeExperience: 4+ yearsPrimary Skills:Python with OOPs concept.Data flowCloud ComposerBig querySecondary Skills:AgileSpinnakerJenkinsGitGKEGOOD TO HAVE: Data modelling basicsTableau basicsSQL Performance tuningResponsibilities:Develops and maintain scalable data...

  • Gcp Data Engineer

    2 hours ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Greetings from Tata Consulting ServicesTCS is Hiring for GCP Data engineerExperience : 5-10 yearsLocation: Pune, Hyderabad, Bangalore, Chennai, GurgaonJob descriptionExpertise in Google Data Engineering tools (BigQuery, Dataproc).Strong programming skills in Python and PySpark for data manipulation.Proficient in SQL and NoSQL databases.Solid understanding of...

  • GCP Data Engineer

    2 hours ago

    Bengaluru, Karnataka, India, Karnataka E-Solutions Full time

    Job Role: GCP Data EngineerLocation: Pan IndiaExperience: 5+ yearsType of Hire: PermanentRequired Technical Skill Set: GCP, PySpark, Python, HDFS, Hadoop, SQLMust Have Skills:• Good Handson Experience on GCP• Should have worked on Data Migration projects, from On-prem to Cloud• Should have Cloud Storage Knowledge, Big Query, Cluster Knowledge• Sound...