Lead GCP Data Engineer
4 days ago
Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark) Location: Bengaluru Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities About the Role: You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products. Key Responsibilities: Architect and implement end-to-end data pipelines using BigQuery, PySpark/Spark, Python. Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring. Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning). Develop and manage large-scale Spark/PySpark jobs for batch and potentially streaming data. Ensure cloud-native architecture on GCP: storage (Cloud Storage), compute (Dataproc/Dataflow), orchestration (Composer), security/iam. Lead and mentor a team of data engineers: code reviews, best practices, architecture decisions. Required Skills & Qualifications: Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities. Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration. Strong experience with PySpark/Spark for large-scale data processing. Excellent proficiency in Python (scripting, automation, building frameworks). Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation. Experience designing data models, data warehouses/lakes, ingestion pipelines, transformations. Experience building/operating CI/CD pipelines, version control (Git), test/monitoring practices. Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders. Why Join Us: Lead a talented team and influence data engineering architecture & tooling. Work on high-impact data platforms that enable business growth. Use cutting-edge GCP services and modern data engineering practices.
-
Lead GCP Data Engineer
1 day ago
bangalore, India Impetus Full timeJob Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)Location: BengaluruExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesAbout the Role:You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...
-
GCP Lead Data Engineer
7 days ago
bangalore, India People Prime Worldwide Full timeLead Data Engineer – Python & GCPLocation - 10+ YearsJob Overview:We are seeking an experienced Lead Data Engineer with strong expertise in Python and Google Cloud Platform (GCP). The ideal candidate will lead the end-to-end data engineering lifecycle—from requirement gathering and solution design to development, deployment, and post-delivery support....
-
Lead GCP Data Engineer
1 day ago
bangalore district, India Impetus Full timeJob Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark) Location: Bengaluru Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities About the Role: You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...
-
Lead Data Engineer GCP
4 weeks ago
bangalore, India Egen Full timeJob Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract,...
-
Lead GCP Data Engineer
7 days ago
bangalore, India People Prime Worldwide Full timeImportant Note (Please Read Before Applying)🚫 Do NOT apply if: • You have less than 10 years of relevant IT experience • You lack hands-on Python + GCP project experience • You have no real-time experience with Dataflow, BigQuery, Airflow, or Spark • You are not experienced in architecting or designing data pipelines • You cannot work in the...
-
Lead Data Engineer – Python
7 days ago
bangalore, India People Prime Worldwide Full timeJob Title: Lead Data Engineer – Python & GCPExperience: 10+ YearsLocation: HyderabadInterview Mode: Face-to-FaceAbout the RoleWe are seeking an experienced Lead Data Engineer with deep expertise in Python and Google Cloud Platform (GCP). This role involves designing and building scalable data solutions, developing ETL/ELT pipelines, and leading the...
-
GCP Data Engineer
3 days ago
bangalore, India Adastra Full timeJob DescriptionWe are looking for a proactive and solution-oriented GCP Data Engineer to join our team. This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, alongside strong SQL and Python skills. The ideal candidate is a self-starter who thrives in solving problems independently, communicates...
-
GCP Data Engineer
3 days ago
bangalore, India Adastra Full timeJob Description We are looking for a proactive and solution-oriented GCP Data Engineer to join our team. This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, alongside strong SQL and Python skills. The ideal candidate is a self-starter who thrives in solving problems independently, communicates...
-
GCP Data engineer
1 week ago
bangalore, India Tata Consultancy Services Full timeGreetings from Tata Consulting Services TCS is Hiring for GCP Data engineer Experience : 5-10 years Location: PAN INDIA Please find the JD below Required Technical Skill - GCP Data engineer, Pyspark, Data proc, Data flow
-
GCP Lead Engineer
2 days ago
bangalore, India Impetus Full timeQualifications8-11 years of IT experience range is preferred.BE/B.Tech/MCA/MS-IT/M.Tech or any other Engineering degrees in related fieldsThe candidate should have extensive production experience (5 Years) with GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 4-5 Years of exp in Big Data technologies including,...