GCP Data Engineer
2 hours ago
Job Title: GCP Data Engineer
Location: Bengaluru
Experience: 3-8 years
About the Role:
- Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.
- Use Python and PySpark/Spark to transform, clean, aggregate and prepare data for analytics/ML.
- Orchestrate workflows using Cloud Composer (Airflow) to schedule, monitor and operationalise jobs.
- Optimize query performance, partitioning, clustering and cost in BigQuery.
- Work with structured, semi-structured and unstructured data, integrating multiple data sources.
- Collaborate with data scientists, analysts, business stakeholders to translate requirements into data solutions.
- Implement data governance, quality checks, pipeline monitoring, version control & CI/CD practices.
Required Skills / Qualifications:
- Strong hands-on experience with GCP services: BigQuery, Cloud Storage, DataProc/Dataproc, Dataflow, Pub/Sub, Cloud Composer. For example: designing pipelines, data ingestion, transformations. (Several roles explicitly list BigQuery + Composer + DataProc or Dataflow)
- Proficiency in Python (scripting, ETL, automation) and PySpark (or Spark) for large-scale data processing.
- Excellent SQL and BigQuery SQL skills, including query optimization, partitioning/clustering design.
- Experience with workflow orchestration tools: Cloud Composer (Airflow) or equivalent scheduling tools.
- Experience building and managing ELT/ETL/data-warehouse solutions at scale (data modelling, schemas, star/snowflake, analytics).
- Good understanding of cloud-native architecture, cost optimisation, data security, monitoring, and possibly DevOps/CI/CD.
- (Preferable) Certifications such as Google Cloud Professional Data Engineer or hands-on large-scale projects in GCP.
-
GCP data Engineer
2 hours ago
Bangalore Urban, Karnataka, India, IN Impetus Full timeProvides technical leadership in Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies.ResponsibilitiesMust have: Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer services).Should be...
-
GCP Lead Engineer
2 hours ago
Bangalore Urban, Karnataka, India, IN Impetus Full timeQualifications8-11 years of IT experience range is preferred.BE/B.Tech/MCA/MS-IT/M.Tech or any other Engineering degrees in related fieldsThe candidate should have extensive production experience (5 Years) with GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 4-5 Years of exp in Big Data technologies including,...
-
Senior Data Engineer
2 hours ago
Bangalore Urban district, India, IN AuxoAI Full timeAuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP). This role is ideal for someone with deep experience building scalable batch and streaming data workflows, strong hands-on engineering skills, and a drive to mentor junior...
-
AI Data Engineer
2 hours ago
Bangalore Urban, Karnataka, India, IN Tata Consultancy Services Full timeJob Title: AI Data EngineerExp- 4 to 8 yearsLocation- PAN IndiaJob DescriptionKey Responsibilities:• Build and maintain data infrastructure: Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud.• Ensure data quality: Clean, transform, and enrich raw data to create "business truth" that AI models can use for...
-
Senior Data Engineer
2 hours ago
Bangalore Urban, Karnataka, India, IN Publicis Production Full timeJob Summary:We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with...
-
GCP data Engineer
2 hours ago
Gurugram, Haryana, India, IN Impetus Full timeLocation: Gurgaon and BangaloreExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesJob Descriptions for Big data or Cloud EngineerWe are looking for candidates with hands on experience in pyspark with GCP cloud.Qualifications3-10 years of IT experience range is preferred.Able to effectively use GCP managed...
-
Lead GCP Data Engineer
2 hours ago
Gurugram, Haryana, India, IN Impetus Full timeJob Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)Location: GurgaonExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesAbout the Role:You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...
-
GCP Data Engineer
2 hours ago
, India, IN HCLTech Full timeLooking for 5+ Years of experiencenotice period- immediate to 60 daysSkill required - GCP - Data Side, Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow
-
Engineering Manager
2 hours ago
Bangalore Urban, Karnataka, India, IN HiLabs Full timeWe are looking for an experienced Data Engineering Manager to lead and scale our data engineering function. The ideal candidate will be responsible for designing, building, and maintaining high-quality data pipelines and platforms that support analytics, reporting, and data-driven decision-making across the organization. This role involves leading a team of...
-
Freelance Apache NiFi GCP Data Engineer
2 hours ago
india, IN ThreatXIntel Full timeCompany DescriptionThreatXIntel is a startup cybersecurity company specializing in protecting businesses and organizations from cyber threats. We offer services including cloud security, web and mobile security testing, DevSecOps, and cloud security assessments to deliver customized, affordable solutions tailored to client needs. Committed to proactive...