GCP Data Engineer

7 days ago

Bengaluru, India Tech Mahindra Full time

We are seeking a highly skilled GCP Data Engineer to join our team. The ideal candidate will have extensive experience with Google Cloud Platform (GCP) services, particularly Dataflow, BigQuery, Pub/Sub, and related services. Additionally, the candidate should be proficient in provisioning infrastructure on GCP using Infrastructure as Code (IaC) with Terraform. This role will be critical in building and managing data pipelines, ensuring data quality, and optimizing data storage and retrieval processes.


Responsibilities:

• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.

• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.

• Use Pub/Sub for real-time data ingestion and streaming analytics.

• Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed.

• Optimize data storage and retrieval processes to enhance performance and reduce costs.

• Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services.

• Ensure data quality and integrity through robust testing and validation processes.

• Stay updated with the latest GCP features and best practices, integrating them into existing workflows.

• Document data workflows, infrastructure setups, and processes for future reference and knowledge sharing.

Requirements:

• Proven experience as a Data Engineer with a focus on GCP services.

• Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub.

• Hands-on experience with Terraform for provisioning and managing GCP infrastructure.

• Proficiency in SQL and Python for data manipulation and analysis.

• Solid understanding of data warehousing concepts and ETL processes.

• Experience with real-time data processing and streaming analytics.

• Strong problem-solving skills and attention to detail.

• Excellent communication and collaboration skills.

Preferred Qualifications:

• Google Cloud Professional Data Engineer certification.

• Experience with other GCP services like Cloud Storage, Cloud Functions, and Cloud Composer.

• Familiarity with other IaC tools such as Ansible or Cloud Deployment Manager.

• Experience with containerization technologies like Docker and Kubernetes.

• Knowledge of data security and governance practices.

  • Gcp Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tech Mahindra Full time

    We are seeking a highly skilled GCP Data Engineer to join our team.The ideal candidate will have extensive experience with Google Cloud Platform (GCP) services, particularly Dataflow, Big Query, Pub/Sub, and related services.Additionally, the candidate should be proficient in provisioning infrastructure on GCP using Infrastructure as Code (Ia C) with...

  • Gcp Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Impetus Full time

    Location: Bangalore/Gurgaon4-7 years of IT experience range is preferred.Able to effectively use GCP managed services e.G. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies – Hadoop, Sqoop, Hive...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world's biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We're harnessing the power of technology and humanity to create...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tech Mahindra Full time

    Tech Mahindra hiring GCP Data Engineers for all across IndiaNotice- Immediate/ Early joiners only**Experience- 4+ yearsMust have skills:Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, PythonSend CVs to if eligible.

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tech Mahindra Full time

    Tech Mahindra hiring GCP Data Engineers for all across India Notice- Immediate/ Early joiners only** Experience- 4+ years Must have skills: Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, Python Send CVs to if eligible.

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, India Tech Mahindra Full time

    Tech Mahindra hiring GCP Data Engineers for all across India Notice- Immediate/ Early joiners only** Experience- 4+ years Must have skills: Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, Python Send CVs to if eligible.

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, India Tech Mahindra Full time

    Tech Mahindra hiring GCP Data Engineers for all across IndiaNotice- Immediate/ Early joiners only**Experience- 4+ yearsMust have skills:Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, PythonSend CVs to KO00759472@TechMahindra.com if eligible.

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, India Tech Mahindra Full time

    Tech Mahindra hiring GCP Data Engineers for all across IndiaNotice- Immediate/ Early joiners only**Experience- 4+ yearsMust have skills:Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, PythonSend CVs to KO00759472@TechMahindra.com if eligible.

  • Lead GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Recro Full time

    Job Title: Lead GCP Data Engineer Location: Bengaluru, Karnataka, India Experience: 7-10 years Responsibilities: Cloud Analytics Platform : Build and optimize a cloud analytics platform on Google Cloud Platform (GCP) to meet evolving business needs using lean Agile practices. Design and implement solutions for transformation and modernization on GCP. ...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 29, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts (AWS/GCP). ...

  • Lead GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Recro Full time

    Job Title: Lead GCP Data EngineerLocation: Bengaluru, Karnataka, IndiaExperience: 7-10 yearsResponsibilities:Cloud Analytics Platform :Build and optimize a cloud analytics platform on Google Cloud Platform (GCP) to meet evolving business needs using lean Agile practices.Design and implement solutions for transformation and modernization on GCP.Data...

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, India Alp Consulting Limited Full time

    We are seeking a skilled Data Engineer with a specialisation in building robust ETL (Extract, Transform, Load) processes and a strong background in utilising Google Cloud Platform (GCP) services. The ideal candidate should have experience designing, developing, and maintaining data pipelines that facilitate the collection, processing, and storage of large...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India CIEL HR Services Full time

    Hi,Total years of experience: 5+Description:Job Description:GCP Data Engineer Engineers :Prepare DAGPrepare Airflow based ETL JobsDocument architecture & technical designAnalyze and implement Securities Services use caseImplement required Securities for product data acquisition

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, IndiaPosted on: June 14, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESneed someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts (AWS/GCP).EXPERIENCE6-8...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, IndiaPosted on: May 24, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESneed someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts (AWS/GCP).EXPERIENCE6-8...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Alp Consulting Limited Full time

    Requirement:- Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems. Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and ETL Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Alp Consulting Limited Full time

    We are seeking a skilled Data Engineer with a specialisation in building robust ETL (Extract, Transform, Load) processes and a strong background in utilising Google Cloud Platform (GCP) services. The ideal candidate should have experience designing, developing, and maintaining data pipelines that facilitate the collection, processing, and storage of large...

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, India CIEL HR Services Full time

    Hi, Total years of experience: 5+ Description: Job Description: GCP Data Engineer Engineers : Prepare DAG Prepare Airflow based ETL Jobs Document architecture & technical design Analyze and implement Securities Services use case Implement required Securities for product data acquisition