GCP Data Engineer

1 week ago

Bangalore Urban, India Tech Mahindra Full time

We are seeking a highly skilled GCP Data Engineer to join our team. The ideal candidate will have extensive experience with Google Cloud Platform (GCP) services, particularly Dataflow, BigQuery, Pub/Sub, and related services. Additionally, the candidate should be proficient in provisioning infrastructure on GCP using Infrastructure as Code (IaC) with Terraform. This role will be critical in building and managing data pipelines, ensuring data quality, and optimizing data storage and retrieval processes.


Responsibilities:

• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.

• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.

• Use Pub/Sub for real-time data ingestion and streaming analytics.

• Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed.

• Optimize data storage and retrieval processes to enhance performance and reduce costs.

• Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services.

• Ensure data quality and integrity through robust testing and validation processes.

• Stay updated with the latest GCP features and best practices, integrating them into existing workflows.

• Document data workflows, infrastructure setups, and processes for future reference and knowledge sharing.

Requirements:

• Proven experience as a Data Engineer with a focus on GCP services.

• Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub.

• Hands-on experience with Terraform for provisioning and managing GCP infrastructure.

• Proficiency in SQL and Python for data manipulation and analysis.

• Solid understanding of data warehousing concepts and ETL processes.

• Experience with real-time data processing and streaming analytics.

• Strong problem-solving skills and attention to detail.

• Excellent communication and collaboration skills.

Preferred Qualifications:

• Google Cloud Professional Data Engineer certification.

• Experience with other GCP services like Cloud Storage, Cloud Functions, and Cloud Composer.

• Familiarity with other IaC tools such as Ansible or Cloud Deployment Manager.

• Experience with containerization technologies like Docker and Kubernetes.

• Knowledge of data security and governance practices.

  • Lead GCP Data Engineer

    2 months ago

    Bangalore Urban, India Recro Full time

    Job Title: Lead GCP Data EngineerLocation: Bengaluru, Karnataka, IndiaExperience: 7-10 yearsResponsibilities:Cloud Analytics Platform:Build and optimize a cloud analytics platform on Google Cloud Platform (GCP) to meet evolving business needs using lean Agile practices.Design and implement solutions for transformation and modernization on GCP.Data...

  • Lead GCP Data Engineer

    2 months ago

    Bangalore Urban, India Recro Full time

    Job Title: Lead GCP Data Engineer Location: Bengaluru, Karnataka, India Experience: 7-10 years Responsibilities: Cloud Analytics Platform : Build and optimize a cloud analytics platform on Google Cloud Platform (GCP) to meet evolving business needs using lean Agile practices. Design and implement solutions for transformation and modernization on GCP. ...

  • GCP Data Engineer

    4 weeks ago

    Bangalore Urban, India Impetus Full time

    Immediate Joiners Preferred 3-7 years of IT experience range is preferred.Strong experience in Java programming – Java 8+, SpringBoot, Microservices, REST, Webservices, Hybernate/JPAGood to have knowledge on - Kubernetes basicsAble to effectively use GCP managed services e.g. VMs, Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of...

  • GCP Data Engineer

    3 weeks ago

    Bangalore Urban, India Impetus Full time

    Immediate Joiners Preferred 3-7 years of IT experience range is preferred.Strong experience in Java programming – Java 8+, SpringBoot, Microservices, REST, Webservices, Hybernate/JPAGood to have knowledge on - Kubernetes basicsAble to effectively use GCP managed services e.g. VMs, Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of...

  • GCP Data Engineer

    3 weeks ago

    Bangalore Urban, India Impetus Full time

    Immediate Joiners Preferred 3-7 years of IT experience range is preferred. Strong experience in Java programming – Java 8+, SpringBoot, Microservices, REST, Webservices, Hybernate/JPA Good to have knowledge on - Kubernetes basics Able to effectively use GCP managed services e.g. VMs, Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At...

  • GCP Data Engineer

    1 week ago

    bangalore, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • GCP Data Engineer

    1 week ago

    bangalore, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • Lead GCP Data Engineer

    2 months ago

    bangalore, India Recro Full time

    Job Title: Lead GCP Data EngineerLocation: Bengaluru, Karnataka, IndiaExperience: 7-10 yearsResponsibilities:Cloud Analytics Platform :Build and optimize a cloud analytics platform on Google Cloud Platform (GCP) to meet evolving business needs using lean Agile practices.Design and implement solutions for transformation and modernization on GCP.Data...

  • GCP Data Engineer

    3 weeks ago

    bangalore, India Tech Mahindra Full time

    Tech Mahindra hiring GCP Data Engineers for all across IndiaNotice- Immediate/ Early joiners only**Experience- 4+ yearsMust have skills:Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, PythonSend CVs to if eligible.

  • GCP Data Engineer

    1 week ago

    bangalore, India Tech Mahindra Full time

    We are seeking a highly skilled GCP Data Engineer to join our team. The ideal candidate will have extensive experience with Google Cloud Platform (GCP) services, particularly Dataflow, BigQuery, Pub/Sub, and related services. Additionally, the candidate should be proficient in provisioning infrastructure on GCP using Infrastructure as Code (IaC) with...

  • GCP Data Engineer

    4 weeks ago

    bangalore, India Alp Consulting Limited Full time

    Requirement:- Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems. Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and ETL Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big...

  • GCP Data Engineer

    3 weeks ago

    bangalore, India Alp Consulting Limited Full time

    We are seeking a skilled Data Engineer with a specialisation in building robust ETL (Extract, Transform, Load) processes and a strong background in utilising Google Cloud Platform (GCP) services. The ideal candidate should have experience designing, developing, and maintaining data pipelines that facilitate the collection, processing, and storage of large...

  • Senior Data Engineer

    2 months ago

    bangalore, India TecHHire Global Full time

    Job Description : We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP : Must be able to write quality code and build secure, highly available...

  • Senior Data Engineer

    1 week ago

    bangalore, India TecHHire Global Full time

    Job Description : We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP : Must be able to write quality code and build secure, highly available...

  • Senior Data Engineer

    2 months ago

    Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP :Must be able to write quality code and build secure, highly available...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, India TecHHire Global Full time

    Job Description : We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP : Must be able to write quality code and build secure, highly available...

  • Senior Data Engineer

    2 months ago

    Bangalore, India TecHHire Global Full time

    Job Description : We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP : Must be able to write quality code and build secure, highly available...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP :Must be able to write quality code and build secure, highly available...

  • GCP Data Engineer

    3 weeks ago

    bangalore, India Impetus Full time

    Immediate Joiners Preferred3-7 years of IT experience range is preferred.Strong experience in Java programming – Java 8+, SpringBoot, Microservices, REST, Webservices, Hybernate/JPAGood to have knowledge on - Kubernetes basicsAble to effectively use GCP managed services e.g. VMs, Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of...

  • GCP engineer

    4 weeks ago

    Bangalore Urban, India Tekgence Inc Full time

    Role : SME - Sr. Developer GCP Exp : 6 to 11 YrsLocation : PAN IndiaNP : Immediate to 30 DaysSkillsLinux- mandatory, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, Python