GCP Data Engineer

2 months ago

bangalore, India Tech Mahindra Full time

Responsibilities:

• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.

• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.

• Use Pub/Sub for real-time data ingestion and streaming analytics.

• Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed.

• Optimize data storage and retrieval processes to enhance performance and reduce costs.

• Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services.

• Ensure data quality and integrity through robust testing and validation processes.

• Stay updated with the latest GCP features and best practices, integrating them into existing workflows.

• Document data workflows, infrastructure setups, and processes for future reference and knowledge sharing.


Requirements:

• Proven experience as a Data Engineer with a focus on GCP services.

• Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub.

• Hands-on experience with Terraform for provisioning and managing GCP infrastructure.

• Proficiency in SQL and Python for data manipulation and analysis.

• Solid understanding of data warehousing concepts and ETL processes.

• Experience with real-time data processing and streaming analytics.

• Strong problem-solving skills and attention to detail.

• Excellent communication and collaboration skills.


Preferred Qualifications:

• Google Cloud Professional Data Engineer certification.

• Experience with other GCP services like Cloud Storage, Cloud Functions, and Cloud Composer.

• Familiarity with other IaC tools such as Ansible or Cloud Deployment Manager.

• Experience with containerization technologies like Docker and Kubernetes.

• Knowledge of data security and governance practices.

  • Gcp data engineer

    2 months ago

    Bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for GCP Data Engineer Desired Experience Range: 5+ Years Job Location: Gurgaon / Bangalore / Pune/ Chennai / Mumbai Key responsibilities: As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and...

  • GCP Data Engineer

    2 months ago

    bangalore, India Tech Mahindra Full time

    Responsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...

  • Gcp data engineer

    3 weeks ago

    Bangalore, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as GCP Data Engineer. Experience Required: 5+ years. Location: Bengaluru, Karnataka, India Responsibilities: Big Query Development & Optimization: Write and optimize complex SQL queries for efficient data processing and retrieval in Big Query. Analyze query performance and implement...

  • GCP Data Engineer

    2 months ago

    Bangalore Metropolitan Area, India Tech Mahindra Full time

    Responsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...

  • Gcp data quality observability engineer

    2 weeks ago

    Bangalore, India Tredence Inc. Full time

    Role - GCP Dev Ops Observability Engineer Overall Experience:8 + years Relevant: 3+ years Hybrid role from Bangalore, Chennai, Pune, Gurgaon, Kolkata Required Skills - Cloud(GCP) Observability(logs, metrics, and traces), Dev Ops, Terraform, Python We are seeking a highly skilled Data Observability Engineer with 6+ years of experience to join...

  • Apptad Inc. | GCP Data Engineer | bangalore

    4 weeks ago

    bangalore, India Apptad Inc. Full time

    Job Title: GCP Data Engineer - Teradata, ETLJob Location: BangaloreJob Type: PermanentKey Responsibilities:Data Engineering on Google Cloud Platform (GCP):Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub.Implement and optimize ETL processes to ensure efficient data transformation...

  • GCP Data Quality Observability Engineer

    2 weeks ago

    Bangalore, India Tredence Inc. Full time

    Role - GCP DevOps Observability Engineer Overall Experience:8 + years Relevant: 3+ years Hybrid role from Bangalore, Chennai, Pune, Gurgaon, Kolkata Required Skills - Cloud(GCP) Observability(logs, metrics, and traces), DevOps, Terraform, Python We are seeking a highly skilled Data Observability Engineer with 6+ years of experience to join...

  • Apptad Inc. | GCP Data Engineer | bangalore

    4 weeks ago

    bangalore, India Apptad Inc. Full time

    Job Title: GCP Data Engineer - Teradata, ETL Job Location: Bangalore Job Type: Permanent Key Responsibilities: Data Engineering on Google Cloud Platform (GCP): Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub. Implement and optimize ETL processes to ensure efficient data...

  • Apptad Inc. | GCP Data Engineer | bangalore

    4 weeks ago

    bangalore, India Apptad Inc. Full time

    Job Title: GCP Data Engineer - Teradata, ETLJob Location: BangaloreJob Type: PermanentKey Responsibilities:Data Engineering on Google Cloud Platform (GCP):Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub.Implement and optimize ETL processes to ensure efficient data transformation and...

  • Gcp data quality observability engineer

    2 weeks ago

    Bangalore, India Tredence Inc. Full time

    Role - GCP Dev Ops Observability Engineer Overall Experience: 10+ years Relevant: 3+ years Hybrid role from Bangalore, Chennai, Pune, Gurgaon, Kolkata Required Skills - Cloud(GCP) Observability(logs, metrics, and traces), Dev Ops, Terraform, Python Roles and Responsibilities Lead the overall technical strategy for Cloud Observability...

  • Deloitte | GCP Data Engineer | bangalore

    1 month ago

    bangalore, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as GCP Data Engineer.Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaResponsibilities:BigQuery Development & Optimization:Write and optimize complex SQL queries for efficient data processing and retrieval in BigQuery.Analyze query performance and implement optimization techniques...

  • Deloitte | GCP Data Engineer | bangalore

    1 month ago

    bangalore, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as GCP Data Engineer. Experience Required: 5+ years. Location: Bengaluru, Karnataka, India Responsibilities: BigQuery Development & Optimization: Write and optimize complex SQL queries for efficient data processing and retrieval in BigQuery. Analyze query performance and implement optimization...

  • Deloitte | GCP Data Engineer | bangalore

    1 month ago

    bangalore, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as GCP Data Engineer.Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaResponsibilities:BigQuery Development & Optimization:Write and optimize complex SQL queries for efficient data processing and retrieval in BigQuery.Analyze query performance and implement optimization techniques...

  • Cloud Data Architect for GCP

    4 weeks ago

    Bangalore/Chennai, India MNR Solutions Private Limited Full time

    Job Summary: We are seeking an experienced Cloud Data Architect to join our team at MNR Solutions Private Limited. As a Cloud Data Architect, you will be responsible for designing and implementing scalable data models and architecture on Google Cloud Platform (GCP).About the Role: The ideal candidate will have 8-10 years of experience in data modeling and...

  • Tredence Inc. | GCP Data Quality Observability Engineer

    2 weeks ago

    bangalore, India Tredence Inc. Full time

    Role - GCP DevOps Observability EngineerOverall Experience:8+ yearsRelevant: 3+ yearsHybrid role from Bangalore, Chennai, Pune, Gurgaon, KolkataRequired Skills - Cloud(GCP) Observability(logs, metrics, and traces), DevOps, Terraform, PythonWe are seeking a highly skilled Data Observability Engineer with 6+ years of experience to join our team. This role will...

  • Gcp engineer

    2 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    TCS Greeting!! Desired Competencies (Technical/Behavioral Competency) Must-Have · 5+ years of hands on experience on programming Java + Spark on processing unstructured data · Sound knowledge on Big Query and SQL · 3+ years of hands on experience on working on GCP Platform · Strong experiencing on designing, developing & performance tuning of...

  • Data engineer

    2 months ago

    Bangalore, India Tech Mahindra Full time

    is for GCP Data Engineer. If you're an experienced professional looking for an exciting new challenge. We want to hear from you! Please apply to with your resume explaining your experience and qualifications. Location : Pan India GCP Data Engineer : U2 – up to 3 years Primary Skill : Big Querry, Data flow, Data Composer, SQL,...

  • Data Engineer

    1 month ago

    bangalore, India Tech Mahindra Full time

    Tech Mahindra is #hiring for GCP Data Engineer .If you're an experienced professional looking for an exciting new challenge.We want to hear from you! Please apply to with your resume explaining your experience and qualifications.Location : Pan IndiaGCP Data Engineer : U2 – up to 3 yearsPrimary Skill : Big Querry, Data flow, Data Composer, SQL,...

  • Data Engineer

    1 month ago

    Bangalore, India Tech Mahindra Full time

    is for GCP Data Engineer . If you're an experienced professional looking for an exciting new challenge. We want to hear from you! Please apply to with your resume explaining your experience and qualifications. Location : Pan India GCP Data Engineer : U2 – up to 3 years Primary Skill : Big Querry, Data flow, Data Composer, SQL,...

  • Data Engineer

    1 month ago

    bangalore, India Tech Mahindra Full time

    Tech Mahindra is #hiring for GCP Data Engineer .If you're an experienced professional looking for an exciting new challenge.We want to hear from you! Please apply to BA00858299@TechMahindra.com with your resume explaining your experience and qualifications.Location: Pan IndiaGCP Data Engineer : U2 – up to 3 yearsPrimary Skill : Big Querry, Data flow, Data...