GCP Data Engineer

3 weeks ago


bangalore, India Tech Mahindra Full time

Responsibilities:

• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.

• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.

• Use Pub/Sub for real-time data ingestion and streaming analytics.

• Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed.

• Optimize data storage and retrieval processes to enhance performance and reduce costs.

• Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services.

• Ensure data quality and integrity through robust testing and validation processes.

• Stay updated with the latest GCP features and best practices, integrating them into existing workflows.

• Document data workflows, infrastructure setups, and processes for future reference and knowledge sharing.


Requirements:

• Proven experience as a Data Engineer with a focus on GCP services.

• Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub.

• Hands-on experience with Terraform for provisioning and managing GCP infrastructure.

• Proficiency in SQL and Python for data manipulation and analysis.

• Solid understanding of data warehousing concepts and ETL processes.

• Experience with real-time data processing and streaming analytics.

• Strong problem-solving skills and attention to detail.

• Excellent communication and collaboration skills.


Preferred Qualifications:

• Google Cloud Professional Data Engineer certification.

• Experience with other GCP services like Cloud Storage, Cloud Functions, and Cloud Composer.

• Familiarity with other IaC tools such as Ansible or Cloud Deployment Manager.

• Experience with containerization technologies like Docker and Kubernetes.

• Knowledge of data security and governance practices.


  • Gcp data engineer

    3 weeks ago


    Bangalore, India Tech Mahindra Full time

    Responsibilities: • Design, develop, and maintain data pipelines using GCP services such as Dataflow, Big Query, and Pub/Sub. • Implement and manage data warehouse solutions using Big Query, ensuring data is stored securely and efficiently. • Use Pub/Sub for real-time data ingestion and streaming analytics. • Provision and manage GCP...

  • Gcp data engineer

    1 month ago


    Bangalore, India Tata Consultancy Services Full time

    Role : GCP Data Engineer Required Technical Skill Set : Airflow , Big Query, Dataflow, Data Proc, Cloud Functions, Cloud Composer, Sql Desired Experience Range: 5 – 7 Years Location of Requirement : Chennai, Bangalore, Kochi, Hyderabad, Mumbai, Pune, Delhi, Trivandrum, Indore, Ahmedabad, Kolkata, BBSR Must-Have Strong and working experience in data...

  • GCP Data Engineer

    3 weeks ago


    bangalore, India Tech Mahindra Full time

    Responsibilities: • Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. • Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. • Use Pub/Sub for real-time data ingestion and streaming analytics. • Provision and manage GCP infrastructure...

  • GCP Data Engineer

    3 weeks ago


    bangalore, India Tata Consultancy Services Full time

    Role : GCP Data Engineer Required Technical Skill Set :Airflow , BigQuery, Dataflow, DataProc, Cloud Functions, Cloud Composer, Sql Desired Experience Range: 5 – 7 Years Location of Requirement : Chennai, Bangalore, Kochi, Hyderabad, Mumbai, Pune, Delhi, Trivandrum, Indore, Ahmedabad, Kolkata, BBSR Must-Have Strong and working experience in data migration...

  • GCP Data Engineer

    5 days ago


    Bengaluru / Bangalore, Kolkata, India Zenfinet Solutions Opc Private Limited Full time

    Please find the below JD:Job Title: Data EngineerJob Type: Permanent RoleLocation:Bangalore/Hyderabad/Kolkata/Pune/Noida Inviting applications for the role of Principal / Senior Principal Consultant Google Cloud Platform (GCP) Data Engineer Experience Required - 8 yrs to 12 yrs. In this role, As a GCP Data Engineer a, you will be a key player in...

  • GCP Data Stream

    5 days ago


    Bangalore, India Tekgence Inc Full time

    Mandatory Skills: Azure CI/CD pipeline, GCP Cloud, Terraform, Kubernetes, Dataflow, Big Query , GCP DataStream. Azure Devops (CI/CD pipelines), GCP Cloud, Terraform, Docker, Kubernetes, GitHub actions, scripting ADO, Jenkins, GitHub Location- Pan India, hybrid mode 3 days in a week EXP range- 7-12 Job Role: Senior Cloud Infrastructure Engineer...

  • GCP Data Engineer

    1 month ago


    Bangalore, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full time

    Hello , Greetings from RIDIK, We have opening for position GCP Data Engineer Technical Skills · Overall 3-5 years of professional experience · Experience developing Datapipelines using Dataflow. Integrate with Composer/Airflow or any scheduler Components. · Build and deploy services using Gradle, Maven, Jenkins, GitHubActions etc. as part of CI/CD...

  • Gcp data engineer

    1 month ago


    Bangalore, India RiDiK Full time

    Hello , Greetings from RIDIK, We have opening for position GCP Data Engineer Technical Skills · Overall 3-5 years of professional experience · Experience developing Datapipelines using Dataflow. Integrate with Composer/Airflow or any scheduler Components. · Build and deploy services using Gradle, Maven, Jenkins, Git Hub Actions etc. as part of...

  • GCP Data Engineer

    3 weeks ago


    bangalore, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full time

    Hello , Greetings from RIDIK, We have opening for position GCP Data Engineer Technical Skills · Overall 3-5 years of professional experience · Experience developing Datapipelines using Dataflow. Integrate with Composer/Airflow or any scheduler Components. · Build and deploy services using Gradle, Maven, Jenkins, GitHubActions etc. as part of CI/CD...

  • GCP Data Engineer

    3 weeks ago


    Bangalore Metropolitan Area, India Tech Mahindra Full time

    Responsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...

  • GCP Data Engineer

    4 weeks ago


    Hyderabad/Chennai/Bangalore/Delhi/Kolkata/Mumbai/Pune, India MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Data EngineerWe are looking for a skilled Data Engineer to join our team at MLOPS SOLUTIONS PRIVATE LIMITED. As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data engineering solutions using Google Cloud Platform (GCP).Key Responsibilities :Develop and implement data engineering solutions using standards,...

  • Data Engineer

    1 month ago


    Bangalore, India ALCHEMY TECHSOL INDIA PRIVATE LIMITED Full time

    Job Title: Data EngineerRole: Data Engineer (Hadoop & GCP)Experience: Minimum 5 years of relevant experience.Shift: GeneralModel: Hybrid (2 to 3 days from office)Notice Period: Immediate - 15 daysJob Summary:We are seeking a highly skilled Data Engineer to join our team at Alchemy Techsols India Private Limited. The ideal candidate will have a strong...

  • GCP Data Engineer

    1 month ago


    Bangalore, India CodeVyasa Full time

    Looking for a GCP Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+yrs experience and 4 yrs of experience in GCP. There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into...

  • Gcp data engineer

    1 month ago


    Bangalore, India CodeVyasa Full time

    Looking for a GCP Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+yrs experience and 4 yrs of experience in GCP. There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into...

  • GCP Data Engineer

    2 months ago


    Bangalore, India Elite recruitments Full time

    About the Role : We are seeking a skilled GCP Data Engineer to join our team in Bangalore. The ideal candidate will have a strong foundation in Google Cloud Platform (GCP) and data engineering principles.Key Responsibilities : - Design, develop, and maintain scalable data pipelines using GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud...

  • Sr. Data Engineer-GCP

    2 weeks ago


    bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCP Exp: 4+ Location: Bangalore (Hybrid) Notice: Immediate Joiner Qualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools, including...

  • GCP Data Engineer

    1 month ago


    bangalore, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full time

    Hello ,Greetings from RIDIK,We have opening for position GCP Data EngineerTechnical Skills· Overall 3-5 years of professional experience· Experience developing Datapipelines using Dataflow. Integrate with Composer/Airflow or any scheduler Components.· Build and deploy services using Gradle, Maven, Jenkins, GitHubActions etc. as part of CI/CD process·...

  • GCP Data Lead

    2 weeks ago


    bangalore, India Cygnus Professionals Inc. Full time

    Role: Google Cloud Platform (GCP) Data Lead Location: Bangalore, India (Day 1 Onsite) Job Type: Contract Job Description: Strong GCP experience Prior experience in building pipelines using dataflow, data fusion, data proc, etc Very strong python coding skill Experience in optimising GCP resources for cost and performance Experience in containerisation of...

  • Sr. data engineer-gcp

    2 weeks ago


    Bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCP Exp: 4+ Location: Bangalore (Hybrid) Notice: Immediate Joiner Qualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools,...


  • bangalore, India weITglobal - W.IT.G Consulting AB Full time

    We are looking for a Certified GCP Data Engineer who is proficient in leveraging Google Cloud Platform (GCP) services to build and manage robust data pipelines. This is a fully remote role, where you will work on implementing data solutions, optimizing cloud infrastructure, and delivering data insights to support business needs. Key Responsibilities: -...