GCP Data Engineer

6 months ago


PuneHyderabadAnywhere in IndiaMultiple Locations Huquo Full time

Job Description :


Must-Have :

- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.

- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure

- Strong technical expertise in Python and SQL

- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage, Cloud Composer, DataProc, Dataflow, Pub/Sub.

- Experience with Big Data Tools such as Hadoop and Apache Spark (Pyspark)

- Experience Developing DAGs in Apache Airflow 1.10.x or 2. x

- Good Problem-Solving Skills

- Detail Oriented

- Strong Analytical skills working with a large store of Databases and Tables

- Ability to work with geographically diverse teams.

Good to Have :

- Certification in GCP service.

- Experience with Kubernetes.

- Experience with Docker

- Experience with CircleCI for Deployment

- Experience with Great Expectations.

Responsibilities :

- Build Data and ETL pipelines in GCP.

- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Talend, Java

- Interact with customers on daily basis to ensure smooth engagement.

- Responsible for timely and quality deliveries.

- Fulfill organization responsibilities : Sharing knowledge and experience with the other groups in the organization, and conducting various technical training sessions.

Location : Pune, Hyderabad, Remote

Education : Bachelors or Masters (preferably BE/B.Tech) - Computer Science/IT.

(ref:hirist.tech)
  • GCP Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations IT Source Global Full time

    Role : GCP Data EngineerJob Description :Data Pipeline Development : - Design, implement, and maintain scalable data pipelines using GCP services such as Dataflow, Dataproc, and Pub/Sub. - Ensure efficient extraction, transformation, and loading (ETL) of data.Cloud Infrastructure Management : - Manage and optimize GCP data storage and processing...

  • Senior Data Architect

    3 weeks ago


    Anywhere in India/Multiple Locations IT Source Global Full time

    Job Title: GCP Data EngineerData Pipeline Development:As a GCP Data Engineer at IT Source Global, you will design, implement, and maintain scalable data pipelines using GCP services such as Dataflow, Dataproc, and Pub/Sub.Key Responsibilities:Ensure efficient extraction, transformation, and loading (ETL) of data.Implement best practices for data security,...

  • GCP Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations IT Source Global Full time

    Job SummaryIT Source Global is seeking a highly skilled GCP Data Engineer to design and implement scalable data pipelines using GCP services.Data Pipeline DevelopmentDesign and implement efficient data pipelines using GCP services such as Dataflow, Dataproc, and Pub/Sub.Develop and maintain Python scripts and applications to automate data processing...

  • GCP Cloud Engineer

    3 weeks ago


    Pune/Hyderabad/Anywhere in India/Multiple Locations Huquo Full time

    Job Title: GCP Cloud EngineerJob Summary:We are seeking a highly skilled GCP Cloud Engineer to join our team at Huquo. As a GCP Cloud Engineer, you will be responsible for designing and implementing large-scale data pipelines using Google Cloud Platform.Key Responsibilities:Design and implement large-scale data pipelines using GCPSupport migration of data to...


  • Anywhere in India/Multiple Locations Hum Technologies Full time

    About this role:We are seeking a highly skilled GCP Migration Engineer to join our team at Hum Technologies.Key responsibilities:Design and implement GCP infrastructure, including compute, storage, networking, and security components.Migrate applications, databases, and workloads from on-premises to GCP.Optimize GCP resources to ensure cost-efficiency and...


  • Anywhere in India/Multiple Locations DoublU Pty Ltd Full time

    Job Title: Data EngineerJob Overview:We at DoublU Pty Ltd are seeking a skilled and experienced Data Engineer to join our dynamic data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures in Google Cloud Platform (GCP).Key Responsibilities:Design, develop, and implement data...


  • Anywhere in India/Multiple Locations HuQuo Consulting Pvt. Ltd. Full time

    Job Summary:As a Data Engineering Manager at HuQuo Consulting Pvt. Ltd., you will be responsible for driving the design, architecting, and implementing of GCP Cloud-based big data solutions for clients. Your role will involve delivering high-quality solutions by leading design discussions related to Data Ingestion, Transformation & Consumption, Data Storage...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN DoublU Pty Ltd Full time

    Job Overview :We are seeking a skilled GCP Data Engineer to join our dynamic data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures in Google Cloud Platform (GCP). You will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible,...

  • Senior Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations DoublU Pty Ltd Full time

    Job OverviewWe are seeking a skilled GCP Data Engineer to design, build, and maintain scalable data pipelines and architectures in Google Cloud Platform (GCP).The ideal candidate will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible, reliable, and ready for analysis.Key Responsibilities- Design, develop,...


  • Anywhere in India/Multiple Locations Techwaukee Full time

    Job Description:As a Senior Cloud Data Engineer at Techwaukee, you will play a crucial role in designing and implementing scalable data architectures on Google Cloud Platform (GCP).Key Responsibilities:Lead the development of data pipelines using GCP Dataflow and Cloud Pub/Sub.Design and implement data quality frameworks and data governance...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations Hum Technologies Full time

    Company Description : Hum Technologies is a data solutions/AI services company in Noida. We specialize in advance data management, cloud transformation, custom AI Development, and talent management. With a focus on enabling businesses to become data-led enterprises powered by AI, we offer comprehensive solutions to overcome complex data and AI...

  • GCP Data Engineer

    2 weeks ago


    India Mastech InfoTrellis Full time

    Position: GCP Data Engineer Location: Chennai, Tamil Nadu(3 day/week) / (Remote with travel 1 week/ 3 months) Duration: Full Time Service based Company: Mastech InfoTrellis and Mastech Digital Notice Period: 15-45 days (Non negotiable) Job Description: We are seeking a talented and motivated Data Engineer with expertise in Google Cloud...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations Orangeskill Technologies Pvt Ltd Full time

    Job Title: Data EngineerAt Orangeskill Technologies Pvt Ltd, we are seeking a highly skilled Data Engineer to design, build, and maintain data pipelines, workflows, and infrastructure to support efficient data processing and analysis.Key Responsibilities:Design and implement data pipelines for large-scale data processing.Develop and manage workflow...

  • Senior Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations MindBrain Full time

    Job Title :Data Engineering Lead.Location :Remote.Experience : 6+ Years.Contract : 6 Months (Extendable).Key Responsibilities :Design and develop robust data pipelines and ETL processes to handle large volumes of data, ensuring data integrity, consistency, and security.Collaborate with cross-functional teams, including data scientists, analysts, and business...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN Orangeskill Technologies Pvt Ltd Full time

    Job Description :We are looking for a talented and experienced Data Engineer to join our team. You will be responsible for designing, building, and maintaining data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have experience in workflow orchestration tools, database management, data...

  • GCP Data Engineer

    1 month ago


    India Tata Consultancy Services Full time

    Role : GCP Data Engineer Required Technical Skill Set :Airflow , BigQuery, Dataflow, DataProc, Cloud Functions, Cloud Composer, Sql Desired Experience Range: 5 – 7 Years Location of Requirement : Chennai, Bangalore, Kochi, Hyderabad, Mumbai, Pune, Delhi, Trivandrum, Indore, Ahmedabad, Kolkata, BBSR Must-Have Strong and working experience in data...

  • GCP Data Engineer

    2 weeks ago


    pune, India Tata Consultancy Services Full time

    Inviting applications for GCP Data Engineer (5 - 10 years) Location : Pune/ Bengaluru -Google Data Engineer (Overall 5+ Years with 3 years relevant experience in GCP) -Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc etc. -Good...


  • Anywhere in India/Multiple Locations Info Services Full time

    Data EngineerAt Info Services, we're seeking a skilled Data Engineer to drive efficient data solutions across our organization.Main Responsibilities:- Develop and implement scalable data pipelines using big data frameworks like Spark for efficient data processing.- Utilize strong coding skills in Scala, Python, or Java to create high-performance data...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Qualintia solutions Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Qualintia Solutions. As a Data Engineer, you will play a critical role in designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesCollaborate with cross-functional teams to translate business requirements into software solutions.Develop...

  • GCP Data Engineer

    13 hours ago


    Pune, India Tekgence Inc Full time

    1 of our MNC client is looking for GCP Data Engineers on an urgent basis. Kindly find below the details for your reference.Role: GCP Data Engineer (SME - Sr. Developer)Experience: 5 - 10 YearsNotice Period: Immediate - 2 months serving maxBudget: 20 - 32 LPA maxLocation: Pune/Chennai/HyderabadMandate Skills:GCP BigQuery, SQL Scripting & Python coding...