Lead GCP Data Engineer

4 weeks ago


india EXL Full time

As a Lead GCP Data Engineer, you will be responsible for data migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable sector-specific use cases. Your responsibilities will involve technology adoptions pertaining to AI/ML, Generative AI, Advanced analytics, serverless and service driven ecosystem for data led and AI enabled digital transformations.

Expert proficiency in operationalization of data pipelines, warehouses, data lakes, analytics platforms and activation services on GCP is crucial. We are looking for professionals with solid experience on design, delivery, and implementation of GCP infrastructure.


Work Location – Pune (Hybrid)

Experience - 8 to 10 Years

Must have skills:

  • 8+ years of proven experience as a Lead in Big Data Engineering .
  • Mandatory Technical Proficiency - Hands-on experience with Python , PySpark , Google Cloud Full Stack , SQL , DevOps , Databricks , DBT & Terraform .
  • Experience with Google Cloud Services such as Streaming +Batch, Cloud Storage, Cloud Dataflow, Data Proc, Big Query & Big Table
  • Proven real-time exposure and use of contemporary data mining, cloud computing, and data management ecosystems like Google Cloud, Hadoop, HDFS, and Spark.
  • Proficient in Data Modelling that can represent complex data structures while ensuring accuracy, consistency, and efficiency; data warehousing , and ETL processes .
  • Ability to perform system analysis and assessment of existing Systems Design and operating methodologies leveraging in-depth knowledge of big data technologies and ecosystems.
  • Experience with GitHub, Anaplan, Looker & Power BI,
  • Excellent problem-solving skills and the ability to address complex technical challenges.
  • Strong communication and leadership skills.


Good to have:

  • Experience with Apigee, Apollo GraphQL.
  • Experience with Quality Assurance, Agile , Documentation & Presentation.
  • Experience with serverless Data warehousing concepts,
  • Knowledge of Snowflake , ML - Machine Learning, Gen AI (LLMs), Marketing activation.


Role & Responsibilities:

  • Accountable for overall technical implementations and management of respective engineering POD
  • Liaise with Foundry on solutions design; Agile Project Manager on planning & estimation; Engineers on task assignment; Business stakeholders on prioritization
  • Streamline workflows and orchestrate Data pipelines .
  • Automate deployments and facilitate MTQ/MTP through CI-CD/DevOps
  • Conduct code reviews, automate regression tests, and facilitate data reloads.
  • Participate in requirements gathering and architectural discussions.
  • Responsible for the Overall Quality of Engineering builds and Architecture.
  • Technical Leadership: Lead creation of technical design/specifications and provide technical leadership and guidance to development teams, promoting best practices. Provide expertise in Master Data Management, Reference Data Management, Data Quality , Meta Data Management , and Data Governance in General.
  • Programming Hands on: Develop and maintain software components using Python , PySpark , and GCP services to process and analyze large datasets efficiently. Build data pipelines and perform data transformations.
  • Enforce consistent standards and quality through end-to-end review of all artifacts (incl. BRD, HLD, LLD, Data Models, STTMs, UI-UX, NFRs, Code, Test, PBI architecture design)
  • POC and Pilot of new reusable frameworks, tools & technologies.
  • Evaluate the newest technologies for optimization opportunities and future enhancement needs like self-serve and ad hoc reporting. Implement necessary infrastructure for optimal and efficient ETL from disparate data.
  • Performance Optimization : Identify and address performance bottlenecks, ensuring the system meets required throughput and latency targets.
  • Security and Compliance : Ensure that data solutions adhere to security and compliance standards, implementing necessary controls and encryption mechanisms.
  • Scalability : Architect scalable and highly available data solutions, considering both batch and real-time processing.
  • Documentation : Create and maintain comprehensive technical documentation to support the development and maintenance of data solutions


  • india PURVIEW Full time

    Role: Lead Data Engineer with GCP Location: Pune or Hyderabad (Onsite) Job Type: Contract (Permanent to Purview Services) Experience Level - 8 to 12 Years NOTE: Client will accept immediate joiners or 1 Month Notice period candidates only. Job description: Technical leadership for a team of engineers that focus on development, deployment and operations...

  • GCP Data Engineer

    1 month ago


    india LTIMindtree Full time

    Job Title: GCP Sr. Data Engineer Experience: 5-12 years Education: Bachelor of engineering in any discipline/equivalent Location: Bangalore, Chennai, Mumbai, Pune, Kolkata, Hyderabad, Delhi Desired Candidate Profile Job Description: Overall, more than 5+ Yrs of experience in Data projects. Good Knowledge of GCP Bigquery, SQL, Python, dataflow skills....

  • GCP Data Engineer

    4 weeks ago


    india TekWissen India Full time

    Role: GCP Data Engineer Location: Chennai, India Experience: 4+ years Notice Period: Immediate to 15 days joiners Position Description: We are looking for an experienced data engineer to join our growing software engineering product team responsible for supporting finished vehicle logistics at Client Motor Company. As a team member of this product team...

  • GCP Data Engineer

    1 month ago


    india Tech Mahindra Full time

    GCP Data Engineer – 6 years of experience in GCP and Big Query, Cloud Storage Strong python programming experience in using Google Cloud python client libraries Strong SQL and data analysis skills Proficient ETL/ELT experience in workflows, data modelling and data pipelines

  • GCP Data Engineer

    1 month ago


    india Tech Mahindra Full time

    Tech Mahindra hiring GCP Data Engineers for all across India Notice- Immediate/ Early joiners only** Experience- 4+ years Must have skills: Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, Python Send CVs to if eligible.

  • GCP Data Engineer

    1 month ago


    india Enterprise Minds, Inc Full time

    Job title : GCP Data Engineer Location : Pune Mode : Hybrid Model Job Description: Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on programming with Python / Scala Proficiency with latest Hadoop, HDFS, Sqoop HANDS ON GCP Data Flow module is required Good Experience with Apache...


  • India IKAI Technology Solutions Full time

    We are seeking a talented Big Data + GCP Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will collaborate closely with cross-functional teams to ensure that our data platform meets the needs of our business...


  • india IKAI Technology Solutions Full time

    We are seeking a talented Big Data + GCP Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will collaborate closely with cross-functional teams to ensure that our data platform meets the needs of our business...


  • India IKAI Technology Solutions Full time

    We are seeking a talented Big Data + GCP Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will collaborate closely with cross-functional teams to ensure that our data platform meets the needs of our business...

  • GCP Data Engineer

    1 month ago


    India Idyllic Services Pvt. Ltd. Full time

    Job Title - GCP Data Engineer Skill - Data Engineer, Python, Scala & GCPLocation – Pune & Hyderabad* Must have an understanding of Python / Scala / Java and related commonly used packages, especially with GCP.* Hands-on experience in Data migration and data processing on the Google Cloud stack, specifically: Big Query, Cloud Dataflow, Cloud DataProc, Cloud...

  • GCP Data Engineer

    6 days ago


    India Idyllic Services Pvt. Ltd. Full time

    Job Title - GCP Data Engineer Skill - Data Engineer, Python, Scala & GCP Location – Pune & Hyderabad Must have an understanding of Python / Scala / Java and related commonly used packages, especially with GCP. Hands-on experience in Data migration and data processing on the Google Cloud stack, specifically: Big Query, Cloud Dataflow, Cloud DataProc, Cloud...

  • Data Engineer

    4 weeks ago


    india Mindverse Consulting Services Full time

    Job Description For our Client we are looking for Data Engineer (GCP) ✔️Responsibilities: Working alongside Platform Engineers to assess and choose suitable technologies and tools for the projectR&D, maintenance, and monitoring of the platform's componentsImplementing intricate data intake proceduresConstructing efficient data modelsImplementing and...

  • Lead Data Engineer

    3 weeks ago


    india QuEST Global Full time

    Applicants can submit CV direct to Email : Sunil Chandran ; Experience : 6 - 12 Years Responsibilities: Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses. Design and develop microservices to Collaborate with data scientists, analysts, and...

  • GCP Data Engineer

    4 weeks ago


    india Impetus Full time

    Immediate Joiners Preferred 3-7 years of IT experience range is preferred. Strong experience in Java programming – Java 8+, SpringBoot, Microservices, REST, Webservices, Hybernate/JPA Good to have knowledge on - Kubernetes basics Able to effectively use GCP managed services e.g. VMs, Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At...

  • GCP Data Engineer

    6 days ago


    India Huquo Full time

    Job Description :Must-Have : 5+ Years of Experience in Data Engineering and building and maintaining largescale data pipelines. Experience with designing and implementing a largescale Data-Lake on Cloud Infrastructure Strong technical expertise in Python and SQL Extremely wellversed in Google Compute Platform including BigQuery, Cloud Storage, Cloud...

  • GCP Data Architect

    6 days ago


    India Huquo Full time

    Role : GCP Data Architect Description : As a GCP Data Architect, you will be responsible for architecting enterprise data solutions for migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to...

  • GCP Data Architect

    4 weeks ago


    india EXL Full time

    As a GCP Data Engineer Architect, you will be responsible for architecting enterprise data solutions for migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable sector-specific use cases. Your...

  • GCP Data Engineer

    2 months ago


    india InfoBeans Full time

    Good development experience in GCP Data flow with Java Exposure to Cloud databases like GCP big query, Postgres Good SQL, No-SQL knowledge Exposure to other cloud technologies like S3, Snowflake, Salesforce etc is a plus Good Communication skill (written/spoken)

  • GCP Data Engineer

    2 months ago


    india Persistent Systems Full time

    About Position: As a GCP Data Engineer with strong experience in Python, Google Cloud and Bigquery Role: GCP Data Engineer Location: Mumbai Experience: 4-8 years Job Type: Full Time Employment What You'll Do: Establish data model design based on business requirements. Should be hands on. Develop end to end streaming and batch data analytics pipelines....

  • GCP Data Engineer

    6 days ago


    India Sequantix Full time

    You should know what it takes to design, develop, and deliver high quality software. You will use and promote modern software engineering principles, encouraging utilization of proper tools and increase automation to enable our business outcomes. More specifically we are looking for software engineers experts in Java, Python , JavaScript, , REACT and...