GCP Lead Data Engineer

2 days ago

Hyderabad, Telangana, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Lead Data Engineer – Python & GCP

Location - 10+ Years

Job Overview:

We are seeking an experienced
Lead Data Engineer
with strong expertise in
Python
and
Google Cloud Platform (GCP)
. The ideal candidate will lead the end-to-end data engineering lifecycle—from requirement gathering and solution design to development, deployment, and post-delivery support. This role involves designing scalable
ETL/ELT pipelines
, architecting cloud-native solutions, implementing data ingestion & transformation processes, and ensuring data quality across systems.

Experience Level:

10+ years
of relevant IT experience in data engineering and backend development.

Key Responsibilities:

  • Design, develop, test, and maintain scalable ETL/ELT data pipelines using
    Python
    .
  • Architect enterprise-grade data solutions using technologies such as
    Kafka
    ,
    GKE
    , multi-cloud services, load balancers,
    APIGEE
    ,
    DBT
    , LLMs, and
    DLP
    tools.
  • Work extensively with
    GCP services
    , including:
  • Dataflow
    – real-time & batch processing
  • Cloud Functions
    – serverless compute
  • BigQuery
    – data warehousing & analytics
  • Cloud Composer
    – workflow orchestration (Airflow)
  • GCS
    – scalable storage
  • IAM
    – access control & security
  • Cloud Run
    – containerized workloads
  • Build APIs using
    Python FastAPI
    .
  • Work with Big Data and processing technologies:
  • Apache Spark
    ,
    Kafka
    ,
    Airflow
    ,
    MongoDB
    ,
    Redis/Bigtable
  • Perform data ingestion, transformation, cleansing, and validation to ensure high data quality.
  • Implement and enforce data quality checks, monitoring, and validation rules.
  • Collaborate with data scientists, analysts, and engineering teams to understand data needs and deliver solutions.
  • Use
    GitHub
    for version control and support
    CI/CD
    deployments.
  • Write complex SQL queries for relational databases such as
    SQL Server
    ,
    Oracle
    , and
    PostgreSQL
    .
  • Document data pipeline designs, architecture diagrams, and operational procedures.

Required Skills:

  • 10+ years of hands-on experience with
    Python
    in data engineering or backend development.
  • Strong working knowledge of
    GCP
    services (Dataflow, BigQuery, Cloud Functions, Cloud Composer, GCS, Cloud Run).
  • Deep understanding of data pipeline architecture, ETL/ELT processes, and data integration patterns.
  • Experience with
    Apache Spark
    ,
    Kafka
    ,
    Airflow
    ,
    FastAPI
    ,
    Redis/Bigtable
    .
  • Strong SQL skills with at least one enterprise RDBMS (SQL Server, Oracle, PostgreSQL).
  • Experience in on-prem to cloud data migrations.
  • Knowledge of GitHub and
    CI/CD
    best practices.

Good to Have:

  • Experience with
    Snowflake
    .
  • Hands-on knowledge of
    Databricks
    .
  • Familiarity with
    Azure Data Factory (ADF)
    or other Azure data tools.

  • Lead Data Engineer with GCP

    2 weeks ago

    Hyderabad, Telangana, India Egen (Formerly SpringML) Full time ₹ 25,00,000 - ₹ 40,00,000 per year

    Job Overview:We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract,...

  • GCP lead data engineer

    5 days ago

    Hyderabad, Telangana, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Important Note (Please Read Before Applying)DoNOT applyif:You have less than 10 years of experienceYou do not have hands-on GCP 5+ years of experienceYou are on a notice period longer than 15 daysYou are looking for remote onlyYou are a fresher or unrelated background (e.g., support, testing only, non-Java roles) ApplyONLY ifyou meetALLcriteria above....

  • Lead Engineer GCP

    1 day ago

    Hyderabad, Telangana, India Syncarp Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Looking for Lead Engineer / Technical Lead for a Global IT Service Provider based out of Chennai/Bangalore/Hyderabad/Pune Locations.Job Description:Lead Engineer:Exp: 5-8 YearsDesign, develop, and maintain simulation services and tools for ML feature, model, and rule evaluation.Build and optimize data pipelines for point-in-time historical data access and...

  • Lead GCP Data Engineer

    7 days ago

    Hyderabad, Telangana, India Quess Corp Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Exp: 10+ YearsLocation: HyderabadWork Mode: HybridNotice Period: ImmediateMandatory Skills:Bigquery, Google Cloud Storage, GCP, PythonExperience Level:10 to 12 years of relevant IT experienceKey Responsibilities:● Design, develop, test, and maintain scalable ETL data pipelines using Python.● Architect the enterprise solutions with various technologies...

  • Data Engineer

    5 days ago

    Hyderabad, Telangana, India Talescope Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the Role:We are looking for a highly experienced and hands-onGCP Data Engineer(AdTech) to lead our analytics team. This role is ideal for someone with a strong background in log-level data handling, cross-platform data engineering, and a solid command of modern BI tools. You'll play a key role in building scalable data pipelines, leading analytics...

  • GCP Data Engineer

    7 days ago

    Hyderabad, Telangana, India Zetamicron Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    Job Title:GCP Data Engineer (4+ Years Experience)Location:Hyderabad / PuneOpen Positions:3Compensation:Up to₹12 LPA(Based on experience & skills)Must Read Before ApplyingWe are looking forexperienced professionals with a minimum of 4+ yearsinGCP Data Engineering.Only candidates who meet theexperience requirementand possess themandatory skills listed...

  • GCP Data architect

    5 days ago

    Hyderabad, Telangana, India ERM Placement Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role & responsibilitiesWe are seeking a highly skilled GCP professional to lead our team of data architects. The ideal candidate will have 8-10 years of experience in data architecture and design, with a focus on Google Cloud Platform (GCP).The GCP Data Architect will be responsible for managing a team of data engineers and ensuring the successful delivery...

  • GCP Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Estuate Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Job Title : Data Engineer / Integration Engineer Job Summary : We are seeking a highly skilled Data Engineer / Integration Engineer to join our team. The ideal candidate will have expertise in Python, workflow orchestration, cloud platforms (GCP/Google BigQuery), big data frameworks (Apache Spark or similar), API integration, and Oracle EBS. The role...

  • GCP Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Zennial Pro Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title:GCP Data Engineer Location: Hyderabad / Pune Experience: 4+ YearsKey ResponsibilitiesDesign, build, and optimize scalable data pipelines on Google Cloud Platform (GCP) .Work on BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Functions for data ingestion, transformation, and analytics.Develop ETL/ELT processes ensuring data quality,...

  • GCP Data engineer

    1 week ago

    Hyderabad, Telangana, India RSNGINFO SOLUTIONS Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Summary:We are seeking a skilled GCP Data Engineer / Developer to design, build, and optimize scalable data pipelines and applications on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience with BigQuery, PySpark, and Airflow DAGs, with added advantage if they possess Java and ReactJS development experience for...