GCP Lead Data Engineer

2 weeks ago

Hyderabad, Telangana, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Lead Data Engineer – Python & GCP

Location - 10+ Years

Job Overview:

We are seeking an experienced
Lead Data Engineer
with strong expertise in
Python
and
Google Cloud Platform (GCP)
. The ideal candidate will lead the end-to-end data engineering lifecycle—from requirement gathering and solution design to development, deployment, and post-delivery support. This role involves designing scalable
ETL/ELT pipelines
, architecting cloud-native solutions, implementing data ingestion & transformation processes, and ensuring data quality across systems.

Experience Level:

10+ years
of relevant IT experience in data engineering and backend development.

Key Responsibilities:

  • Design, develop, test, and maintain scalable ETL/ELT data pipelines using
    Python
    .
  • Architect enterprise-grade data solutions using technologies such as
    Kafka
    ,
    GKE
    , multi-cloud services, load balancers,
    APIGEE
    ,
    DBT
    , LLMs, and
    DLP
    tools.
  • Work extensively with
    GCP services
    , including:
  • Dataflow
    – real-time & batch processing
  • Cloud Functions
    – serverless compute
  • BigQuery
    – data warehousing & analytics
  • Cloud Composer
    – workflow orchestration (Airflow)
  • GCS
    – scalable storage
  • IAM
    – access control & security
  • Cloud Run
    – containerized workloads
  • Build APIs using
    Python FastAPI
    .
  • Work with Big Data and processing technologies:
  • Apache Spark
    ,
    Kafka
    ,
    Airflow
    ,
    MongoDB
    ,
    Redis/Bigtable
  • Perform data ingestion, transformation, cleansing, and validation to ensure high data quality.
  • Implement and enforce data quality checks, monitoring, and validation rules.
  • Collaborate with data scientists, analysts, and engineering teams to understand data needs and deliver solutions.
  • Use
    GitHub
    for version control and support
    CI/CD
    deployments.
  • Write complex SQL queries for relational databases such as
    SQL Server
    ,
    Oracle
    , and
    PostgreSQL
    .
  • Document data pipeline designs, architecture diagrams, and operational procedures.

Required Skills:

  • 10+ years of hands-on experience with
    Python
    in data engineering or backend development.
  • Strong working knowledge of
    GCP
    services (Dataflow, BigQuery, Cloud Functions, Cloud Composer, GCS, Cloud Run).
  • Deep understanding of data pipeline architecture, ETL/ELT processes, and data integration patterns.
  • Experience with
    Apache Spark
    ,
    Kafka
    ,
    Airflow
    ,
    FastAPI
    ,
    Redis/Bigtable
    .
  • Strong SQL skills with at least one enterprise RDBMS (SQL Server, Oracle, PostgreSQL).
  • Experience in on-prem to cloud data migrations.
  • Knowledge of GitHub and
    CI/CD
    best practices.

Good to Have:

  • Experience with
    Snowflake
    .
  • Hands-on knowledge of
    Databricks
    .
  • Familiarity with
    Azure Data Factory (ADF)
    or other Azure data tools.

  • Gcp Data Engineer

    1 week ago

    Hyderabad, Telangana, India People Prime Worldwide Full time

    Role : GCP Data EngineerExperience : 10 to 15 YearsWork Mode : HybridLocation : HyderabadJob Overview:We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing,...

  • Lead Data Engineer GCP

    3 weeks ago

    Hyderabad, Telangana, India, Telangana Egen Full time

    Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract,...

  • GCP Data Engineer

    1 week ago

    Hyderabad, Telangana, India LTIMindtree Full time

    Job DescriptionEXP YearsNP-Immediate to 60daysLocation Pan India.Data projects Good Knowledge of GCP Big query SQL Python dataflow skills Has worked in Implementation projects building data pipelines transformation logics and data models Responsibility:• GCP Data Engineer Belongs to Data Management Engineering• Education Bachelor of engineering in any...

  • GCP Data Engineer

    1 week ago

    Hyderabad, Telangana, India Quess Corp Limited Full time

    Job Title:GCP Data EngineerLocation:HyderabadExperience:5–10 YearsEmployment Type:Full-timeExperience: 5-10 yearsGCP, Hadoop, Pyspark, BigQueryCandidate should be a team player and will be interacting with client on regular basis.Job Description:We are looking for a skilledGCP Data Engineerto design, build, and manage scalable data pipelines and analytics...

  • GCP Data Engineering – Lead Programmer Analyst

    2 weeks ago

    Hyderabad, Telangana, India Bilvantis Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Description: GCP Data Engineering – Lead Programmer AnalystWe are looking for a highly skilled and experienced GCP Data Engineer as a Lead Programmer Analyst.Experience should have 5 to 7 years of data engineering.Should have strong development skills in GCP services like BigQuery, DataProc, Dataflow, Dataform.Should have good knowledge in SQL.Should...

  • Gcp Data Engineer

    7 days ago

    Hyderabad, Telangana, India People Prime Worldwide Full time

    We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) &...

  • GCP Data Engineer

    3 minutes ago

    Hyderabad, Telangana, India People Prime Worldwide Full time

    Our client is a trusted global innovator of IT and business services. They help clients transform through consulting, industry solutions, business process services, digital & IT modernization and managed services. Our client enables them, as well as society, to move confidently into the digital future. We are committed to our clients' long-term success and...

  • GCP Data Engineer

    1 week ago

    Hyderabad, Telangana, India, Telangana LTIMindtree Full time

    Job Description EXP - 5-12 YearsNP-Immediate to 60daysLocation Pan India.Data projects Good Knowledge of GCP Big query SQL Python dataflow skills Has worked in Implementation projects building data pipelines transformation logics and data models Responsibility: • GCP Data Engineer Belongs to Data Management Engineering • Education Bachelor of...

  • GCP Tech Lead

    2 weeks ago

    Hyderabad, Telangana, India Tekshiras Software Services Private Limited Full time US$ 6,00,000 - US$ 15,00,000 per year

    GCP Tech Lead - Job DescriptionKey Responsibilities :In this role, you will:Provide technical leadership  for a team of engineers that focus on development, deployment and operationsLead and contribute  to multiple pods with moderate resource requirements, risk, and/or complexityInterface technically  with a range of stakeholders with customer and...

  • GCP Data engineer

    3 weeks ago

    Hyderabad, Telangana, India, Telangana Tata Consultancy Services Full time

    We await your innovation at TCS: Hiring | GCP Data Engineer|Greetings from TCS!! We are Hiring for GCP Data EngineerRequired Experience: 5-10 yearsWork location: Hyderabad, Chennai, Bangalore, DelhiSkills: GCP, Big Query, Dataflow, Data Proc, Cloud SQL, Cloud Spanner, Pub/Sub, ETL, Apache airflow, Python, Pandas and NumphyJD: Google Data Engineer (Overall 5+...