Gcp Data Engineer

3 days ago

Hyderabad, Telangana, India Mobilution It Systems Full time

Required Qualifications

  • Expert-level Python for backend/data engineering
  • Hands-on GCP: Dataflow, BigQuery, Cloud Composer/Airflow, Cloud Functions, Cloud Run, GCS, IAM
  • Design and development of ETL/ELT pipelines (batch and streaming)
  • Apache Spark for large-scale processing
  • Apache Kafka for messaging/streaming
  • Orchestration with Airflow/Cloud Composer (DAG design, scheduling, monitoring)
  • Strong SQL with enterprise RDBMS (SQL Server, Oracle, PostgreSQL)
  • Git/GitHub and CI/CD for data projects
  • Deployments on GKE and Cloud Run; understanding of autoscaling and load balancers
  • API development with Python FastAPI; APIGEE proxy management
  • Data quality frameworks, validation rules, monitoring/observability
  • Security: IAM roles/policies, data redaction, DLP
  • Data ingestion from varied sources; transformation and cleansing
  • Documentation of pipelines, data flows, and operations
  • Experience migrating on-prem data to cloud

Responsibilities

  • Design, develop, test, and maintain scalable ETL/ELT data pipelines in Python
  • Architect data solutions using Kafka, GCP services (Dataflow, BigQuery, Composer/Airflow, Functions, Cloud Run/GKE, GCS, IAM), dbt, and related tools
  • Implement streaming and batch processing; ensure autoscaling, reliability, and cost efficiency
  • Develop and manage Airflow/Cloud Composer DAGs for orchestration (scheduling, monitoring, alerting)
  • Build APIs with FastAPI and manage APIs via APIGEE; integrate load balancers when required
  • Ingest data from diverse sources; apply transformation, cleansing, and enrichment
  • Implement data quality checks, validation rules, observability, and monitoring
  • Apply security best practices including IAM, data redaction, and DLP
  • Write and optimize complex SQL for extraction, validation, and analytics
  • Manage code in GitHub; implement CI/CD pipelines for data workloads
  • Deploy and operate workloads on GKE and Cloud Run
  • Collaborate with data science/analytics teams to deliver fit-for-purpose data products
  • Create and maintain documentation of pipeline designs, data flows, and operational runbooks
  • Lead or contribute to on-prem to cloud data migration initiatives

  • GCP Data Engineer

    1 week ago

    Hyderabad, Telangana, India LTIMindtree Full time

    Job DescriptionEXP YearsNP-Immediate to 60daysLocation Pan India.Data projects Good Knowledge of GCP Big query SQL Python dataflow skills Has worked in Implementation projects building data pipelines transformation logics and data models Responsibility:• GCP Data Engineer Belongs to Data Management Engineering• Education Bachelor of engineering in any...

  • GCP Data Engineer

    1 week ago

    Hyderabad, Telangana, India Quess Corp Limited Full time

    Job Title:GCP Data EngineerLocation:HyderabadExperience:5–10 YearsEmployment Type:Full-timeExperience: 5-10 yearsGCP, Hadoop, Pyspark, BigQueryCandidate should be a team player and will be interacting with client on regular basis.Job Description:We are looking for a skilledGCP Data Engineerto design, build, and manage scalable data pipelines and analytics...

  • Gcp Data Engineer

    1 week ago

    Hyderabad, Telangana, India People Prime Worldwide Full time

    Role : GCP Data EngineerExperience : 10 to 15 YearsWork Mode : HybridLocation : HyderabadJob Overview:We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing,...

  • GCP Data Engineer

    1 week ago

    Hyderabad, Telangana, India, Telangana LTIMindtree Full time

    Job Description EXP - 5-12 YearsNP-Immediate to 60daysLocation Pan India.Data projects Good Knowledge of GCP Big query SQL Python dataflow skills Has worked in Implementation projects building data pipelines transformation logics and data models Responsibility: • GCP Data Engineer Belongs to Data Management Engineering • Education Bachelor of...

  • GCP Data engineer

    2 weeks ago

    Hyderabad, Telangana, India, Telangana Tata Consultancy Services Full time

    We await your innovation at TCS: Hiring | GCP Data Engineer|Greetings from TCS!! We are Hiring for GCP Data EngineerRequired Experience: 5-10 yearsWork location: Hyderabad, Chennai, Bangalore, DelhiSkills: GCP, Big Query, Dataflow, Data Proc, Cloud SQL, Cloud Spanner, Pub/Sub, ETL, Apache airflow, Python, Pandas and NumphyJD: Google Data Engineer (Overall 5+...

  • Gcp Data Engineer

    7 days ago

    Hyderabad, Telangana, India People Prime Worldwide Full time

    We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) &...

  • GCP Data Engineer

    1 day ago

    Hyderabad, Telangana, India HSBC Full time

    Some careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...

  • GCP Data Engineer

    1 day ago

    Hyderabad, Telangana, India HSBC Full time

    Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and...

  • GCP Lead Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Lead Data Engineer – Python & GCPLocation - 10+ YearsJob Overview:We are seeking an experiencedLead Data Engineerwith strong expertise inPythonandGoogle Cloud Platform (GCP). The ideal candidate will lead the end-to-end data engineering lifecycle—from requirement gathering and solution design to development, deployment, and post-delivery support. This...

  • Senior manager GCP Data Engineer

    7 days ago

    Hyderabad, Telangana, India Technogen Full time

    Position: Senior Manager Data Engineering (Google Cloud Platform)Location: HyderabadExperience:13-18 years in data engineering, cloud data solutions, or enterprise data management.Minimum 3–5 years of experience delivering large-scale data integration or analytics projects in GCP.Technical Skills:Strong expertise with GCP services – BigQuery, Cloud...