GCP Data Engineer

2 months ago


Mumbai, India Quantiphi Full time

Designation: Data Engineer

Experience Level: 4-16 Years

Location: Mumbai/Bangalore/Trivandrum


Role & Responsibilities:

  • In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable
  • Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB
  • Solid understanding of relational database concepts and technologies such as SQL, MySQL, PostgreSQL, or Oracle.
  • Hands-on experience with other cloud platforms and services such as AWS RDS, or Azure SQL Database.
  • Experience with NoSQL databases such as MongoDB, Scylla, Cassandra, or DynamoDB is a plus.
  • Familiarity with database performance tuning, optimization, and troubleshooting techniques is a plus
  • Strong working experience on one or more of the Big Data/Hadoop distributions (or ecosystems) like, Cloudera/Hortonworks, MapR, Azure HDInsight, IBM Open platform, Kafka, Hive, Spark etc.
  • Good understanding of the following AWS Data services, Redshift, RDS, Athena or SQS/Kinesis
  • Good understanding of Native and external tables, with different file formats : Avro, ORC, Parquet
  • CI/CD pipelines for data workloads using Cloud Build, Artifact Registry, Terraform
  • Data governance solutioning using GCP governance tooling (Dataplex, Data Catalog)


Skills required:

  • GCP Dataflow, Pub/Sub, Cloud Composer, Cloud Workflow, BigQuery, Cloud Run, CloudBuild
  • Must have: programming knowledge and willingness to be hands-on - Python, Java
  • Specialization on streaming such as PubSub or Kafka or equivalent


Good to have:

  • Experience in BigQuery or Presto or Equivalent
  • Experience with open source ecosystem and distributions such as Hadoop, Spark, Cloudera/Hortonworks and frameworks and tech such as SPARK, Oozie, Kafka, HBASE
  • Understanding and experience with NoSQL databases such as HBASE, MongoDB, Cassandra
  • Knowledge of cloud databases such as Spanner, BigTable, Cloud SQL, DB migrations
  • Good to have GCP Data engineering Certification


  • GCP Data Engineer

    4 weeks ago


    mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: - In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable - Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB - Solid...

  • GCP Data Engineer

    2 months ago


    Mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB Solid...

  • Gcp data engineer

    2 months ago


    Mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big Table Must have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DB Solid...

  • GCP Data Engineer

    1 month ago


    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:- In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable- Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB- Solid understanding of...

  • Gcp data engineer

    1 month ago


    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big TableMust have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DBSolid understanding of...

  • GCP Data Engineer

    2 months ago


    mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB Solid understanding of...

  • GCP Data Engineer

    2 months ago


    mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of...


  • Mumbai, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Data Architect

    6 months ago


    Mumbai, India Hopes Forever Consultancy Full time

    From 11 to 17 year(s) of experience - ₹ Not Disclosed by Recruiter - Mumbai*** Roles and Responsibilities **One of Our Client **(CMMi level technology company) is urgently looking out for **Data Architect -GCP (11+ years exp) for Full Time Position for Mumbai /Kolkata (**2 Days in a week)** who can start immediately Or within 15 days NP** **Need someone...


  • Mumbai, Maharashtra, India Quantiphi Full time

    About the RoleWe are seeking an experienced GCP Data Engineer to join our team at Quantiphi. In this role, you will design and develop scalable data systems on Google Cloud Platform.Key Responsibilities:Design and implement data pipelines using GCP services such as BigQuery, Dataflow, and Pub/Sub.Develop and maintain large-scale data processing applications...

  • Data Scientist

    6 months ago


    Mumbai, Maharashtra, India VAYUZ Technologies Private Limited Full time

    Fetching data from Bigquey and other data sources to design and develop machine learning models using Python and frameworks such as TensorFlow and Keras - Strong knowledge on major Regression/Classification/Forecasting/Unsupervised learning and Natural Language processing algorithms. - Experience in Deep Learning, Transfer Learning, State of the art BERT...


  • Mumbai, Maharashtra, India RBL BANK LIMITED Full time

    At RBL Bank Limited, we are seeking an exceptional Data Solutions Architect to join our team in Airoli Mumbai. This is a challenging and rewarding role that requires a strong background in data engineering, architecture design, and cloud computing.Estimated salary for this position is around ₹25,00,000 - ₹35,00,000 per annum, depending on...


  • Mumbai, Maharashtra, India Capgemini Full time

    Job SummaryWe are seeking a highly skilled Cloud Data Infrastructure Specialist to join our team at Capgemini. As a key member of our data engineering team, you will design, build, and maintain our data infrastructure using Google Cloud Platform (GCP) technologies.About the RoleYou will be responsible for ensuring data quality, integrity, and security across...


  • Mumbai, India IKS Health Full time

    What will you be responsible for? ● The ideal candidate will oversee end to end data pipeline stack, including design, development, testing, documenting and deploying the pipeline, by following the defined/proven data engineering practices in a cloud based environment (GCP). ● As principal you will provide subject matter expertise in Pipeline...


  • mumbai, India IKS Health Full time

    What will you be responsible for? ● The ideal candidate will oversee end to end data pipeline stack, including design, development, testing, documenting and deploying the pipeline, by following the defined/proven data engineering practices in a cloud based environment (GCP). ● As principal you will provide subject matter expertise in Pipeline...


  • mumbai, India IKS Health Full time

    What will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...


  • Mumbai, India IKS Health Full time

    What will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...

  • Gcp

    6 months ago


    Airoli, Navi Mumbai, Maharashtra, India Triangle Global Full time

    "5 - 7 years of experience with GCP services and tools. Experience with one or more of these solutions: Google App Engine, Cloud Function, Cloud run or open source software communities. Knowledge of core data structures and concepts: MVCC, CI/CD Pipelines, HTTP Protocol, web frameworks and common web technologies. Basic System/Network Administrator level...

  • Gcp

    1 month ago


    Mumbai, India Deloitte Full time

    We are looking for Candidates who are having experience as GCP.Experience Required: 3+ years.Location: PAN IndiaResponsibilities:Develop scalable data pipelines using GCP tools such as Dataflow, Dataproc, Big Query, Composer, and Dataplex.Write efficient Java/Python code and complex SQL queries for data processing, extraction, transformation, and loading...

  • Data Engineer

    4 weeks ago


    mumbai, India Zyoin Group Full time

    Location : Mumbai WFO Position : Data Engineer Experience : 1-3 Years Mandatory Skills: Python, Scala, Spark, GCP, Apache Email ID for CV sharing : nikita.rai@zyoin.com Responsibilities: ● Design, develop, and maintain scalable and robust data pipelines on Google Cloud Platform (GCP). ● Implement data processing solutions using Spark/Apache beam for...