GCP Data Engineer
2 months ago
Designation: Data Engineer
Experience Level: 4-16 Years
Location: Mumbai/Bangalore/Trivandrum
Role & Responsibilities:
- In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable
- Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB
- Solid understanding of relational database concepts and technologies such as SQL, MySQL, PostgreSQL, or Oracle.
- Hands-on experience with other cloud platforms and services such as AWS RDS, or Azure SQL Database.
- Experience with NoSQL databases such as MongoDB, Scylla, Cassandra, or DynamoDB is a plus.
- Familiarity with database performance tuning, optimization, and troubleshooting techniques is a plus
- Strong working experience on one or more of the Big Data/Hadoop distributions (or ecosystems) like, Cloudera/Hortonworks, MapR, Azure HDInsight, IBM Open platform, Kafka, Hive, Spark etc.
- Good understanding of the following AWS Data services, Redshift, RDS, Athena or SQS/Kinesis
- Good understanding of Native and external tables, with different file formats : Avro, ORC, Parquet
- CI/CD pipelines for data workloads using Cloud Build, Artifact Registry, Terraform
- Data governance solutioning using GCP governance tooling (Dataplex, Data Catalog)
Skills required:
- GCP Dataflow, Pub/Sub, Cloud Composer, Cloud Workflow, BigQuery, Cloud Run, CloudBuild
- Must have: programming knowledge and willingness to be hands-on - Python, Java
- Specialization on streaming such as PubSub or Kafka or equivalent
Good to have:
- Experience in BigQuery or Presto or Equivalent
- Experience with open source ecosystem and distributions such as Hadoop, Spark, Cloudera/Hortonworks and frameworks and tech such as SPARK, Oozie, Kafka, HBASE
- Understanding and experience with NoSQL databases such as HBASE, MongoDB, Cassandra
- Knowledge of cloud databases such as Spanner, BigTable, Cloud SQL, DB migrations
- Good to have GCP Data engineering Certification
-
GCP Data Engineer
4 weeks ago
mumbai, India Quantiphi Full timeDesignation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: - In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable - Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB - Solid...
-
GCP Data Engineer
2 months ago
Mumbai, India Quantiphi Full timeDesignation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB Solid...
-
Gcp data engineer
2 months ago
Mumbai, India Quantiphi Full timeDesignation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big Table Must have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DB Solid...
-
GCP Data Engineer
1 month ago
Mumbai, India Quantiphi Full timeDesignation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:- In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable- Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB- Solid understanding of...
-
Gcp data engineer
1 month ago
Mumbai, India Quantiphi Full timeDesignation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big TableMust have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DBSolid understanding of...
-
GCP Data Engineer
2 months ago
Mumbai, India Quantiphi Full timeDesignation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of...
-
GCP Data Engineer
2 months ago
mumbai, India Quantiphi Full timeDesignation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of...
-
Data Warehouse Engineer
2 weeks ago
Mumbai, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Architect
6 months ago
Mumbai, India Hopes Forever Consultancy Full timeFrom 11 to 17 year(s) of experience - ₹ Not Disclosed by Recruiter - Mumbai*** Roles and Responsibilities **One of Our Client **(CMMi level technology company) is urgently looking out for **Data Architect -GCP (11+ years exp) for Full Time Position for Mumbai /Kolkata (**2 Days in a week)** who can start immediately Or within 15 days NP** **Need someone...
-
GCP Cloud Engineer with Big Data Expertise
1 week ago
Mumbai, Maharashtra, India Quantiphi Full timeAbout the RoleWe are seeking an experienced GCP Data Engineer to join our team at Quantiphi. In this role, you will design and develop scalable data systems on Google Cloud Platform.Key Responsibilities:Design and implement data pipelines using GCP services such as BigQuery, Dataflow, and Pub/Sub.Develop and maintain large-scale data processing applications...
-
Data Scientist
6 months ago
Mumbai, Maharashtra, India VAYUZ Technologies Private Limited Full timeFetching data from Bigquey and other data sources to design and develop machine learning models using Python and frameworks such as TensorFlow and Keras - Strong knowledge on major Regression/Classification/Forecasting/Unsupervised learning and Natural Language processing algorithms. - Experience in Deep Learning, Transfer Learning, State of the art BERT...
-
Data Solutions Architect
2 weeks ago
Mumbai, Maharashtra, India RBL BANK LIMITED Full timeAt RBL Bank Limited, we are seeking an exceptional Data Solutions Architect to join our team in Airoli Mumbai. This is a challenging and rewarding role that requires a strong background in data engineering, architecture design, and cloud computing.Estimated salary for this position is around ₹25,00,000 - ₹35,00,000 per annum, depending on...
-
Cloud Data Infrastructure Specialist
3 weeks ago
Mumbai, Maharashtra, India Capgemini Full timeJob SummaryWe are seeking a highly skilled Cloud Data Infrastructure Specialist to join our team at Capgemini. As a key member of our data engineering team, you will design, build, and maintain our data infrastructure using Google Cloud Platform (GCP) technologies.About the RoleYou will be responsible for ensuring data quality, integrity, and security across...
-
Principal gcp data engineer
1 month ago
Mumbai, India IKS Health Full timeWhat will you be responsible for? ● The ideal candidate will oversee end to end data pipeline stack, including design, development, testing, documenting and deploying the pipeline, by following the defined/proven data engineering practices in a cloud based environment (GCP). ● As principal you will provide subject matter expertise in Pipeline...
-
Principal GCP Data Engineer
1 month ago
mumbai, India IKS Health Full timeWhat will you be responsible for? ● The ideal candidate will oversee end to end data pipeline stack, including design, development, testing, documenting and deploying the pipeline, by following the defined/proven data engineering practices in a cloud based environment (GCP). ● As principal you will provide subject matter expertise in Pipeline...
-
Principal GCP Data Engineer
1 month ago
mumbai, India IKS Health Full timeWhat will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...
-
Principal gcp data engineer
1 month ago
Mumbai, India IKS Health Full timeWhat will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...
-
Gcp
6 months ago
Airoli, Navi Mumbai, Maharashtra, India Triangle Global Full time"5 - 7 years of experience with GCP services and tools. Experience with one or more of these solutions: Google App Engine, Cloud Function, Cloud run or open source software communities. Knowledge of core data structures and concepts: MVCC, CI/CD Pipelines, HTTP Protocol, web frameworks and common web technologies. Basic System/Network Administrator level...
-
Gcp
1 month ago
Mumbai, India Deloitte Full timeWe are looking for Candidates who are having experience as GCP.Experience Required: 3+ years.Location: PAN IndiaResponsibilities:Develop scalable data pipelines using GCP tools such as Dataflow, Dataproc, Big Query, Composer, and Dataplex.Write efficient Java/Python code and complex SQL queries for data processing, extraction, transformation, and loading...
-
Principal GCP Data Engineer
1 month ago
Mumbai, India IKS Health Full timeWhat will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...