Principal GCP Data Engineer

1 month ago

mumbai, India IKS Health Full time

What will you be responsible for?

● The ideal candidate will oversee end to end data pipeline stack, including design, development,

testing, documenting and deploying the pipeline, by following the defined/proven data engineering

practices in a cloud based environment (GCP).

● As principal you will provide subject matter expertise in Pipeline Architecture, Standards and

Practices, for designing, developing, implementing and monitoring enterprise wide secured and

scalable solutions.

● Contribute to Architecture and Design to create a robust and secure Data platform

● Defining integration solutions, creating technology roadmaps and creating an end-to-end plan for

enterprise level projects/initiatives/migrations.

● Mentor team to stay on top of the latest evolving technological suites like Delta Lake, Iceberg,

Data Fabric, DataOps, Data Mesh, Streaming Data Processing, Data Governance etc

● Hire the right talent, build, recognize & retain talent to create a professional culture with IKS

defined values within the team.

● Support to establish SLAs, KPIs and recommend measurement and improvement of processes.

● Create a strong monitoring platform for all the live interfaces for proactive alerting models and

administer the interface engine for assured availability.

● Provide and implement continuous improvements & recommendations on new processes,

policies for software development and management.


● Deliver data-driven & complex solutions with a customer-first mindset with multicultural and global

teams in different time zones.

● Creating and managing a sustainable, self organized, cross-functional and a collaborative team

that follows the best practices of Agile methodology.


What would your day look like?

● Understanding the domain, IKS feature clusters, business, functional and non-functional feature

requirements.

● Create, support and own artifacts : Architecture, Solution Design, Interface Deployment, Interface

Mapping and Transformation logics, Business Context, Data Flow diagrams and others.

● Influencing the culture of delivering high values to the internal and external customers using Agile

methodologies.

● Proactive measures to resolve the possible risks in any of the projects and programs.

● Support leadership team with proper business and technical updates/progress.


Who are we looking for?

● The ideal candidate should have 10+ years of experience in building and deploying data

pipelines

● Masters/Bachelors Degree in Computer Science, Software Engineering, or related field.

● Minimum 5+ years of experience in working using data components like Apache Beam, PySpark,

Serverless Offering from Cloud (like Lambda, Cloud Functions), Data Warehouse, ETL

Orchestration Tools (like Apache Airflow, Control-M)

● Experience in any of the Cloud Platforms (preferably Google Cloud)

● Proficient in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Redis).

● Familiar with CI/CD pipelines, Docker and data as a service concepts.

● Strong understanding of Data Modeling concepts for analytics and transactional systems

● Strong problem-solving and analytical abilities with excellent written & verbal communication

skills.

● Experience in managing tactical operations to achieve successful delivery with a customer-first

mindset.

● Led complex technical development and migration projects from concept to completion.

● Designed scalable systems capable of handling high volumes of data and traffic (both batch and

streaming)

● Experience working with multicultural and global teams in different time zones.

● Nice to have experience: Exposure to Healthcare industry with understanding of lifecycle and

terminologies


Exp: 12-18 yrs


Location: Remote

  • Principal gcp data engineer

    1 month ago

    Mumbai, India IKS Health Full time

    What will you be responsible for? ● The ideal candidate will oversee end to end data pipeline stack, including design, development, testing, documenting and deploying the pipeline, by following the defined/proven data engineering practices in a cloud based environment (GCP). ● As principal you will provide subject matter expertise in Pipeline...

  • Principal GCP Data Engineer

    1 month ago

    mumbai, India IKS Health Full time

    What will you be responsible for? ● The ideal candidate will oversee end to end data pipeline stack, including design, development, testing, documenting and deploying the pipeline, by following the defined/proven data engineering practices in a cloud based environment (GCP). ● As principal you will provide subject matter expertise in Pipeline...

  • Principal GCP Data Engineer

    1 month ago

    mumbai, India IKS Health Full time

    What will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...

  • Principal gcp data engineer

    1 month ago

    Mumbai, India IKS Health Full time

    What will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...

  • Principal GCP Data Engineer

    1 month ago

    Mumbai, India IKS Health Full time

    What will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...

  • GCP Data Engineer

    4 weeks ago

    mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: - In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable - Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB - Solid...

  • GCP Data Engineer

    2 months ago

    Mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB Solid...

  • Gcp data engineer

    2 months ago

    Mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big Table Must have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DB Solid...

  • GCP Data Engineer

    1 month ago

    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:- In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable- Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB- Solid understanding of...

  • Gcp data engineer

    1 month ago

    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big TableMust have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DBSolid understanding of...

  • GCP Data Engineer

    2 months ago

    mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB Solid understanding of...

  • GCP Data Engineer

    2 months ago

    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of...

  • Principal data engineer

    1 month ago

    Mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer: Experience: 10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments. Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of...

  • Principal Data Engineer

    4 weeks ago

    mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:- 10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.- Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of...

  • Principal Data Engineer

    1 month ago

    mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer: Experience: - 10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments. - Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of...

  • Principal Data Engineer

    1 month ago

    Mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:- 10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.- Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of...

  • GCP Data Engineer

    2 months ago

    mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of...

  • Principal Data Engineer

    1 month ago

    mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end...

  • Principal Data Engineer

    1 month ago

    Mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end...

  • Principal data engineer

    1 month ago

    Mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end...