Principal gcp data engineer

1 month ago

Mumbai, India IKS Health Full time
What will you be responsible for?
● The ideal candidate will oversee end to end data pipeline stack, including design, development,
testing, documenting and deploying the pipeline, by following the defined/proven data engineering
practices in a cloud based environment (GCP).
● As principal you will provide subject matter expertise in Pipeline Architecture, Standards and
Practices, for designing, developing, implementing and monitoring enterprise wide secured and
scalable solutions.
● Contribute to Architecture and Design to create a robust and secure Data platform
● Defining integration solutions, creating technology roadmaps and creating an end-to-end plan for
enterprise level projects/initiatives/migrations.
● Mentor team to stay on top of the latest evolving technological suites like Delta Lake, Iceberg,
Data Fabric, Data Ops, Data Mesh, Streaming Data Processing, Data Governance etc
● Hire the right talent, build, recognize & retain talent to create a professional culture with IKS
defined values within the team.
● Support to establish SLAs, KPIs and recommend measurement and improvement of processes.
● Create a strong monitoring platform for all the live interfaces for proactive alerting models and
administer the interface engine for assured availability.
● Provide and implement continuous improvements & recommendations on new processes,
policies for software development and management.
● Deliver data-driven & complex solutions with a customer-first mindset with multicultural and global
teams in different time zones.
● Creating and managing a sustainable, self organized, cross-functional and a collaborative team
that follows the best practices of Agile methodology.
What would your day look like?
● Understanding the domain, IKS feature clusters, business, functional and non-functional feature
requirements.
● Create, support and own artifacts : Architecture, Solution Design, Interface Deployment, Interface
Mapping and Transformation logics, Business Context, Data Flow diagrams and others.
● Influencing the culture of delivering high values to the internal and external customers using Agile
methodologies.
● Proactive measures to resolve the possible risks in any of the projects and programs.
● Support leadership team with proper business and technical updates/progress.
Who are we looking for?
● The ideal candidate should have 10+ years of experience in building and deploying data
pipelines
● Masters/Bachelors Degree in Computer Science, Software Engineering, or related field.
● Minimum 5+ years of experience in working using data components like Apache Beam, Py Spark,
Serverless Offering from Cloud (like Lambda, Cloud Functions), Data Warehouse, ETL
Orchestration Tools (like Apache Airflow, Control-M)
● Experience in any of the Cloud Platforms (preferably Google Cloud)
● Proficient in SQL and No SQL databases (e.g., My SQL, Postgre SQL, Mongo DB, Redis).
● Familiar with CI/CD pipelines, Docker and data as a service concepts.
● Strong understanding of Data Modeling concepts for analytics and transactional systems
● Strong problem-solving and analytical abilities with excellent written & verbal communication
skills.
● Experience in managing tactical operations to achieve successful delivery with a customer-first
mindset.
● Led complex technical development and migration projects from concept to completion.
● Designed scalable systems capable of handling high volumes of data and traffic (both batch and
streaming)
● Experience working with multicultural and global teams in different time zones.
● Nice to have experience: Exposure to Healthcare industry with understanding of lifecycle and
terminologies
Exp: 12-18 yrs
Location: Remote

  • Principal gcp data engineer

    1 month ago

    Mumbai, India IKS Health Full time

    What will you be responsible for? ● The ideal candidate will oversee end to end data pipeline stack, including design, development, testing, documenting and deploying the pipeline, by following the defined/proven data engineering practices in a cloud based environment (GCP). ● As principal you will provide subject matter expertise in Pipeline...

  • Principal GCP Data Engineer

    1 month ago

    mumbai, India IKS Health Full time

    What will you be responsible for? ● The ideal candidate will oversee end to end data pipeline stack, including design, development, testing, documenting and deploying the pipeline, by following the defined/proven data engineering practices in a cloud based environment (GCP). ● As principal you will provide subject matter expertise in Pipeline...

  • Principal GCP Data Engineer

    1 month ago

    mumbai, India IKS Health Full time

    What will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...

  • Principal GCP Data Engineer

    1 month ago

    Mumbai, India IKS Health Full time

    What will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...

  • Principal GCP Data Engineer

    1 month ago

    mumbai, India IKS Health Full time

    What will you be responsible for? ● The ideal candidate will oversee end to end data pipeline stack, including design, development, testing, documenting and deploying the pipeline, by following the defined/proven data engineering practices in a cloud based environment (GCP). ● As principal you will provide subject matter expertise in Pipeline...

  • GCP Data Engineer

    4 weeks ago

    mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: - In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable - Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB - Solid...

  • GCP Data Engineer

    2 months ago

    Mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB Solid...

  • Gcp data engineer

    2 months ago

    Mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big Table Must have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DB Solid...

  • GCP Data Engineer

    1 month ago

    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:- In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable- Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB- Solid understanding of...

  • Gcp data engineer

    1 month ago

    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big TableMust have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DBSolid understanding of...

  • Principal data engineer

    1 month ago

    Mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer: Experience: 10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments. Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of...

  • Principal Data Engineer

    4 weeks ago

    mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:- 10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.- Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of...

  • Principal Data Engineer

    1 month ago

    mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer: Experience: - 10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments. - Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of...

  • Principal Data Engineer

    1 month ago

    Mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:- 10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.- Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of...

  • GCP Data Engineer

    2 months ago

    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of...

  • GCP Data Engineer

    2 months ago

    mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB Solid understanding of...

  • GCP Data Engineer

    2 months ago

    mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of...

  • Principal Data Engineer

    1 month ago

    mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end...

  • Principal Data Engineer

    1 month ago

    Mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end...

  • Principal data engineer

    1 month ago

    Mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end...