Principal gcp data engineer

1 month ago

Mumbai, India IKS Health Full time

What will you be responsible for? ● The ideal candidate will oversee end to end data pipeline stack, including design, development, testing, documenting and deploying the pipeline, by following the defined/proven data engineering practices in a cloud based environment (GCP). ● As principal you will provide subject matter expertise in Pipeline Architecture, Standards and Practices, for designing, developing, implementing and monitoring enterprise wide secured and scalable solutions. ● Contribute to Architecture and Design to create a robust and secure Data platform ● Defining integration solutions, creating technology roadmaps and creating an end-to-end plan for enterprise level projects/initiatives/migrations. ● Mentor team to stay on top of the latest evolving technological suites like Delta Lake, Iceberg, Data Fabric, Data Ops, Data Mesh, Streaming Data Processing, Data Governance etc ● Hire the right talent, build, recognize & retain talent to create a professional culture with IKS defined values within the team. ● Support to establish SLAs, KPIs and recommend measurement and improvement of processes. ● Create a strong monitoring platform for all the live interfaces for proactive alerting models and administer the interface engine for assured availability. ● Provide and implement continuous improvements & recommendations on new processes, policies for software development and management. ● Deliver data-driven & complex solutions with a customer-first mindset with multicultural and global teams in different time zones. ● Creating and managing a sustainable, self organized, cross-functional and a collaborative team that follows the best practices of Agile methodology. What would your day look like? ● Understanding the domain, IKS feature clusters, business, functional and non-functional feature requirements. ● Create, support and own artifacts : Architecture, Solution Design, Interface Deployment, Interface Mapping and Transformation logics, Business Context, Data Flow diagrams and others. ● Influencing the culture of delivering high values to the internal and external customers using Agile methodologies. ● Proactive measures to resolve the possible risks in any of the projects and programs. ● Support leadership team with proper business and technical updates/progress. Who are we looking for? ● The ideal candidate should have 10+ years of experience in building and deploying data pipelines ● Masters/Bachelors Degree in Computer Science, Software Engineering, or related field. ● Minimum 5+ years of experience in working using data components like Apache Beam, Py Spark, Serverless Offering from Cloud (like Lambda, Cloud Functions), Data Warehouse, ETL Orchestration Tools (like Apache Airflow, Control-M) ● Experience in any of the Cloud Platforms (preferably Google Cloud) ● Proficient in SQL and No SQL databases (e.g., My SQL, Postgre SQL, Mongo DB, Redis). ● Familiar with CI/CD pipelines, Docker and data as a service concepts. ● Strong understanding of Data Modeling concepts for analytics and transactional systems ● Strong problem-solving and analytical abilities with excellent written & verbal communication skills. ● Experience in managing tactical operations to achieve successful delivery with a customer-first mindset. ● Led complex technical development and migration projects from concept to completion. ● Designed scalable systems capable of handling high volumes of data and traffic (both batch and streaming) ● Experience working with multicultural and global teams in different time zones. ● Nice to have experience: Exposure to Healthcare industry with understanding of lifecycle and terminologies Exp: 12-18 yrs Location: Remote

  • Principal GCP Data Engineer

    1 month ago

    mumbai, India IKS Health Full time

    What will you be responsible for? ● The ideal candidate will oversee end to end data pipeline stack, including design, development, testing, documenting and deploying the pipeline, by following the defined/proven data engineering practices in a cloud based environment (GCP). ● As principal you will provide subject matter expertise in Pipeline...

  • Principal GCP Data Engineer

    1 month ago

    mumbai, India IKS Health Full time

    What will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...

  • Principal gcp data engineer

    1 month ago

    Mumbai, India IKS Health Full time

    What will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...

  • Principal GCP Data Engineer

    1 month ago

    Mumbai, India IKS Health Full time

    What will you be responsible for?● The ideal candidate will oversee end to end data pipeline stack, including design, development,testing, documenting and deploying the pipeline, by following the defined/proven data engineeringpractices in a cloud based environment (GCP).● As principal you will provide subject matter expertise in Pipeline Architecture,...

  • Principal GCP Data Engineer

    1 month ago

    mumbai, India IKS Health Full time

    What will you be responsible for? ● The ideal candidate will oversee end to end data pipeline stack, including design, development, testing, documenting and deploying the pipeline, by following the defined/proven data engineering practices in a cloud based environment (GCP). ● As principal you will provide subject matter expertise in Pipeline...

  • GCP Data Engineer

    4 weeks ago

    mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: - In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable - Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB - Solid...

  • GCP Data Engineer

    2 months ago

    Mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB Solid...

  • Gcp data engineer

    2 months ago

    Mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big Table Must have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DB Solid...

  • GCP Data Engineer

    1 month ago

    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:- In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable- Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB- Solid understanding of...

  • Gcp data engineer

    1 month ago

    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big TableMust have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DBSolid understanding of...

  • Principal data engineer

    1 month ago

    Mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer: Experience: 10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments. Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of...

  • Principal Data Engineer

    4 weeks ago

    mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:- 10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.- Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of...

  • Principal Data Engineer

    1 month ago

    mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer: Experience: - 10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments. - Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of...

  • Principal Data Engineer

    1 month ago

    Mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:- 10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.- Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of...

  • GCP Data Engineer

    2 months ago

    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of...

  • GCP Data Engineer

    2 months ago

    mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB Solid understanding of...

  • GCP Data Engineer

    2 months ago

    mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of...

  • Principal Data Engineer

    1 month ago

    mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end...

  • Principal Data Engineer

    1 month ago

    Mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end...

  • Principal data engineer

    1 month ago

    Mumbai, India Sony Pictures Networks India Full time

    Principal Data Engineer:Experience:10-12 years of deep technical experience in data engineering, primarily focusing on high-tech or cloud-based environments.Extensive expertise in building, maintaining, and optimizing large-scale data platforms and pipelines. Must have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end...