Principal GCP Data Engineer

5 days ago


Kollam, India IKS Health Full time

What will you be responsible for?

● The ideal candidate will oversee end to end data pipeline stack, including design, development,

testing, documenting and deploying the pipeline, by following the defined/proven data engineering

practices in a cloud based environment (GCP).

● As principal you will provide subject matter expertise in Pipeline Architecture, Standards and

Practices, for designing, developing, implementing and monitoring enterprise wide secured and

scalable solutions.

● Contribute to Architecture and Design to create a robust and secure Data platform

● Defining integration solutions, creating technology roadmaps and creating an end-to-end plan for

enterprise level projects/initiatives/migrations.

● Mentor team to stay on top of the latest evolving technological suites like Delta Lake, Iceberg,

Data Fabric, DataOps, Data Mesh, Streaming Data Processing, Data Governance etc

● Hire the right talent, build, recognize & retain talent to create a professional culture with IKS

defined values within the team.

● Support to establish SLAs, KPIs and recommend measurement and improvement of processes.

● Create a strong monitoring platform for all the live interfaces for proactive alerting models and

administer the interface engine for assured availability.

● Provide and implement continuous improvements & recommendations on new processes,

policies for software development and management.


● Deliver data-driven & complex solutions with a customer-first mindset with multicultural and global

teams in different time zones.

● Creating and managing a sustainable, self organized, cross-functional and a collaborative team

that follows the best practices of Agile methodology.


What would your day look like?

● Understanding the domain, IKS feature clusters, business, functional and non-functional feature

requirements.

● Create, support and own artifacts : Architecture, Solution Design, Interface Deployment, Interface

Mapping and Transformation logics, Business Context, Data Flow diagrams and others.

● Influencing the culture of delivering high values to the internal and external customers using Agile

methodologies.

● Proactive measures to resolve the possible risks in any of the projects and programs.

● Support leadership team with proper business and technical updates/progress.


Who are we looking for?

● The ideal candidate should have 10+ years of experience in building and deploying data

pipelines

● Masters/Bachelors Degree in Computer Science, Software Engineering, or related field.

● Minimum 5+ years of experience in working using data components like Apache Beam, PySpark,

Serverless Offering from Cloud (like Lambda, Cloud Functions), Data Warehouse, ETL

Orchestration Tools (like Apache Airflow, Control-M)

● Experience in any of the Cloud Platforms (preferably Google Cloud)

● Proficient in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Redis).

● Familiar with CI/CD pipelines, Docker and data as a service concepts.

● Strong understanding of Data Modeling concepts for analytics and transactional systems

● Strong problem-solving and analytical abilities with excellent written & verbal communication

skills.

● Experience in managing tactical operations to achieve successful delivery with a customer-first

mindset.

● Led complex technical development and migration projects from concept to completion.

● Designed scalable systems capable of handling high volumes of data and traffic (both batch and

streaming)

● Experience working with multicultural and global teams in different time zones.

● Nice to have experience: Exposure to Healthcare industry with understanding of lifecycle and

terminologies


Exp: 12-18 yrs


Location: Remote


  • GCP DevOps Engineer

    3 weeks ago


    Kollam, Kerala, India Zemoso Technologies Full time

    DevOps Engineer - GCPWe're seeking a skilled DevOps Engineer to join our team at Zemoso Technologies. As a DevOps practitioner, you'll be responsible for providing DevSecOps services to our customers and internal Dev teams.Key Responsibilities:Design and implement CI/CD pipelines using Cloud Build and Cloud DeployProvision and manage GCP resources, including...

  • Data Engineer

    1 month ago


    Kollam, India Tricog Health Full time

    Key Responsibilities:● Design, develop, and optimize complex SQL queries to transform and extract insights from large datasets.● Build and maintain scalable ETL pipelines using Python to ingest, process, and load data from various sources into our data lake and data warehouse.● Implement best practices for data governance, data quality, and data...


  • Kollam, India Intuitive.Cloud Full time

    About us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...

  • Data Engineer

    4 weeks ago


    Kollam, India BytesCraft Full time

    Job Title: Data Engineer Location: Ahmedabad Experience: 3-4 yearsJob Overview:We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have hands-on experience with Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Microsoft Fabric. This role will involve designing, developing, and...

  • AI - Data Engineer

    4 weeks ago


    kollam, India 2coms Full time

    Hiring for Trainer profile for Data EngineerData Architecture and Design: Develop and maintain data architectures including data models data warehouses and data lakes to support AI and machine learning initiatives.Data Pipeline Development: Design and implement data pipelines to extract transform and load (ETL) data from various sources into a centralized...

  • AI - Data Engineer

    3 weeks ago


    kollam, India 2coms Full time

    Hiring for Trainer profile for Data EngineerData Architecture and Design: Develop and maintain data architectures including data models data warehouses and data lakes to support AI and machine learning initiatives.Data Pipeline Development: Design and implement data pipelines to extract transform and load (ETL) data from various sources into a centralized...

  • AI - Data Engineer

    2 months ago


    Kollam, India 2coms Full time

    Hiring for Trainer profile for Data EngineerData Architecture and Design: Develop and maintain data architectures including data models data warehouses and data lakes to support AI and machine learning initiatives.Data Pipeline Development: Design and implement data pipelines to extract transform and load (ETL) data from various sources into a centralized...

  • AI - Data Engineer

    2 months ago


    Kollam, India 2coms Full time

    Hiringfor Trainer profile for DataEngineerDataArchitecture and Design: Develop and maintain data architecturesincluding data models data warehouses and data lakes to support AIand machine learninginitiatives.DataPipeline Development: Design and implement data pipelines toextract transform and load (ETL) data from various sources into acentralized system...

  • Senior Data Engineer

    2 weeks ago


    Kollam, Kerala, India Evolutyz Corp Full time

    **Job Summary**Evolutyz Corp is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data management team, you will be responsible for designing, developing, and maintaining ETL processes using SSIS or other ETL tools to extract data from various sources, transform it according to business rules, and load it into target...

  • Data Engineer

    6 days ago


    Kollam, Kerala, India 2coms Full time

    {"Requirements": "To excel in this role, you should have a strong background in computer science or a related field. A minimum of 5 years of experience in data engineering or a related role is required. Additionally, a bachelor's degree or master's degree in a relevant field is preferred.**Key Skills:**- Strong understanding of data architectures and...


  • Kollam, India INFINIMINDS Full time

    Key Responsibilities:1. Pre-Sales Responsibilities:Engage with potential clients to understand their data needs, challenges, and objectives.Lead discovery sessions, gather requirements, and develop high-level solution architectures for data and analytics initiatives.Prepare and present compelling proposals, solution demos, and proof of concepts that...

  • Data Engineer

    4 weeks ago


    Kollam, India Pitch N Hire Full time

    Tech Skills Details for IICS LeadPrior experience as an IICS LeadExtensive experience with IDCS (Oracle Identity Cloud Service)Hands-on experience with Informatica CloudProficiency in programming languages such as SQLStrong experience in data modelling, data warehousing, and database managementHaving knowledge of cloud platforms (e.g., AWS, Azure, Google...

  • Data Engineer

    2 weeks ago


    Kollam, Kerala, India 2coms Full time

    Data Engineer - AI SpecialistAt 2coms, we are seeking a highly skilled Data Engineer - AI Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data architectures and pipelines to support our AI initiatives.Data Architecture and Design: Develop and maintain...

  • Data Engineer

    3 weeks ago


    Kollam, Kerala, India 2coms Full time

    Data Engineer - AI SpecialistAt 2coms, we're seeking a highly skilled Data Engineer - AI Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data architectures and systems to support our AI and machine learning initiatives.Key Responsibilities:Design and...

  • Data Engineer

    2 weeks ago


    Kollam, Kerala, India 2coms Full time

    Data Engineering for AI and Machine LearningData engineers at 2coms play a crucial role in developing and maintaining data architectures that support AI and machine learning initiatives. Key responsibilities include designing and implementing data pipelines to extract, transform, and load data from various sources into a centralized system. This involves...


  • kollam, India Addepar Full time

    Work Location - BengaluruThe RoleJoin Addepar’s innovative data and intelligence initiatives! We're seeking a Software Engineer to craft and build an AI/ML Ops platform from the ground up, enabling our teams to scale AI/ML solutions efficiently!What You’ll DoBuild and scale a comprehensive platform, accelerating AI adoption across teams.Use core Addepar...

  • Software Engineer

    2 months ago


    Kollam, India Aptonet Inc Full time

    Job Title: Backend (Spring Boot, J2EE, Microservices, Cloud –offshore)100% Remote Long term 12+ Month Technical SkillsOverall 3-7 years of professional experienceExperience developing microservices and cloud native apps using Java/J2EE, REST APIs, Spring Core, Spring MVC Framework, Spring Boot Framework JPA (Java Persistence API) (Or any other ORM), Spring...

  • AI Data Architect

    4 weeks ago


    Kollam, Kerala, India 2coms Full time

    Job Title: AI Data EngineerJob SummaryWe are seeking an experienced AI Data Engineer to join our team at 2coms. The successful candidate will be responsible for designing and implementing data architectures, data pipelines, and data integration solutions to support AI and machine learning initiatives.Key ResponsibilitiesDevelop and maintain data...

  • Big Data Developer

    4 weeks ago


    kollam, India Amossys Consulting Services Full time

    Position Title: Data EngineerExperience Required: 5+ years Employment Type: Full-time Employment Mode: HybridLocation: Bangalore, Pune, Trivandrum.Industry: Banking & Insurance sectorJob Summary:We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong...


  • Kollam, Kerala, India Evolutyz Corp Full time

    At Evolutyz Corp, we are seeking a highly skilled Data Warehouse Specialist to join our team. The ideal candidate will have a strong background in data management principles and a techno-functional knowledge of data governance, data architecture, data profiling, data analysis, and data quality validation.The successful candidate will be responsible for...