Principal GCP Data Engineer

1 month ago


Kollam, India IKS Health Full time

What will you be responsible for?

● The ideal candidate will oversee end to end data pipeline stack, including design, development,

testing, documenting and deploying the pipeline, by following the defined/proven data engineering

practices in a cloud based environment (GCP).

● As principal you will provide subject matter expertise in Pipeline Architecture, Standards and

Practices, for designing, developing, implementing and monitoring enterprise wide secured and

scalable solutions.

● Contribute to Architecture and Design to create a robust and secure Data platform

● Defining integration solutions, creating technology roadmaps and creating an end-to-end plan for

enterprise level projects/initiatives/migrations.

● Mentor team to stay on top of the latest evolving technological suites like Delta Lake, Iceberg,

Data Fabric, DataOps, Data Mesh, Streaming Data Processing, Data Governance etc

● Hire the right talent, build, recognize & retain talent to create a professional culture with IKS

defined values within the team.

● Support to establish SLAs, KPIs and recommend measurement and improvement of processes.

● Create a strong monitoring platform for all the live interfaces for proactive alerting models and

administer the interface engine for assured availability.

● Provide and implement continuous improvements & recommendations on new processes,

policies for software development and management.


● Deliver data-driven & complex solutions with a customer-first mindset with multicultural and global

teams in different time zones.

● Creating and managing a sustainable, self organized, cross-functional and a collaborative team

that follows the best practices of Agile methodology.


What would your day look like?

● Understanding the domain, IKS feature clusters, business, functional and non-functional feature

requirements.

● Create, support and own artifacts : Architecture, Solution Design, Interface Deployment, Interface

Mapping and Transformation logics, Business Context, Data Flow diagrams and others.

● Influencing the culture of delivering high values to the internal and external customers using Agile

methodologies.

● Proactive measures to resolve the possible risks in any of the projects and programs.

● Support leadership team with proper business and technical updates/progress.


Who are we looking for?

● The ideal candidate should have 10+ years of experience in building and deploying data

pipelines

● Masters/Bachelors Degree in Computer Science, Software Engineering, or related field.

● Minimum 5+ years of experience in working using data components like Apache Beam, PySpark,

Serverless Offering from Cloud (like Lambda, Cloud Functions), Data Warehouse, ETL

Orchestration Tools (like Apache Airflow, Control-M)

● Experience in any of the Cloud Platforms (preferably Google Cloud)

● Proficient in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Redis).

● Familiar with CI/CD pipelines, Docker and data as a service concepts.

● Strong understanding of Data Modeling concepts for analytics and transactional systems

● Strong problem-solving and analytical abilities with excellent written & verbal communication

skills.

● Experience in managing tactical operations to achieve successful delivery with a customer-first

mindset.

● Led complex technical development and migration projects from concept to completion.

● Designed scalable systems capable of handling high volumes of data and traffic (both batch and

streaming)

● Experience working with multicultural and global teams in different time zones.

● Nice to have experience: Exposure to Healthcare industry with understanding of lifecycle and

terminologies


Exp: 12-18 yrs


Location: Remote



  • Kollam, India Palo Alto Networks Full time

    Our MissionAt Palo Alto Networks® everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we’re looking for...


  • Kollam, India NCR Voyix Full time

    Dear Aspirant,We have active opening for Devops_Full time_Hyderabad_NCR VOYIX.Experience: 6+yrsLocation: HyderabadNotice period: Immediate -60daysCTC: As per normsSkills: Devops, GCP, Kubernetes, Linux,AWS.Job description:Understand the entire system end to end and involve in every step of software development process like designing, development, and...


  • Kollam, Kerala, India DMart - Avenue Supermarts Ltd Full time

    Company OverviewDMart - Avenue Supermarts Ltd is a leading retail company in India, known for its modern retail format and commitment to quality.About the RoleWe are seeking an experienced Principal Building Design Specialist to join our team. As a key member of our design department, you will be responsible for overseeing the design process of commercial...

  • Big Data Engineer

    4 weeks ago


    kollam, India Pert Telecom Solutions Full time

    Job Description: We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...


  • Kollam, Kerala, India BettingJobs Full time

    About the RoleBettingJobs, a leading player in the Dubai market, is seeking an experienced Principal Backend Developer to join their team. This role offers a unique opportunity to leverage your technical expertise and contribute to the growth of a cutting-edge business.


  • Kollam, India Talent Pulse 360 Full time

    PLEASE READ THE JOB DESCRIPTION CAREFULLY BEFORE APPLYINGOpportunityWe are seeking a highly skilled Full Stack Developer with expertise in building multi-agent Retrieval-Augmented Generation (RAG) systems and proficiency in prompt engineering. The ideal candidate should excel in backend development using Python, frontend development using Node.js, and...

  • Software Engineer

    4 weeks ago


    Kollam, India BayOne Solutions Full time

    ROLE SUMMARYAs an early member of the engineering team, you will play a key role in developing the core software and also maintaining & upholding the culture of brilliance in our tightly-knit organization.You will:- Develop and maintain data pipelines that are at the core of empowering the product's discovery and AI search capabilities.- Participate in the...


  • Kollam, India Briq Full time

    Why is working in this department AMAZING!Working in engineering at Briq puts you squarely in the driver’s seat of building the next generation of construction financial management, planning, and intelligence software. The problems we work to solve every day are deeply complex and rewarding, both for the engineering team and our customers. Engineering at...


  • kollam, India Deluxe Full time

    About the Company As the world’s leading multidisciplinary service provider, Deluxe underpins the media and entertainment industry, servicing premium content creators and distributors. From Global Cinema, Content Distribution, Localization, and Mastering to end-to-end innovation and scale across Streaming, Theatrical, Broadcast and Mobile landscapes,...

  • Data Researcher

    2 months ago


    Kollam, India Clarksons Research Full time

    Clarksons Research, the market leading provider of data and intelligence across shipping and trade, is seeking hard working and enthusiastic individuals to join our expert team to support the expansion and development of our business. Clarksons Research is part of the Clarksons group, the world’s leading integrated shipping services provider and a FTSE 250...

  • Senior Data Scientist

    3 weeks ago


    Kollam, India Bidgely Full time

    Roles and Responsibilities ● Research and develop advanced statistical and machine learning models for analysis of large-scale, high-dimensional data. ● Dig deeper into data, understand characteristics of data, evaluate alternate models and validate hypothesis through theoretical and empirical approaches. ● Productize proven or working models into...


  • Kollam, Kerala, India Roro Full time

    Roro is seeking a highly skilled AI Engineer to join our team. As an AI Innovator, you will be responsible for designing and implementing cutting-edge AI solutions that leverage state-of-the-art Generative AI techniques.Key Responsibilities:Design, implement, and optimize AI solutions leveraging state-of-the-art Generative AI techniques.Develop and fine-tune...

  • Data Scientist

    3 months ago


    kollam, India bluCognition Full time

    About bluCognition: bluCognition is an AI/ML based start-up specializing in risk analytics, data conversion and data enrichment capabilities. Founded in 2017, by some very named senior professionals from the financial services industry, the company is headquartered in the US, with the delivery center based in Pune. We build all our solutions while leveraging...


  • Kollam, Kerala, India ZANSKAR RESEARCH Full time

    We are seeking a highly skilled Data Science Quantitative Researcher to join our team at Zanskar Research in Bangalore. The successful candidate will work on applying machine learning techniques to develop, test and enhance models for trading strategies, market analysis and optimization.This is an exciting opportunity to work at the intersection of finance...


  • Kollam, Kerala, India Insight Global Full time

    We are seeking a skilled Java Developer to join our team at Insight Global, working with our enterprise client's pricing team. The successful candidate will support the Price Engine tool, which is currently undergoing a migration to international markets.About the PositionThis role involves taking existing code built for the US system and rebuilding it piece...

  • Cloud Architect

    1 month ago


    Kollam, India Searce Inc Full time

    We are hiring for Cloud Architect & Lead Cloud Engineer in Delivery & not in support | admin.EXP - 6 to 13 yearsLocation - Hyderabad & PuneNotice period - Less than 30 days or immediate joiner.About SearceSearce is a modern tech consulting firm that empowers clients to futurify their businesses, leveraging Cloud, AI & Analytics.We are a category-defining...

  • Big Data

    3 months ago


    Kollam, India Myananta Technologies Full time

    At Myananta Technologies, we’re looking for a Big Data (Hadoop). The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. Job descriptionFull-Time Big Data (Hadoop) DeveloperMyananta Technologies | Gurugram is hiring for “Big Data (Hadoop) Developer” Experience: 3 - 5 Years.Salary: 5.0 - 12.0...


  • Kollam, India Canopus Infosystems - A CMMI Level 3 Company Full time

    We are seeking a highly skilled Senior Product Analytics Engineer experienced in product data analysis to guide product strategy and drive business growth. In this role, you will be responsible for analyzing product and monitoring product performance while providing actionable insights to optimize product features and support successful product launches. You...


  • Kollam, India Three Across Full time

    Frontend (TypeScript)Developer Job DescriptionLocation:Noida, Hybrid (3 Days from Office)Employment Type:Full-timeCompensation:25 Lacs - 30 LacsRole Summary:We are looking for a skilledTypeScript Developerto design, develop, and maintain cutting-edge software applications. This role involves collaborating with cross-functional teams to create efficient,...

  • DevOps Engineer

    4 weeks ago


    Kollam, India Rakuten India Full time

    Are you interested in working for a Global Leader in E-commerce? Are you excited about working on highly scalable platforms and applications that are accessed by millions of users every day? If so, read on to find out more about the opportunity.Rakuten is the largest E-commerce company in Japan and one of the largest E-commerce and Internet Services...