Principal GCP Data Engineer
5 days ago
What will you be responsible for?
● The ideal candidate will oversee end to end data pipeline stack, including design, development,
testing, documenting and deploying the pipeline, by following the defined/proven data engineering
practices in a cloud based environment (GCP).
● As principal you will provide subject matter expertise in Pipeline Architecture, Standards and
Practices, for designing, developing, implementing and monitoring enterprise wide secured and
scalable solutions.
● Contribute to Architecture and Design to create a robust and secure Data platform
● Defining integration solutions, creating technology roadmaps and creating an end-to-end plan for
enterprise level projects/initiatives/migrations.
● Mentor team to stay on top of the latest evolving technological suites like Delta Lake, Iceberg,
Data Fabric, DataOps, Data Mesh, Streaming Data Processing, Data Governance etc
● Hire the right talent, build, recognize & retain talent to create a professional culture with IKS
defined values within the team.
● Support to establish SLAs, KPIs and recommend measurement and improvement of processes.
● Create a strong monitoring platform for all the live interfaces for proactive alerting models and
administer the interface engine for assured availability.
● Provide and implement continuous improvements & recommendations on new processes,
policies for software development and management.
● Deliver data-driven & complex solutions with a customer-first mindset with multicultural and global
teams in different time zones.
● Creating and managing a sustainable, self organized, cross-functional and a collaborative team
that follows the best practices of Agile methodology.
What would your day look like?
● Understanding the domain, IKS feature clusters, business, functional and non-functional feature
requirements.
● Create, support and own artifacts : Architecture, Solution Design, Interface Deployment, Interface
Mapping and Transformation logics, Business Context, Data Flow diagrams and others.
● Influencing the culture of delivering high values to the internal and external customers using Agile
methodologies.
● Proactive measures to resolve the possible risks in any of the projects and programs.
● Support leadership team with proper business and technical updates/progress.
Who are we looking for?
● The ideal candidate should have 10+ years of experience in building and deploying data
pipelines
● Masters/Bachelors Degree in Computer Science, Software Engineering, or related field.
● Minimum 5+ years of experience in working using data components like Apache Beam, PySpark,
Serverless Offering from Cloud (like Lambda, Cloud Functions), Data Warehouse, ETL
Orchestration Tools (like Apache Airflow, Control-M)
● Experience in any of the Cloud Platforms (preferably Google Cloud)
● Proficient in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Redis).
● Familiar with CI/CD pipelines, Docker and data as a service concepts.
● Strong understanding of Data Modeling concepts for analytics and transactional systems
● Strong problem-solving and analytical abilities with excellent written & verbal communication
skills.
● Experience in managing tactical operations to achieve successful delivery with a customer-first
mindset.
● Led complex technical development and migration projects from concept to completion.
● Designed scalable systems capable of handling high volumes of data and traffic (both batch and
streaming)
● Experience working with multicultural and global teams in different time zones.
● Nice to have experience: Exposure to Healthcare industry with understanding of lifecycle and
terminologies
Exp: 12-18 yrs
Location: Remote
-
GCP DevOps Engineer
3 weeks ago
Kollam, Kerala, India Zemoso Technologies Full timeDevOps Engineer - GCPWe're seeking a skilled DevOps Engineer to join our team at Zemoso Technologies. As a DevOps practitioner, you'll be responsible for providing DevSecOps services to our customers and internal Dev teams.Key Responsibilities:Design and implement CI/CD pipelines using Cloud Build and Cloud DeployProvision and manage GCP resources, including...
-
Data Engineer
1 month ago
Kollam, India Tricog Health Full timeKey Responsibilities:● Design, develop, and optimize complex SQL queries to transform and extract insights from large datasets.● Build and maintain scalable ETL pipelines using Python to ingest, process, and load data from various sources into our data lake and data warehouse.● Implement best practices for data governance, data quality, and data...
-
Principal DevSecOps Architect
1 month ago
Kollam, India Intuitive.Cloud Full timeAbout us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...
-
Data Engineer
4 weeks ago
Kollam, India BytesCraft Full timeJob Title: Data Engineer Location: Ahmedabad Experience: 3-4 yearsJob Overview:We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have hands-on experience with Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Microsoft Fabric. This role will involve designing, developing, and...
-
AI - Data Engineer
4 weeks ago
kollam, India 2coms Full timeHiring for Trainer profile for Data EngineerData Architecture and Design: Develop and maintain data architectures including data models data warehouses and data lakes to support AI and machine learning initiatives.Data Pipeline Development: Design and implement data pipelines to extract transform and load (ETL) data from various sources into a centralized...
-
AI - Data Engineer
3 weeks ago
kollam, India 2coms Full timeHiring for Trainer profile for Data EngineerData Architecture and Design: Develop and maintain data architectures including data models data warehouses and data lakes to support AI and machine learning initiatives.Data Pipeline Development: Design and implement data pipelines to extract transform and load (ETL) data from various sources into a centralized...
-
AI - Data Engineer
2 months ago
Kollam, India 2coms Full timeHiring for Trainer profile for Data EngineerData Architecture and Design: Develop and maintain data architectures including data models data warehouses and data lakes to support AI and machine learning initiatives.Data Pipeline Development: Design and implement data pipelines to extract transform and load (ETL) data from various sources into a centralized...
-
AI - Data Engineer
2 months ago
Kollam, India 2coms Full timeHiringfor Trainer profile for DataEngineerDataArchitecture and Design: Develop and maintain data architecturesincluding data models data warehouses and data lakes to support AIand machine learninginitiatives.DataPipeline Development: Design and implement data pipelines toextract transform and load (ETL) data from various sources into acentralized system...
-
Senior Data Engineer
2 weeks ago
Kollam, Kerala, India Evolutyz Corp Full time**Job Summary**Evolutyz Corp is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data management team, you will be responsible for designing, developing, and maintaining ETL processes using SSIS or other ETL tools to extract data from various sources, transform it according to business rules, and load it into target...
-
Data Engineer
6 days ago
Kollam, Kerala, India 2coms Full time{"Requirements": "To excel in this role, you should have a strong background in computer science or a related field. A minimum of 5 years of experience in data engineering or a related role is required. Additionally, a bachelor's degree or master's degree in a relevant field is preferred.**Key Skills:**- Strong understanding of data architectures and...
-
Data and Analytics Principal Solution Architect
4 weeks ago
Kollam, India INFINIMINDS Full timeKey Responsibilities:1. Pre-Sales Responsibilities:Engage with potential clients to understand their data needs, challenges, and objectives.Lead discovery sessions, gather requirements, and develop high-level solution architectures for data and analytics initiatives.Prepare and present compelling proposals, solution demos, and proof of concepts that...
-
Data Engineer
4 weeks ago
Kollam, India Pitch N Hire Full timeTech Skills Details for IICS LeadPrior experience as an IICS LeadExtensive experience with IDCS (Oracle Identity Cloud Service)Hands-on experience with Informatica CloudProficiency in programming languages such as SQLStrong experience in data modelling, data warehousing, and database managementHaving knowledge of cloud platforms (e.g., AWS, Azure, Google...
-
Data Engineer
2 weeks ago
Kollam, Kerala, India 2coms Full timeData Engineer - AI SpecialistAt 2coms, we are seeking a highly skilled Data Engineer - AI Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data architectures and pipelines to support our AI initiatives.Data Architecture and Design: Develop and maintain...
-
Data Engineer
3 weeks ago
Kollam, Kerala, India 2coms Full timeData Engineer - AI SpecialistAt 2coms, we're seeking a highly skilled Data Engineer - AI Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data architectures and systems to support our AI and machine learning initiatives.Key Responsibilities:Design and...
-
Data Engineer
2 weeks ago
Kollam, Kerala, India 2coms Full timeData Engineering for AI and Machine LearningData engineers at 2coms play a crucial role in developing and maintaining data architectures that support AI and machine learning initiatives. Key responsibilities include designing and implementing data pipelines to extract, transform, and load data from various sources into a centralized system. This involves...
-
Engineer - AI/ML Operations
4 weeks ago
kollam, India Addepar Full timeWork Location - BengaluruThe RoleJoin Addepar’s innovative data and intelligence initiatives! We're seeking a Software Engineer to craft and build an AI/ML Ops platform from the ground up, enabling our teams to scale AI/ML solutions efficiently!What You’ll DoBuild and scale a comprehensive platform, accelerating AI adoption across teams.Use core Addepar...
-
Software Engineer
2 months ago
Kollam, India Aptonet Inc Full timeJob Title: Backend (Spring Boot, J2EE, Microservices, Cloud –offshore)100% Remote Long term 12+ Month Technical SkillsOverall 3-7 years of professional experienceExperience developing microservices and cloud native apps using Java/J2EE, REST APIs, Spring Core, Spring MVC Framework, Spring Boot Framework JPA (Java Persistence API) (Or any other ORM), Spring...
-
AI Data Architect
4 weeks ago
Kollam, Kerala, India 2coms Full timeJob Title: AI Data EngineerJob SummaryWe are seeking an experienced AI Data Engineer to join our team at 2coms. The successful candidate will be responsible for designing and implementing data architectures, data pipelines, and data integration solutions to support AI and machine learning initiatives.Key ResponsibilitiesDevelop and maintain data...
-
Big Data Developer
4 weeks ago
kollam, India Amossys Consulting Services Full timePosition Title: Data EngineerExperience Required: 5+ years Employment Type: Full-time Employment Mode: HybridLocation: Bangalore, Pune, Trivandrum.Industry: Banking & Insurance sectorJob Summary:We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong...
-
Data Warehouse Specialist
2 weeks ago
Kollam, Kerala, India Evolutyz Corp Full timeAt Evolutyz Corp, we are seeking a highly skilled Data Warehouse Specialist to join our team. The ideal candidate will have a strong background in data management principles and a techno-functional knowledge of data governance, data architecture, data profiling, data analysis, and data quality validation.The successful candidate will be responsible for...