Data Engineer

2 weeks ago

Any Location, India Marktine Technology Solutions Pvt Ltd Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Description :

Job Title : GCP Data Engineer Adobe Experience Platform Integration.

Experience : 8 Years.

Location : Remote.

Employment Type : Contract (Freelancing).

Shift : General IST/UK Shift.

Roles and Responsibilities :

Project Overview :

This project aims to establish Google Cloud Platform (GCP) as the central data foundation layer for the integration of website (Hybris CMS) and offline (Instore SaaS, EDW, Loyalty, Rewards) data sources into Adobe Experience Platform (AEP).

The vendor will be responsible for building, configuring, and operationalizing the data pipelines, schemas, and integration components necessary for seamless data ingestion and activation.

Objectives :

- Design and deploy a scalable GCP architecture to support AEP integrations.

- Enable secure and automated data ingestion from multiple enterprise systems (Hybris, Oracle EDW, TAMS, etc.

- Standardize data using defined schema structures (Customer, Transaction, Product, Store, Custom).

- Facilitate incremental and historical data feeds to AEP using Adobe connectors.

- Ensure data governance, security, and monitoring best practices are implemented.

Scope of Work :

1 GCP Environment Setup :

- Configure GCP project structure, IAM roles, and service accounts.

- Set up secure networking, encryption, and audit logging policies.

- Deploy foundational services : BigQuery, Cloud Storage, Dataflow, and Pub/Sub.

2 Data Ingestion & Processing :

- Build data pipelines to ingest data from :

- Hybris CMS (Website data).

- Instore SaaS (Offline transactions).

- Oracle Database / Customer EDW.

- Loyalty & Rewards and TAMS systems.

- Implement both batch (historical) and streaming (near real-time) ingestion modes.

- Transform data into standardized structures and validate quality checks.

3 Schema Design & Data Modeling :

Develop and maintain schema definitions for :

- Customer Data.

- Transactions Data.

- Product Catalog.

- Store Metadata.

- Custom Business Schemas (if applicable).

- Maintain schema documentation aligned with AEP XDM (Experience Data Model) standards.

4 AEP Integration :

- Configure and validate AEP GCP Connector for BigQuery datasets.

- Support Adobe CJA, (AA) Source Connector, Web SDK, and Klaviyo integrations.

- Map Google BigQuery datasets to Adobe XDM Schemas through Datastream Mapping.

5 Monitoring & Automation :

- Deploy automated workflows for data refresh, validation, and schema updates.

- Configure alerts for failures, data delays, and schema mismatches.

- Implement logging and health dashboards using GCP Monitoring tools.

6 Documentation & Knowledge Transfer :

- Deliver architecture diagrams, pipeline workflows, and access management documentation.

- Conduct hands-on knowledge transfer sessions with internal data engineering and marketing teams.

Experience with Google analytics, Adobe Analytics clickstream data will be an additional advantage.

  • Data Engineer

    4 days ago

    Any Location, India Insight Global Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Description : POSITION : GCP Data Engineer. LOCATION : 100% Remote in India. DURATION : 12-Month-Contract Plus Extensions. TARGET START DATE : 11/17/2025. REQUIRED SKILLS & EXPERIENCE : - 6+ Years of experience as a Data Engineer. - Experience with GCP Data (e.g., BigQuery, Cloud Storage, Bigtable, Airflow, Dataproc, Dataflow. - Strong SQL...

  • Data Engineer

    6 days ago

    Any Location, India NS Global Corporation Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    We are looking for an experienced GCP Data Engineer with a minimum of 5 years of professional experience in data engineering, cloud-based data solutions, and large-scale distributed systems. This role is fully remote and requires a hands-on professional who can design, build, and optimize data pipelines and solutions on Google Cloud Platform (GCP). Key...

  • Data Engineer

    4 days ago

    Any Location, India SkillKart Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About the Role : We are seeking experienced Google Cloud Platform (GCP) Engineers to join our team in building a scalable and robust Model Monitoring Framework. This solution will integrate data from diverse sources including Excel files, SAS datasets, and GCP-native services, with the target architecture fully hosted on Google Cloud Platform.Key...

  • Senior Azure Data Engineer

    2 weeks ago

    Any Location, India Marktine Technology Solutions Pvt Ltd Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Description : About the Role : We are looking for a highly skilled Senior Azure Data Engineer to join our data engineering team on a contractual basis. The ideal candidate will have a strong background in building modern data pipelines and architectures using the Azure Data Platform. You should be proficient in PySpark, Azure Databricks, ADF, and...

  • Full Stack Big Data Engineer

    14 hours ago

    Any Location, India Upamp Business Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    About the advertising data flow team : The advertising data flow team is responsible for the streaming and batch data processes that power our reporting, analytics, attribution, forecasting, optimization, ad delivery, and billing systems with a business focus on accurately associating real-world visits to digital media impressions and growing our...

  • Data Governance Analyst

    4 days ago

    Any Location, India Insight Global Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Description : Key Responsibilities : - Manage and maintain enterprise data catalog platforms such as Alation, Collibra, or Informatica EDC. - Partner with data engineering and analytics teams to enhance data discoverability, quality, and lineage tracking. - Write and optimize SQL queries to analyze, validate, and reconcile large datasets. -...

  • Lead Architect Engineer

    4 days ago

    Any Location, India Careerfit Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Description : Job Title : Lead Architect Engineer (Data). Location : Hybrid/Remote. Job Type : Full-time.About the Role : We are seeking a highly skilled and experienced Lead Architect Engineer (Data) to play a pivotal leadership role in the development, architecture, and engineering of data solutions that underpin key products and services. ...

  • Senior Data Platform Administrator

    2 days ago

    Any Location, India JSS HRM Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Description : We are seeking a highly skilled and certified Senior Data Platform Administrator with extensive experience in administering Alteryx Server, Power BI, and Databricks platforms. The ideal candidate has a proven track record in installation, upgrades, patching, performance tuning, user and server support, and governance across enterprise...

  • Snowflake/DBT Engineer

    1 week ago

    Any Location, India TESTQ Technologies Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role Overview : We are looking for a talented Snowflake DBT Engineer with extensive experience in building and optimizing data pipelines using DBT and Snowflake. The ideal candidate will have a strong command of SQL, a sound understanding of Data Vault 2.0 (DV2.0) methodology, and familiarity with Enterprise Data Management (EDM) principles. ...

  • Software Engineer

    2 weeks ago

    Any Location, India SkyFlow Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Skyflow is a data privacy vault company built to radically simplify how companies isolate, protect, and govern their customers most sensitive data. With its global network of data privacy vaults, Skyflow is also a comprehensive solution for companies around the world looking to meet complex data localization requirements. Skyflow currently supports a...