Data Engineer

3 days ago

Bengaluru, Karnataka, India Factspan Analytics Full time ₹ 6,00,000 - ₹ 18,00,000 per year

About the Role

This role is part of the MarTech Data Engineering POD supporting a large-scale ESP (Email Service Provider) migration program from Oracle Responsys to Adobe Journey Optimizer. The initiative aims to build a scalable, real-time marketing data foundation integrating customer journeys, preference orchestration, and omnichannel personalization across email, mobile, and direct channels.

The offshore team will focus on designing, building, and maintaining data pipelines across SAS, OES, Wunderkind, and AEP (Adobe Experience Platform), enabling real-time campaign execution and advanced targeting capabilities.

Key Responsibilities

  • Design and develop data ingestion, transformation, and orchestration pipelines using GCP (BigQuery, Dataflow, Cloud Composer) and Airflow.
  • Implement and maintain data integrations between AEP and data lake, ensuring high performance and scalability.
  • Build and optimize ETL/ELT workflows to support campaign orchestration, preference logic, and audience segmentation.
  • Implement data quality checks, monitoring, and exception handling frameworks to ensure clean and reliable data.
  • Work closely with Lead DE and SME to translate campaign archetypes into data pipelines and orchestration rules.
  • Support performance tuning, data reconciliation, and defect resolution during testing and hypercare phases.
  • Collaborate with QA team for end-to-end test validation and ensure production readiness.
  • Participate in daily Agile ceremonies, sprint reviews, and deployment planning.

Required Technical Skills

  • Strong hands-on experience in GCP services: BigQuery, Dataflow, GCS, Cloud Composer (Airflow).
  • Proficiency in SQL for data profiling, transformation, and performance optimization.
  • Proficiency in Python for pipeline automation, scripting, and orchestration.
  • Experience building batch and streaming data pipelines.
  • Exposure to working with marketing or customer engagement platforms is a plus.
  • Understanding of data quality, logging, monitoring, and alerting best practices.

Preferred Skills

  • Experience in Airflow DAG development for complex data pipelines.
  • Familiarity with MarTech platforms such as Adobe Experience Platform or similar ESPs.
  • Knowledge of data modeling for campaign orchestration and audience segmentation.
  • Experience with CI/CD and DevOps principles for data deployments.
  • Strong troubleshooting and performance tuning skills.

Soft Skills & Attributes

  • Strong problem-solving skills and attention to detail.
  • Ability to work effectively in a distributed global POD model (onsite + offshore).
  • Proactive communication and ownership mindset.
  • Comfortable working in fast-paced agile environments with tight timelines.
  • Excellent verbal and written communication skills.

Education

  • Bachelors or Masters degree in Computer Science, Information Technology, or a related field.
  • GCP certifications (e.g., Professional Data Engineer) preferred but not mandatory

  • Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Data Engineer

    10 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Build scalable data pipelines from structured and unstructured sources Design ontologies that model business entities, relationships, and process flows Collaborate with domain SMEs and ML engineers to structure agent inputs and outputs Implement transformation, validation, and enrichment logic across diverse datasets Maintain and optimize cloud data...

  • Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Sr. Data Engineer Data Science

    11 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 342869NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer Data Science to join our team in Bangalore, Karnātaka (IN-KA), India (IN). ...

  • Data Engineer

    19 hours ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Engineer

    10 hours ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Req ID: 344005NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - ETL Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job Duties: Design,...