Data Engineer

2 weeks ago

Mumbai, India Celebal Technologies Full time

Job Description – ETL Migration Specialist (Informatica to Databricks)

Position Overview

We are looking for an experienced ETL Migration Specialist with strong expertise in Informatica PowerCenter and Databricks (PySpark). The ideal candidate will be responsible for analysing and reverse engineering existing Informatica mappings/workflows, understanding the business logic implemented, and refactoring these pipelines into scalable, efficient data processing workflows on Databricks.

This role requires strong analytical skills, hands-on experience in ETL development, and the ability to collaborate with both business and technical teams to ensure seamless migration.

________________________________________

Key Responsibilities

• Reverse Engineering: Analyze existing Informatica mappings, workflows, sessions, and variables to understand data flow, transformations, joins, filters, lookups, and aggregations.

• ETL Refactoring: Translate Informatica logic into PySpark/Databricks workflows, ensuring accuracy and performance.

• Data Modeling & Transformation: Design and implement transformation logic in Databricks aligned with business rules.

• Performance Optimization: Refactor ETL logic for scalability and performance tuning in Databricks.

• Documentation: Create detailed documentation for the converted pipelines, capturing both technical logic and business rules.

• Testing & Validation: Collaborate with QA/Business teams to validate data correctness between Informatica outputs and Databricks outputs.

• Best Practices: Ensure adherence to Databricks and cloud data engineering best practices, including modular coding, error handling, and reusability.

• Collaboration: Work with stakeholders, data architects, and business SMEs to clarify requirements and resolve discrepancies.

________________________________________

Must Have Informatica Expertise

• Strong knowledge of Informatica objects:

o Mappings, Mapplets, Workflows, Worklets, Sessions

• Hands-on experience with Informatica transformations:

o Lookup, Joiner, Router, Aggregator, Expression, Sequence Generator, Filter, Stored Procedure, Update Strategy, etc.

• Proficiency in handling Informatica parameters and variables:

o Mapping variables and parameters

o Workflow variables

o Session parameters

o Parameter files and variable scoping

• Ability to debug and trace variable values across sessions and workflows.

• Experience in designing reusable transformations and optimization techniques in Informatica.

________________________________________

Required Skills & Experience

• 5+ years of hands-on experience in ETL development with Informatica PowerCenter (or IICS).

• 2+ years of experience in Databricks (PySpark, SQL, Delta Lake) for ETL/ELT implementation.

• Strong understanding of data warehousing concepts (SCDs, fact/dimension modeling, partitioning, indexing).

• Hands-on experience with cloud platforms (Azure / AWS / GCP) and Databricks workspace setup.

• Proficiency in SQL and performance tuning of large datasets.

• Experience in reverse engineering ETL logic and re-implementing in modern platforms.

• Excellent problem-solving, debugging, and communication skills.

________________________________________

Good to Have

• Experience with DevOps/CI-CD pipelines for Databricks (e.g., GitHub Actions, Azure DevOps, Jenkins).

• Exposure to Informatica to Spark migration tools or accelerators.

• Knowledge of Medallion architecture or modern data lakehouse patterns.

• Experience in Agile/Scrum delivery.

  • Data Engineer

    4 weeks ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: ....

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FID Federal Risk Applications Data Engineer Req ID: 341951 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in...

  • Data Engineer

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Data Engineer Req ID: 340021 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN). Job Duties: Key...

  • FID Federal Risk Applications Data Engineer

    2 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 341951NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN). Job Duties:...

  • Lead Mechanical Engineer

    1 week ago

    Navi Mumbai, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Mid Data Science

    2 weeks ago

    Mumbai, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid Data Science & AIML, GenAI Lead/Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India...

  • Mid Data Science

    2 weeks ago

    Mumbai, India NTT DATA Full time

    Job Description Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid Data Science & AIML, GenAI Lead/Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India...

  • Mid Data Science

    2 weeks ago

    Mumbai, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid Data Science & AIML, GenAI Lead/Engineer to join our team in Mumbai, Mahārāshtra (IN-MH),...

  • Data Engineer

    2 weeks ago

    Mumbai Metropolitan Region, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID:342707NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN).Job Duties: Key Responsibilities:Design and...