Data Engineer

2 weeks ago

Navi Mumbai, India Celebal Technologies Full time

Job Description – ETL Migration Specialist (Informatica to Databricks)

Position Overview

We are looking for an experienced ETL Migration Specialist with strong expertise in Informatica PowerCenter and Databricks (PySpark). The ideal candidate will be responsible for analysing and reverse engineering existing Informatica mappings/workflows, understanding the business logic implemented, and refactoring these pipelines into scalable, efficient data processing workflows on Databricks.

This role requires strong analytical skills, hands-on experience in ETL development, and the ability to collaborate with both business and technical teams to ensure seamless migration.

________________________________________

Key Responsibilities

• Reverse Engineering: Analyze existing Informatica mappings, workflows, sessions, and variables to understand data flow, transformations, joins, filters, lookups, and aggregations.

• ETL Refactoring: Translate Informatica logic into PySpark/Databricks workflows, ensuring accuracy and performance.

• Data Modeling & Transformation: Design and implement transformation logic in Databricks aligned with business rules.

• Performance Optimization: Refactor ETL logic for scalability and performance tuning in Databricks.

• Documentation: Create detailed documentation for the converted pipelines, capturing both technical logic and business rules.

• Testing & Validation: Collaborate with QA/Business teams to validate data correctness between Informatica outputs and Databricks outputs.

• Best Practices: Ensure adherence to Databricks and cloud data engineering best practices, including modular coding, error handling, and reusability.

• Collaboration: Work with stakeholders, data architects, and business SMEs to clarify requirements and resolve discrepancies.

________________________________________

Must Have Informatica Expertise

• Strong knowledge of Informatica objects:

o Mappings, Mapplets, Workflows, Worklets, Sessions

• Hands-on experience with Informatica transformations:

o Lookup, Joiner, Router, Aggregator, Expression, Sequence Generator, Filter, Stored Procedure, Update Strategy, etc.

• Proficiency in handling Informatica parameters and variables:

o Mapping variables and parameters

o Workflow variables

o Session parameters

o Parameter files and variable scoping

• Ability to debug and trace variable values across sessions and workflows.

• Experience in designing reusable transformations and optimization techniques in Informatica.

________________________________________

Required Skills & Experience

• 5+ years of hands-on experience in ETL development with Informatica PowerCenter (or IICS).

• 2+ years of experience in Databricks (PySpark, SQL, Delta Lake) for ETL/ELT implementation.

• Strong understanding of data warehousing concepts (SCDs, fact/dimension modeling, partitioning, indexing).

• Hands-on experience with cloud platforms (Azure / AWS / GCP) and Databricks workspace setup.

• Proficiency in SQL and performance tuning of large datasets.

• Experience in reverse engineering ETL logic and re-implementing in modern platforms.

• Excellent problem-solving, debugging, and communication skills.

________________________________________

Good to Have

• Experience with DevOps/CI-CD pipelines for Databricks (e.g., GitHub Actions, Azure DevOps, Jenkins).

• Exposure to Informatica to Spark migration tools or accelerators.

• Knowledge of Medallion architecture or modern data lakehouse patterns.

• Experience in Agile/Scrum delivery.

  • Lead Mechanical Engineer

    1 week ago

    Navi Mumbai, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Site Engineer

    4 weeks ago

    Navi Mumbai, India M L Labade Engineer Contractor Full time

    Role & responsibilities Organizing materials and ensuring sites are safe and clean. Preparing cost estimates and ensuring appropriate materials and tools are available. Providing technical advice and suggestions for improvement on particular projects. Diagnosing and troubleshooting equipment as required. Negotiating with suppliers and vendors to ensure the...

  • Data Engineer

    4 weeks ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: ....

  • Mechanical Shift Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India Bridge Data Centres Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    A graduate in Electrical or Mechanical Engineering / Professional Engineering Diploma. With Good Communication skills5-7 years of experience in running large data Center operation.Should have good understanding of Data Centres Tier certificationsShift allowanceOver time allowanceHealth insuranceLife insuranceAccidental insuranceAnnual bonusProvident fund

  • Electrical engineering lead

    7 days ago

    Navi Mumbai, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Electrical engineering innovation lead

    1 week ago

    Navi Mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEW:Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect...

  • Electrical Engineering Innovation Lead

    1 week ago

    Navi Mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEW: Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect...

  • Electrical Engineering Innovation Lead

    2 weeks ago

    Navi Mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEW: Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect...

  • Electrical engineering innovation lead

    1 week ago

    Navi Mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEW:Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect...