Data Engineer

3 weeks ago


Navi Mumbai Maharashtra India, Maharashtra Celebal Technologies Full time

Job Description – ETL Migration Specialist (Informatica to Databricks)

Position Overview

We are looking for an experienced ETL Migration Specialist with strong expertise in Informatica PowerCenter and Databricks (PySpark). The ideal candidate will be responsible for analysing and reverse engineering existing Informatica mappings/workflows, understanding the business logic implemented, and refactoring these pipelines into scalable, efficient data processing workflows on Databricks.

This role requires strong analytical skills, hands-on experience in ETL development, and the ability to collaborate with both business and technical teams to ensure seamless migration.

________________________________________

Key Responsibilities

• Reverse Engineering: Analyze existing Informatica mappings, workflows, sessions, and variables to understand data flow, transformations, joins, filters, lookups, and aggregations.

• ETL Refactoring: Translate Informatica logic into PySpark/Databricks workflows, ensuring accuracy and performance.

• Data Modeling & Transformation: Design and implement transformation logic in Databricks aligned with business rules.

• Performance Optimization: Refactor ETL logic for scalability and performance tuning in Databricks.

• Documentation: Create detailed documentation for the converted pipelines, capturing both technical logic and business rules.

• Testing & Validation: Collaborate with QA/Business teams to validate data correctness between Informatica outputs and Databricks outputs.

• Best Practices: Ensure adherence to Databricks and cloud data engineering best practices, including modular coding, error handling, and reusability.

• Collaboration: Work with stakeholders, data architects, and business SMEs to clarify requirements and resolve discrepancies.

________________________________________

Must Have Informatica Expertise

• Strong knowledge of Informatica objects:

o Mappings, Mapplets, Workflows, Worklets, Sessions

• Hands-on experience with Informatica transformations:

o Lookup, Joiner, Router, Aggregator, Expression, Sequence Generator, Filter, Stored Procedure, Update Strategy, etc.

• Proficiency in handling Informatica parameters and variables:

o Mapping variables and parameters

o Workflow variables

o Session parameters

o Parameter files and variable scoping

• Ability to debug and trace variable values across sessions and workflows.

• Experience in designing reusable transformations and optimization techniques in Informatica.

________________________________________

Required Skills & Experience

• 5+ years of hands-on experience in ETL development with Informatica PowerCenter (or IICS).

• 2+ years of experience in Databricks (PySpark, SQL, Delta Lake) for ETL/ELT implementation.

• Strong understanding of data warehousing concepts (SCDs, fact/dimension modeling, partitioning, indexing).

• Hands-on experience with cloud platforms (Azure / AWS / GCP) and Databricks workspace setup.

• Proficiency in SQL and performance tuning of large datasets.

• Experience in reverse engineering ETL logic and re-implementing in modern platforms.

• Excellent problem-solving, debugging, and communication skills.

________________________________________

Good to Have

• Experience with DevOps/CI-CD pipelines for Databricks (e.g., GitHub Actions, Azure DevOps, Jenkins).

• Exposure to Informatica to Spark migration tools or accelerators.

• Knowledge of Medallion architecture or modern data lakehouse patterns.

• Experience in Agile/Scrum delivery.


  • Site Engineer

    1 week ago


    Navi Mumbai, Maharashtra, India M L Labade Engineer Contractor Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Role & responsibilitiesOrganizing materials and ensuring sites are safe and clean.Preparing cost estimates and ensuring appropriate materials and tools are available.Providing technical advice and suggestions for improvement on particular projects.Diagnosing and troubleshooting equipment as required.Negotiating with suppliers and vendors to ensure the best...


  • Navi Mumbai, Maharashtra, India Nxtra Data Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Engineer to oversee Data center Design for all new HyperScale and Edge Data Centers. Right from site selection, civil and architectural design from HVAC side including chillers, precision air handling units, fan wall units, VRF, thermal storage tanks, pumps, PACsand low side works.The candidate's job will be to ensure that the Design for every data center...


  • Navi Mumbai, Maharashtra, India Nxtra Data Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job DescriptionJob Title: Electrical Engineer (Design)Job Level: ManagerFunction: EngineeringLocation : Pan IndiaReporting to : Engineering HeadPurpose of the Job1) Use expertise to assist in the design of electrical systems; helping to avoid problems and addressing any issues that might arise in the reliability of the design, thus reducing downtime and...


  • Navi Mumbai, Maharashtra, India Bridge Data Centres Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    A graduate in Electrical or Mechanical Engineering / Professional Engineering Diploma. With Good Communication skills5-7 years of experience in running large data Center operation.Should have good understanding of Data Centres Tier certificationsShift allowanceOver time allowanceHealth insuranceLife insuranceAccidental insuranceAnnual bonusProvident fund

  • Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India, Maharashtra Straive Full time

    Data Engineer will be responsible for designing, developing, and maintaining data pipelines and architectures that support the organization's analytics and reporting needs. The ideal candidate will have strong expertise in SQL Server, Snowflake, and data warehousing concepts, ensuring efficient and reliable data flow across systems.Key Responsibilities:...

  • Data Engineer

    6 days ago


    Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    3 weeks ago


    Mumbai, Maharashtra, India, Maharashtra SolarSquare Full time

    Job Description: Data EngineerAs a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure. You willdesign and implement robust, scalable data pipelines and architect modern data solutionsusing a best-in-class technology stack. Your work will transform raw, messy data into clean,reliable, and actionable data products that power...

  • Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India, Maharashtra Global Consulting Full time

    ➡ : Data Engineer➡ : Mumbai, Maharashtara (5 Days Work from Office)➡ : Minimum 4+ yrs.➡ : Can join immediately or within 30 Days➡ : Permanent➡ : 10 AM to 7 PM ISTKey Skills & Experience:- 2+ years of hands-on experience with Databricks, including job optimization and performance tuning.- 4+ years in Data Engineering, with a solid foundation...

  • Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India, Maharashtra Coffeee.io Full time

    Job Title-Data EngineerExp-6-8 YerasLocation- MumbaiJob Responsibilities-Actionable · Designing and implementing data storage solutions on Azure· Building and maintaining data pipelines for data integration and processing· Optimizing data processing performance through tuning and monitoring· Developing and maintaining data models and schemas· Ensuring...


  • Navi Mumbai, Maharashtra, India, Maharashtra BDx Data Centers Full time

    Company IntroductionHGC Big Data Exchange (BDX), continues to build aggressively across Asia. Our mission is to offer AI - enabled Datacenter services. A step forward would be to work along with Opensource community and associated technology. The immediate target is to enable our Datacenters to be software defined with a single visibility layer across the...