Senior Data Engineer

Title: Senior Data Engineer (IDMC-CDI)

Primary Skills: IDMC (CDI), ETL Concepts

Mode of Work: Remote/WFH

Experience: 8-15 years

Shift Timing: Open to work in EST shift (5PM to 2AM IST)

About Us

We are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various market-leading products, we help enterprises implement scalable and secure data solutions using tools like Informatica, AWS, Azure, Snowflake, and GCP. We continue to grow as a leader in data integration, data quality, and data security across industries, supporting customers in their digital transformation journeys.

Job Overview

We are seeking a highly skilled and experienced Informatica IDMC ETL Developer (Lead-Level) with a deep understanding of ETL design, data pipeline development, and Informatica Cloud Data Integration (CDI). The ideal candidate will have a strong background in developing, documenting, testing, and maintaining ETL applications and will take ownership in delivering scalable solutions that meet business and technical requirements.

Key Responsibilities

• Lead the design, development, and deployment of complex ETL solutions using Informatica IDMC.
• Collaborate with business stakeholders, analysts, and data architects to define technical requirements and translate them into efficient ETL workflows.
• Develop, document, unit test, and maintain high-quality data pipelines that support both batch and incremental (CDC-based) data processing.

• Configure and manage:

• Mappings, Mapping Tasks, and Taskflows

• Secure Agents, runtime environments, and connection parameters

• Design and implement robust data transformation logic, including:

• Cleansing, enrichment, joins, lookups, aggregations

• Handling hierarchical (JSON, XML) and semi-structured data (REST APIs, Kafka)

• Use of parameterized mappings and reusable components

• Build and manage Taskflows with conditional logic, error handling, branching, and scheduling mechanisms.

• Optimize mapping performance through pushdown optimization, partitioning, and data minimization techniques.
• Provide leadership and guidance to junior developers, conduct code reviews, and ensure adherence to best practices.
• Troubleshoot and resolve complex data integration issues promptly.
• Stay updated on new features and industry trends in data integration and cloud technologies.

Required Skills

• 8+ years of IT experience in data integration and management roles.
• 5+ years of hands-on experience with Informatica products.
• 2+ years specifically working with Informatica IDMC/CDI.
• Experience in leading large projects and mentoring junior developers.
• Proficiency with Secure Agents, runtime configuration, parameterization, and environment management.
• Experience integrating external applications with IDMC via batch, APIs, and message queues.
• Strong experience with relational databases such as Oracle, SQL Server, or MySQL.
• Solid understanding of data warehousing concepts (e.g., Kimball, Inmon).
• Excellent problem-solving skills and ability to handle complex data integration scenarios.
• Strong verbal and written communication skills.
• Experience working in Agile/Scrum environments.

Preferred/Bonus Skills

• Experience with cloud platforms: AWS, Azure, or GCP.
• Exposure to data quality tools and governance frameworks.
• Familiarity with scripting languages like Python or Shell for automation.

Why Join?

• Work with cutting-edge data integration tools as part of a fast-growing, elite consulting firm.
• Collaborate with top-tier clients and deliver impactful data management solutions.
• Access to ongoing training and opportunities to work with the latest in cloud, AI, and big data technologies.