Senior Data Engineering Specialist

5 days ago

Meerut, Uttar Pradesh, India beBeeDataEngineer Full time

Job Title: Senior Data Engineer (IDMC-CDI)

Primary Skills: SQL, IDMC (CDI), ETL Concepts Base

Location: Remote

Shift: US EST (5 PM to 2 AM IST)

Experience: 5-12 Years

About the Role:

We are seeking a highly skilled and experienced Informatica IDMC ETL Developer with a deep understanding of ETL design, data pipeline development, and Informatica Cloud Data Integration (CDI). The ideal candidate will have a strong background in developing, documenting, testing, and maintaining ETL applications and will take ownership in delivering scalable solutions that meet business and technical requirements.

Key Responsibilities:

  • Lead the design, development, and deployment of complex ETL solutions using Informatica IDMC.
  • Collaborate with business stakeholders, analysts, and data architects to define technical requirements and translate them into efficient ETL workflows.
  • Develop, document, unit test, and maintain high-quality data pipelines that support both batch and incremental (CDC-based) data processing.
  • Configure and manage mappings, mapping tasks, and taskflows. Secure agents, runtime environments, and connection parameters.
  • Design and implement robust data transformation logic, including cleansing, enrichment, joins, lookups, aggregations. Handling hierarchical (JSON, XML) and semi-structured data (REST APIs, Kafka).
  • Use parameterized mappings and reusable components. Build and manage taskflows with conditional logic, error handling, branching, and scheduling mechanisms.
  • Optimize mapping performance through pushdown optimization, partitioning, and data minimization techniques.
  • Provide leadership and guidance to junior developers, conduct code reviews, and ensure adherence to best practices.
  • Troubleshoot and resolve complex data integration issues promptly.
  • Stay updated on new features and industry trends in data integration and cloud technologies.

Required Skills:

  • 5+ years of IT experience in data integration and management roles.
  • 4+ years of hands-on experience with Informatica products.
  • 2+ years specifically working with Informatica IDMC/CDI.
  • Experience in leading large projects and mentoring junior developers.
  • Proficiency with secure agents, runtime configuration, parameterization, and environment management.
  • Experience integrating external applications with IDMC via batch, APIs, and message queues.
  • Strong experience with relational databases such as Oracle, SQL Server, or MySQL.
  • Solid understanding of data warehousing concepts (e.g., Kimball, Inmon).
  • Excellent problem-solving skills and ability to handle complex data integration scenarios.
  • Strong verbal and written communication skills.
  • Experience working in Agile/Scrum environments.

Why Work with Us?

  • Work with cutting-edge data integration tools as part of a fast-growing, elite consulting firm.
  • Collaborate with top-tier clients and deliver impactful data management solutions.
  • Access to ongoing training and opportunities to work with the latest in cloud, AI, and big data technologies.

  • Chief Data Engineering Specialist

    7 hours ago

    Meerut, Uttar Pradesh, India beBeeDataArchitecture Full time ₹ 6,00,000 - ₹ 12,00,000

    Senior Data Architect PositionJob Summary:The ideal candidate will have 5+ years of experience in designing and implementing data architecture solutions, with a strong background in real-time and close-to-real-time data integration using Kafka, MS Event Hubs, etc.Experience in developing Business Intelligence Dashboards and Data Models using PowerBI, Azure...

  • Senior Data Engineer

    3 weeks ago

    Meerut, Uttar Pradesh, India Talent Corner HR Services Pvt Ltd Full time

    We are looking for an experienced Senior Data Engineer to lead the development of scalable AWS-native data lake pipelines with a strong focus on time series forecasting and upsert-ready architectures. This role requires end-to-end ownership of the data lifecycle, from ingestion to partitioning, versioning, and BI delivery. The ideal candidate must be highly...

  • Senior Data and AI Specialist

    2 days ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 13,72,358 - ₹ 25,16,844

    We're seeking a skilled Data and AI Specialist to lead the development of our training content.">Job Description:As a Subject Matter Expert in data and AI, you'll drive the technical depth and accuracy of our learning experiences. You'll work closely with content creators to define and review presentations, labs, and real-world scenarios on modern data and...

  • Senior Data Extraction Engineer

    1 day ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Advanced Web Scraping Specialist">We are seeking a highly skilled and experienced web scraping professional to drive our data extraction operations forward. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.">About the Role:">Design and develop scalable data...

  • Senior Data Architect

    1 day ago

    Meerut, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking a senior data engineer to play a pivotal part in designing, developing, and optimizing data ingestion, transformation, and governance frameworks.This role will enable real-time and batch data analytics across our data platform.Deep expertise in building scalable data pipelines is required.Implementing enterprise-grade data...

  • Data Insights Specialist

    5 days ago

    Meerut, Uttar Pradesh, India beBeeDataAnalysis Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Data Insights SpecialistRole OverviewWe are seeking a skilled data insights specialist to join our team. The ideal candidate will have experience in data cleaning, transformation, and standardization, as well as proficiency in SQL and Python programming languages.Key ResponsibilitiesData Preparation: Clean, transform, and standardize large and...

  • Senior Technical Product Specialist

    6 hours ago

    Meerut, Uttar Pradesh, India beBeeEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title:Senior Technical Product SpecialistAs a Senior Technical Product Specialist, you will play a crucial role in ensuring the success of our engineering team by developing and maintaining component specifications, technical documentation, and collaborating with cross-functional teams.Key Responsibilities:Create and maintain component specifications...

  • Senior Data Engineer

    2 days ago

    Meerut, Uttar Pradesh, India Mitra AI Full time

    We are seeking a candidate who is comfortable working on B shift (3PM - 11PM IST).JOB SPECIFIC DUTIES AND RESPONSIBILITIESDevelop and maintain ETL pipelines using FiveTran, DBT Cloud, and custom frameworksImplement client-specific data transformations for HighTouch integrationSupport data ingestion and quality checks during client onboardingOptimize...

  • Cloud Data Architect Position

    9 hours ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000

    Senior Cloud Data SpecialistAs a seasoned expert in data engineering and architecture, you will lead our initiatives to design and implement end-to-end data pipelines and integration solutions. Your deep understanding of cloud-based technologies like Google Cloud Platform (GCP), Amazon Web Services (AWS), and Microsoft Azure is essential for this role.You...

  • Cloud Data Architectural Specialist

    9 hours ago

    Meerut, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking an experienced Senior Data Engineer to lead the design and maintenance of our cloud-based data architectures.This individual will be responsible for developing scalable real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark.The ideal candidate will possess expertise in:Built scalable real-time...