Data Engineer

Company Description

Cloudmatic Technologies Pvt. Ltd. is a leading web solutions IT firm, specializing in driving digital transformation through innovative and robust solutions. The company is powered by a talented team of leaders, project managers, architects, developers, and testers, all of whom embody curiosity and practicality in their approach. Cloudmatic is dedicated to guiding customers into impactful digital experiences by delivering cutting-edge technological solutions. The organization thrives on fostering innovation and creating pathways for businesses to succeed in the digital landscape.

Role Description

This is a contract-based, on-site role for a Data Engineer located in Chennai. The Data Engineer will be responsible for designing, building, and maintaining efficient and reliable data systems, pipelines, and architectures. The role involves collaborating with cross-functional teams to analyze data requirements, ensure data accuracy, and support business intelligence initiatives. Additional tasks include optimizing data flow, handling large datasets, and leveraging technology to solve data-related challenges.

Qualifications

• Proficient in Data Engineering technologies, including designing scalable data pipelines and data architectures
• Strong programming and development skills in SQL, Python, and relevant data-related languages
• Experience in big data technologies such as Apache Spark, Hadoop, and ETL frameworks
• Familiarity with cloud platforms and tools like AWS, Azure, or Google Cloud Platform
• Knowledge of data modeling, warehousing, and database management systems
• Proficient in data analysis, visualization tools, and business intelligence platforms
• Excellent problem-solving abilities and communication skills to collaborate with diverse teams
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Prior experience in similar roles and knowledge of industry best practices is highly desirable

Key Responsibilities:

• Design, build, and optimize end-to-end data pipelines using
  Informatica IDMC (or IICS)
  , including Cloud Data Integration and Cloud Application Integration.
• Implement ETL/ELT processes to support data lakehouse, and EDW use cases.
• Perform data cleansing activities. Data profiling and implement data quality rules using IDQ.
• Develop and maintain CI/CD pipelines to support automated deployment and version control.
• Work closely with data architects, analysts, and business stakeholders to translate data requirements into scalable solutions.
• Monitor job performance, troubleshoot issues, and ensure compliance with SLAs and data quality standards and policies.
• Document technical designs, workflows, and integration processes following best practices.
• Collaborate with DevOps and cloud engineering teams to ensure seamless integration within the cloud ecosystem.

Required Qualifications:

• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
• Minimum
  5 years of hands-on experience
  with
  Informatica IDMC
  .
• Hands-on experience with
  Informatica Data Quality (IDQ)
  for data profiling, cleansing.
• Experience in building and deploying
  CI/CD pipelines
  using tools such as Git, or Azure DevOps.
• Proficient in
  SQL
  , data modeling, and transformation logic.
• Experience with cloud platforms (Azure or OCI).
• Strong problem-solving skills in data operations and pipeline performance.

Preferred / Nice-to-Have Skills:

• Experience with
  Informatica Data Catalog
  for metadata and lineage tracking.
• Familiarity with
  Informatica Data Governance
  tools such as Axon and Business Glossary.
• Experience developing data pipelines using Azure Data Factory or Oracle ODI.