Talend/ETL Developer

Description :

Role : Talend ETL Developer

Location : Hyderabad, India Hybrid (3 days onsite)

Experience : 4 - 6 Years

Job Summary :

We are seeking a highly motivated and skilled Talend ETL Developer to join our team, focusing on supporting large-scale data transformation initiatives. The Developer will be responsible for the end-to-end design, development, testing, and optimization of complex ETL jobs using the Talend Studio platform.

This role requires an individual with deep hands-on experience in Talend components and strong expertise in SQL to manage significant data volumes and ensure data quality and integrity across various enterprise data sources. The successful candidate must be able to ramp up quickly to meet demanding project timelines and deliver robust data solutions.

Core Responsibilities :

Talend Development and Data Transformation :

- Develop, implement, and maintain high-volume ETL/ELT jobs using Talend Open Studio and/or Talend Data Integration (including DI components, parallel processing, and context variables).

- Work extensively with ETL tools to support large-scale data transformation and movement between heterogeneous sources and target data warehouses or data lakes.

- Implement robust error handling, logging, and job recovery mechanisms within all developed Talend jobs to ensure data process reliability.

SQL and Data Expertise :

- Leverage strong, advanced SQL knowledge to write complex queries, stored procedures, functions, and views for data extraction, manipulation, and validation.

- Optimize SQL queries and Talend job components to ensure maximum performance and minimal impact on source systems during data load processes.

- Possess a solid understanding of relational database principles and various data warehousing concepts (e.g., dimensional modeling, slowly changing dimensions).

Tool Management and Deployment :

- Utilize and manage the Talend Administration Center (TAC) for scheduling, monitoring, deployment, and auditing of ETL jobs in development, QA, and production environments.

- Perform technical and performance tuning on existing Talend jobs to improve throughput and resource utilization.

Collaboration and Quality Assurance :

- Collaborate effectively with data architects, data modelers, and business analysts to understand data requirements and translate them into efficient technical designs.

- Conduct thorough unit testing and actively support system integration testing (SIT) for all developed ETL pipelines to guarantee data accuracy and transformation logic correctness.

- Demonstrate the ability to quickly grasp new business requirements and operational data structures to support the high volume of expected work.

Required Skills and Qualifications :

- Experience : 4 - 6 years of dedicated, hands-on experience in ETL development, with a significant focus on the Talend platform.

- Talend Proficiency : Proven, expert-level competency in developing complex data integration solutions using Talend Studio.

- Core Skills : Direct experience with Talend Administration Center (TAC) for job deployment, scheduling, monitoring, and user/access management.

- SQL Mastery : Strong, advanced proficiency in SQL for intricate data analysis, query optimization, and manipulation across large relational database systems (e.g., Oracle, PostgreSQL, SQL Server).

- Data Handling : Proven experience in implementing resilient error handling and data validation routines within ETL jobs.

- Problem Solving : Excellent analytical and debugging skills with the ability to quickly identify and resolve data flow and job execution issues.

Preferred Skills :

- Cloud/Big Data Integration : Experience integrating Talend with cloud platforms (e.g., AWS S3, Azure Data Lake) or Big Data technologies (Spark, Hadoop).

- Version Control : Proficiency with version control systems, specifically Git, for managing Talend job repositories and collaborative development.

- Scripting : Familiarity with shell scripting (Bash, Python) for job orchestration and automation of ETL workflows outside of TAC.

- Certification : Relevant certification in Talend Data Integration.