ETL Developers with Experience in Airflow

Job Title: ETL Developer
with Experience in Airflow , Snowflake & Redshift

Team: Technology

Work Location: Coimbatore

Job Summary:

We are looking for an experienced Senior ETL Developer with strong hands-on expertise in SSIS and SQL Server to join our data engineering team on a contract basis. The selected candidate will be responsible for developing, optimizing, and maintaining robust ETL workflows that support business analytics and reporting needs.

This is a high-impact role for someone who thrives in a fast-paced, delivery-oriented environment and can work independently with minimal supervision.

Key Responsibilities:

1. Design and Development of ETL Workflows:

Develop, enhance, and maintain robust SSIS packages to extract, transform, and load data from various sources (e.g., flat files, Excel, SQL Server, APIs).

Implement complex business logic and transformation rules within SSIS.

Design reusable components like configuration-driven packages, parameterized data flows, and modular templates.

2. Performance Optimization:

Analyse and tune SSIS packages for performance (e.g., buffer sizes, data flow parallelism, lookup caching).

Identify and resolve bottlenecks in ETL workflows.

Use best practices for managing large volumes of data, including incremental loads and change data capture (CDC).

3. Data Quality and Validation:

Implement data quality checks and validations within ETL pipelines.

Create audit and control frameworks for monitoring completeness and accuracy of data movement.

Handle data cleansing, deduplication, and standardization as part of transformation logic.

4. Error Handling and Logging:

Build comprehensive logging and error-handling mechanisms within SSIS (e.g., event handlers, custom logs, notification alerts).

Troubleshoot and debug failed packages or erroneous data movements effectively.

5. Deployment and Automation:

Package and deploy SSIS solutions using tools like SSDT, MSBuild, and Azure DevOps or other CI/CD pipelines.

Schedule and monitor ETL jobs using SQL Server Agent or enterprise schedulers.

Maintain SSIS package versions and manage deployment across dev/test/prod environments.

6. Documentation and Technical Specifications:

Document data flow logic, transformation rules, and package dependencies.

Create and maintain technical specifications for ETL processes.

Support knowledge transfer and onboarding of junior developers by maintaining updated documentation.

7. Collaboration and Stakeholder Communication:

Work closely with data architects, DBAs, and business analysts to understand requirements and translate them into ETL solutions.

Participate in requirement gathering sessions and contribute to solution design discussions.

Provide estimations, timelines, and status updates for development activities.

8. Standards and Best Practices:

Promote SSIS development standards including naming conventions, modularity, parameterization, and logging.

Participate in code reviews to ensure maintainability and consistency.

Continuously evaluate and apply improvements to coding and performance practices.

Required Skills & Experience:

• 6+ years of experience in ETL development using SSIS.
• Strong proficiency in SQL Server and advanced T-SQL scripting.
• Solid understanding of data warehousing principles, dimensional modeling (Kimball), and data integration patterns.
• Experience with job orchestration tools and schedulers (e.g., SQL Agent, Control-M, Azure Data Factory).
• Strong troubleshooting and performance optimization skills.
• Ability to work independently, meet deadlines, and communicate effectively with technical and business teams.

Preferred Skills:

• Exposure to cloud platforms like Azure Data Factory, Azure Synapse, or AWS Glue.
• Experience with reporting tools such as Power BI, SSRS, or Tableau.
• Previous experience working in healthcare, finance, or other regulated domains is a plus.
• Familiarity with version control tools (e.g., Git, Azure DevOps).
• Bachelor's degree in Computer Science, Information Technology, or a related field.