Senior Etl Developer

6 days ago

Coimbatore, Tamil Nadu, India Connected Value Health Solutions Full time ₹ 6,00,000 - ₹ 12,00,000 per year

Sr ETL Developer

Job Title: Sr ETL Developer

Location: Coimbatore

Start Date: ASAP

Job Summary:

We are looking for an experienced Sr ETL Developer with strong expertise in Apache Airflow, Redshift, and SQL-based data pipelines, with upcoming transitions to Snowflake. This is a contract role based in Coimbatore, ideal for professionals who can independently deliver high-quality ETL solutions in a cloud-native, fast-paced environment.

Key Responsibilities:

1. ETL Design and Development:

  • Design and develop scalable and modular ETL pipelines using Apache Airflow, with orchestration and monitoring capabilities.
  • Translate business requirements into robust data transformation pipelines across cloud data platforms.
  • Develop reusable ETL components to support a configuration-driven architecture.

2. Data Integration and Transformation:

  • Integrate data from multiple sources: Redshift, flat files, APIs, Excel, and relational databases.
  • Implement transformation logic such as cleansing, standardization, enrichment, and deduplication.
  • Manage incremental and full loads, along with SCD handling strategies.

3. SQL and Database Development:

  • Write performant SQL queries for data staging and transformation within Redshift and Snowflake.
  • Utilize joins, window functions, and aggregations effectively.
  • Ensure indexing and query tuning for high-performance workloads.

4. Performance Tuning:

  • Optimize data pipelines and orchestrations for large-scale data volumes.
  • Tune SQL queries and monitor execution plans.
  • Implement best practices in distributed data processing and cloud-native optimizations.

5. Error Handling and Logging:

  • Implement robust error handling and logging in Airflow DAGs.
  • Enable retry logic, alerting mechanisms, and failure notifications.

6. Testing and Quality Assurance:

  • Conduct unit and integration testing of ETL jobs.
  • Validate data outputs against business rules and source systems.
  • Support QA during UAT cycles and help resolve data defects.

7. Deployment and Scheduling:

  • Deploy pipelines using Git-based CI/CD practices.
  • Schedule and monitor DAGs using Apache Airflow and integrated tools.
  • Troubleshoot failures and ensure data pipeline reliability.

8. Documentation and Maintenance:

  • Document data flows, DAG configurations, transformation logic, and operational procedures.
  • Maintain change logs and update job dependency charts.

9. Collaboration and Communication:

  • Work closely with data architects, analysts, and BI teams to define and fulfill data needs.
  • Participate in stand-ups, sprint planning, and post-deployment reviews.

10. Compliance and Best Practices:

  • Ensure ETL processes adhere to data security, governance, and privacy regulations (HIPAA, GDPR, etc.).
  • Follow naming conventions, version control standards, and deployment protocols.

Required Skills & Experience:

  • 6+ years of hands-on experience in ETL development.
  • Proven experience with Apache Airflow, Amazon Redshift, and strong SQL.
  • Strong understanding of data warehousing concepts and cloud-based data ecosystems.
  • Familiarity with handling flat files, APIs, and external sources.
  • Experience with job orchestration, error handling, and scalable transformation patterns.
  • Ability to work independently and meet deadlines.

Preferred Skills:

  • Exposure to Snowflake or plans to migrate to Snowflake platforms.
  • Experience in healthcare, life sciences, or regulated environments is a plus.
  • Familiarity with Azure Data Factory, Power BI, or other cloud BI tools.
  • Knowledge of Git, Azure DevOps, or other version control and CI/CD platforms.

Role & responsibilities

Preferred candidate profile

  • ETL Developer

    4 weeks ago

    Coimbatore, Tamil Nadu, India Value Health Inc Full time

    Job Title : ETL Developer with Experience in Airflow , Snowflake & Redshift.Team : Technology.Work Location : Coimbatore.Job Summary :We are looking for an experienced Senior ETL Developer with strong hands-on expertise in SSIS and SQL Server to join our data engineering team on a contract basis.The selected candidate will be responsible for developing,...

  • ETL Developer

    5 days ago

    Coimbatore, Tamil Nadu, India Value Health Inc Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Job Title :ETL Developer with Experience in Airflow , Snowflake & Redshift.Team :Technology.Work Location :Coimbatore.Job SummaryWe are looking for an experienced Senior ETL Developer with strong hands-on expertise in SSIS and SQL Server to join our data engineering team on a contract basis.The selected candidate will be responsible for developing,...

  • ETL Developer

    3 weeks ago

    Coimbatore, Tamil Nadu, India Value Health Inc Full time

    Job Title : ETL Developers.Job Location : Coimbatore.Type : WFO.Job description :Key Responsibilities : ETL Design and Development :- Design and develop efficient, scalable SSIS packages to extract, transform, and load data between systems.- Translate business requirements into technical ETL solutions using data flow and control flow logic.- Develop...

  • ETL Developers with Experience in Airflow

    6 days ago

    Coimbatore, Tamil Nadu, India Value Health Inc Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title: ETL Developerwith Experience in Airflow , Snowflake & RedshiftTeam: TechnologyWork Location: CoimbatoreJob Summary:We are looking for an experienced Senior ETL Developer with strong hands-on expertise in SSIS and SQL Server to join our data engineering team on a contract basis. The selected candidate will be responsible for developing, optimizing,...

  • ETL Specialist

    4 weeks ago

    Coimbatore, Tamil Nadu, India Responsive Full time

    About the job :We are seeking a highly skilled ETL Specialist with expertise in building, maintaining, and optimizing data pipelines using Python scripting. The ideal candidate will have experience working in a Linux environment, managing large-scale data ingestion, processing files in S3, and balancing disk space and warehouse storage efficiently. This role...

  • SSIS Developer

    3 days ago

    Coimbatore, Tamil Nadu, India Digital Orbis Creators LLP Full time ₹ 24,00,000 - ₹ 60,00,000 per year

    Roles & Responsibilities of an SSIS Developer● ETL Development – Design, develop, and deploy SSIS packages to extract, transform, and load (ETL) data from various sources into target systems (data warehouses, databases, reporting systems).● SQL Development – Write and optimize complex T-SQL queries, stored procedures, and functions for data...

  • Senior Software Engineer

    1 week ago

    Coimbatore, Tamil Nadu, India Talent21 Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Are you a skilled Senior Software Engineer who is proficient in C#, .NET Framework, MVC, SSIS, SQL Server 2016, Visual Studio 2017 for SSIS, VS 2019 for web applications, and IBM MQ? If so, we have an exciting opportunity for you to join our team.Job Responsibilities:Design, develop, and maintain software applications using C#, .NET Framework, and MVC.Create...

  • Business Analyst/Developer

    5 days ago

    Coimbatore, Tamil Nadu, India Zettastack Systems Full time ₹ 1,50,000 - ₹ 2,00,000 per year

    Business Analyst/DeveloperLocation: Remote (US Hours)Reporting To: VP of SalesCompany: ZettaStack (on behalf of our US client)About the RoleZettaStack is seeking a highly skilled Business Analyst/Developer to support our US-based client. The ideal candidate will be detail-oriented, self-driven, and capable of working in a fast-paced environment while...

  • Backend Developer- Golang

    5 days ago

    Coimbatore, Tamil Nadu, India Loanwiser Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Location:Onsite – Coimbatore, IndiaEmployment Type:Full-timeAbout UsWe are building next-generationlending and financial systemsthat demand scalable backends, complex data models, and computation-heavy processing. Our platforms power CRM, loan origination, loan management, credit assessment, and financial analytics for lenders and financial...

  • Senior React Native Developer

    3 weeks ago

    Coimbatore, Tamil Nadu, India Squash Apps Full time

    Role : Senior React Native DeveloperLocation : Coimbatore, IndiaEmployment Type : Full-timeJob Overview : We are seeking a Senior React Native Developer for a full-time, on-site role in Coimbatore. You'll be responsible for creating and maintaining high-performance mobile applications using React Native. This role involves collaborating with cross-functional...