ETL Developers with Experience in Airflow, Snowflake

4 weeks ago

Erode, Tamil Nadu, India Value Health Inc Full time

Job Title: ETL Developers

Job Location: Coimbatore

Type: WFO

Job description

Key Responsibilities:

1. ETL Design and Development:

Design and develop efficient, scalable SSIS packages to extract, transform, and load data between systems.

Translate business requirements into technical ETL solutions using data flow and control flow logic.

Develop reusable ETL components that support modular, configuration-driven architecture.

2. Data Integration and Transformation:

Integrate data from multiple heterogeneous sources: SQL Server, flat files, APIs, Excel, etc.

Implement business rules and data transformations such as cleansing, standardization, enrichment, and deduplication.

Manage incremental loads, full loads, and slowly changing dimensions (SCD) as required.

3. SQL and Database Development:

Write complex T-SQL queries, stored procedures, and functions to support data transformations and staging logic.

Perform joins, unions, aggregations, filtering, and windowing operations effectively for data preparation.

Ensure referential integrity and proper indexing for performance.

4. Performance Tuning:

Optimize SSIS packages by tuning buffer sizes, using parallelism, and minimizing unnecessary transformations.

Tune SQL queries and monitor execution plans for efficient data movement and transformation.

Implement efficient data loads for high-volume environments.

5. Error Handling and Logging:

Develop error-handling mechanisms and event logging in SSIS using Event Handlers and custom logging frameworks.

Implement restartability, checkpoints, and failure notifications in workflows.

6. Testing and Quality Assurance:

Conduct unit and integration testing of ETL pipelines.

Validate data outputs against source and business rules.

Support QA teams in user acceptance testing (UAT) and defect resolution.

7. Deployment and Scheduling:

Package, deploy, and version SSIS solutions across development, test, and production environments.

Schedule ETL jobs using SQL Server Agent or enterprise job schedulers (e.g., Control-M, Tidal).

Monitor and troubleshoot job failures and performance issues.

8. Documentation and Maintenance:

Maintain documentation for ETL designs, data flow diagrams, transformation logic, and job schedules.

Update job dependencies and maintain audit trails for data pipelines.

9. Collaboration and Communication:

Collaborate with data architects, business analysts, and reporting teams to understand data needs.

Provide technical support and feedback during requirements analysis and post- deployment support.

Participate in sprint planning, status reporting, and technical reviews.

10. Compliance and Best Practices:

Ensure ETL processes comply with data governance, security, and privacy regulations (HIPAA, GDPR, etc.).

Follow team coding standards, naming conventions, and deployment protocols.

Required Skills s Experience:

  • 4–8 years of hands-on experience with ETL development using SSIS.
  • Strong SQL Server and T-SQL skills.
  • Solid understanding of data warehousing concepts and best practices.
  • Experience with flat files, Excel, APIs, or other common data sources.
  • Familiarity with job scheduling and monitoring (e.g., SQL Agent).
  • Strong analytical and troubleshooting skills.
  • Ability to work independently and meet deadlines.

Preferred Skills:

  • Exposure to Azure Data Factory or cloud-based ETL tools.
  • Experience with Power BI or other reporting platforms.
  • Experience in healthcare, finance, or regulated domains is a plus.
  • Knowledge of version control tools like Git or Azure DevOps.

  • Senior Data Engineer with GCP, ETL

    4 weeks ago

    Erode, Tamil Nadu, India iitjobs, Inc. Full time

    GreetingsRole : Senior Data Engineer with GCP, ETLLocation- 100 % RemoteExp Range- 4+ YrsNotice Period- Immediate Joiners only.Duration- 4 months ContractTime: 11 am to 8 pm ISTMust have skills:1. GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, Python(preferred)/Java2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best...

  • Data Architect

    4 weeks ago

    Erode, Tamil Nadu, India Bits In Glass Full time

    Practice: Data Engineering & AILocation: Office (Pune / Mohali / Hyderabad)Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL processes to support downstream analytics and AI applications.Collaborate with ML Engineers to integrate data solutions into machine learning models and workflows.Work closely with clients to understand...

  • Ecosys, PPM

    4 weeks ago

    Erode, Tamil Nadu, India People Prime Worldwide Full time

    About Company: They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society.Job...

  • AWS Data Engineer with Dynamo DB Experience

    4 weeks ago

    Erode, Tamil Nadu, India Sustainability Economics Full time

    Position Title: AWS Data Engineer with Dynamo DB Experience Location: Bengaluru, Karnataka About the Company: Sustainability Economics.ai is a global organisation targeting the markets of US, Japan, EU, UK, Canada and Singapore. As a pioneer, our focus is on the Lifecycle Management of E2E Net-Zero transitions while leveraging our automation-first...

  • User Experience Designer

    2 weeks ago

    Erode, Tamil Nadu, India araCreate Group Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role OverviewWe are seeking a skilled UI/UX Designer with strong design concepts, attention to aesthetics, and hands-on expertise in delivering user-centered design projects. You will take end-to-end ownership of design projects, collaborate with cross-functional teams, and help us establish a design-first culture within our growing team.Knowledge of...

  • AWS Data Engineer

    4 weeks ago

    Erode, Tamil Nadu, India DigiHelic Solutions Pvt. Ltd. Full time

    Key Responsibilities:• Design, develop, and maintain scalable data pipelines and ETL/ELT solutions usingAWS cloud services.• Ingest, process, and store structured/unstructured data from multiple sources (IoTdevices, sensors, ERP systems, drilling logs, production data, etc.).• Implement data lakeand data warehouse solutions• Optimize data pipelines...

  • Senior Site Engineer

    3 days ago

    Erode, Tamil Nadu, India Smart Infratech Developers Full time ₹ 2,40,000 - ₹ 4,80,000 per year

    We are Hiring ....Position : Site EngineerExperience : 2 to 7 yearsEducation : Dip civil, BE civil , any degree Experience in Site EngineerWork Location : Chennai, Salem, Karur, Ulumalpet, Rameshwaram, Karaikudi, Perambalur, Coimbatore.Salary : 20000 to 40000 / Based Experienced Also .Free Accommodation ( As per the Site Condition )provide Food ( As per the...

  • Site Reliability Engineer II

    4 weeks ago

    Erode, Tamil Nadu, India Zafin Full time

    Senior Site Reliability Engineer (SRE II) Own availability, latency, performance, and efficiency for Zafin's SaaS on Azure. You'll define and enforce reliability standards, lead high-impact projects, mentor engineers, and eliminate toil at scale. Reports to the Director of SRE.What you'll doSLIs/SLOs & contracts: Define customer-centric SLIs/SLOs for...

  • Flutter Developer

    7 days ago

    Erode, Tamil Nadu, India Paperfox Technologies (OPC) Pvt. Ltd Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Company DescriptionPaperfox Technologies (OPC) Pvt. Ltd. specializes in turning digitalization ideas into real software solutions, including web and mobile app development. They focus on design to development, ensuring faster time-to-market solutions that address significant business operational problems.Role DescriptionThis is a full-time on-site role for a...

  • Staff Engineer

    4 weeks ago

    Erode, Tamil Nadu, India DISH Network Technologies Full time

    13+ years of experience in online charging systems, with at least 4-5 years in a solution architect role focused on Matrixx online charging system. Deep understanding of online and offline charging principles.Proven hands-on experience designing and implementing solutions using the Matrixx Digital Commerce Platform (DCP).Strong work experience in Matrixx...