ETL Engineer

1 week ago

Remote, India Redlinux Full time

Freelancing Opportunity

Job Title: ETL Engineer/ML

Experience: 7+ Years

Job Overview

We are seeking a highly skilled Machine Learning / ETL Engineer to join our Business Intelligence IT team. The ideal candidate will design, develop, and optimize large-scale ETL/ELT pipelines, integrate diverse data sources, and apply Machine Learning frameworks for data quality and anomaly detection. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver scalable, reliable, and actionable data-driven solutions.

This is a critical role in ensuring data integrity, scalability, and performance of our enterprise data platforms across cloud environments such as Snowflake, AWS, and GCP.

Key Responsibilities

  • Design, architect, and implement robust, high-performance ETL/ELT pipelines for large-scale data processing.
  • Collect and integrate data from multiple sources (databases, APIs, web services) into data lakes or warehouses.
  • Develop and maintain scalable data processing solutions using Snowflake, AWS, and GCP platforms.
  • Implement data quality, anomaly detection, and monitoring systems using Machine Learning frameworks.
  • Optimize query performance and manage large-scale data models, schemas, and metadata.
  • Support data governance through documentation, access control, lineage tracking, and retention policies.
  • Collaborate with cross-functional teams (data scientists, analysts, engineers, and business units) to translate requirements into actionable technical solutions.
  • Participate in CI/CD and automation initiatives to streamline data workflows and improve efficiency.
  • Ensure data accuracy, reliability, and availability for analytical and reporting purposes.

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 7+ years of experience in data warehouse architecture, ETL/ELT pipelines, and data engineering.
  • 5+ years of experience in data modeling and writing advanced SQL queries across Snowflake, Oracle, and Columnar Databases.
  • Strong knowledge of data modeling, schema design, and data lakes.
  • Experience with AWS services such as S3, Lambda, and Data Pipeline.
  • Hands-on experience with Machine Learning algorithms for data quality and anomaly detection.

Technical Skills

  • Programming: Python, SQL
  • ETL Tools: Databricks, IBM DataStage (preferred)
  • Cloud Platforms: Snowflake, AWS, GCP, BigQuery
  • Data Processing Frameworks: Apache Spark (or equivalent big data tools)
  • Workflow Orchestration: Apache Airflow, AWS MWAA
  • DevOps Tools: CI/CD pipelines, automation frameworks
  • Data Architecture: Data lakes, warehouses, multi-cluster architecture, shareable data features
  • Bonus: Familiarity with Databricks, DataStage, and advanced Snowflake capabilities

Job Types: Part-time, Freelance

Contract length: 12 months

Pay: ₹30, ₹40,000.00 per month

Benefits:

  • Work from home

Experience:

  • total work: 6 years (Required)

Shift availability:

  • Night Shift (Required)
  • Overnight Shift (Required)

Work Location: Remote

  • Etl Tester

    1 week ago

    Remote, India Mindtel Global Private Limited Full time

    We are looking for a detail-oriented and experienced ETL (Extract, Transform, Load) Testing Engineer to join our team. As an ETL Testing Engineer, you will be responsible for ensuring the accuracy, completeness, and performance of data extraction, transformation, and loading processes. You will collaborate with cross-functional teams to design, execute, and...

  • ETL / SQL / Data Engineer

    2 weeks ago

    Remote, India ABCO COMPUTERS PVT LTD Full time ₹ 84,000 - ₹ 12,00,000 per year

    QualificationsBachelor's degree in Computer Science, Information Systems, or related field (or equivalent work experience).4+ years of experience as a SQL Developer or Data Engineer.Strong expertise in writing and optimizing SQL queries (complex joins, window functions, performance tuning).Hands-on ETL development experience using any ETL tools . Good to...

  • AWS/Snowflake Support Engineer

    4 days ago

    Remote, India Data Engineer Academy LLP Full time ₹ 10,000 - ₹ 1,50,000 per year

    We're Hiring: AWS/Snowflake Support Engineer (SME Role)Remote | Full Time | 7AM EST to 3PM EST| Pay: $ /MonthlyAbout the OpportunityThis role is a blend of a Subject Matter Expert (SME) and support engineer. The primary responsibility is to clear project issues for students while working on multiple projects involving AWS, Snowflake, and dbt. The engineer...

  • ETL Developer with DBT

    5 days ago

    Remote, India 0651a02c-0aea-4982-b8da-80bf0e922826 Full time ₹ 15,00,000 - ₹ 18,00,000 per year

    Job Opportunity – ETL / DBT / SQL DeveloperExperience Required: 5+ YearsDBT Experience: Min 3 yearsLocation: RemoteNotice Period: Immediate to 30 daysKey Responsibilities:Design, develop, and maintain ETL pipelines using DBT and SQL.Optimize queries and data models for performance and scalability.Collaborate with data engineers, analysts, and business...

  • GIS Data Engineer

    4 days ago

    remote, India Venpa Global Technologies Full time ₹ 20 - ₹ 40

    GIS Data Engineer / FME ETL Engineer LOCATION- Remote Experience- 5- 10 yrs Budget - 20 -40 LPA Job Summary: We are looking for a GIS Data Engineer / FME ETL Engineer with hands-on experience in building, automating, and optimizing geospatial data pipelines for Electric and Gas Utility Networks.  The role focuses on data integration, transformation, and...

  • Senior ETL Developer

    2 weeks ago

    Remote, India INFOSEUM IT OPC PVT LTD Full time ₹ 9,86,000 - ₹ 12,21,868 per year

    Job Title: ETL Automation Tester (Databricks, PySpark, Delta Lake)Job Summary:We're looking for an experienced Data Pipeline Test Engineer to join our team. The successful candidate will have strong expertise in Databricks, PySpark, Delta Lake, and ETL testing, with a focus on automation and data integrity. You'll design, develop, and execute test plans for...

  • GIS Data Engineer

    3 days ago

    remote, India Venpa Global Technologies Full time

    GIS Data Engineer / FME ETL EngineerLOCATION- RemoteExperience yrsBudget LPAJob Summary:We are looking for a GIS Data Engineer / FME ETL Engineer with hands-on experience in building, automating, and optimizing geospatial data pipelines for Electric and Gas Utility Networks. The role focuses on data integration, transformation, and validation using FME,...

  • QA Tester

    2 weeks ago

    Remote, India Rapsys Technologies Full time

    **Years of experience: 5+ Years** **JD**: **Responsibilities**: - Design and execute test plans and test cases for validating ETL pipelines and data transformations during the migration to Snowflake. - Perform data reconciliation between source systems (S3 files, PostgreSQL) and target Snowflake tables. - Validate Snowflake scripting logic (SQL/stored...

  • GIS Data Engineer

    4 days ago

    remote, India Venpa Global Technologies Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    GIS Data Engineer / FME ETL EngineerLOCATION- RemoteExperience yrsBudget LPAJob Summary:We are looking for a GIS Data Engineer / FME ETL Engineer with hands-on experience in building, automating, and optimizing geospatial data pipelines for Electric and Gas Utility Networks. The role focuses on data integration, transformation, and validation using FME,...

  • GIS Data Engineer

    3 days ago

    Remote, India VENPA GLOBAL TECHNOLOGIES Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    GIS Data Engineer / FME ETL EngineerLOCATION- RemoteExperience yrsBudget LPAJob Summary:We are looking for a GIS Data Engineer / FME ETL Engineer with hands-on experience in building, automating, and optimizing geospatial data pipelines for Electric and Gas Utility Networks.The role focuses on data integration, transformation, and validation using FME,...