ETL Engineer

2 weeks ago

Remote, India Redlinux Full time

Freelancing Opportunity

Job Title: ETL Engineer/ML

Experience: 7+ Years

Job Overview

We are seeking a highly skilled Machine Learning / ETL Engineer to join our Business Intelligence IT team. The ideal candidate will design, develop, and optimize large-scale ETL/ELT pipelines, integrate diverse data sources, and apply Machine Learning frameworks for data quality and anomaly detection. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver scalable, reliable, and actionable data-driven solutions.

This is a critical role in ensuring data integrity, scalability, and performance of our enterprise data platforms across cloud environments such as Snowflake, AWS, and GCP.

Key Responsibilities

  • Design, architect, and implement robust, high-performance ETL/ELT pipelines for large-scale data processing.
  • Collect and integrate data from multiple sources (databases, APIs, web services) into data lakes or warehouses.
  • Develop and maintain scalable data processing solutions using Snowflake, AWS, and GCP platforms.
  • Implement data quality, anomaly detection, and monitoring systems using Machine Learning frameworks.
  • Optimize query performance and manage large-scale data models, schemas, and metadata.
  • Support data governance through documentation, access control, lineage tracking, and retention policies.
  • Collaborate with cross-functional teams (data scientists, analysts, engineers, and business units) to translate requirements into actionable technical solutions.
  • Participate in CI/CD and automation initiatives to streamline data workflows and improve efficiency.
  • Ensure data accuracy, reliability, and availability for analytical and reporting purposes.

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 7+ years of experience in data warehouse architecture, ETL/ELT pipelines, and data engineering.
  • 5+ years of experience in data modeling and writing advanced SQL queries across Snowflake, Oracle, and Columnar Databases.
  • Strong knowledge of data modeling, schema design, and data lakes.
  • Experience with AWS services such as S3, Lambda, and Data Pipeline.
  • Hands-on experience with Machine Learning algorithms for data quality and anomaly detection.

Technical Skills

  • Programming: Python, SQL
  • ETL Tools: Databricks, IBM DataStage (preferred)
  • Cloud Platforms: Snowflake, AWS, GCP, BigQuery
  • Data Processing Frameworks: Apache Spark (or equivalent big data tools)
  • Workflow Orchestration: Apache Airflow, AWS MWAA
  • DevOps Tools: CI/CD pipelines, automation frameworks
  • Data Architecture: Data lakes, warehouses, multi-cluster architecture, shareable data features
  • Bonus: Familiarity with Databricks, DataStage, and advanced Snowflake capabilities

Job Types: Part-time, Freelance

Contract length: 12 months

Pay: ₹30, ₹40,000.00 per month

Benefits:

  • Work from home

Experience:

  • total work: 6 years (Required)

Shift availability:

  • Night Shift (Required)
  • Overnight Shift (Required)

Work Location: Remote

  • Etl Tester

    5 days ago

    Remote, India Mindtel Global Private Limited Full time

    We are looking for a detail-oriented and experienced ETL (Extract, Transform, Load) Testing Engineer to join our team. As an ETL Testing Engineer, you will be responsible for ensuring the accuracy, completeness, and performance of data extraction, transformation, and loading processes. You will collaborate with cross-functional teams to design, execute, and...

  • AWS/Snowflake Support Engineer

    4 days ago

    Remote, India Data Engineer Academy LLP Full time

    We're Hiring: AWS/Snowflake Support Engineer (SME Role)Remote | Full Time | 7AM EST to 3PM EST| Pay: $ /MonthlyAbout the OpportunityThis role is a blend of a Subject Matter Expert (SME) and support engineer. The primary responsibility is to clear project issues for students while working on multiple projects involving AWS, Snowflake, and dbt. The engineer...

  • ETL Test Engineer

    10 hours ago

    Remote, India MedRec Technologies Full time

    4 years of QA experience in data warehousing and ETL testing.Strong SQL/Snowflake expertise (SnowSQL, Snowpipe processes, stored procedures).Hands-on experience validating large datasets, transformations, and data lineage.Familiarity with data quality frameworks (DBT, Great Expectations, or equivalent).Working knowledge of CI/CD, Git/Bitbucket, and JIRA for...

  • Python Sme

    2 weeks ago

    Remote, India Data Engineer Academy Full time

    **We're Hiring**: Python Expert (SME) - Content Creation on Pandas, SQL, and AWS Remote | Part Time | Flexible Timings | Pay: $500 to $600/Month **About the Opportunity**: We are looking for a highly skilled Python Expert with strong command over Pandas, SQL, and working knowledge of AWS. In this content-focused role, you'll be responsible for creating...

  • GIS Data Engineer

    4 days ago

    remote, India Venpa Global Technologies Full time ₹ 20 - ₹ 40

    GIS Data Engineer / FME ETL Engineer LOCATION- Remote Experience- 5- 10 yrs Budget - 20 -40 LPA Job Summary: We are looking for a GIS Data Engineer / FME ETL Engineer with hands-on experience in building, automating, and optimizing geospatial data pipelines for Electric and Gas Utility Networks.  The role focuses on data integration, transformation, and...

  • GIS Data Engineer

    4 days ago

    Remote, India VENPA GLOBAL TECHNOLOGIES Full time

    GIS Data Engineer / FME ETL EngineerLOCATION- RemoteExperience yrsBudget LPAJob Summary:We are looking for a GIS Data Engineer / FME ETL Engineer with hands-on experience in building, automating, and optimizing geospatial data pipelines for Electric and Gas Utility Networks.The role focuses on data integration, transformation, and validation using FME,...

  • GIS Data Engineer

    5 days ago

    remote, India Venpa Global Technologies Full time

    GIS Data Engineer / FME ETL EngineerLOCATION- RemoteExperience yrsBudget LPAJob Summary:We are looking for a GIS Data Engineer / FME ETL Engineer with hands-on experience in building, automating, and optimizing geospatial data pipelines for Electric and Gas Utility Networks. The role focuses on data integration, transformation, and validation using FME,...

  • Etl Testing with Database and SQL

    5 days ago

    Remote, India DGN Technologies Full time

    Roles and Responsibilities: This position has responsibility and authority for: - Ownership in design, development of test plans/protocols for functional SW verification of system data related products - Provide feedback to Development on requirement/specification clarity and understanding to support proper testing method development - Act as a core team...

  • Data Engineer

    1 week ago

    Remote, India Prospus Consulting Pvt. Ltd. Full time

    Job Title: Data EngineerLocation: RemoteEmployment Type: Full-timeAbout the Role We are looking for a highly skilled Data Engineer with strong expertise in data ingestion, transformation and indexing pipelines for AI agents. The ideal candidate will have experience designing scalable data pipelines, implementing chunking strategies, and ensuring vector DB...

  • Senior Data Engineer

    2 days ago

    Remote, India Rojgar group Full time

    Senior Data EngineerAbout the RoleWe are seeking an experienced **Senior Data Engineer** with expertise in cloud data engineering to join our team. This is an exceptional opportunity for a seasoned professional to work on complex data solutions, leveraging Azure cloud services and Snowflake data platform in a fully remote environment.Position...