Data Observability Engineer

1 week ago


Remote, India Redlinux Full time ₹ 3,60,000 - ₹ 4,80,000 per year

Freelancing Opportunity

Job Title: Data Observability Engineer

Experience: 5+ years

About the Role

Seeking a Data Observability Engineer to design, build, and maintain systems ensuring data reliability, quality, traceability, and visibility across the organization. The role involves developing observability frameworks, managing Azure Data Lake Storage (ADLS), and implementing metadata management and governance frameworks.

Key Responsibilities

  • Build data observability frameworks to monitor freshness, accuracy, lineage, and anomalies.
  • Automate alerts, logging, and monitoring for data pipelines using tools like Monte Carlo, Databand, Great Expectations, OpenLineage, Airflow logging.
  • Implement centralized log aggregation (Azure Monitor, Log Analytics, ELK) and ensure full data traceability.
  • Manage and optimize ADLS Gen2—architecture, access control, lifecycle, and governance compliance.
  • Design metadata frameworks integrating with Azure Purview, Collibra, Amundsen, enabling data discoverability and compliance.

Required Skills

  • 5+ years in Data Engineering / Data Platform roles.
  • Strong with Azure Data Lake Storage and the Azure data ecosystem.
  • Proficient in Python, SQL, Airflow, Databricks, Synapse.
  • Experience with data observability and monitoring tools (Datadog, Monte Carlo, Great Expectations, OpenLineage).
  • Knowledge of data governance, lineage, and compliance (GDPR, HIPAA).

Preferred Skills

  • Experience building custom observability or metadata tools.
  • Familiarity with modern data stack (dbt, Snowflake, Kafka, Delta Lake).
  • Understanding of scalable data architectures and CI/CD, IaC (Terraform, ARM templates).

Job Types: Part-time, Freelance

Contract length: 12 months

Pay: ₹30, ₹40,000.00 per month

Benefits:

  • Work from home

Experience:

  • total work: 7 years (Required)

Shift availability:

  • Night Shift (Required)
  • Overnight Shift (Required)

Work Location: Remote


  • Data Engineer

    6 days ago


    Remote, India Mig Staffing Full time ₹ 12,00,000 - ₹ 30,00,000 per year

    We are seeking a dynamic and highly skilled Data Engineer who has extensive experience building enterprise scale data platforms and lead these foundational efforts. This role demands someone who not only possesses a profound understanding of the data engineering landscape but is also at the forefront of their game. The ideal candidate will contribute...

  • Operation Analyst

    1 week ago


    Remote, India Data Engineer Academy LLP Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Job Title: Operations AnalystLocation: Remote | Experience: 0-1 YearsType: Full-TimeNotice-Immediate JoinerAbout Us: Data Engineering Academy is an edtech startup led by FAANG data engineers. We equip aspiring data professionals with the tools, training, and support to succeed in the tech industry.About the Role:We're looking for a proactive Operations...


  • Remote, India Data PlatformExperts Full time ₹ 70,000 - ₹ 15,00,000 per year

    Job Description:We are looking for a skilled and motivated AI Azure Data Engineer with strong expertise in Microsoft Azure data services. The ideal candidate must have hands-on experience with Databricks or Microsoft Fabric and hold a valid certification in either. You will be responsible for designing, developing, and deploying scalable data pipelines,...

  • Part Time

    24 hours ago


    Remote, India The Language SKOOL Full time

    **Monitoring and Tracking**:The primary duty of a batch observer is to meticulously observe and record the status of each step within a batch process. This involves tracking inputs, outputs, and any deviations from the expected workflow. - **Documentation**:Accurate and detailed documentation of the batch process is essential. This includes recording any...

  • Data Engineer

    2 days ago


    Remote, India JUTEQ Inc Full time

    JUTEQ is an AI-native and cloud-native consulting firm helping enterprises in financial services, telecom, and automotive retail build intelligent, production-grade platforms. We combine the power of GenAI, scalable cloud architecture, and automation to deliver next-generation business tools. Our platform supports multi-tenant AI agent workflows, real-time...


  • Remote, India AABM Cloud Data Solutions Full time ₹ 20,00,000 per year

    Senior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.Job Type: Full-timePay: From ₹2,000,000.00 per yearApplication Question(s):How many years of Python Experience do you have?How many...

  • Data Engineer

    2 days ago


    India - Remote Motive Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About the Role: As a Data Engineer you will be part of the core data team building out world class data models and pipelines that will feed into our products. You will be working on the intersection of all data streams in the company from our IOT data consuming 100s of thousands of data points per minute to our user data. You will partner closely with both...


  • Remote, India ABCloudZ Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Remote, IndiaWe're looking for a skilled AI and Data Engineer to join our team. You'll be at the forefront of designing, building, and maintaining the infrastructure that powers our data-driven products and machine learning models. This role requires a strong blend of data engineering expertise, a deep understanding of MLOps principles, and the ability to...


  • Remote, India delphic Full time ₹ 14,00,000 per year

    We're Hiring: Senior Data Engineer (Remote)Join our growing data team as a Senior Data Engineer and help shape the future of data infrastructure and analytics. We're looking for someone with strong Databricks expertise and a passion for building robust, scalable data solutions.Location: RemoteExperience: 8+ yearsEmployment Type: Full-timeWhat You'll Do:Build...

  • ▷ High Salary! Data

    2 weeks ago


    Remote, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data & AI Engineer Lead to join our team in Remote, Karntaka (IN-KA), India (IN). Job Duties: Role Overview The Data...