Data Observability Engineer
1 week ago
Freelancing Opportunity
Job Title: Data Observability Engineer
Experience: 5+ years
About the Role
Seeking a Data Observability Engineer to design, build, and maintain systems ensuring data reliability, quality, traceability, and visibility across the organization. The role involves developing observability frameworks, managing Azure Data Lake Storage (ADLS), and implementing metadata management and governance frameworks.
Key Responsibilities
- Build data observability frameworks to monitor freshness, accuracy, lineage, and anomalies.
- Automate alerts, logging, and monitoring for data pipelines using tools like Monte Carlo, Databand, Great Expectations, OpenLineage, Airflow logging.
- Implement centralized log aggregation (Azure Monitor, Log Analytics, ELK) and ensure full data traceability.
- Manage and optimize ADLS Gen2—architecture, access control, lifecycle, and governance compliance.
- Design metadata frameworks integrating with Azure Purview, Collibra, Amundsen, enabling data discoverability and compliance.
Required Skills
- 5+ years in Data Engineering / Data Platform roles.
- Strong with Azure Data Lake Storage and the Azure data ecosystem.
- Proficient in Python, SQL, Airflow, Databricks, Synapse.
- Experience with data observability and monitoring tools (Datadog, Monte Carlo, Great Expectations, OpenLineage).
- Knowledge of data governance, lineage, and compliance (GDPR, HIPAA).
Preferred Skills
- Experience building custom observability or metadata tools.
- Familiarity with modern data stack (dbt, Snowflake, Kafka, Delta Lake).
- Understanding of scalable data architectures and CI/CD, IaC (Terraform, ARM templates).
Job Types: Part-time, Freelance
Contract length: 12 months
Pay: ₹30, ₹40,000.00 per month
Benefits:
- Work from home
Experience:
- total work: 7 years (Required)
Shift availability:
- Night Shift (Required)
- Overnight Shift (Required)
Work Location: Remote
-
Data Engineer
6 days ago
Remote, India Mig Staffing Full time ₹ 12,00,000 - ₹ 30,00,000 per yearWe are seeking a dynamic and highly skilled Data Engineer who has extensive experience building enterprise scale data platforms and lead these foundational efforts. This role demands someone who not only possesses a profound understanding of the data engineering landscape but is also at the forefront of their game. The ideal candidate will contribute...
-
Operation Analyst
1 week ago
Remote, India Data Engineer Academy LLP Full time ₹ 6,00,000 - ₹ 12,00,000 per yearJob Title: Operations AnalystLocation: Remote | Experience: 0-1 YearsType: Full-TimeNotice-Immediate JoinerAbout Us: Data Engineering Academy is an edtech startup led by FAANG data engineers. We equip aspiring data professionals with the tools, training, and support to succeed in the tech industry.About the Role:We're looking for a proactive Operations...
-
Azure AI Data Engineer
7 hours ago
Remote, India Data PlatformExperts Full time ₹ 70,000 - ₹ 15,00,000 per yearJob Description:We are looking for a skilled and motivated AI Azure Data Engineer with strong expertise in Microsoft Azure data services. The ideal candidate must have hands-on experience with Databricks or Microsoft Fabric and hold a valid certification in either. You will be responsible for designing, developing, and deploying scalable data pipelines,...
-
Part Time
24 hours ago
Remote, India The Language SKOOL Full time**Monitoring and Tracking**:The primary duty of a batch observer is to meticulously observe and record the status of each step within a batch process. This involves tracking inputs, outputs, and any deviations from the expected workflow. - **Documentation**:Accurate and detailed documentation of the batch process is essential. This includes recording any...
-
Data Engineer
2 days ago
Remote, India JUTEQ Inc Full timeJUTEQ is an AI-native and cloud-native consulting firm helping enterprises in financial services, telecom, and automotive retail build intelligent, production-grade platforms. We combine the power of GenAI, scalable cloud architecture, and automation to deliver next-generation business tools. Our platform supports multi-tenant AI agent workflows, real-time...
-
Senior Data Engineer
1 week ago
Remote, India AABM Cloud Data Solutions Full time ₹ 20,00,000 per yearSenior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.Job Type: Full-timePay: From ₹2,000,000.00 per yearApplication Question(s):How many years of Python Experience do you have?How many...
-
Data Engineer
2 days ago
India - Remote Motive Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAbout the Role: As a Data Engineer you will be part of the core data team building out world class data models and pipelines that will feed into our products. You will be working on the intersection of all data streams in the company from our IOT data consuming 100s of thousands of data points per minute to our user data. You will partner closely with both...
-
AI and Data Engineer
4 days ago
Remote, India ABCloudZ Full time ₹ 8,00,000 - ₹ 24,00,000 per yearRemote, IndiaWe're looking for a skilled AI and Data Engineer to join our team. You'll be at the forefront of designing, building, and maintaining the infrastructure that powers our data-driven products and machine learning models. This role requires a strong blend of data engineering expertise, a deep understanding of MLOps principles, and the ability to...
-
Senior Data Engineer
1 week ago
Remote, India delphic Full time ₹ 14,00,000 per yearWe're Hiring: Senior Data Engineer (Remote)Join our growing data team as a Senior Data Engineer and help shape the future of data infrastructure and analytics. We're looking for someone with strong Databricks expertise and a passion for building robust, scalable data solutions.Location: RemoteExperience: 8+ yearsEmployment Type: Full-timeWhat You'll Do:Build...
-
▷ High Salary! Data
2 weeks ago
Remote, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data & AI Engineer Lead to join our team in Remote, Karntaka (IN-KA), India (IN). Job Duties: Role Overview The Data...