Equifax - Data Observability Lead - Scala/Python

3 weeks ago


Pune, India Equifax Full time

Data Observability Lead


We are looking for an experienced Data Observability Lead to drive the design and implementation of data monitoring, reliability, and governance solutions across our enterprise data ecosystem. This role will combine technical hands-on skills with leadership responsibilities to ensure that data pipelines and platforms remain reliable, transparent, and trustworthy for business-critical decisions.


What You Will Do :


- Lead the design, implementation, and operation of data observability platforms to track data quality, freshness, lineage, and reliability.


- Define and implement cross-pipeline monitoring frameworks to proactively detect anomalies, drift, or issues across data sources.


- Collaborate with data engineering, analytics, and platform teams to integrate observability solutions into existing data pipelines (on-prem and cloud).


- Establish standards for data health metrics, SLAs, and error handling across ingestion, transformation, and consumption layers.


- Manage data lineage tracking, schema evolution monitoring, and compliance reporting.


- Define and evangelize best practices for monitoring, alerting, dashboards, and incident response related to data pipelines.


- Research and apply modern observability tools (Monte Carlo, Databand, Bigeye, OpenLineage, Great Expectations, custom frameworks).


- Build infrastructure-as-code (Terraform/CloudFormation) to deploy observability components consistently across environments.


- Engage in architecture discussions and technology roadmaps to embed observability into the core of our data strategy.


- Mentor junior engineers and lead sprint deliverables focused on pipeline reliability and monitoring.


What Experience You Need :


- Bachelors/Masters in Computer Science, Data Engineering, or related field.


- 8+ years of professional experience in data engineering, software development, or reliability engineering, with at least 3+ years dedicated to observability or monitoring.


- Strong coding skills in Python, Java, or Scala for building observability automation.


- Deep expertise with data engineering frameworks (Spark, Airflow, dbt, Kafka, Glue, EMR).


- Hands-on experience with observability/monitoring/logging tools (Datadog, Prometheus, Grafana, Monte Carlo, OpenTelemetry, OpenLineage).


- Strong understanding of cloud data ecosystems (AWS, GCP, or Azure).


- Familiarity with DevOps/CI-CD practices including Git, Jenkins/GitHub Actions, Docker, Kubernetes.


- Knowledge of frontend tools (React/Angular, JavaScript/TypeScript) for custom observability dashboards is a plus.


- Excellent problem-solving, debugging, and system-level thinking abilities.

(ref:hirist.tech)

  • Pune, India Equifax Full time

    What Youll Do :- Works independently within Data and Analytics with limited design help from manager or senior associates.- Leverage coding best practices and advanced techniques to ensure efficient execution of code against large datasets, ensuring code is repeatable and scalable.- Run, create and optimize standard processes to ensure metrics, reports and...


  • IND-Pune-Equifax Analytics-PTEC, India Equifax Credit Information Services Pvt Ltd Full time ₹ 25,00,000 - ₹ 40,00,000 per year

    Data Observability - Lead Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you.Job Description What you will do Perform general application development activities, including unit testing,...

  • Data Analyst

    3 weeks ago


    Pune, India Equifax Full time

    Equifax is looking for a Data Analyst to join our team in India supporting the Canada business unit. As a Data Analyst at Equifax, you will work with stakeholders to use data and analytics to provide key insights and drive business decisions. The ideal candidate will possess strong technical skills and a passion for uncovering solutions, business insights...

  • Data Analyst

    2 weeks ago


    Pune, Maharashtra, India Equifax Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Equifax is looking for a Data Analyst to join our team in India supporting the Canada business unit. As a Data Analyst at Equifax, you will work with stakeholders to use data and analytics to provide key insights and drive business decisions.The ideal candidate will possess strong technical skills and a passion for uncovering solutions, business insights...


  • Pune, India Equifax Analytics Private Limited Full time

    This position allows the successful incumbent to develop deep technical and broad commercial skills by being exposed to, and working on a wide variety of internal projects. Working as part of a large, sophisticated analytics team, this role will be required to: Manipulate and analyse data for the development and validation of predictive models in the areas...

  • Data Scientist

    2 weeks ago


    Pune, Maharashtra, India Equifax Full time

    **Pune** **India** **Data & Analytics** **Full time** **6/9/2025** **J00168455** Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. This position allows the successful incumbent to develop...

  • Data Scientist

    3 weeks ago


    Pune, India Equifax Full time

    This position allows the successful incumbent to develop deep technical and broad commercial skills by being exposed to, and working on a wide variety of internal projects. Working as part of a large, sophisticated analytics team, this role will be required to: Manipulate and analyse data for the development and validation of predictive models in the areas...

  • Data Scientist

    2 weeks ago


    Pune, Maharashtra, India Equifax Full time

    This position allows the successful incumbent to develop deep technical and broad commercial skills by being exposed to, and working on a wide variety of internal projects. Working as part of a large, sophisticated analytics team, this role will be required to: - Manipulate and analyse data for the development and validation of predictive models in the...


  • Pune, India Equifax Full time

    (SRE) at Equifax is a discipline that combines software and systems engineering for building and running large-scale, distributed, fault-tolerant systems. SRE ensures that internal and external services meet or exceed reliability and performance expectations while adhering to Equifax engineering principles. SRE is also an engineering approach to building and...


  • Pune, India Equifax Full time

    Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. The Database Engineer will be actively involved in the evaluation, review, and management of databases. You will be part of a team who supports a...