Equifax - Data Observability Lead - Scala/Python

3 weeks ago


Pune, India Equifax Full time

Data Observability LeadWe are looking for an experienced Data Observability Lead to drive the design and implementation of data monitoring, reliability, and governance solutions across our enterprise data ecosystem. This role will combine technical hands-on skills with leadership responsibilities to ensure that data pipelines and platforms remain reliable, transparent, and trustworthy for business-critical decisions.What You Will Do :- Lead the design, implementation, and operation of data observability platforms to track data quality, freshness, lineage, and reliability.- Define and implement cross-pipeline monitoring frameworks to proactively detect anomalies, drift, or issues across data sources.- Collaborate with data engineering, analytics, and platform teams to integrate observability solutions into existing data pipelines (on-prem and cloud).- Establish standards for data health metrics, SLAs, and error handling across ingestion, transformation, and consumption layers.- Manage data lineage tracking, schema evolution monitoring, and compliance reporting.- Define and evangelize best practices for monitoring, alerting, dashboards, and incident response related to data pipelines.- Research and apply modern observability tools (Monte Carlo, Databand, Bigeye, OpenLineage, Great Expectations, custom frameworks).- Build infrastructure-as-code (Terraform/CloudFormation) to deploy observability components consistently across environments.- Engage in architecture discussions and technology roadmaps to embed observability into the core of our data strategy.- Mentor junior engineers and lead sprint deliverables focused on pipeline reliability and monitoring.What Experience You Need :- Bachelors/Masters in Computer Science, Data Engineering, or related field.- 8+ years of professional experience in data engineering, software development, or reliability engineering, with at least 3+ years dedicated to observability or monitoring.- Strong coding skills in Python, Java, or Scala for building observability automation.- Deep expertise with data engineering frameworks (Spark, Airflow, dbt, Kafka, Glue, EMR).- Hands-on experience with observability/monitoring/logging tools (Datadog, Prometheus, Grafana, Monte Carlo, OpenTelemetry, OpenLineage).- Strong understanding of cloud data ecosystems (AWS, GCP, or Azure).- Familiarity with DevOps/CI-CD practices including Git, Jenkins/GitHub Actions, Docker, Kubernetes.- Knowledge of frontend tools (React/Angular, JavaScript/TypeScript) for custom observability dashboards is a plus.- Excellent problem-solving, debugging, and system-level thinking abilities. (ref:hirist.tech)



  • Pune, India Equifax Full time

    What Youll Do :- Works independently within Data and Analytics with limited design help from manager or senior associates.- Leverage coding best practices and advanced techniques to ensure efficient execution of code against large datasets, ensuring code is repeatable and scalable.- Run, create and optimize standard processes to ensure metrics, reports and...

  • Data Observability

    1 week ago


    IND-Pune-Equifax Analytics-PTEC, India Equifax Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds,  and make a meaningful impact, we want to hear from you. Job Description What you will doPerform general application development activities, including unit testing, code deployment to development...

  • Data Analyst

    5 days ago


    Pune, Maharashtra, India Equifax Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Equifax is looking for a Data Analyst to join our team in India supporting the Canada business unit. As a Data Analyst at Equifax, you will work with stakeholders to use data and analytics to provide key insights and drive business decisions.The ideal candidate will possess strong technical skills and a passion for uncovering solutions, business insights...


  • Pune, India Equifax Full time

    (SRE) at Equifax is a discipline that combines software and systems engineering for building and running large-scale, distributed, fault-tolerant systems. SRE ensures that internal and external services meet or exceed reliability and performance expectations while adhering to Equifax engineering principles. SRE is also an engineering approach to building and...


  • Pune, India Equifax Full time

    Equifax is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects. Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology. You are ideal for this position if you are a forward-thinking, committed,...


  • Pune, India Equifax Full time

    Description : is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects.Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology.You are ideal for this position if you are a forward-thinking,...


  • Pune, India Equifax Full time

    Equifax is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects. Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology. You are ideal for this position if you are a forward-thinking, committed,...


  • Pune, India Equifax Full time

    Job Description : - You are passionate about quality and how customers experience the products you test.- You have the ability to create, maintain and execute test plans in order to verify requirements.- As a Performance Engineer at Equifax, you will be a catalyst in both the development and the testing of high priority initiatives.- You will develop and...


  • Pune, India Equifax Full time

    Equifax is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects. Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology.You are ideal for this position if you are a forward-thinking, committed,...


  • Pune, Maharashtra, India Equifax Full time

    Role & responsibilitiesAs an Equifax Model Performance Monitoring Analytics Consultant you will play a pivotal role in the Model Governance function within Data and Analytics (D&A). You will deliver and manage Model Governance projects, including complex modelling monitoring and supporting ongoing validation assignments. You will provide consultancy and have...