Data Quality Engineer
1 week ago
ur AI/ML engineering team ensures delivers innovative, immersive web experiences that delight our clients and their customers. We are always striving to balance the demanding nature of working on cutting-edge technologies with the real-world demands of high performance, high security, and accessibility. Working in collaboration with our multi-disciplinary engineering, design, and quality assurance teams, you will build software that solves real-world problems for incredible clients.
WHAT YOULL DO:
- Write Python and SQL scripts to evaluate outputs from large language models (LLMs).
- Design and implement LLM-as-Judge evaluations with clear scoring rubrics (faithfulness, relevance, completeness, correctness).
- Define and calculate quality metrics such as exact match, token-level F1, ROUGE, and subjective rubric scores.
- Build and maintain ground-truth datasets for benchmarking and regression testing.
- Automate evaluation pipelines and integrate them into CI/CD workflows.
- Conduct in-depth analysis of large unstructured datasets to identify inconsistencies, anomalies, missing values, and potential biases
- Diagnose and report failure modes (hallucinations, irrelevant answers, formatting errors).
- Collaborate and serve as a crucial link between AI engineers, QA, data scientists and product managers to set quality standards and release criteria.
- Document processes and maintain reproducibility of evaluation runs.
- Create comprehensive technical documentation, including design specifications, architecture diagrams, and code comments.
WHAT YOULL NEED:
- Strong proficiency in Python and SQL (data handling, scripting, test automation).
- Experience with data cleaning and standardization techniques to facilitate ingestion and analysis by various teams
- Understanding of generative AI concepts (prompts, hallucinations, grounding)
- Experience designing structured LLM prompts for evaluations.
- Familiarity with at least one evaluation framework (RAGAS, DeepEval, TruLens, LangSmith) or ability to learn quickly.
- Familiarity with cloud runs and automation (GCP preferred) or ability to learn quickly
- Ability to translate ambiguous quality expectations into measurable metrics.
- Excellent problem-solving abilities and analytical thinking
- Effective communication skills to collaborate with cross-functional teams and present technical concepts to both technical and non-technical stakeholders
-
Data Engineer
1 week ago
India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per yearJob DescriptionData Engineer – ChennaiBuild the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights.Location: Chennai, IndiaExperience: 2–3 years in data engineering or data-driven product developmentRole OverviewAs a Data Engineer, you will be responsible for building and maintaining scalable...
-
Data & AI Engineer Lead
1 week ago
India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearReq ID: 344686NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data & AI Engineer Lead to join our team in Remote, Karnātaka (IN-KA), India (IN). "Job Duties: Role Overview The...
-
Senior Manager- Data Quality Engineer
6 days ago
Airoli, India, Navi Mumbai, NA, Maharashtra, MEA Data Engineering Full time ₹ 12,00,000 - ₹ 36,00,000 per yearA Lead Data Quality role involves overseeing the accuracy, consistency, and reliability of an organization's data assets. This includes developing and implementing data quality standards, managing data quality projects, and leading teams in maintaining data integrity. Key responsibilities include developing validation rules, monitoring data quality, and...
-
Data Quality Engineer
8 hours ago
India CodeVyasa Full timeRole Overview We are seeking a highly skilled and motivated Data Quality Engineer|| Bangalore with 8+ years of experience. If you're passionate about coding, problem-solving, and innovation, we'd love to hear from you! CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart,...
-
Data Quality engineer
7 days ago
Hyderabad, India algoleap Full timeJob Description Martech Data team is looking for a Quality Engineer with strong expertise in data validation and quality assurance to support critical Data initiatives like CDP driven campaigns, Lead qualifications Architecture Uplift, and Data Governance & Trust. The Quality Engineer will work closely with Product Manager, Data Engineers, Marketing SMEs to...
-
Data Quality Engineer
8 hours ago
India CodeVyasa Full timeRole Overview We are seeking a highly skilled and motivated Data Quality Engineer|| Bangalore with 8+ years of experience. If you're passionate about coding, problem-solving, and innovation, we'd love to hear from you! About Us CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart,...
-
Data Quality Engineer
2 days ago
Pune, India Virtusa Full timeJob Description Responsibilities Data Quality Implementation & Monitoring (Acceldata & DemandTools): Design, develop, and implement data quality rules and checks using Acceldata to monitor data accuracy, completeness, consistency, and timeliness. Configure and utilize Acceldata to profile data, identify anomalies, and establish data quality thresholds....
-
Data Engineer
6 days ago
Hyderabad, Telangana, , India The Modern Data Company Full time ₹ 5,00,000 - ₹ 12,00,000 per yearAbout the role: Role Overview: The Data Engineer is responsible for building and maintaining data infrastructure that enables organizations to store, process, and analyze large volumes of data. This role focuses on developing robust batch and streaming data pipelines to create data products, derive insights, and support analytics initiatives. The engineer...
-
Data Quality Engineer
1 week ago
India Leading MNC Full timeLooking for a Freelance Data Quality Engineer to join a team of rockstar developers. of experience. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of development experience + work...
-
Senior Quality Engineer
7 days ago
Pune, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Quality Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN). Once You Are Here, You Will: -...