AI Quality Assurance Lead
2 days ago
Job DescriptionWe are seeking a highly skilled professional to lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems.This role will be responsible for leading and scaling test automation initiatives, designing and executing LLM evaluation frameworks, implementing RAG evaluation frameworks, building Python-based automation frameworks, integrating automation into CI/CD pipelines, and more.The ideal candidate will have strong expertise in Python automation, LLM evaluation, RAG pipelines, observability, adversarial testing, and Azure monitoring.Required Skills and QualificationsTest Automation – Python, PyTest, DeepEvalLLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-JudgeRAG Evaluation – RAGAS, Retrieval MetricsEvaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring – LangFuse, LangSmithCI/CD – GitHub ActionsMulti-Agent Testing – Reasoning & Tool ValidationAdversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing – REST & Async WorkflowsAzure Monitoring – App Insights, Log AnalyticsSynthetic & Golden Dataset ManagementBenefitsThis role offers the opportunity to work on cutting-edge technologies and contribute to the development of innovative solutions.OthersThe ideal candidate will be able to work independently and as part of a team, with excellent communication and problem-solving skills.
-
AI/MLOps Quality Assurance Lead
5 days ago
belgaum, India beBeeCareer Full timeJob Description:We are seeking a seasoned Senior QA Lead to spearhead the quality engineering strategy for our cutting-edge Gen AI and MLOps platform. The ideal candidate will oversee QA teams, design scalable test processes, and ensure end-to-end reliability, performance, and security across all AI/ML and platform components.Lead and manage the QA team,...
-
AI Quality Assurance Test Engineer
2 days ago
belgaum, India beBeeArtificialIntelligence Full timeJob Overview:We're seeking an expert AI Quality Assurance Test Engineer to ensure the quality, reliability, and integrity of our AI solutions.This role involves working on production-grade systems to deliver robust, client-ready products that leverage Generative AI and Agentic AI.Key Responsibilities:Verify the quality, reliability, and integrity of AI...
-
Quality Assurance Specialist
2 days ago
belgaum, India beBeeCheating Full timeWe are looking for a detail-oriented QA specialist to join our team at Taskify AI.Conduct Technical Quality Assurance: Watch recorded interviews end-to-end, flagging issues like premature termination, audio/video glitches, and other anomalies.Perform Fraud Investigations: Review candidate profiles flagged by our system, cross-checking claims through online...
-
Senior qa lead
6 days ago
belgaum, India Katonic AI Full timeExperience: 10+ Years Job Type: Full-time About Katonic: We are a young, Aussie Generative AI startup headquartered in Sydney, Australia. Job Description: We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade Gen AI and MLOps platform. This platform...
-
Software Quality Assurance Specialist
6 days ago
Belgaum, India Comviva Full timeJOB DESCRIPTION Job Title: Process Quality Auditor & Process Improvement Specialist Experience Level: Mid-Level (4 Years) Location: Gurugram, Bengaluru Department: Quality Assurance / Process Excellence Reports To: Head of Quality / Process Excellence Job Summary We are seeking a meticulous and driven Product Quality Auditor & Process Improvement Specialist...
-
Lead Tester and Quality Assurance Specialist
4 days ago
belgaum, India beBeeAutomation Full timeExpert Quality Assurance Engineer Job DescriptionWe seek a seasoned professional to join our engineering team and bring new features to life.As an expert quality assurance engineer, you must be able to provide:Able to work in an autonomous, self-responsible and self-organized way.6+ years of experience in software testing, manual and automated.Knowledge of...
-
Quality Assurance Specialist
2 days ago
belgaum, India beBeeQuality Full timeQuality Assurance SpecialistWe are seeking a detail-oriented and experienced quality auditor to join our Call Center process.The ideal candidate will be responsible for auditing technician calls, validating membership sales, voice training using tools such as Rilla, ensuring accuracy and compliance across all customer and technician interactions.Validating...
-
Quality Assurance Compliance Officer
2 days ago
belgaum, India beBeeCompliance Full timeClinical Research Quality Assurance SpecialistAt our organization, we are dedicated to upholding the highest standards of quality and compliance in clinical trials.Key Responsibilities:We seek an experienced Clinical Research Quality Assurance Specialist to conduct thorough site audits across all phases (I–IV)The ideal candidate will review CRFs, informed...
-
Software Quality Assurance Specialist
2 days ago
belgaum, India beBeeQualityAssurance Full timeWe are looking for skilled professionals with a passion for quality assurance to join our team.Experience in testing React-based web applications is essential for this role.Familiarity with Drupal CMS and its capabilities is required.API automation expertise, preferably with Python, is highly valued.This position offers a unique opportunity to work on...
-
Lead Frontend Quality Assurance Specialist
2 days ago
belgaum, India beBeeJavaScript Full timeJob Opportunity: Senior JavaScript QA EngineerMain Responsibilities:Collaborate with our digital technology team to design, test and maintain cutting-edge solutions that support brand websites.Develop comprehensive test plans and cases for new frontend web applications and REST APIs.Design automated scripts with JavaScript, TypeScript and Cypress to achieve...