AI Quality Assurance Lead

2 days ago


belgaum, India beBeeArtificialIntelligence Full time

Job DescriptionWe are seeking a highly skilled professional to lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems.This role will be responsible for leading and scaling test automation initiatives, designing and executing LLM evaluation frameworks, implementing RAG evaluation frameworks, building Python-based automation frameworks, integrating automation into CI/CD pipelines, and more.The ideal candidate will have strong expertise in Python automation, LLM evaluation, RAG pipelines, observability, adversarial testing, and Azure monitoring.Required Skills and QualificationsTest Automation – Python, PyTest, DeepEvalLLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-JudgeRAG Evaluation – RAGAS, Retrieval MetricsEvaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring – LangFuse, LangSmithCI/CD – GitHub ActionsMulti-Agent Testing – Reasoning & Tool ValidationAdversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing – REST & Async WorkflowsAzure Monitoring – App Insights, Log AnalyticsSynthetic & Golden Dataset ManagementBenefitsThis role offers the opportunity to work on cutting-edge technologies and contribute to the development of innovative solutions.OthersThe ideal candidate will be able to work independently and as part of a team, with excellent communication and problem-solving skills.



  • belgaum, India beBeeCareer Full time

    Job Description:We are seeking a seasoned Senior QA Lead to spearhead the quality engineering strategy for our cutting-edge Gen AI and MLOps platform. The ideal candidate will oversee QA teams, design scalable test processes, and ensure end-to-end reliability, performance, and security across all AI/ML and platform components.Lead and manage the QA team,...


  • belgaum, India beBeeArtificialIntelligence Full time

    Job Overview:We're seeking an expert AI Quality Assurance Test Engineer to ensure the quality, reliability, and integrity of our AI solutions.This role involves working on production-grade systems to deliver robust, client-ready products that leverage Generative AI and Agentic AI.Key Responsibilities:Verify the quality, reliability, and integrity of AI...


  • belgaum, India beBeeCheating Full time

    We are looking for a detail-oriented QA specialist to join our team at Taskify AI.Conduct Technical Quality Assurance: Watch recorded interviews end-to-end, flagging issues like premature termination, audio/video glitches, and other anomalies.Perform Fraud Investigations: Review candidate profiles flagged by our system, cross-checking claims through online...

  • Senior qa lead

    6 days ago


    belgaum, India Katonic AI Full time

    Experience: 10+ Years Job Type: Full-time About Katonic:  We are a young, Aussie Generative AI startup headquartered in Sydney, Australia. Job Description: We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade Gen AI and MLOps platform. This platform...


  • Belgaum, India Comviva Full time

    JOB DESCRIPTION Job Title: Process Quality Auditor & Process Improvement Specialist Experience Level: Mid-Level (4 Years) Location: Gurugram, Bengaluru Department: Quality Assurance / Process Excellence Reports To: Head of Quality / Process Excellence Job Summary We are seeking a meticulous and driven Product Quality Auditor & Process Improvement Specialist...


  • belgaum, India beBeeAutomation Full time

    Expert Quality Assurance Engineer Job DescriptionWe seek a seasoned professional to join our engineering team and bring new features to life.As an expert quality assurance engineer, you must be able to provide:Able to work in an autonomous, self-responsible and self-organized way.6+ years of experience in software testing, manual and automated.Knowledge of...


  • belgaum, India beBeeQuality Full time

    Quality Assurance SpecialistWe are seeking a detail-oriented and experienced quality auditor to join our Call Center process.The ideal candidate will be responsible for auditing technician calls, validating membership sales, voice training using tools such as Rilla, ensuring accuracy and compliance across all customer and technician interactions.Validating...


  • belgaum, India beBeeCompliance Full time

    Clinical Research Quality Assurance SpecialistAt our organization, we are dedicated to upholding the highest standards of quality and compliance in clinical trials.Key Responsibilities:We seek an experienced Clinical Research Quality Assurance Specialist to conduct thorough site audits across all phases (I–IV)The ideal candidate will review CRFs, informed...


  • belgaum, India beBeeQualityAssurance Full time

    We are looking for skilled professionals with a passion for quality assurance to join our team.Experience in testing React-based web applications is essential for this role.Familiarity with Drupal CMS and its capabilities is required.API automation expertise, preferably with Python, is highly valued.This position offers a unique opportunity to work on...


  • belgaum, India beBeeJavaScript Full time

    Job Opportunity: Senior JavaScript QA EngineerMain Responsibilities:Collaborate with our digital technology team to design, test and maintain cutting-edge solutions that support brand websites.Develop comprehensive test plans and cases for new frontend web applications and REST APIs.Design automated scripts with JavaScript, TypeScript and Cypress to achieve...