AI Quality Assurance Specialist
4 days ago
Job DescriptionThe Mid QA Engineer – Automated Testing & AI Validation will be responsible for designing, developing, and executing automated test cases using Python and Pytest for AI-driven applications.Key Responsibilities:Design, develop, and execute automated test cases using Python and Pytest for AI-driven applications.Validate LLM integrations, APIs, and multi-agent workflows through functional, regression, and smoke testing.Perform intent classification, semantic similarity, and response consistency testing for conversational AI systems.Conduct hallucination detection and factual accuracy checks using automated and semi-automated methods.Implement response quality scoring using LLM-as-a-Judge evaluation patterns.Use LLM observability and tracing tools such as LangFuse or LangSmith to monitor and validate model behavior.Test conversational AI applications including chatbots and virtual assistants across use cases.Support Kubernetes-based application health checks and basic smoke testing.Integrate automated tests into CI/CD pipelines using GitHub Actions.Document test cases, evaluation criteria, defects, and QA findings clearly and concisely.Collaborate with engineering and AI teams to improve evaluation pipelines and testing strategies.Continuously learn and contribute to advanced AI evaluation methodologies.Required Skills:3–5 years of experience in QA or test automation roles.Strong proficiency in Python-based test frameworks (Pytest).Basic to intermediate understanding of LLM evaluation concepts and AI system testing.Hands-on experience with LLM observability and tracing tools (LangFuse, LangSmith, or similar).Experience in API testing and validation of AI integrations.Exposure to conversational AI or chatbot testing.Familiarity with CI/CD processes and GitHub Actions.Knowledge of Kubernetes-based environments for testing and validation.Strong documentation and defect reporting skills.Ability to understand semantic correctness over strict assertion-based testing.Self-driven mindset with the ability to work independently and handle ambiguity.
-
Technical Quality Assurance Specialist
2 weeks ago
thoothukudi, India beBeeQualityAssurance Full timeJob Opportunity: Technical Quality Assurance SpecialistWe are seeking a detail-oriented individual to conduct thorough technical quality assurance of recorded interviews. The selected candidate will be responsible for reviewing assigned recordings from start to finish, flagging and annotating any issues such as premature termination, audio/video glitches, or...
-
Quality Assurance Specialist
6 days ago
thoothukudi, India beBeeQuality Full timeQuality Assurance SpecialistWe are seeking a skilled Quality Assurance Specialist to join our multidisciplinary team in building next-generation software products and solutions.This role is critical to ensuring the high quality of our software, and as a key member of our agile development process, you will participate in frequent releases and work closely...
-
Expert in AI Quality Assurance
2 weeks ago
thoothukudi, India beBeeAutomation Full timeLead Automation Quality Assurance SpecialistWe are seeking a seasoned professional to lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems.Main Responsibilities:Oversee the development and execution of test automation strategies with a focus on GenAI and AI systemsDesign and implement evaluation frameworks using...
-
Software Quality Assurance Specialist
4 days ago
thoothukudi, India beBeeSoftwareQuality Full timeJob Title: Software Quality Assurance SpecialistAbout the RoleWe are seeking a skilled software quality assurance specialist to ensure the reliability and performance of our applications.The ideal candidate will be responsible for translating business requirements into technical specifications, designing automated testing frameworks, creating comprehensive...
-
Quality Assurance Engineer
3 days ago
Thoothukudi, India Delphi Consulting Middle East Full timeJoin Delphi - Where Innovation meets transformation At Delphi, we believe in creating an environment where our people thrive. Our hybrid work model empowers you to choose where you work—whether it's from the office, your home, or a mix of both—so you can prioritize what matters most. We are committed to supporting your personal goals, family, and overall...
-
AI Software Quality Assurance Professional
2 weeks ago
thoothukudi, India beBeeArtificial Full timeAbout This OpportunityAs a Senior Test Engineer, you will play a pivotal role in guaranteeing the excellence, dependability, and ethical integrity of our cutting-edge AI solutions.We are seeking an exceptionally skilled and experienced Artificial Intelligence Quality Assurance Test Engineer to join our dynamic team.The ideal candidate will have expertise in...
-
Senior Quality Assurance Professional
4 days ago
thoothukudi, India beBeeQuality Full timeQuality Assurance Specialist Job DescriptionWe are seeking a highly skilled Quality Assurance Specialist to join our team. The successful candidate will be responsible for ensuring the accuracy of appointments booked by our back-office team, performing call audits of our agents, and conducting voice and speech training for new joiners.The ideal candidate...
-
thoothukudi, India beBeeQuality Full timeWarehouse Management Systems (WMS) Quality Assurance SpecialistWe are seeking an experienced Warehouse Management Systems (WMS) Quality Assurance Specialist to support quality assurance activities within our WMS. The ideal candidate will have hands-on experience in PKMS / Manhattan WMi, a strong understanding of supply chain and distribution operations, and...
-
Lead Quality Assurance Specialist
1 week ago
thoothukudi, India beBeeJob Full timeQuality Assurance EngineerWe are seeking a skilled Quality Assurance (QA) Engineer to join our team. As a QA Engineer, you will play a vital role in ensuring the high quality of our products.About the RoleRequirementsBenefits
-
Software Quality Assurance Specialist
4 days ago
thoothukudi, India beBeeQuality Full timeJob Title:A Software Quality Assurance Professional is required to ensure the highest standards of software quality and performance.The role involves designing and executing test plans, performing manual testing, and validating test cases to guarantee seamless software delivery. Key Responsibilities:Designing and executing comprehensive test plansPerforming...
