AI Model Quality Assurance Specialist

6 days ago

Eluru, India beBeeQuality Full time

Job Title:Senior Quality Assurance SpecialistKey Responsibilities:Design, Develop and Execute Automated Test Cases for Large Language Models (LLMs)Validate LLM Integrations, APIs, and Multi-Agent Workflows with Robust Testing MethodsPerform Intent Classification, Semantic Similarity, and Response Consistency Testing to Ensure AI Model AccuracyConduct Hallucination Detection and Factual Accuracy Checks on LLM OutputsImplement Response Quality Scoring Using LLM-as-a-Judge Evaluation Patterns for Enhanced AI Model PerformanceMonitor and Validate LLM Behavior using Observability and Tracing Tools for Real-Time InsightsTest Conversational AI Applications Including Chatbots and Virtual Assistants for Seamless User ExperiencesSupport Kubernetes-Based Application Health Checks and Basic Smoke Testing for Efficient DeploymentIntegrate Automated Tests into CI/CD Pipelines for Continuous Quality AssuranceDocument Test Cases, Evaluation Criteria, Defects, and QA Findings Clearly and Concisely for Effective CollaborationCollaborate with Engineering and AI Teams to Improve Evaluation Pipelines and Testing Strategies for Better AI Model DevelopmentRequired Skills and Qualifications:3–5 Years of Experience in QA or Test Automation Roles with a Focus on AI Model TestingStrong Proficiency in Python-Based Test Frameworks (Pytest) with Ability to Write Efficient Automated Test CasesBasic to Intermediate Understanding of LLM Evaluation Concepts and AI System Testing for Accurate Model ValidationHands-On Experience with LLM Observability and Tracing Tools for Real-Time Monitoring and ValidationExperience in API Testing and Validation of AI Integrations for Secure and Reliable Data ExchangeExposure to Conversational AI or Chatbot Testing for Effective User Interaction AnalysisFamiliarity with CI/CD Processes and GitHub Actions for Efficient Automated Testing and DeploymentKnowledge of Kubernetes-Based Environments for Testing and Validation of Containerized ApplicationsStrong Documentation and Defect Reporting Skills with Ability to Communicate Technical Complexity to Non-Technical StakeholdersAbility to Understand Semantic Correctness Over Strict Assertion-Based Testing for More Accurate AI Model Evaluation

  • AI-Powered Quality Assurance Specialist

    6 days ago

    Eluru, India beBeeQuality Full time

    Looking for a diligent Quality Assurance Specialist to bridge the gap between clients, products, and engineering teams.The ideal candidate will possess exceptional attention to detail, be able to identify issues, ensure product quality, and maintain clear communication with stakeholders throughout the resolution process.Perform manual and exploratory testing...

  • Quality Assurance Specialist

    7 days ago

    eluru, India beBeeTestEngineer Full time

    Quality Assurance SpecialistWe are seeking a meticulous Quality Assurance specialist to join our team. As a key player in our product development process, you will be responsible for ensuring the quality of our products meets the highest standards.

  • Software Quality Assurance Specialist

    2 weeks ago

    Eluru, India beBeeSoftware Full time

    Job Title: Software Quality Assurance SpecialistA career as a Software Quality Assurance Specialist offers you the opportunity to play a critical role in ensuring the quality and reliability of software products.Key Responsibilities:Requirements Analysis & Test Planning:Collaborate with clients to understand testing and automation requirements.Translate...

  • Software Quality Assurance Specialist

    3 days ago

    Eluru, India beBeesoftware Full time

    Job OverviewAs a Senior Quality Assurance Specialist, you will be responsible for ensuring the quality of our software products through meticulous manual testing and rigorous analysis.This role focuses on hands-on testing, test case creation, and detailed reporting to maintain high standards of software quality.

  • Chief AI Quality Assurance Specialist

    2 weeks ago

    Eluru, India beBeeAutomation Full time

    Job Opportunity:We are seeking a seasoned expert to lead our quality assurance initiatives, focusing on cutting-edge Generative AI and Multi-Agent Systems.Key Responsibilities:Develop and execute LLM evaluation frameworks using G-Eval, custom evaluators, and hallucination detection techniques.Implement RAG evaluation frameworks (RAGAS or similar) and create...

  • Capital Market Quality Assurance Specialist

    2 weeks ago

    Eluru, India beBeeQuality Assurance Full time

    Key Requirements:Analytical and problem-solving skills to identify, document, and track defects through resolution.A structured approach to manual testing and the ability to execute comprehensive test cases.Critical thinking and communication skills to ensure product quality across business-critical applications.Excellent client-handling experience with a...

  • AI Model Development Specialist

    2 weeks ago

    Eluru, India beBeeDataInsights Full time

    About the PositionWe are seeking a highly skilled Data Insights Specialist to contribute to our AI model development team. In this role, you will work with datasets, apply analytical techniques, and provide valuable insights that improve AI performance.Key Responsibilities:Identify and source relevant data sets for AI training and research.Clean, structure,...

  • AI Model Deployment Specialist

    6 days ago

    Eluru, India beBeeArtificialIntelligence Full time

    Expert Python Developer WantedWe are seeking an experienced Python developer to join our team.The ideal candidate will have a strong background in software development and a proven track record of delivering high-quality solutions.The successful candidate will be responsible for designing, developing, and deploying AI models using Python and relevant...

  • AI Development Specialist

    2 weeks ago

    Eluru, India beBeeVoice Full time

    **Job Opportunity for AI Engineer**A forward-thinking organization is seeking an experienced AI Engineer with a proven track record in developing and optimizing voice models.The ideal candidate will have hands-on experience in building text-to-speech models that achieve human-like voice synthesis, maintaining the unique style of voice actors across multiple...

  • AI Innovation Specialist

    2 weeks ago

    eluru, India beBeeinnovation Full time

    AI Innovation SpecialistWe are seeking a skilled AI specialist with 2-4 years of experience to design, develop, and deploy AI solutions, focusing on NLP, Generative AI, RAG, and Time Series Forecasting.Create end-to-end solutions integrating large language models (LLMs) with VectorDB for document retrieval, semantic search, and contextual query...