AI Quality Assurance Specialist

6 days ago


mangalore, India beBeeQuality Full time

As a professional in the field of AI quality assurance, you will play a critical role in ensuring the performance, reliability, and trustworthiness of advanced Large Language Models (LLMs), sub-models, and multi-agent systems.Main Responsibilities:• Design and execute evaluation strategies for LLMs, sub-models, and multi-agent systems.  • Perform manual and automated testing of AI models, ensuring comprehensive coverage.• Develop synthetic test data using Python scripting to simulate real-world scenarios and edge cases.• Ensure boundary condition coverage through automated data generation techniques.• Prepare and maintain prompt libraries for model evaluation across diverse use cases.• Evaluate multi-model and multi-agent architectures, ensuring functional and performance benchmarks are met.• Apply and interpret evaluation metrics (e.g., accuracy, precision, recall, F1-score, Bias check, hallucination, Consistency, Relevance, Fact Check, BLEU, ROUGE, perplexity, etc.) with a clear understanding of their formulas and implications.• Collaborate closely with Data Science and Engineering teams to align QA strategies with model development.• Document test plans, test cases, and evaluation reports for stakeholder review and signoff.About This Role:This is an exceptional opportunity for individuals passionate about AI and quality assurance to make a meaningful impact on the development of cutting-edge technologies. If you possess excellent analytical skills, attention to detail, and a commitment to excellence, this role may be ideal for you.



  • mangalore, India beBeeAI Full time

    Conversational AI Quality Assurance EngineerWe're redefining the future of banking with AI, and we need your expertise to ensure our virtual assistants perform flawlessly.Key Responsibilities:Create comprehensive test strategies for our Conversational AI platform, covering functional, performance, security, and scalability aspects.Design and develop...


  • mangalore, India beBeeAutomation Full time

    Technical Test Automation Engineer RoleWe seek a skilled iOS Quality Assurance Specialist to fortify the reliability of our native mobile apps.Design and execute detailed test plans for new features, covering functional, integration, and regression testing across real devices and simulators.Collaborate with Product Owners and Designers to refine feature...


  • mangalore, India beBeeQuality Full time

    Enhancing product excellence requires a dedicated professional to guarantee that our offerings meet high standards before they reach the market.This Quality Assurance/Quality Control Engineer position plays a pivotal role in ensuring the quality of products, systems, and processes.Closely collaborating with cross-functional teams, you will identify defects,...


  • mangalore, India beBeeQuality Full time

    Quality Assurance SpecialistWe are seeking a highly skilled Quality Assurance Specialist to join our team. In this role, you will play a critical part in ensuring the quality of our software applications.About the Role:This is a challenging and rewarding role that requires a unique blend of technical and analytical skills.You will be responsible for testing...


  • mangalore, India beBeeVoice Full time

    Job Title: AI Voice Solutions SpecialistAbout the Role:We are seeking an experienced AI Voice Solutions Specialist to join our team. As a key member of our organization, you will be responsible for designing, developing, and fine-tuning deep learning models for voice synthesis.Responsibilities:Develop text-to-speech models achieving human-like voice...


  • mangalore, India beBeeSoftware Full time

    Ensuring the quality and reliability of software products is a crucial aspect of any successful organization.The role of a Software Quality Assurance Specialist involves reviewing software requirements and creating test scenarios to ensure that the final product meets the required standards.A comprehensive understanding of software development methodologies...


  • mangalore, India beBeeAutomation Full time

    We're seeking a diligent Automation Quality Specialist to join our team.This is an excellent opportunity for someone who thrives in fast-paced environments and is passionate about automation testing.The ideal candidate will have a solid background in software development, quality assurance, or related field, with experience in automated testing using tools...


  • mangalore, India beBeeQuality Full time

    Senior Quality Assurance EngineerAbout this roleWe are seeking an experienced QA engineer to ensure high-quality software solutions by designing and executing effective test strategies.This individual should have hands-on experience in Java, Cypress, and API testing.Key responsibilitiesThe ideal candidate will be responsible for:Developing and maintaining...


  • Mangalore, India TechVerito Full time

    About the Role: 3-5 years of proven experience as a QA Automation Engineer with expertise in Selenium with Java and API testing with Rest Assured. Beyond finding defects, you will help the team design for quality from the start, working closely with developers, product managers, and stakeholders in a collaborative XP environment. Responsibilities: - Ensures...


  • mangalore, India beBeeQualityAssurance Full time

    Job Opportunity: Quality Assurance Test EngineerWe are seeking a skilled QA Test Engineer with hands-on experience in Oracle Fusion Finance and Procurement modules.The ideal candidate will possess expertise in functional, integration, regression, and user acceptance testing of these modules.To be successful in this role, you must have experience working with...