AI Quality Assurance Specialist

21 hours ago

alwar, India beBeeConversational Full time

Senior Conversational AI TesterWe are seeking an experienced and skilled Senior Conversational AI Tester to join our team. As a key member of our team, you will play a critical role in ensuring the highest quality of conversational AI systems.Key Responsibilities:Develop, execute, and maintain automated test cases for conversational AI applications using Python and Pytest.Validate LLM integrations, APIs, and workflows through functional, regression, and smoke testing.Perform intent classification, semantic similarity, and response consistency testing.Conduct hallucination detection and factual accuracy checks.Implement response quality scoring using LLM-as-a-Judge evaluation patterns.Utilize observability and tracing tools such as LangFuse or LangSmith to monitor model behavior.Test conversational AI applications including chatbots and virtual assistants across use cases.Support application health checks and basic smoke testing on Kubernetes-based applications.Integrate automated tests into CI/CD pipelines using GitHub Actions.Document test cases, evaluation criteria, defects, and QA findings clearly and concisely.Collaborate with engineering and AI teams to improve evaluation pipelines and testing strategies.Requirements:5+ years of experience in conversational AI testing and development.Strong knowledge of Python, Pytest, and LLM technologies.Experience with CI/CD pipelines, observability tools, and Kubernetes.Excellent communication and collaboration skills.Ability to learn and adapt quickly to new technologies and methodologies.Benefits:Competitive salary and benefits package.Opportunities for professional growth and development.Collaborative and dynamic work environment.Flexible working hours and remote work options.About Us:We are a leading technology company dedicated to developing innovative conversational AI solutions. Our team is passionate about creating high-quality products that make a real difference in people's lives.

  • AI Quality Assurance Specialist

    1 week ago

    alwar, India beBeeArtificialIntelligence Full time

    Advanced AI Quality Assurance ExpertAbout the Role:We are seeking a seasoned professional in Artificial Intelligence Quality Assurance to ensure the quality, reliability and ethical integrity of our cutting-edge AI solutions.Key Responsibilities:Develop and execute comprehensive test plans and strategies for AI and Machine Learning products.Maintain and...

  • Quality Assurance Specialist

    1 week ago

    alwar, India beBeeSoftware Full time

    Quality Assurance SpecialistThe Quality Assurance Specialist will lead the development of test scripts from use cases, user stories and other sources.This role involves collaborating with the development team to set up and run automated tests using Selenium and write and maintain automated test scripts in C# using Spec Flow and Selenium.Additionally, the...

  • Quality Assurance Specialist

    2 weeks ago

    Alwar, Rajasthan, India Celofe Pvt Ltd Full time

    Company DescriptionSorico is the brainchild of two entrepreneurs who sought to end the ongoing search for quality cheese. Under the leadership of Mr. K.D Bharal, Sorico has been providing premium high-quality cheeses since the early 90s. Offering a range from semi-hard to soft cheeses including Cheddar, Mozzarella, and more exotic varieties like Mascarpone...

  • Quality Assurance Specialist

    2 weeks ago

    alwar, India beBeeQuality Full time

    Job Title: Quality Assurance SpecialistAbout the RoleWe are seeking an experienced Quality Assurance Specialist to join our team.The successful candidate will be responsible for ensuring the highest quality of our products through rigorous testing and evaluation.Key ResponsibilitiesMain Responsibilities:Develop and execute comprehensive test plans to...

  • Quality Assurance Specialist

    5 days ago

    alwar, India beBeeQuality Full time

    Senior Quality Assurance SpecialistWe are seeking a highly skilled Senior QA Specialist to join our organization, driving quality standards and best practices forward.This exciting opportunity allows a quality-focused professional to make a significant impact on our product, working in a fully remote and asynchronous environment.Lead the QA team, defining...

  • AI-Powered Quality Assurance Engineer

    2 weeks ago

    alwar, India beBeeQuality Full time

    AI-Powered Quality Assurance EngineerAs an AI-Powered Quality Assurance Engineer, you'll be responsible for leading quality strategies for our Conversational AI platform.Leading test strategy and building automation frameworks to ensure the robustness and scalability of our AI-driven solutions.Collaborating closely with AI engineers, product teams, and...

  • Senior Quality Assurance Engineer Position

    17 hours ago

    alwar, India beBeeAssurance Full time

    **Job Opportunity:** We are seeking a highly skilled Quality Assurance Specialist to join our team.The ideal candidate will be responsible for ensuring the performance, reliability, and trustworthiness of advanced Large Language Models (LLMs), sub-models, and multi-agent systems. This role offers an exciting opportunity to shape the quality and performance...

  • Expert Quality Assurance Specialist

    1 day ago

    alwar, India beBeeTester Full time

    Quality Assurance Tester & Support SpecialistWe are seeking a Quality Assurance Tester and Support Specialist to improve the quality of our deliveries and provide first-level support to our users.This role combines QA, product, support, and development expertise with excellent communication, organisational skills, and in-depth knowledge of WordPress and...

  • Advanced Quality Assurance Expert

    1 week ago

    alwar, India beBeeQualityAssurance Full time

    Quality Assurance SpecialistWe are seeking a skilled Quality Assurance Specialist to join our core engineering team. The successful candidate will be responsible for ensuring the quality of our SaaS product features and dashboard analytics.The ideal candidate will have a strong understanding of quality assurance principles and experience with automated...

  • PKMS / WMi Quality Assurance Specialist

    1 week ago

    alwar, India beBeeQuality Full time

    Job Title: PKMS / WMi Quality Assurance SpecialistWe are seeking a skilled and experienced PKMS / WMi Quality Assurance Specialist to join our team. As a key member of our quality assurance department, you will play a vital role in ensuring the accuracy, reliability, and efficiency of our Warehouse Management Systems (WMS).Key Responsibilities:Perform...