Lead Quality Assurance Specialist

3 days ago

Kolhapur, India beBeeArtificialintelligence Full time

Job Title: Lead Quality Assurance – Automated Testing & AI ValidationWe are seeking a skilled professional to lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems.Design and execute evaluation frameworks using LLM-as-a-Judge (G-Eval, custom evaluators) to assess the performance of GenAI systems.Implement RAG evaluation frameworks (RAGAS or similar) to evaluate the quality of AI outputs.Develop Python-based automation frameworks using PyTest & DeepEval to automate testing processes.Integrate automation into CI/CD pipelines using GitHub Actions to ensure seamless deployment of AI systems.Perform adversarial and red-team testing to identify vulnerabilities in AI systems.Required Skills:Python programming language with expertise in PyTest and DeepEval.Strong understanding of LLM evaluation metrics, including hallucination detection, faithfulness, relevance, and precision/recall.Experience with RAG evaluation frameworks (RAGAS or similar).Familiarity with Azure monitoring tools, including Application Insights and Log Analytics.Knowledge of multi-agent evaluation pipelines, including tool usage, collaboration, and reasoning chains.Understanding of API testing principles, including REST and async workflows.This role requires a strong understanding of AI systems, software development, and testing methodologies. If you have experience in developing and deploying AI systems, we encourage you to apply.

  • Software Quality Assurance Lead

    3 days ago

    Kolhapur, India beBeeQuality Full time

    Software Quality Assurance LeadWe are seeking a skilled Software Quality Assurance Lead to join our team. As a key member of our software development lifecycle, you will drive the quality assurance process to ensure that our software products meet the highest standards of quality.Your responsibilities will include:Owning the development of test scripts from...

  • Quality Assurance Specialist

    1 day ago

    Kolhapur, India beBeeQuality Full time

    **Job Title:** Quality Assurance Specialist Job DescriptionThe ideal candidate will be responsible for conducting assessments and qualifications of manufacturers and products, including pharmaceuticals, medical devices, and other related activities.Key Responsibilities:Perform desktop evaluations of plants as applicable.Verify ISO and other certificates for...

  • Quality Assurance Specialist

    5 days ago

    Kolhapur, India beBeeAutomation Full time

    Senior Automation TesterWe seek a skilled Quality Assurance Specialist to join our engineering team, drive innovation, and support product growth through modern technical practices and architectures.As a seasoned quality assurance professional, you must be able to:Work autonomously in a self-responsible and organized environment.Bring 6+ years of experience...

  • Mobile Software Quality Assurance Specialist

    3 days ago

    Kolhapur, India beBeeQuality Full time

    Job Title: Mobile Software Quality Assurance SpecialistWe are seeking an experienced software quality assurance specialist to ensure the quality and reliability of mobile SDKs, web SDKs, and analytics services. You will design and execute comprehensive testing strategies, including automation, to maintain exceptional standards for data collection and...

  • Pega Quality Assurance Professional

    5 days ago

    Kolhapur, India beBeeAssurance Full time

    Senior Pega Quality Assurance SpecialistThis is a full-time remote role for a Senior Pega Quality Assurance Specialist.

  • Senior Quality Assurance Engineer

    23 hours ago

    Kolhapur, India beBeeQuality Full time

    Quality Assurance Specialist Job DescriptionWe are seeking a seasoned Quality Assurance Specialist to guarantee the excellence and reliability of our mobile, web, and analytics services.Conduct thorough testing for our mobile, web, and analytics solutions, encompassing UI and API validation.Review technical requirements and specifications, providing...

  • Senior Quality Assurance Specialist

    24 hours ago

    Kolhapur, India beBeeQualityAssurance Full time

    Job OverviewThis role is responsible for ensuring quality standards are met across all departments. The successful candidate will have excellent analytical and communication skills, as well as the ability to identify training needs and develop effective solutions.Key Responsibilities:Conduct quality assurance reviews of business processes to identify areas...

  • Advanced Quality Assurance Specialist

    5 days ago

    Kolhapur, India beBeeSoftwareQuality Full time

    Senior Software Quality Assurance EngineerWe're looking for an experienced Senior Software Quality Assurance (SQA) Engineer to drive our software quality assurance initiatives and ensure the delivery of high-quality software products. This is a hands-on role where you will design, develop, and maintain robust testing strategies and automation platforms to...

  • Senior Quality Assurance Specialist

    5 days ago

    Kolhapur, India beBeeQuality Full time

    Job Description:Contract - long termAt least 8 years of extensive professional hands-on experience in Quality Assurance is required.The Quality Assurance Test Engineer will be responsible for ensuring consistent, high-quality testing standards are utilized on all products and systems within our applications portfolio.Primary responsibilities include manual...

  • Chief Quality Assurance Specialist

    3 days ago

    Kolhapur, India beBeeQuality Full time

    Quality Assurance RoleWe are seeking a skilled Quality Assurance Analyst to ensure the high quality of our software applications.The ideal candidate will have excellent analytical and problem-solving skills, as well as strong communication and collaboration abilities.The successful candidate will develop detailed test plans, test cases, and test scripts...