Senior Quality Assurance Manager

1 day ago

Malappuram, India beBeeAIValidator Full time

Job Title: Lead QA – Automated TestingThe role of Lead QA & AI Validator is a crucial position that demands expertise in Python automation, Large Language Model (LLM) evaluation, RAG pipelines, observability, adversarial testing, and Azure monitoring.This senior quality assurance position will lead initiatives for cutting-edge Generative AI and Multi-Agent Systems. Our team requires strong leadership skills to execute LLM evaluation frameworks using LLM-as-a-Judge (G-Eval, custom evaluators), design and implement AI-driven validation frameworks, and lead cross-functional teams to drive automation excellence.Design and implement advanced validation frameworks using G-Eval and custom evaluators for AI-driven systemsHallucination detection, faithfulness, relevance, precision/recall metrics for AI outputsImplement and integrate LLM-based evaluation pipelines using RAGAS or similar platformsBuild automated frameworks using PyTest and DeepEval for robust testing and validationIntegrate test automation into CI/CD pipelines using GitHub Actions and DevOps practicesKey Skills:Test Automation: Python, PyTest, DeepEval, automation frameworksLLM Evaluation: G-Eval, Custom Evaluators, LLM-as-a-Judge, AI-driven validationRAG Evaluation: RAGAS, Retrieval Metrics, AI-based evaluationEvaluation Metrics: Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring: LangFuse, LangSmith, real-time monitoringCI/CD: GitHub Actions, DevOps practices, continuous integrationMulti-Agent Testing: Reasoning & Tool Validation, AI-driven testingAdversarial/Red Team Testing: Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing: REST & Async Workflows, API validationAzure Monitoring: App Insights, Log Analytics, cloud-based monitoringAutomated Scoring System Design: GenAI Outputs, AI-driven scoringJoin us on this exciting journey to push the boundaries of AI-driven automation and multi-agent testing.

  • Senior Pega Quality Assurance Specialist

    4 days ago

    Malappuram, India beBeePega Full time

    Job OverviewWe are seeking a highly skilled professional to fill the role of Senior Pega QA. The ideal candidate will have extensive experience in quality assurance and control, as well as software systems and processes.The successful applicant will be responsible for ensuring the quality and effectiveness of our software systems, including testing...

  • Senior Quality Assurance Engineer

    4 days ago

    Malappuram, India beBeeAutomation Full time

    Job Title: Quality Assurance Automation EngineerHello professionals,We are looking for an experienced senior quality assurance engineer to join our dynamic team in Bengaluru.The role involves working closely with developers to clarify feature requirements and ensuring all test scope is addressed in the test plan and executed effectively.Ongoing communication...

  • Advanced Quality Assurance Specialist

    2 days ago

    Malappuram, India beBeeSoftware Full time

    Quality Assurance ProfessionalPosition: Senior Test Engineer (Automation+ Manual)Experience: 4+ years in software development, quality assurance and testing.Location: Remote work opportunity available.Domain: Fintech, Web3 and related technologies.About the role:Join a passionate team shaping the future of payments. As a Quality Assurance Professional, you...

  • AI Quality Assurance Specialist

    2 days ago

    Malappuram, India beBeeArtificialIntelligence Full time

    Job TitleSenior AI Quality Assurance Test EngineerAbout the RoleWe are seeking an experienced Senior AI Quality Assurance Test Engineer to join our team. As a key member of our engineering team, you will be responsible for ensuring the quality, reliability and ethical integrity of advanced in-house developed AI solutions.Key Responsibilities- Ensure the...

  • Expert Software Quality Assurance Professional

    4 days ago

    Malappuram, India beBeeQuality Full time

    Senior Quality Assurance LeaderJob Summary:This leadership role is focused on delivering high-quality software solutions, offering a unique opportunity to enhance your QA expertise in a dynamic environment.Key Responsibilities:Develop and implement quality assurance strategies, create comprehensive test plans, and oversee execution for web and mobile...

  • Quality Assurance Professional

    4 days ago

    Malappuram, India beBeeQualityAssurance Full time

    Job Title: Quality Assurance SpecialistAbout the RoleWe are seeking a Quality Assurance Specialist to join our team. This role is responsible for ensuring that our processes and procedures meet the highest standards of quality.Key ResponsibilitiesConduct process reviews to identify areas for improvementDevelop and implement training materials and SOPsAnalyze...

  • Senior Quality Assurance Manager

    4 days ago

    malappuram, India beBeeTest Full time

    We are seeking a highly skilled Senior Test Lead to spearhead our testing initiatives.The ideal candidate will possess 10+ years of experience, with expertise in translating business requirements into effective test scenarios and collaborating closely with stakeholders to deliver high-quality results.Develop and execute manual and automated test cases using...

  • Quality Assurance Specialist

    2 days ago

    Malappuram, India beBeeAutomation Full time

    Job Title: Quality Assurance SpecialistLocation: Pan IndiaRemote/Office: RemoteJob Overview:We are seeking a skilled professional to join our team as a Quality Assurance Specialist.The ideal candidate will have experience in testing React-based web applications, working knowledge of Drupal CMS, and proficiency in API automation using JavaScript or...

  • Expert Software Quality Assurance Lead

    4 days ago

    Malappuram, India beBeeSoftware Full time

    We are seeking a skilled quality assurance professional to lead our testing efforts and contribute to product modernization.As a senior / expert quality assurance engineer, you must be able to provide:Independent work in self-managed and self-organized teams.6+ years of experience in software testing, both manual and automated.In-depth knowledge of software...

  • Senior quality assurance automation engineer

    2 weeks ago

    Malappuram, India JiBe ERP Full time

    Position: Senior Quality Assurance Automation Engineer About Ji Be Ji Be is a cloud based fully integrated ERP system for the shipping industry. Our goal is to allow shipping companies to improve productivity, efficiency and safety levels, while reducing costs. Ji Be ERP enables increased automation and streamlining of processes, creating pre-defined...