Senior Quality Assurance Specialist
2 weeks ago
Job DescriptionWe are seeking a Lead QA – Automated Testing & AI Validation with strong expertise in Python automation, LLM evaluation, RAG pipelines, observability, adversarial testing, and Azure monitoring.Role OverviewThis role will lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems. The successful candidate will design and execute LLM evaluation frameworks using G-Eval, custom evaluators, Hallucination detection, faithfulness, relevance, precision/recall.Key ResponsibilitiesLead and scale test automation initiatives with a focus on GenAI and AI systems. Design and implement RAG evaluation frameworks (RAGAS or similar). Build Python-based automation frameworks using PyTest & DeepEval. Integrate automation into CI/CD pipelines using GitHub Actions.Adversarial and Red-Team Testing:Prompt injection, Jailbreak attacks, Bias and toxicity detection. Conduct API testing for microservices (REST, async workflows). Monitor applications using Azure Application Insights & Log Analytics.Required Skills and QualificationsMandatory SkillsTest Automation – Python, PyTest, DeepEvalLLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-JudgeRAG Evaluation – RAGAS, Retrieval MetricsEvaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring – LangFuse, LangSmithCI/CD – GitHub ActionsMulti-Agent Testing – Reasoning & Tool ValidationAdversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing – REST & Async WorkflowsAzure Monitoring – App Insights, Log AnalyticsSynthetic & Golden Dataset ManagementAutomated Scoring System Design for GenAI Outputs],
-
Quality Assurance Expert
1 week ago
mount, India beBeeAudit Full timeJob Title: Quality Assurance SpecialistWe are seeking a skilled Quality Assurance Specialist to join our team. This is an exciting opportunity for a detail-oriented individual to make a meaningful impact on the quality of our processes.This role involves performing quality assurance reviews across various departments, identifying areas for improvement, and...
-
Mobile Software Quality Assurance Specialist
2 weeks ago
mount, India beBeeQuality Full time**Job Title:** Mobile Software Quality Assurance SpecialistWe are seeking an experienced software quality assurance specialist to join our team. In this role, you will be responsible for ensuring the quality and reliability of our mobile software.The ideal candidate will have a strong understanding of software quality methodologies, tools, and best...
-
mount, India beBeeAutomation Full timeOur company is seeking a highly skilled professional to fill the position of Senior Quality Assurance Specialist.The ideal candidate will have experience working with project and product teams, delivering functional and automated testing of APIs and validating repeatable back-end/infrastructure processes.Main Responsibilities:Required Skills and...
-
Senior Software Quality Assurance Engineer
5 days ago
mount, India beBeeQuality Full timeJob Title: Software Quality Assurance Specialist Job Description:We are seeking an experienced software quality assurance specialist to join our team. The successful candidate will be responsible for ensuring the quality and usability of our products through thorough testing.Key responsibilities include performing functional, regression, and exploratory...
-
Senior Quality Assurance Specialist
2 weeks ago
mount, India beBeeQualityAssurance Full timeJob OverviewOur organization is seeking a skilled professional to assume the role of Quality Assurance Analyst. The selected candidate will be responsible for conducting thorough technical quality assessments of recorded interviews.Technical Quality Assurance: Conduct end-to-end reviews of assigned recordings to identify any issues or anomalies.Fraud...
-
Pkms Wmi Quality Assurance Specialist
2 weeks ago
mount, India beBeeQuality Full timeJob Title: Pkms Wmi Quality Assurance SpecialistWe are seeking an experienced Pkms Wmi Quality Assurance Specialist to support quality assurance activities within Warehouse Management Systems. The ideal candidate will have hands-on experience in Pkms / Manhattan Wmi, a strong understanding of supply chain and distribution operations, and a proven track...
-
Senior Quality Assurance Manager
1 week ago
mount, India beBeeQuality Full timeSenior Quality Assurance ManagerTotal Work Experience: +18 years of experience in quality assurance & control of medium to large civil / infrastructure or building projects.Develop and implement a quality culture & strategy for the project, establishing programs & processes to achieve objectives.Collaborate with group manager quality and environment to...
-
Salesforce Quality Assurance Specialist
5 days ago
mount, India beBeeQuality Full timeJob DescriptionWe are seeking a skilled Salesforce Quality Assurance Specialist with expertise in Manual and Automation Testing. The ideal candidate will work remotely and be able to handle end-to-end testing of Salesforce applications, ensuring high-quality releases.Perform manual and automation testing for Salesforce applications, including functional,...
-
Software Quality Assurance Professional
7 days ago
mount, India beBeeSoftware Full timeQuality Assurance SpecialistAs a Quality Assurance Specialist, you will be responsible for ensuring that products and systems meet the highest quality standards before they reach our customers.You will develop and execute test cases to validate product functionality.Perform functional, regression, integration, system, and user acceptance testing to identify...
-
Quality Assurance Specialist
2 weeks ago
mount, India beBeeQuality Full timeWe are seeking a seasoned quality assurance professional to join our team.Title : Senior QA - OMAN MVP2 SIT resourcesLocation : Offshore India - BangaloreDuration : 6 MonthsDescription:At least 7-9 years of experience in testing Oracle Banking ApplicationHands-on experience on trade product life cycle such as import LC, Export LC, Collections,...
