Senior Quality Assurance Engineer
5 days ago
Job Title: Senior Quality Assurance Engineer & AI Validator We are seeking a seasoned professional to lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems. As a Senior Quality Assurance Engineer & AI Validator, you will be responsible for designing and executing test automation frameworks, evaluating Large Language Models (LLMs), and monitoring applications using Azure Application Insights & Log Analytics. Key Responsibilities:Design and execute LLM evaluation frameworks using G-Eval and custom evaluators.Implement RAG evaluation frameworks (RAGAS or similar).Build Python-based automation frameworks using PyTest and DeepEval.Integrate automation into CI/CD pipelines using GitHub Actions.Design and validate multi-agent evaluation pipelines (tool usage, collaboration, reasoning chains).Perform adversarial and red-team testing: prompt injection, jailbreak attacks, bias and toxicity detection.Conduct API testing for microservices (REST, async workflows).Monitor applications using Azure Application Insights & Log Analytics.Define automated scoring systems for GenAI outputs.Manage synthetic datasets and golden datasets for AI validation.Implement observability and trace monitoring using LangFuse, LangSmith, or similar tools. Required Skills and Qualifications:Test Automation – Python, PyTest, DeepEvalLLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-JudgeRAG Evaluation – RAGAS, Retrieval MetricsEvaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring – LangFuse, LangSmithCI/CD – GitHub ActionsMulti-Agent Testing – Reasoning & Tool ValidationAdversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing – REST & Async WorkflowsAzure Monitoring – App Insights, Log AnalyticsSynthetic & Golden Dataset ManagementAutomated Scoring System Design for GenAI Outputs Benefits:As a Senior Quality Assurance Engineer & AI Validator, you will have the opportunity to work on cutting-edge projects, develop your skills in AI and automation, and collaborate with a team of experienced professionals.
-
Senior Quality Assurance Manager
7 days ago
ghaziabad, India beBeeQuality Full timeSenior Quality Assurance ManagerWe are seeking an experienced Senior Quality Assurance Manager to drive our automation, performance, and data integrity initiatives.Create a scalable automation framework resilient to UI changes and supports continuous releases.Establish a data integrity testing system to ensure customer isolation and prevent cross-tenant data...
-
Senior Quality Assurance Inspector
2 days ago
ghaziabad, India beBeeQuality Full timeJob OverviewAs a Senior Quality Assurance Inspector, you will be responsible for overseeing the production and quality control of renewable energy equipment.The ideal candidate will have a strong background in quality control and inspection procedures, with experience working in a fast-paced environment.Key Responsibilities:Develop and implement quality...
-
Senior Quality Assurance Specialist
6 hours ago
ghaziabad, India beBeeAutomation Full timeHigh-Quality Engineering Expertise is crucial to us.We are seeking a Senior Quality Assurance Automation Engineer to play a pivotal role in ensuring product quality through thorough planning and execution of product testing. Direct involvement in manual & automation test efforts will lead to developing and managing compliance to standards for process or...
-
Senior Quality Assurance Professional
5 days ago
ghaziabad, India beBeeAutomation Full timeWe are seeking an experienced Senior Quality Assurance Automation Engineer to join our team.You will play a key role in building robust automation frameworks, driving test quality and collaborating with development teams in India and clients in the US.The ideal candidate will have strong experience in automation and working with development teams. Excellent...
-
Senior Software Quality Engineer
4 days ago
ghaziabad, India beBeeQualityAssurance Full timeQuality Assurance LeadWe're seeking a seasoned Quality Assurance Architect to spearhead our quality strategy, drive automation vision, and shape testing architecture across our engineering ecosystem.The ideal candidate will bring deep expertise in modern testing frameworks, non-functional engineering, and quality-driven design, with a strong ability to...
-
Senior Quality Assurance Specialist
7 days ago
ghaziabad, India beBeeQuality Full timeWe are seeking a detail-oriented and experienced Quality Auditor to join our HVAC Call Center process.Key Responsibilities:Diligently inspecting equipment and processes for quality issues.Evaluating data and identifying areas for improvement.Requirements:Minimum 3 years of experience in quality assurance or auditing.Proven track record of success in...
-
ghaziabad, India beBeeAutomation Full timeSenior Quality Assurance Automation Engineer Role DescriptionWe are seeking a highly experienced and skilled Lead QA Test Automation Engineer to join our team on a full-time remote basis. The ideal candidate will possess excellent communication skills, a strong engineering background, and the ability to interact effectively with customers.The primary...
-
ghaziabad, India beBeeAutomation Full timeSenior Quality Assurance Automation SpecialistThe ideal candidate will possess extensive experience in manual testing and a strong background in automation testing using Selenium and Java.Responsibilities:Ensure product quality through meticulous planning and execution of product testing.Develop and manage compliance to industry standards for process or...
-
Senior Software Quality Assurance Specialist
4 days ago
ghaziabad, India beBeeSoftwareTesting Full timeQuality Assurance EngineerWe are seeking a meticulous Quality Assurance Engineer to ensure the quality of software products through rigorous manual testing.Responsibilities:Create comprehensive test plans and cases based on product specifications.Execute manual tests to verify functionality, usability, and performance across various platforms.Identify,...
-
Quality Assurance Test Automation Specialist
6 days ago
ghaziabad, India beBeeAutomation Full timeSenior Quality Assurance Automation EngineerWe are looking for an experienced automation engineer to join our team. As a key member, you will be responsible for ensuring the quality and reliability of our products.Key Responsibilities:Ongoing collaboration with developers to clarify feature requirements and ensure all test scope is addressed in test plans...
