Senior Test Assurance Engineer
5 days ago
Lead QA Specialist in Automated Testing & AI ValidationWe are seeking a highly skilled Lead QA Specialist to lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems. This role will focus on test automation, LLM evaluation, RAG pipelines, observability, adversarial testing, and Azure monitoring.Key Responsibilities:Design and execute LLM evaluation frameworks using G-Eval, custom evaluators, and LLM-as-a-Judge.Implement RAG evaluation frameworks (RAGAS or similar) and build Python-based automation frameworks using PyTest & DeepEval.Integrate automation into CI/CD pipelines using GitHub Actions and monitor applications using Azure Application Insights & Log Analytics.Develop automated scoring systems for GenAI outputs and manage synthetic datasets and golden datasets for AI validation.Implement observability and trace monitoring using LangFuse, LangSmith, or similar tools.Mandatory Skills:Test Automation – Python, PyTest, DeepEvalLLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-JudgeRAG Evaluation – RAGAS, Retrieval MetricsEvaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring – LangFuse, LangSmithCI/CD – GitHub ActionsMulti-Agent Testing – Reasoning & Tool ValidationAdversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing – REST & Async WorkflowsAzure Monitoring – App Insights, Log AnalyticsSynthetic & Golden Dataset ManagementAutomated Scoring System Design for GenAI Outputs
-
Senior Software Quality Assurance Tester
1 week ago
guntur, India beBeeQuality Full timeJob Title:Senior Quality Assurance EngineerWe are seeking a skilled Senior Quality Assurance Engineer to join our team. The ideal candidate will have 8+ years of experience in software testing and automation, with a strong background in engineering.This is a full-time remote role that involves developing and executing automated tests, creating test cases,...
-
Senior Software Engineer
1 week ago
guntur, India beBeeSoftware Full timeJob OverviewAs a senior software engineer in quality assurance, you will play a pivotal role in driving the quality strategy for our cutting-edge conversational AI platform.Define and implement comprehensive test strategies for our conversational AI platform, covering functional, performance, security, and scalability aspects.Design and develop advanced,...
-
Senior Product Quality Engineer
3 days ago
guntur, India beBeeSeniorQualityAssurance Full timeJob Overview: Our organization seeks a dedicated Senior Quality Assurance Automation Engineer to spearhead quality engineering initiatives. This role will play a pivotal part in ensuring product excellence through meticulous testing planning and execution.This position requires close collaboration with cross-functional teams, fostering global quality...
-
AI Solutions Test Engineer
5 days ago
guntur, India beBeeArtificialIntelligence Full timeAs we continue to push the boundaries of Artificial Intelligence, our organization is seeking a highly skilled Quality Assurance Test Engineer to ensure the quality and reliability of our advanced AI solutions.Key qualifications for this role include experience in test automations and tools such as Tosca, Python, and Selenium, as well as strong knowledge of...
-
Senior Quality Assurance Specialist
6 days ago
guntur, India Ascendion Full timeJob Title :: Senior Quality Assurance Engineer (ServiceNow Modules)Location :: India (Remote)Minimum relevant experience :: 4Top Skills/Must have Skills:ServiceNow ModulesTesting tools (AutomatePro OR Selenium)Languages (C# OR Java)QA MethodologiesJob Description:This Service Now focused functional test analyst role is required to work within project &...
-
Pega Software Quality Assurance Specialist
7 days ago
guntur, India beBeeSoftware Full timeSenior Pega QA RoleThis is a full-time remote opportunity for a Senior Pega QA.The Senior Pega QA will be responsible for quality assurance, control and management.The role involves ensuring the quality and effectiveness of software systems and processes.Key Responsibilities:Ensuring the quality and effectiveness of software systems and processes.Developing...
-
Senior Quality Engineering Manager
3 days ago
guntur, India beBeeQuality Full timeSenior Quality Engineering ManagerAbout the Role:We're seeking a seasoned Senior Quality Engineering Manager to drive our quality engineering vision and strategy, ensuring the delivery of high-quality software products.Key Responsibilities:Develop and execute a comprehensive quality engineering roadmap that aligns with business objectives.Leverage automation...
-
Test Automation Engineer
6 days ago
guntur, India beBeeSoftwareQuality Full timeJob DescriptionWe are seeking a detail-oriented Quality Assurance Professional to join our team. This role involves ensuring the delivery of high-quality software solutions by designing and executing effective test strategies.The ideal candidate has hands-on experience in Java, Cypress, and API testing and is passionate about building defect-free software...
-
Senior Quality Assurance Manager
7 days ago
guntur, India beBeeSoftware Full timeJob OpportunityThe QA Team Lead will oversee the development of quality standards and best practices across various platforms. To achieve this, they must design test automation strategies for regression and performance testing.Collaborate with cross-functional teams to drive the integration of quality into every stage of software developmentEstablish...
-
Senior Software Quality Assurance Specialist
4 days ago
guntur, India beBeeQuality Full timeHigh-quality data and analytics solutions rely on robust testing strategies. As a dedicated Quality Assurance Engineer, you will play a crucial role in ensuring the reliability and performance of our mobile and web services.We process billions of events daily, aggregating online and offline data to provide real-time insights through an intuitive interface....