Senior Test Assurance Engineer

5 days ago


guntur, India beBeeQualityAssurance Full time

Lead QA Specialist in Automated Testing & AI ValidationWe are seeking a highly skilled Lead QA Specialist to lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems. This role will focus on test automation, LLM evaluation, RAG pipelines, observability, adversarial testing, and Azure monitoring.Key Responsibilities:Design and execute LLM evaluation frameworks using G-Eval, custom evaluators, and LLM-as-a-Judge.Implement RAG evaluation frameworks (RAGAS or similar) and build Python-based automation frameworks using PyTest & DeepEval.Integrate automation into CI/CD pipelines using GitHub Actions and monitor applications using Azure Application Insights & Log Analytics.Develop automated scoring systems for GenAI outputs and manage synthetic datasets and golden datasets for AI validation.Implement observability and trace monitoring using LangFuse, LangSmith, or similar tools.Mandatory Skills:Test Automation – Python, PyTest, DeepEvalLLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-JudgeRAG Evaluation – RAGAS, Retrieval MetricsEvaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring – LangFuse, LangSmithCI/CD – GitHub ActionsMulti-Agent Testing – Reasoning & Tool ValidationAdversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing – REST & Async WorkflowsAzure Monitoring – App Insights, Log AnalyticsSynthetic & Golden Dataset ManagementAutomated Scoring System Design for GenAI Outputs



  • guntur, India beBeeQuality Full time

    Job Title:Senior Quality Assurance EngineerWe are seeking a skilled Senior Quality Assurance Engineer to join our team. The ideal candidate will have 8+ years of experience in software testing and automation, with a strong background in engineering.This is a full-time remote role that involves developing and executing automated tests, creating test cases,...


  • guntur, India beBeeSoftware Full time

    Job OverviewAs a senior software engineer in quality assurance, you will play a pivotal role in driving the quality strategy for our cutting-edge conversational AI platform.Define and implement comprehensive test strategies for our conversational AI platform, covering functional, performance, security, and scalability aspects.Design and develop advanced,...


  • guntur, India beBeeSeniorQualityAssurance Full time

    Job Overview: Our organization seeks a dedicated Senior Quality Assurance Automation Engineer to spearhead quality engineering initiatives. This role will play a pivotal part in ensuring product excellence through meticulous testing planning and execution.This position requires close collaboration with cross-functional teams, fostering global quality...


  • guntur, India beBeeArtificialIntelligence Full time

    As we continue to push the boundaries of Artificial Intelligence, our organization is seeking a highly skilled Quality Assurance Test Engineer to ensure the quality and reliability of our advanced AI solutions.Key qualifications for this role include experience in test automations and tools such as Tosca, Python, and Selenium, as well as strong knowledge of...


  • guntur, India Ascendion Full time

    Job Title :: Senior Quality Assurance Engineer (ServiceNow Modules)Location :: India (Remote)Minimum relevant experience :: 4Top Skills/Must have Skills:ServiceNow ModulesTesting tools (AutomatePro OR Selenium)Languages (C# OR Java)QA MethodologiesJob Description:This Service Now focused functional test analyst role is required to work within project &...


  • guntur, India beBeeSoftware Full time

    Senior Pega QA RoleThis is a full-time remote opportunity for a Senior Pega QA.The Senior Pega QA will be responsible for quality assurance, control and management.The role involves ensuring the quality and effectiveness of software systems and processes.Key Responsibilities:Ensuring the quality and effectiveness of software systems and processes.Developing...


  • guntur, India beBeeQuality Full time

    Senior Quality Engineering ManagerAbout the Role:We're seeking a seasoned Senior Quality Engineering Manager to drive our quality engineering vision and strategy, ensuring the delivery of high-quality software products.Key Responsibilities:Develop and execute a comprehensive quality engineering roadmap that aligns with business objectives.Leverage automation...


  • guntur, India beBeeSoftwareQuality Full time

    Job DescriptionWe are seeking a detail-oriented Quality Assurance Professional to join our team. This role involves ensuring the delivery of high-quality software solutions by designing and executing effective test strategies.The ideal candidate has hands-on experience in Java, Cypress, and API testing and is passionate about building defect-free software...


  • guntur, India beBeeSoftware Full time

    Job OpportunityThe QA Team Lead will oversee the development of quality standards and best practices across various platforms. To achieve this, they must design test automation strategies for regression and performance testing.Collaborate with cross-functional teams to drive the integration of quality into every stage of software developmentEstablish...


  • guntur, India beBeeQuality Full time

    High-quality data and analytics solutions rely on robust testing strategies. As a dedicated Quality Assurance Engineer, you will play a crucial role in ensuring the reliability and performance of our mobile and web services.We process billions of events daily, aggregating online and offline data to provide real-time insights through an intuitive interface....