Senior Quality Assurance Specialist

1 week ago

tiruppur, India beBeeArtificial Full time

Lead QA & AI Validation EngineerWe are seeking a seasoned professional to lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems.Job Description:The ideal candidate will have strong expertise in Python automation, LLM evaluation, RAG pipelines, observability, adversarial testing, and Azure monitoring.Design and execute LLM evaluation frameworks using G-Eval, custom evaluators, and LLM-as-a-Judge.Hallucination detection, faithfulness, relevance, precision/recallImplement RAG evaluation frameworks (RAGAS or similar).Build Python-based automation frameworks using PyTest & DeepEval.Integrate automation into CI/CD pipelines using GitHub Actions.Monitor applications using Azure Application Insights & Log Analytics.Define automated scoring systems for GenAI outputs.Manage synthetic datasets and golden datasets for AI validation.Implement observability and trace monitoring using LangFuse, LangSmith, or similar tools.Mandatory Skills:The following skills are required for this position:Test Automation – Python, PyTest, DeepEvalLLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-JudgeRAG Evaluation – RAGAS, Retrieval MetricsEvaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring – LangFuse, LangSmithCI/CD – GitHub ActionsMulti-Agent Testing – Reasoning & Tool ValidationAdversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing – REST & Async WorkflowsAzure Monitoring – App Insights, Log AnalyticsSynthetic & Golden Dataset ManagementAutomated Scoring System Design for GenAI OutputsThis role is ideal for individuals with 6+ years of experience in the field.

  • Senior Quality Assurance Automation Specialist

    1 week ago

    tiruppur, India beBeeSpecialist Full time

    Job Title: Senior Quality Assurance Automation SpecialistWe are seeking a skilled Senior Quality Assurance Automation Specialist to join our team. This is an exciting opportunity to work with us and contribute your expertise in automation testing, technical skills, and experience working with distributed systems.The ideal candidate will have hands-on...

  • Quality Assurance Specialist

    1 week ago

    tiruppur, India beBeeqaengineer Full time

    Quality Assurance SpecialistWe are seeking a talented Quality Assurance Specialist to join our team. In this role, you will be responsible for ensuring the highest quality of our digital products.

  • Automation Quality Assurance Specialist

    1 week ago

    tiruppur, India beBeeQuality Full time

    Job OverviewWe are seeking an experienced Automation Quality Assurance Specialist to join our team.This key role plays a crucial part in ensuring the quality and efficiency of software applications. As an Automation Quality Assurance Specialist, you will be responsible for identifying and fixing bugs, as well as creating automated tests to prevent future...

  • SAP Quality Assurance Specialist

    2 days ago

    tiruppur, India beBeeQuality Full time

    SAP Quality Assurance SpecialistThis position involves the implementation, configuration, and support of SAP modules for quality control and asset management. The specialist will be responsible for tasks such as preventive maintenance planning, inspection setup, defect tracking, work order administration, and ensuring seamless integration with other modules.

  • Chief Quality Assurance Specialist

    2 days ago

    tiruppur, India beBeeQuality Full time

    Chief Quality Assurance SpecialistOur company is seeking a seasoned quality assurance specialist to spearhead the optimization of our testing procedures.Oversee and mentor the QA team, establishing industry benchmarks and best practices for software quality assuranceDevelop and implement comprehensive test automation strategies for regression and performance...

  • Key Quality Assurance Role

    2 weeks ago

    tiruppur, India beBeeQuality Full time

    Job Title: Quality Assurance SpecialistWe are seeking a highly skilled Quality Assurance Specialist to join our team.The ideal candidate will have excellent communication skills, both written and verbal, for conducting audits. Proficiency in Microsoft Office suite, particularly Excel for data analysis, is also essential.We offer a dynamic and challenging...

  • Warehouse Management Systems Quality Assurance Specialist

    1 week ago

    tiruppur, India beBeeQuality Full time

    Job Title:Warehouse Management Systems Quality Assurance Specialist

  • Senior Quality Assurance Specialist

    2 weeks ago

    tiruppur, India beBeePega Full time

    About the RoleWe are seeking a Senior Pega QA to oversee the quality control, assurance and management of software systems and processes.The successful candidate will be responsible for ensuring the highest standards of quality in our software development lifecycle.

  • Senior Quality Assurance Specialist

    4 days ago

    tiruppur, India beBeeQualityAssurance Full time

    Quality Assurance Engineer Job DescriptionInnovate at the intersection of AI, SEO, and growth.We shape the future of enterprise SEO and content performance by transforming content into measurable traffic, engagement, and revenue for clients.Execute manual and automated testing with a focus on quality assurance.Develop and maintain automated test scripts...

  • Data Pipeline Quality Assurance Specialist

    2 weeks ago

    tiruppur, India beBeeDataPipelineQuality Full time

    Job Title: Data Pipeline Quality Assurance SpecialistJob DescriptionWe are seeking an experienced data pipeline quality assurance specialist to validate and analyze data pipelines, ensure accuracy, performance, and reliability of business intelligence reports and analytics solutions.Required Skills and Qualifications5-10+ years of experience in data...