Senior Quality Assurance Engineer

4 days ago


thiruvananthapuram, India beBeeAutomation Full time

Job Title: Senior Quality Assurance Engineer - AI ValidationAbout the Role:We are seeking an experienced Senior Quality Assurance Engineer to lead our quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems. As a key member of our team, you will be responsible for designing and executing test automation frameworks using Python, PyTest, and DeepEval.Key Responsibilities:Lead and scale test automation initiatives with a focus on GenAI and AI systemsDesign and execute LLM evaluation frameworks using G-Eval, custom evaluators, and LLM-as-a-JudgeImplement RAG evaluation frameworks (RAGAS or similar)Build Python-based automation frameworks using PyTest & DeepEvalIntegrate automation into CI/CD pipelines using GitHub ActionsPerform adversarial and red-team testing using prompt injection, jailbreak attacks, bias, and toxicity detectionConduct API testing for microservices (REST, async workflows)Monitor applications using Azure Application Insights & Log AnalyticsDefine automated scoring systems for GenAI outputsManage synthetic datasets and golden datasets for AI validationImplement observability and trace monitoring using LangFuse, LangSmith, or similar toolsMandatory Skills:Test Automation – Python, PyTest, DeepEvalLLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-JudgeRAG Evaluation – RAGAS, Retrieval MetricsEvaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring – LangFuse, LangSmithCI/CD – GitHub ActionsMulti-Agent Testing – Reasoning & Tool ValidationAdversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing – REST & Async WorkflowsAzure Monitoring – App Insights, Log AnalyticsSynthetic & Golden Dataset ManagementAutomated Scoring System Design for GenAI OutputsAbout You:We are looking for a skilled QA engineer who has experience in test automation, LLM evaluation, and RAG evaluation. You should have strong knowledge of Python, PyTest, and DeepEval, as well as experience with CI/CD pipelines and Azure monitoring.Bonus Points:Experience with adversarial testing and red-team testingKnowledge of Azure DevOps and GitHub ActionsAbility to work in a fast-paced environment and prioritize tasks effectivelyWhat We Offer:We offer a competitive salary, comprehensive benefits package, and opportunities for growth and professional development.Apply Now:If you are a motivated and experienced QA engineer looking for a new challenge, please submit your resume and cover letter.



  • thiruvananthapuram, India beBeeQuality Full time

    Job Title: Senior Quality Assurance ManagerWe are seeking a seasoned senior quality assurance manager to oversee our testing processes and lead a distributed QA team. As a key member of our development team, you will play a vital role in strengthening our quality assurance strategies and ensuring seamless delivery.The ideal candidate will have 3+ years of...


  • thiruvananthapuram, India beBeeRenewable Full time

    Job Overview:We are seeking a highly skilled Senior Quality Assurance Inspector to join our team. This is an exciting opportunity for a motivated and detail-oriented individual to coordinate and perform pre-dispatch and post-dispatch inspections for renewable energy equipment.The ideal candidate will have a strong understanding of inspection plans, site...


  • thiruvananthapuram, India beBeeArtificialIntelligence Full time

    Quality Assurance Engineer - Advanced Test StrategiesWe are seeking an experienced Quality Assurance Engineer to lead advanced test strategies for our Conversational AI platform.Lead Test Strategy: Define and implement comprehensive test plans covering functional, performance, security, and scalability aspects.Build Automation Frameworks: Design and develop...


  • thiruvananthapuram, India beBeeQuality Full time

    Senior QA StrategistThe Role:As a Senior QA Strategist, you will be responsible for leading the development of scalable quality assurance systems to support high-volume customer and user traffic.Key Responsibilities include:Developing and implementing automation frameworks to streamline testing processes.Designing data integrity testing systems to ensure...


  • thiruvananthapuram, India beBeeSoftware Full time

    Key ResponsibilitiesWe are seeking a Senior Software Quality Assurance Engineer to deliver high-quality software through advanced testing strategies. This is a hands-on IC role where you will design and implement automation frameworks, execute complex test plans, and drive an AI-first approach to quality assurance.Lead Testing Initiatives: Develop robust...


  • Thiruvananthapuram, India Apexon Full time

    About Apexon:Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.Apexon brings together distinct core...


  • Thiruvananthapuram, India Apexon Full time

    About Apexon:Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.Apexon brings together distinct core...


  • Thiruvananthapuram, Kerala, India KV Joseph & Sons Full time

    Company DescriptionKV Joseph & Sons is a renowned construction company based in Kochi, Kerala, India. With a strong reputation in the industry, we deliver high-quality construction projects and services to meet the diverse needs of our clients. Our commitment to excellence and innovation makes KV Joseph & Sons a trusted choice for construction solutions.Role...


  • thiruvananthapuram, India beBeeAutomation Full time

    Job Summary:We are seeking a seasoned Quality Assurance Automation Engineer to join our team. As a key member of our product development process, you will play a crucial role in ensuring the quality and reliability of our products.Key Responsibilities:Develop high-quality software products through technical expertise in quality engineeringCollaborate with...


  • thiruvananthapuram, India beBeeArtificial Full time

    AI Quality Assurance EngineerWe are seeking a highly skilled and experienced test engineer to ensure the quality, reliability and ethical integrity of our AI solutions.Must have:6+ years of experience in test automation with tools like Tosca, Python, Selenium.Strong knowledge of QA methodologies like Agile, Waterfall, DevOps for functional test...