Senior Quality Assurance Engineer
4 days ago
Job Title: Senior Quality Assurance Engineer - AI ValidationAbout the Role:We are seeking an experienced Senior Quality Assurance Engineer to lead our quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems. As a key member of our team, you will be responsible for designing and executing test automation frameworks using Python, PyTest, and DeepEval.Key Responsibilities:Lead and scale test automation initiatives with a focus on GenAI and AI systemsDesign and execute LLM evaluation frameworks using G-Eval, custom evaluators, and LLM-as-a-JudgeImplement RAG evaluation frameworks (RAGAS or similar)Build Python-based automation frameworks using PyTest & DeepEvalIntegrate automation into CI/CD pipelines using GitHub ActionsPerform adversarial and red-team testing using prompt injection, jailbreak attacks, bias, and toxicity detectionConduct API testing for microservices (REST, async workflows)Monitor applications using Azure Application Insights & Log AnalyticsDefine automated scoring systems for GenAI outputsManage synthetic datasets and golden datasets for AI validationImplement observability and trace monitoring using LangFuse, LangSmith, or similar toolsMandatory Skills:Test Automation – Python, PyTest, DeepEvalLLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-JudgeRAG Evaluation – RAGAS, Retrieval MetricsEvaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring – LangFuse, LangSmithCI/CD – GitHub ActionsMulti-Agent Testing – Reasoning & Tool ValidationAdversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing – REST & Async WorkflowsAzure Monitoring – App Insights, Log AnalyticsSynthetic & Golden Dataset ManagementAutomated Scoring System Design for GenAI OutputsAbout You:We are looking for a skilled QA engineer who has experience in test automation, LLM evaluation, and RAG evaluation. You should have strong knowledge of Python, PyTest, and DeepEval, as well as experience with CI/CD pipelines and Azure monitoring.Bonus Points:Experience with adversarial testing and red-team testingKnowledge of Azure DevOps and GitHub ActionsAbility to work in a fast-paced environment and prioritize tasks effectivelyWhat We Offer:We offer a competitive salary, comprehensive benefits package, and opportunities for growth and professional development.Apply Now:If you are a motivated and experienced QA engineer looking for a new challenge, please submit your resume and cover letter.
-
Senior Quality Assurance Manager
6 days ago
thiruvananthapuram, India beBeeQuality Full timeJob Title: Senior Quality Assurance ManagerWe are seeking a seasoned senior quality assurance manager to oversee our testing processes and lead a distributed QA team. As a key member of our development team, you will play a vital role in strengthening our quality assurance strategies and ensuring seamless delivery.The ideal candidate will have 3+ years of...
-
Senior Quality Assurance Inspector
2 days ago
thiruvananthapuram, India beBeeRenewable Full timeJob Overview:We are seeking a highly skilled Senior Quality Assurance Inspector to join our team. This is an exciting opportunity for a motivated and detail-oriented individual to coordinate and perform pre-dispatch and post-dispatch inspections for renewable energy equipment.The ideal candidate will have a strong understanding of inspection plans, site...
-
Senior Quality Assurance Engineer
6 days ago
thiruvananthapuram, India beBeeArtificialIntelligence Full timeQuality Assurance Engineer - Advanced Test StrategiesWe are seeking an experienced Quality Assurance Engineer to lead advanced test strategies for our Conversational AI platform.Lead Test Strategy: Define and implement comprehensive test plans covering functional, performance, security, and scalability aspects.Build Automation Frameworks: Design and develop...
-
Senior Quality Assurance Strategist
6 days ago
thiruvananthapuram, India beBeeQuality Full timeSenior QA StrategistThe Role:As a Senior QA Strategist, you will be responsible for leading the development of scalable quality assurance systems to support high-volume customer and user traffic.Key Responsibilities include:Developing and implementing automation frameworks to streamline testing processes.Designing data integrity testing systems to ensure...
-
Senior Software Quality Assurance Engineer
6 days ago
thiruvananthapuram, India beBeeSoftware Full timeKey ResponsibilitiesWe are seeking a Senior Software Quality Assurance Engineer to deliver high-quality software through advanced testing strategies. This is a hands-on IC role where you will design and implement automation frameworks, execute complex test plans, and drive an AI-first approach to quality assurance.Lead Testing Initiatives: Develop robust...
-
Senior Quality Assurance Manager
3 weeks ago
Thiruvananthapuram, India Apexon Full timeAbout Apexon:Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.Apexon brings together distinct core...
-
Senior Quality Assurance Manager
3 weeks ago
Thiruvananthapuram, India Apexon Full timeAbout Apexon:Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.Apexon brings together distinct core...
-
Quality Assurance/Quality Control Engineer
5 days ago
Thiruvananthapuram, Kerala, India KV Joseph & Sons Full timeCompany DescriptionKV Joseph & Sons is a renowned construction company based in Kochi, Kerala, India. With a strong reputation in the industry, we deliver high-quality construction projects and services to meet the diverse needs of our clients. Our commitment to excellence and innovation makes KV Joseph & Sons a trusted choice for construction solutions.Role...
-
Senior Software Quality Assurance Engineer
2 days ago
thiruvananthapuram, India beBeeAutomation Full timeJob Summary:We are seeking a seasoned Quality Assurance Automation Engineer to join our team. As a key member of our product development process, you will play a crucial role in ensuring the quality and reliability of our products.Key Responsibilities:Develop high-quality software products through technical expertise in quality engineeringCollaborate with...
-
Senior AI Quality Assurance Test Engineer
4 days ago
thiruvananthapuram, India beBeeArtificial Full timeAI Quality Assurance EngineerWe are seeking a highly skilled and experienced test engineer to ensure the quality, reliability and ethical integrity of our AI solutions.Must have:6+ years of experience in test automation with tools like Tosca, Python, Selenium.Strong knowledge of QA methodologies like Agile, Waterfall, DevOps for functional test...
