AI Quality Assurance Specialist
2 days ago
Job Title: Lead AI Validation and Quality Assurance SpecialistWe are seeking an experienced professional to lead our quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems.This role will involve designing and executing evaluation frameworks for Large Language Models, building Python-based automation frameworks, and integrating automation into CI/CD pipelines using GitHub Actions.The ideal candidate will have strong expertise in test automation, LLM evaluation, RAG pipelines, observability, adversarial testing, and Azure monitoring.Key Responsibilities:Design and execute LLM evaluation frameworks using G-Eval and custom evaluatorsImplement RAG evaluation frameworks (RAGAS or similar)Build Python-based automation frameworks using PyTest & DeepEvalIntegrate automation into CI/CD pipelines using GitHub ActionsDesign and validate multi-agent evaluation pipelinesPerform adversarial and red-team testingMonitor applications using Azure Application Insights & Log AnalyticsDefine automated scoring systems for GenAI outputsManage synthetic datasets and golden datasets for AI validationMandatory Skills:Test Automation – Python, PyTest, DeepEvalLLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-JudgeRAG Evaluation – RAGAS, Retrieval MetricsEvaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring – LangFuse, LangSmithCI/CD – GitHub ActionsMulti-Agent Testing – Reasoning & Tool ValidationAdversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing – REST & Async WorkflowsAzure Monitoring – App Insights, Log AnalyticsSynthetic & Golden Dataset ManagementBenefits:Opportunity to work with cutting-edge technologiesChance to lead quality assurance initiatives for innovative projectsProfessional development and growth opportunities
-
Senior Quality Assurance Specialist
2 days ago
anand, India beBeeData Full timeSenior Quality Assurance Specialist - Data IntegrationWe are seeking a seasoned quality assurance specialist to lead data integration testing and validation efforts.The ideal candidate will possess strong SQL skills, in-depth knowledge of data flows, and proficiency with Informatica tools such as IDMC/IICS, CDI, and MDM SaaS.This role involves:Data Pipeline...
-
Senior Quality Assurance Analyst
2 days ago
anand, India beBeeQuality Full timeJob OverviewWe are seeking a highly skilled QA Specialist to join our team.Conduct thorough technical quality assurance of recorded interviews, watching assigned recordings from start to finish, identifying and documenting issues such as premature termination, audio/video glitches, and other anomalies.Perform in-depth fraud investigations by reviewing...
-
Technical Quality Assurance Specialist
2 days ago
anand, India beBeeQuality Full timeJob OverviewWe're looking for an experienced Quality Assurance professional to ensure the reliability of software development kits and analytics services.Conduct automated and manual testing for various technologies, including mobile and web applications.Develop thorough test strategies and cases to guarantee comprehensive coverage of functionalities.Execute...
-
anand, India beBeeQualityAssurance Full timeSoftware Quality Assurance SpecialistWe are seeking a detail-oriented and skilled software quality assurance specialist to enhance the reliability and performance of our trading platforms and financial applications.The ideal candidate will be responsible for ensuring comprehensive testing strategies and automation frameworks are in place to meet business...
-
Senior Quality Assurance Specialist
4 days ago
anand, India beBeeSoftware Full timeQuality Assurance AnalystAt our organization, we are looking for a skilled Quality Assurance Analyst to join our team.The Quality Assurance Analyst will be responsible for testing software applications, identifying defects, and ensuring high-quality deliverables. This role involves creating test plans, executing test cases, documenting results, and...
-
anand, India beBeeSoftwareQuality Full timeJob OpportunityThe Software Quality Assurance Specialist plays a pivotal role in ensuring the high quality of software applications. This involves creating test plans, executing manual and automated tests, documenting results, and collaborating with development teams to identify areas for improvement.Key Responsibilities:1. Test Planning & Documentation:...
-
Expert Software Quality Assurance Specialist
4 days ago
anand, India beBeeQualityAssurance Full timeSoftware Quality Assurance ExpertJoin us in a quest to ensure our software applications are of the highest quality, functional, and user-friendly.This role will bridge the gap between technical development and business needs, focusing on Quality Assurance (QA) testing. Our ideal candidate will be responsible for owning, writing, and editing user stories and...
-
anand, India beBeeArtificial Full timeSeeking a skilled AI Test Engineer to ensure the quality and reliability of advanced AI solutions.To succeed, you will need a deep understanding of artificial intelligence principles, including generative models, agentic AI, and responsible AI practices.About the Role:We are looking for an experienced professional who can lead test automation frameworks,...
-
iOS Software Quality Assurance Specialist
2 days ago
anand, India beBeeQuality Full timeQuality Assurance Role for iOS ApplicationsWe are seeking a skilled Quality Assurance Engineer to strengthen the quality foundation of our native mobile applications.Key Responsibilities:Design and execute detailed test plans for new features, covering functional, integration, and regression testing across real devices and simulators.Lead exploratory testing...
-
Quality Control Professional
4 days ago
anand, India beBeeCompliance Full timeProduct Quality Assurance SpecialistThe Product Quality Assurance Specialist plays a pivotal role in ensuring the quality and integrity of our products from raw materials to finished goods.Key Responsibilities:
