Automated AI Validation Specialist

1 week ago


Koṭa, India beBeeAIAutomation Full time

Quality Assurance LeadWe are seeking a seasoned Quality Assurance professional to lead our efforts in automated testing and AI validation.About the RoleThis is an exceptional opportunity for a highly skilled individual to drive quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems. The successful candidate will be responsible for designing, executing, and optimizing LLM evaluation frameworks, as well as implementing RAG evaluation frameworks.Key ResponsibilitiesDesign and execute LLM evaluation frameworks using LLM-as-a-Judge (G-Eval, custom evaluators)Implement RAG evaluation frameworks (RAGAS or similar)Develop and integrate automation into CI/CD pipelines using GitHub ActionsConduct API testing for microservices (REST, async workflows) and monitor applications using Azure Application Insights & Log AnalyticsDefine automated scoring systems for GenAI outputs, manage synthetic datasets and golden datasets for AI validation, and implement observability and trace monitoring using LangFuse, LangSmith, or similar toolsRequirementsThe ideal candidate will have extensive experience in building Python-based automation frameworks using PyTest & DeepEval, integrating automation into CI/CD pipelines, designing and validating multi-agent evaluation pipelines, and performing adversarial and red-team testing.BenefitsThe role offers a unique chance to work on cutting-edge technologies and collaborate with a talented team of professionals. The successful candidate will have opportunities for growth and development, as well as a competitive compensation package.



  • Koṭa, India beBeeAutomation Full time

    About the Business Process Automation Specialist role.This specialist empowers businesses with innovative solutions in financial services, DevOps, and digital transformation. Our team drives cutting-edge AI applications that deliver real business value.The position focuses on integrating AI-powered Intelligent Document Processing (IDP) with RPA bots to...


  • Koṭa, India beBeeAutomation Full time

    We are seeking a highly skilled and motivated individual to join our team as an AI Automation Intern. This is a full-time, remote internship opportunity where you will work closely with our cross-functional teams to develop and deploy no-code AI agents, streamline workflows, and enhance solutions.This role requires strong analytical, problem-solving, and...


  • Koṭa, India beBeeAutomation Full time

    Role Summary:This internship provides a hands-on experience in developing chatbots, voice automation systems, and AI-powered process automation tools.As a remote intern, you will work with our product and engineering teams on live automation projects, focusing on designing and developing chat and voice automation workflows, writing scripts to improve...


  • Koṭa, India beBeeDataValidation Full time

    Data Validation SpecialistEmpowering your career means being part of a collaborative community that unlocks the value of technology worldwide. Our goal is to build a more sustainable and inclusive world through innovative solutions.Your RoleWe are looking for a Data Validation Specialist to design, develop, and execute test cases, scenarios, and scripts for...

  • AI Specialist

    2 weeks ago


    Koṭa, India beBeeArtificialIntelligence Full time

    Role OverviewWe are seeking a highly skilled AI Specialist to join our team. As an AI Specialist, you will be responsible for developing and implementing algorithms and models for Generative Engine Optimizations (GEOs), Efficient AI Agents, and Rule-based AI processing.Your Key Responsibilities:Develop and implement AI models and algorithms for GEOs,...


  • Koṭa, India beBeeAi Full time

    AI-Powered Psychometric SpecialistWe are seeking a skilled specialist to join our R&D and Consulting department.This role combines AI-driven innovation with psychometric expertise to design and improve assessment tools, while supporting consulting projects worldwide.Our ideal candidate will be responsible for designing and integrating AI-based programs to...


  • Koṭa, India beBeeAccounting Full time

    Job Description:We're transforming accounting operations by introducing no-code AI automation. Our mission is to empower accountants to focus on high-value tasks, serving clients effectively.As an Accounting Automation Specialist, you'll leverage our no-code AI platform to design, build, and optimize workflows for accounting firms. Your accounting or finance...


  • Koṭa, India beBeeSoftware Full time

    Job Title:Senior Quality Assurance Specialist Job DescriptionWe are seeking a highly skilled Senior QA Specialist to join our team. This individual will be responsible for designing, executing and automating tests for our internal systems, covering backend APIs and frontend components.The ideal candidate will have experience in test automation within CI/CD...


  • Koṭa, India beBeeAutomation Full time

    As a Test Automation Specialist, you will work closely with stakeholders to design and execute comprehensive test cases for entire features or functionalities. Your key responsibilities include automating application features, creating test data for scripts, maintaining execution logs and results, logging defects, and reporting issues in a timely manner.Your...


  • Koṭa, India beBeeModel Full time

    Quantitative Model Validation ExpertJob Description As a Quantitative Model Validation Expert, you will be responsible for leading independent validations and reviews of various risk models. This role ensures that models are functioning as intended, comply with regulatory requirements, and accurately identify, measure, and report risks to senior...