AI Quality Assurance Expert

3 days ago


Jamnagar, India beBeeAutomated Full time

Job OpportunityWe are seeking a high-caliber professional to lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems. The ideal candidate will have 6+ years of experience in test automation using Python, PyTest, and DeepEval, LLM evaluation using G-Eval, custom evaluators, and LLM-as-a-Judge, RAG evaluation using RAGAS and retrieval metrics, and observability and monitoring using LangFuse and LangSmith.Lead and scale test automation initiatives with a focus on GenAI and AI systems.Design and execute LLM evaluation frameworks, implementing RAG evaluation frameworks, building Python-based automation frameworks, integrating automation into CI/CD pipelines, and conducting API testing for microservices.RequirementsTest automation using Python.LLM evaluation using G-Eval.RAG evaluation using RAGAS.Observability and monitoring using LangFuse.Key ResponsibilitiesDevelop and implement efficient test automation strategies.Evaluate the performance of LLMs and provide recommendations for improvement.Collaborate with cross-functional teams to design and deploy automation frameworks.



  • Jamnagar, India beBeeAI Full time

    Artificial Intelligence Quality Assurance Test Engineer We are seeking a highly skilled and experienced Artificial Intelligence Quality Assurance Test Engineer to fill this role. The ideal candidate will be instrumental in ensuring the quality, reliability, and ethical integrity of our advanced AI solutions, particularly those leveraging Generative AI and...


  • Jamnagar, India beBeeAssurance Full time

    Quality Assurance ExpertWe are seeking a skilled quality assurance expert to join our dynamic team at a leading AI-powered recruitment platform.Conduct thorough technical quality assurance of recorded interviews, watching assigned recordings from start to finish. Identify and annotate issues such as premature termination, audio/video glitches, and other...


  • Jamnagar, India Escalan Infotech Full time

    Company Description Escalan Infotech transforms ideas, business goals, and marketing strategies into reality by creating seamless websites, apps, and e-commerce platforms. We specialize in helping businesses introduce their products and services to a global audience with ease. Our team of experts ensures the integration of cutting-edge technology to meet the...


  • Jamnagar, India Woyage AI Full time

    We are an early-stage startup using AI to revolutionize the recruitment landscape. We are transforming the recruitment process by adopting an AI-driven approach and candidate-centricity. Our AI platform empowers candidates to refine their interview skills and improve success rates with intelligent feedback from AI-powered Mock interviews. It enables...


  • Jamnagar, India Woyage AI Full time

    We are an early-stage startup using AI to revolutionize the recruitment landscape. We are transforming the recruitment process by adopting an AI-driven approach and candidate-centricity. Our AI platform empowers candidates to refine their interview skills and improve success rates with intelligent feedback from AI-powered Mock interviews. It enables...


  • Jamnagar, India beBeeSoftware Full time

    Test Assurance SpecialistThe role of a Test Assurance Specialist involves ensuring the quality of software products through meticulous testing.Main Responsibilities:Create comprehensive test plans and cases based on product specifications to ensure functionality, usability, and performance across various platforms and devices.Identify and document defects...


  • Jamnagar, India beBeeQuality Full time

    The role of a Quality Assurance Specialist involves ensuring that software meets functional requirements and is free of bugs. This position requires close collaboration with developers to resolve defects in a timely manner.This QA Specialist will be responsible for designing and developing test plans, scenarios, scripts, and procedures based on project...


  • Jamnagar, India Mindrift Full time

    This opportunity is only for candidates currently residing in the specified country Your location may affect eligibility and rates At innovation meets opportunity We believe in using the power of collective intelligence to ethically shape the future of AI What we do The Mindrift platform connects specialists with AI projects from major tech innovators Our...


  • Jamnagar, India Altisource Full time

    Job DescriptionThis is not a manual or automation testing QA profile. Please read through the job description and apply.Perform quality assurance call and/or process reviews for all departments in AltisourceConduct 'Process Refresher' and 'New Hire' trainings with the employeesProvide ongoing coaching and support to employees to strengthen understanding and...

  • Expert AI Developer

    5 days ago


    Jamnagar, India beBeeExperise Full time

    GenAI Expert Role OverviewWe are seeking a highly skilled and experienced GenAI Expert to guide our teams in building and implementing advanced systems based on Large Language Models (LLMs), chatbots, AI agents, and Retrieval-Augmented Generation (RAG) mechanisms.As a GenAI Expert, you will be responsible for designing, implementing, and optimizing GenAI...