Senior AI Testing Specialist

13 hours ago

vijayawada, India beBeeAI Full time

Job DescriptionWe seek an experienced AI Testing Engineer to design, develop and execute automated test cases using Python and Pytest for AI-driven applications.This role requires high autonomy, comfort with ambiguity, and strong written communication skills in an async-first setup.Design and develop automated test cases for AI-powered systems, including LLM-driven applications.Validate LLM integrations, APIs and multi-agent workflows through functional, regression and smoke testing.Perform intent classification, semantic similarity and response consistency testing for conversational AI systems.Conduct hallucination detection and factual accuracy checks using automated methods.Implement response quality scoring using LLM-as-a-Judge evaluation patterns.Use LLM observability tools to monitor and validate model behavior.Test conversational AI applications, including chatbots and virtual assistants.Support application health checks and basic smoke testing.Integrate automated tests into CI/CD pipelines using GitHub Actions.Document test cases, evaluation criteria, defects and QA findings clearly and concisely.Collaborate with engineering teams to improve testing strategies.As a member of our team, you will have the opportunity to continuously learn and contribute to advanced AI testing methodologies.Required Skills and Qualifications• 3+ years of experience in AI testing and automation• Strong knowledge of Python and Pytest• Experience with LLMs and conversational AI systems• Excellent written and verbal communication skills• Ability to work independently and as part of a teamBenefits• Competitive salary and benefits package• Opportunities for professional growth and development• Collaborative and dynamic work environment

  • Senior Test Automation Specialist

    5 days ago

    vijayawada, India beBeeAutomation Full time

    Senior Test Automation SpecialistWe're looking for a senior test automation specialist to help us scale our quality assurance processes further.The ideal candidate will have experience with leading and mentoring QA teams, defining quality standards and best practices.Develop and implement test automation strategies for regression and performance...

  • Test Engineer Specialist

    7 days ago

    vijayawada, India beBeeQualityAssurance Full time

    Job Title: Test Engineer SpecialistWe are seeking a Test Engineer Specialist to conduct thorough quality assurance of recorded interviews and perform fraud investigations by reviewing candidate profiles flagged by our system.The ideal candidate will have exceptional comprehension skills, as well as familiarity with AI and assessing professional...

  • AI Specialist

    1 week ago

    vijayawada, India beBeeArtificialintelligence Full time

    As an AI specialist, you will be responsible for designing and developing scalable backend integrations of LLM-powered workflows.You will design, build, and iterate LLM-powered workflows (retrieval, routing, tool use, function calling, multi-step agents) to optimize efficiency.You will implement agentic apps that plan, call tools/APIs, and maintain state...

  • Senior Test Specialist

    1 week ago

    vijayawada, India beBeeSenior Full time

    As a Senior Test Lead, you will play a pivotal role in spearheading our testing initiatives.We are seeking an exceptional professional with 10+ years of experience and expertise in Eggplant and both manual and automation testing. The ideal candidate should be able to effectively translate business requirements into detailed test scenarios, collaborate...

  • Responsible AI Ethicist

    5 days ago

    vijayawada, India beBeeEthics Full time

    **AI Ethics Specialist**We are seeking a seasoned AI Ethics Specialist to drive responsible AI practices across our enterprise. This role encompasses evaluating, auditing, and ensuring the ethical development and deployment of AI models across multi-cloud environments.The ideal candidate will possess deep technical expertise in AI/ML, LLMs, and GenAI...

  • AI Transformation Specialist

    3 days ago

    vijayawada, India beBeeArtificialintelligence Full time

    AI Transformation SpecialistSocratix AI is developing intelligent fraud detection and investigation tools. The company is expanding its founding team to meet growing demand.This role offers significant opportunities for growth, with a focus on defining how AI transforms financial operations. You will drive execution in a high-ownership position, learning...

  • AI-Powered Prompt Engineer

    12 hours ago

    vijayawada, India beBeePrompting Full time

    Job Title: Prompt Optimization Specialist**About the Role:**We are seeking a highly skilled Prompt Optimization Specialist to design, develop and optimize AI prompts and workflows to enhance our FinTech tools, models and websites. The successful candidate will be responsible for creating prompt templates, integrating LLM capabilities, testing model outputs...

  • Software Quality Assurance Engineer

    3 weeks ago

    Vijayawada, India Woyage AI Full time

    We are an early-stage startup using AI to revolutionize the recruitment landscape. We are transforming the recruitment process by adopting an AI-driven approach and candidate-centricity. Our AI platform empowers candidates to refine their interview skills and improve success rates with intelligent feedback from AI-powered Mock interviews. It enables...

  • Ai Product Development Specialist

    1 week ago

    vijayawada, India beBeeDevelopment Full time

    **Job Description:**We are seeking a skilled Ai Product Development Specialist to join our team. As an Ai Product Development Specialist, you will be responsible for developing and implementing AI-driven products from conception to delivery.You will work closely with cross-functional teams to design and develop product workflows and UI/UX prototypes using AI...

  • AI Innovations Lead

    1 week ago

    vijayawada, India beBeeGenerative Full time

    Gen AI SpecialistJoin a dynamic team as a Gen AI specialist, responsible for delivering cutting-edge generative AI solutions. Key Responsibilities:Serve as the primary point of contact for clients in Gen AI needs, including senior executives, to understand their needs and deliver tailored generative AI solutions.Lead multiple generative AI projects, ensuring...