AI Evaluation Expert

1 day ago

Bengaluru, Karnataka, India beBeeSpecialist Full time ₹ 50,00,000 - ₹ 1,00,00,000
Chat and Voice Bot Specialist

We are seeking a detail-oriented and analytical individual to evaluate the performance and quality of AI-driven chat and voice assistants.

In this role, you will be responsible for systematically testing chat and voice bot outputs for coherence, relevance, tone, factual accuracy, and alignment with business objectives. Additionally, you will assess conversation flows and user journeys for edge cases, logical consistency, and usability across different platforms.

  • Evaluate AI Responses: Systematically test chat and voice bot outputs for coherence, relevance, tone, factual accuracy, and alignment with business objectives.
  • Test Workflows: Assess conversation flows and user journeys for edge cases, logical consistency, and usability across different platforms.
  • First-Principles Problem Solving: Analyze and break down complex issues using first-principles thinking; question assumptions and propose better alternatives.
  • Scenario Creation: Develop diverse test scenarios and real-world prompts to validate AI performance across varied contexts and user intents.
  • Feedback & Reporting: Document bugs, inconsistencies, and improvement opportunities; work closely with product, design, and engineering teams.
  • Ai Alignment Audits: Ensure the Ai responses align with user intent, brand tone, and ethical guidelines.

The ideal candidate brings a high level of first-principles thinking to assess bot responses, understands the fundamentals of generative AI, and is passionate about delivering seamless user experiences.

About the Role:

This is an exciting opportunity to join our team as a Chat and Voice Bot Specialist. You will have the chance to work on cutting-edge projects, collaborate with experienced professionals, and develop your skills in AI evaluation and conversational design.

  • Expert/AI Solution Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Birbal AI Full time

    We are looking for a Dify.ai Expert / AI Solutions Engineer to join our team and lead the development of Generative AI applications using Dify.ai and related technologies. This role requires a strong understanding of Large Language Models (LLMs), prompt engineering, and the ability to integrate external APIs and workflows for real-world business...

  • Expert/AI Solution Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Birbal AI Full time

    We are looking for a Dify.ai Expert / AI Solutions Engineer to join our team and lead the development of Generative AI applications using Dify.ai and related technologies. This role requires a strong understanding of Large Language Models (LLMs), prompt engineering, and the ability to integrate external APIs and workflows for real-world business...

  • Visual Content Evaluator – AI Training Data

    2 days ago

    Bengaluru, Karnataka, India beBeeGraphicDesign Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Visual Content Evaluator - AI Training DataDescription:We are seeking meticulous and creatively attuned individuals to contribute to the training and refinement of large language models. In this role, you will assess the quality of visual content data and provide expert-level feedback based on established criteria.Key Responsibilities:Evaluate and...

  • Expert/AI Solution Engineer

    2 days ago

    Bengaluru, Karnataka, India Birbal AI Full time

    Were looking for a skilled Generative AI Engineer to build agentic AI solutions using Dify.ai or similar platforms (LangChain, LlamaIndex, Haystack). Youll design and implement intelligent, autonomous AI agents and workflows that solve real business problems. Key Responsibilities Develop agentic AI workflows with Dify.ai, LangChain, or LlamaIndex Build and...

  • Expert/AI Solution Engineer

    4 hours ago

    Bengaluru, Karnataka, India Birbal AI Full time

    Were looking for a skilled Generative AI Engineer to build agentic AI solutions using Dify.ai or similar platforms (LangChain, LlamaIndex, Haystack). Youll design and implement intelligent, autonomous AI agents and workflows that solve real business problems.Key ResponsibilitiesDevelop agentic AI workflows with Dify.ai, LangChain, or LlamaIndexBuild and...

  • Skan AI

    3 weeks ago

    Bengaluru, Karnataka, India Skan ai Full time

    DescriptionAs a Senior Business Intelligence Manager at Skan, you will take full ownership of transforming raw data into actionable intelligence that drives strategic decisions and enhances customer experiences. This role sits at the intersection of cutting-edge analytics, business strategy, and customer success, where you'll transform complex datasets into...

  • AI Engineer

    4 days ago

    Bengaluru, Karnataka, India Genios AI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    As an AI Engineer, you will build cutting-edge solutions at the intersection of automation and artificial intelligence ensuring scalability, performance, and user experience standards. You will focus on creating minimum loveable products that empower financial professionals to focus on strategic decision-making rather than tedious tasks. You'll design...

  • AI Expert

    19 hours ago

    Bengaluru, Karnataka, India beBeeAIExpert Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: AI ExpertWe are seeking a highly skilled and innovative AI expert to design, develop, and deploy intelligent agents capable of reasoning, planning, learning, and interacting with real or simulated environments.Key Responsibilities:Design and develop intelligent agents using AI technologies.Deploy agents in real or simulated...

  • 3 Days Left Maths Msc Expert

    3 weeks ago

    Bengaluru, Karnataka, India Soul Ai Full time

    Job DescriptionKey Deliverables:- Develop and refine mathematical problems and solutions for AI learning- Evaluate AI-generated math content for accuracy and clarity- Debug logical flaws in AI-driven reasoning and problem-solving- Collaborate with AI teams to enhance conceptual understandingRole Responsibilities:- Apply PhD-level mathematics expertise in...

  • AI Expert

    4 days ago

    Bengaluru, Karnataka, India beBeeArtificial Full time ₹ 20,00,000 - ₹ 30,00,000

    AI ProfessionalJob Overview:Proficiency in Python programming is required.Experience with Langchain and vector databases is essential.A strong understanding of machine learning fundamentals, natural language processing (NLP), and NLP algorithms is necessary.Familiarity with Azure cloud deployments and expertise in generative AI are expected.Strong knowledge...