AI Evaluator
5 days ago
Company Description In today’s fast-evolving educational landscape, true impact comes not just from knowledge but from the wisdom to apply it effectively and continuously improve through real-world experience. Educatio Learning helps enterprises operationalize the entire learning value chain—from data to insights, knowledge, and advanced AI solutions—unlocking wisdom through iterative experimentation and human-centered innovation. Our diverse clients include EdTech platforms, academic publishers, competitive exam providers, and corporate learning teams. By blending AI with iterative human insight, Educatio Learning empowers clients worldwide to transform data into actionable knowledge and knowledge into transformative wisdom. Key Responsibilities: 1. Review and Validate AI Responses: a) Evaluators will work via our online platform. b) All decisions of the Evaluators must be guided towards evaluating this central theme: usefulness of the AI response. This is the primary metric for measuring AI response quality: Is the AI response useful in addressing the question posed in the user prompt c) The goal is to assess the quality, safety, and utility of AI-generated content- particularly in use cases like literature summarization, clinical question answering, and decision support. Each AI-generated response should be scored across 10 key criteria. d) Evaluators must use a Likert scale (4=Great, 3=Good, 2=Fair, 1=Poor) on the first six criterion, and pass or fail on the remaining four. e) A commentary must be provided on the AI response, and flag critical issues (e.g., hallucinations, or ethical/safety concerns). f) Commentaries must be error-free, concise, and consistent with established medical guidelines, evidence-based practices, and current clinical standards. Rewriting the commentary and revisiting the evaluation may also be within scope based on feedback from quality checks. 2. Stay Current with the latest in their domain: Stay up-to-date with the latest research, guidelines, and advancements in your area of expertise, ensuring that their validation and feedback are informed by the most current and accurate information. 3. Maintain Confidentiality: Adhere to strict confidentiality of the data received for processing and comply with data protection protocols and other relevant laws and guidelines. Qualifications: 1) Master’s or PhD in a relevant field (see domains below). 2) Strong command of academic writing and critical evaluation. 3) Familiarity with research methodology and scholarly review preferred. 4) Excellent attention to detail and analytical thinking. 5) Prior experience in reviewing or teaching will be an added advantage. Domains: Accounting Operations Management Civil Engineering Mechanical Engineering Finance & Accountancy Physics Chemical Engineering Earth Science Environmental Science History Political Science Sociology Agriculture Business Management Anatomy and Physiology Dentistry Health Professions(BPT,Mpharma) Nursing Pharmacology and Toxicology Veterinary Science Biochemistry Requirements: Minimum 6 months - 1 year of experience in the respective domain. Having your own laptop/PC. Having a stable wifi network. Why Join Us: 1) Work remotely with global research and AI innovation teams. 2) Influence the evolution of AI systems in your subject domain. 3) Flexible work hours and intellectually stimulating projects. Hiring Process: 1) Profile Screening 2) Assessment Completion 3) One-to-One Interview 4) Onboarding Interested candidates can send their resume to
-
AI Evaluator
5 days ago
bangalore, India Educatio Learning Inc. Full timeCompany DescriptionIn today’s fast-evolving educational landscape, true impact comes not just from knowledge but from the wisdom to apply it effectively and continuously improve through real-world experience. Educatio Learning helps enterprises operationalize the entire learning value chain—from data to insights, knowledge, and advanced AI...
-
AI Agent Evaluation Analyst
2 days ago
bangalore, India Mindrift Full timeThis opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of...
-
AI Engineer
2 days ago
bangalore, India Weekday AI Full timeThis role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 6-8 LPA)Min Experience: 0 yearsLocation: BangaloreJobType: full-timeWe are looking for a passionate and motivated AI Engineer to join our growing team. This role is ideal for individuals who are eager to build a career in artificial intelligence and machine learning. You will work...
-
AI Evaluator
6 days ago
bangalore, India Muenot Full timeAbout the Role: We’re seeking subject-matter experts from diverse academic and research backgrounds to join our AI Evaluation Team. Your mission: Review and Assess AI-generated responses for accuracy, depth, and clarity — and flag any factual or conceptual errors with clear, concise feedback in the comment box. If you have a sharp academic eye, love...
-
AI Evaluator
5 days ago
Bangalore, India Muenot Full timeAbout the Role: We're seeking subject-matter experts from diverse academic and research backgrounds to join our AI Evaluation Team. Your mission: Review and Assess AI-generated responses for accuracy, depth, and clarity - and flag any factual or conceptual errors with clear, concise feedback in the comment box. If you have a sharp academic eye, love...
-
AI Evaluator
6 days ago
bangalore, India Muenot Full timeAbout the Role:We’re seeking subject-matter experts from diverse academic and research backgrounds to join our AI Evaluation Team. Your mission: Review and Assess AI-generated responses for accuracy, depth, and clarity — and flag any factual or conceptual errors with clear, concise feedback in the comment box.If you have a sharp academic eye, love...
-
AI Lead
2 days ago
bangalore, India Weekday AI Full timeThis role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 20-30 LPA)Min Experience: 6 yearsLocation: BengaluruJobType: full-timeWe are seeking an experienced AI Lead to architect, design, and deliver scalable Generative AI (GenAI) solutions that drive enterprise innovation. This role involves leading the development of advanced AI workflows...
-
Evaluation Specialist
7 days ago
bangalore, India LawSikho Full timeJob Description: Evaluation Associate SkillArbitrage About the Role As an Evaluations Associate, you will: Review student submissions in real-world skills: - AI Tools (ChatGPT, Canva, Wix, Jasper, Midjourney, Notion AI, etc.) - Personal Branding (LinkedIn, Twitter (X), Instagram profile optimization, content strategy, client pitching, thought leadership) -...
-
AI Engineer
2 weeks ago
bangalore, India Amogha AI Full timeAbout Amogha AIAt Amogha AI, we are building India’s first voice-led conversational AI app specifically for mental health, therapy, and emotional well-being. Our mission is to provide a supportive, empathetic listener in your pocket, 24/7. We are creating a next-generation product that understands user context, provides therapy-grade support, and...
-
AI Engineer
1 week ago
bangalore, India Amogha AI Full timeAbout Amogha AI At Amogha AI, we are building India’s first voice-led conversational AI app specifically for mental health, therapy, and emotional well-being. Our mission is to provide a supportive, empathetic listener in your pocket, 24/7. We are creating a next-generation product that understands user context, provides therapy-grade support, and...
