Ai evaluator

2 weeks ago

Bengaluru, India Educatio Learning Inc. Full time

Company Description In today’s fast-evolving educational landscape, true impact comes not just from knowledge but from the wisdom to apply it effectively and continuously improve through real-world experience. Educatio Learning helps enterprises operationalize the entire learning value chain—from data to insights, knowledge, and advanced AI solutions—unlocking wisdom through iterative experimentation and human-centered innovation. Our diverse clients include Ed Tech platforms, academic publishers, competitive exam providers, and corporate learning teams. By blending AI with iterative human insight, Educatio Learning empowers clients worldwide to transform data into actionable knowledge and knowledge into transformative wisdom. Key Responsibilities: 1. Review and Validate AI Responses: a) Evaluators will work via our online platform. b) All decisions of the Evaluators must be guided towards evaluating this central theme: usefulness of the AI response. This is the primary metric for measuring AI response quality: Is the AI response useful in addressing the question posed in the user prompt c) The goal is to assess the quality, safety, and utility of AI-generated content- particularly in use cases like literature summarization, clinical question answering, and decision support. Each AI-generated response should be scored across 10 key criteria. d) Evaluators must use a Likert scale (4=Great, 3=Good, 2=Fair, 1=Poor) on the first six criterion, and pass or fail on the remaining four. e) A commentary must be provided on the AI response, and flag critical issues (e.g., hallucinations, or ethical/safety concerns). f) Commentaries must be error-free, concise, and consistent with established medical guidelines, evidence-based practices, and current clinical standards. Rewriting the commentary and revisiting the evaluation may also be within scope based on feedback from quality checks. 2. Stay Current with the latest in their domain: Stay up-to-date with the latest research, guidelines, and advancements in your area of expertise, ensuring that their validation and feedback are informed by the most current and accurate information. 3. Maintain Confidentiality: Adhere to strict confidentiality of the data received for processing and comply with data protection protocols and other relevant laws and guidelines. Qualifications: 1) Master’s or Ph D in a relevant field (see domains below). 2) Strong command of academic writing and critical evaluation. 3) Familiarity with research methodology and scholarly review preferred. 4) Excellent attention to detail and analytical thinking. 5) Prior experience in reviewing or teaching will be an added advantage. Domains: Accounting Operations Management Civil Engineering Mechanical Engineering Finance & Accountancy Physics Chemical Engineering Earth Science Environmental Science History Political Science Sociology Agriculture Business Management Anatomy and Physiology Dentistry Health Professions(BPT, Mpharma) Nursing Pharmacology and Toxicology Veterinary Science Biochemistry Requirements: Minimum 6 months - 1 year of experience in the respective domain. Having your own laptop/PC. Having a stable wifi network. Why Join Us: 1) Work remotely with global research and AI innovation teams. 2) Influence the evolution of AI systems in your subject domain. 3) Flexible work hours and intellectually stimulating projects. Hiring Process: 1) Profile Screening 2) Assessment Completion 3) One-to-One Interview 4) Onboarding Interested candidates can send their resume to

  • AI Evaluation Analyst

    7 days ago

    Bengaluru, Karnataka, India Ema Full time ₹ 40,00,000 - ₹ 80,00,000 per year

    About Ema: Ema is at the forefront of artificial intelligence research and application, dedicated to creating cutting-edge AI solutions that empower users globally. Join our dynamic team to help shape the future of AI technology.Responsibilities:Create Enterprise AI Model Evaluation Test Sets: Develop and maintain comprehensive test sets tailored for...

  • AI Engineer

    6 days ago

    Bengaluru, India Weekday AI Full time

    This role is for one of the Weekday's clientsSalary range: Rs - Rs (ie INR 6-8 LPA) Min Experience: 0 years Location: Bangalore JobType: full-timeWe are looking for a passionate and motivated AI Engineer to join our growing team. This role is ideal for individuals who are eager to build a career in artificial intelligence and machine learning. You will work...

  • AI Engineer

    2 weeks ago

    Bengaluru, India Weekday AI Full time

    This role is for one of the Weekday's clients Salary range: Rs 600000 - Rs 800000 (ie INR 6-8 LPA) Min Experience: 0 years Location: Bangalore JobType: full-time We are looking for a passionate and motivated AI Engineer to join our growing team. This role is ideal for individuals who are eager to build a career in artificial intelligence and machine...

  • AI Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 60,00,000 - ₹ 80,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 6-8 LPA)Min Experience: 0 yearsLocation: BangaloreJobType: full-timeWe are looking for a passionate and motivated AI Engineer to join our growing team. This role is ideal for individuals who are eager to build a career in artificial intelligence and machine learning. You will work...

  • AI Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 6,00,000 - ₹ 8,00,000

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 6-8 LPA)Min Experience: 0 yearsLocation: BangaloreJobType: full-timeWe are looking for a passionate and motivated AI Engineer to join our growing team. This role is ideal for individuals who are eager to build a career in artificial intelligence and machine learning. You will work...

  • AI Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 6,00,000 - ₹ 8,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 6-8 LPA)Min Experience: 0 yearsLocation: BangaloreJobType: full-time We are looking for a passionate and motivated AI Engineer to join our growing team. This role is ideal for individuals who are eager to build a career in artificial intelligence and machine learning. You will work...

  • AI Research Engineer

    1 week ago

    Bengaluru, India Tether Operations Limited Full time

    Join Tether and Shape the Future of Digital Finance At Tether, we’re not just building products, we’re pioneering a global financial revolution. Our cutting-edge solutions empower businesses—from exchanges and wallets to payment processors and ATMs—to seamlessly integrate reserve-backed tokens across blockchains. By harnessing the power of blockchain...

  • AI Lead

    1 week ago

    Bengaluru, India Weekday AI Full time

    This role is for one of the Weekday's clients Salary range: Rs - Rs (ie INR 20-30 LPA)Min Experience: 6 years Location: Bengaluru JobType: full-timeWe are seeking an experienced AI Lead to architect, design, and deliver scalable Generative AI (GenAI) solutions that drive enterprise innovation. This role involves leading the development of advanced AI...

  • AI Agent Engineer

    5 days ago

    Bengaluru, India VoiceCare AI Full time

    Company Description Voicecare AI is a Healthcare Administration General Intelligence company specializing in Revenue Cycle Management (RCM) and back-office automation. Our mission is to improve access, adherence, and outcomes for patients and the healthcare workforce through generative AI technology. VoiceCare AI operates with security and compliance at its...

  • Ai agent engineer

    5 days ago

    Bengaluru, India VoiceCare AI Full time

    Company Description Voicecare AI is a Healthcare Administration General Intelligence company specializing in Revenue Cycle Management (RCM) and back-office automation. Our mission is to improve access, adherence, and outcomes for patients and the healthcare workforce through generative AI technology. Voice Care AI operates with security and compliance at its...