Expert Rater – AI Model Evaluation

3 days ago


Malappuram, India MyRemoteTeam Inc Full time

Position: Expert Rater – AI Model Evaluation & Code Quality Email- nancy.singh@truelancer.com Fill up this form- https://forms.gle/RELmAdij16e9jyFF8 We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems. If you enjoy analyzing AI-generated content, evaluating technical accuracy, and working with cutting-edge tools — this role is calling your name. 🔍 About the Role As an Expert Rater, you will evaluate AI model responses across programming, machine learning, and general technical reasoning. Your feedback will directly influence the accuracy, safety, and performance of AI systems used worldwide. This role is perfect for software engineers, ML/AI practitioners, tech reviewers, or anyone who loves deep technical problem-solving. 🧠 What You’ll Do Model Quality Assessment - Evaluate AI-generated responses involving code, ML/AI concepts, and technical workflows - Identify errors, inefficiencies, vulnerabilities, and deviations from best practices - Ensure outputs meet strict quality guidelines Code Annotation & Labeling - Annotate code snippets, algorithms, and documentation - Apply project-specific labeling frameworks accurately Review & Feedback - Provide structured, actionable feedback to improve AI behavior - Spot correctness issues, edge cases, and quality gaps Comparative Analysis - Compare multiple AI outputs and rank them based on correctness, clarity, and efficiency Data Validation - Validate, clean, and correct datasets used in training and evaluation Collaboration - Work alongside data scientists and engineers - Contribute to refining rating and annotation guidelines ✅ Required Qualifications Technical Background - Strong foundation in software engineering, computer science, ML/AI, or related fields - Excellent attention to detail and passion for data quality Programming Expertise Must-have: - Python Plus at least one of the following: - JavaScript, Rust, Node.js, TypeScript, C, C++, Shell Bonus languages: - Go, Ruby, Swift, PHP, Kotlin, Rust (extra points), Shell Web Technologies - APIs, web scraping - HTML/CSS/JavaScript - Web app development (Flask, Node.js, React, etc.) ML & AI Knowledge - Machine Learning fundamentals - Deep Learning frameworks (TensorFlow, PyTorch, JAX, Keras) - NLP, CV, RL concepts - Understanding of transformer architectures, CNNs, RNNs, LSTMs Data Science & Engineering - Pandas, NumPy, visualization libraries - SQL/NoSQL databases Algorithms & Math - Strong understanding of algorithms (e.g., A*, MCTS, optimization, combinatorics) Software Engineering Practices - Version control (Git/GitHub) - Clean code principles - Debugging & problem-solving - Ability to follow complex multi-step instructions Soft Skills - Excellent written communication - Analytical mindset - Proactive, detail-oriented, and willing to challenge assumptions ⭐ Preferred Qualifications - Experience with LLMs or AI-driven code generation - Familiarity with multiple programming paradigms - Prior experience reviewing code (professional or academic) - Background in annotation, QA, or technical evaluation


  • Stem Specialist

    12 hours ago


    Malappuram, India Whatjobs IN C2 Full time

    Role Overview As a STEM Rater for (Maths/Physics/Chemistry/Biology/Coding/Finance), you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine high-quality data. This involves evaluating AI responses for accuracy, clarity,...

  • Ai trainers

    5 hours ago


    Malappuram, Kerala, India QNAYDS LLP Full time ₹ 4,80,000 per year

    We are looking for an experienced AI Trainer with at least 3 years of teaching experience to train and improve AI systems. The ideal candidate will combine educational expertise with a strong understanding of AI and data annotation to help develop intelligent learning models. Key Responsibilities: Train AI systems by providing high-quality labeled data and...

  • Gen AI Intern

    1 week ago


    Malappuram, Kerala, India Nizzcorp Full time

    We are looking for a highly motivated and curious Generative AI Intern to join our team. This internship is an exciting opportunity to work on cutting-edge AI technologies including language models (like ChatGPT), image generation tools, and more. You will assist in building, testing, and evaluating AI-powered applications and contribute to real-world AI...

  • Ai engineer

    1 week ago


    Malappuram, India SwarmLens Full time

    AI Engineer/Senior AI Engineer We are redefining the future of autonomous intelligence and we’re looking for an exceptional Agentic AI Engineer to help us build it. Role Overview As an Agentic AI Engineer on our core team, you will architect, build, and ship sophisticated autonomous multi-agent systems that push beyond traditional LLM workflows. Your work...

  • Gen Ai Intern

    4 days ago


    Malappuram, India Nizzcorp Full time

    **Key Responsibilities**: - Assist in the development and fine-tuning of generative AI models (text, image, audio, etc.). - Support the team in creating prompts, evaluating outputs, and refining model responses. - Perform data cleaning, annotation, and preparation for model training. - Conduct literature research on the latest AI/ML techniques and tools. -...

  • Ai developer

    2 weeks ago


    Malappuram, India Omnibound AI Full time

    Please Note : ➡️ Only candidates who are immediate joiners (0–7 days) will be considered ➡️ This also includes for those who are already serving notice period , as long as they are available to join within 10-15 days. ➡️ If you do not have hands-on experience with building AI software, please do not apply About us: Omnibound ( is building the...

  • Ai Engineer

    12 hours ago


    Malappuram, India Whatjobs IN C2 Full time

    AI Engineer (2 - 4 Years Experience) Company Description: Idea Elan LLC is a product based company that provides comprehensive software solutions for research facilities in Universities and Institutions worldwide. Please visit for more information. Job Description: We are seeking a skilled AI Engineer with 2-4 years of experience to design, develop, and...

  • Ai Trainers

    3 weeks ago


    Malappuram, KL, IN QNAYDS LLP Full time

    We are looking for an experienced AI Trainer with at least 3 years of teaching experience to train and improve AI systems The ideal candidate will combine educational expertise with a strong understanding of AI and data annotation to help develop intelligent learning models Key Responsibilities Train AI systems by providing high-quality labeled data and...


  • Malappuram, India People Prime Worldwide Full time

    About Client :Our client is one of the world's fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. They helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier...


  • Malappuram, India People Prime Worldwide Full time

    About Client :Our client is one of the world's fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. They helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier...