Expert Rater – AI Model Evaluation
3 days ago
Position: Expert Rater – AI Model Evaluation & Code Quality Email- nancy.singh@truelancer.com Fill up this form- https://forms.gle/RELmAdij16e9jyFF8 We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems. If you enjoy analyzing AI-generated content, evaluating technical accuracy, and working with cutting-edge tools — this role is calling your name. 🔍 About the Role As an Expert Rater, you will evaluate AI model responses across programming, machine learning, and general technical reasoning. Your feedback will directly influence the accuracy, safety, and performance of AI systems used worldwide. This role is perfect for software engineers, ML/AI practitioners, tech reviewers, or anyone who loves deep technical problem-solving. 🧠 What You’ll Do Model Quality Assessment - Evaluate AI-generated responses involving code, ML/AI concepts, and technical workflows - Identify errors, inefficiencies, vulnerabilities, and deviations from best practices - Ensure outputs meet strict quality guidelines Code Annotation & Labeling - Annotate code snippets, algorithms, and documentation - Apply project-specific labeling frameworks accurately Review & Feedback - Provide structured, actionable feedback to improve AI behavior - Spot correctness issues, edge cases, and quality gaps Comparative Analysis - Compare multiple AI outputs and rank them based on correctness, clarity, and efficiency Data Validation - Validate, clean, and correct datasets used in training and evaluation Collaboration - Work alongside data scientists and engineers - Contribute to refining rating and annotation guidelines ✅ Required Qualifications Technical Background - Strong foundation in software engineering, computer science, ML/AI, or related fields - Excellent attention to detail and passion for data quality Programming Expertise Must-have: - Python Plus at least one of the following: - JavaScript, Rust, Node.js, TypeScript, C, C++, Shell Bonus languages: - Go, Ruby, Swift, PHP, Kotlin, Rust (extra points), Shell Web Technologies - APIs, web scraping - HTML/CSS/JavaScript - Web app development (Flask, Node.js, React, etc.) ML & AI Knowledge - Machine Learning fundamentals - Deep Learning frameworks (TensorFlow, PyTorch, JAX, Keras) - NLP, CV, RL concepts - Understanding of transformer architectures, CNNs, RNNs, LSTMs Data Science & Engineering - Pandas, NumPy, visualization libraries - SQL/NoSQL databases Algorithms & Math - Strong understanding of algorithms (e.g., A*, MCTS, optimization, combinatorics) Software Engineering Practices - Version control (Git/GitHub) - Clean code principles - Debugging & problem-solving - Ability to follow complex multi-step instructions Soft Skills - Excellent written communication - Analytical mindset - Proactive, detail-oriented, and willing to challenge assumptions ⭐ Preferred Qualifications - Experience with LLMs or AI-driven code generation - Familiarity with multiple programming paradigms - Prior experience reviewing code (professional or academic) - Background in annotation, QA, or technical evaluation
-
Stem Specialist
12 hours ago
Malappuram, India Whatjobs IN C2 Full timeRole Overview As a STEM Rater for (Maths/Physics/Chemistry/Biology/Coding/Finance), you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine high-quality data. This involves evaluating AI responses for accuracy, clarity,...
-
Ai trainers
5 hours ago
Malappuram, Kerala, India QNAYDS LLP Full time ₹ 4,80,000 per yearWe are looking for an experienced AI Trainer with at least 3 years of teaching experience to train and improve AI systems. The ideal candidate will combine educational expertise with a strong understanding of AI and data annotation to help develop intelligent learning models. Key Responsibilities: Train AI systems by providing high-quality labeled data and...
-
Gen AI Intern
1 week ago
Malappuram, Kerala, India Nizzcorp Full timeWe are looking for a highly motivated and curious Generative AI Intern to join our team. This internship is an exciting opportunity to work on cutting-edge AI technologies including language models (like ChatGPT), image generation tools, and more. You will assist in building, testing, and evaluating AI-powered applications and contribute to real-world AI...
-
Ai engineer
1 week ago
Malappuram, India SwarmLens Full timeAI Engineer/Senior AI Engineer We are redefining the future of autonomous intelligence and we’re looking for an exceptional Agentic AI Engineer to help us build it. Role Overview As an Agentic AI Engineer on our core team, you will architect, build, and ship sophisticated autonomous multi-agent systems that push beyond traditional LLM workflows. Your work...
-
Gen Ai Intern
4 days ago
Malappuram, India Nizzcorp Full time**Key Responsibilities**: - Assist in the development and fine-tuning of generative AI models (text, image, audio, etc.). - Support the team in creating prompts, evaluating outputs, and refining model responses. - Perform data cleaning, annotation, and preparation for model training. - Conduct literature research on the latest AI/ML techniques and tools. -...
-
Ai developer
2 weeks ago
Malappuram, India Omnibound AI Full timePlease Note : ➡️ Only candidates who are immediate joiners (0–7 days) will be considered ➡️ This also includes for those who are already serving notice period , as long as they are available to join within 10-15 days. ➡️ If you do not have hands-on experience with building AI software, please do not apply About us: Omnibound ( is building the...
-
Ai Engineer
12 hours ago
Malappuram, India Whatjobs IN C2 Full timeAI Engineer (2 - 4 Years Experience) Company Description: Idea Elan LLC is a product based company that provides comprehensive software solutions for research facilities in Universities and Institutions worldwide. Please visit for more information. Job Description: We are seeking a skilled AI Engineer with 2-4 years of experience to design, develop, and...
-
Ai Trainers
3 weeks ago
Malappuram, KL, IN QNAYDS LLP Full timeWe are looking for an experienced AI Trainer with at least 3 years of teaching experience to train and improve AI systems The ideal candidate will combine educational expertise with a strong understanding of AI and data annotation to help develop intelligent learning models Key Responsibilities Train AI systems by providing high-quality labeled data and...
-
Machine Learning Specialist
4 weeks ago
Malappuram, India People Prime Worldwide Full timeAbout Client :Our client is one of the world's fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. They helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier...
-
Machine Learning Specialist
4 weeks ago
Malappuram, India People Prime Worldwide Full timeAbout Client :Our client is one of the world's fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. They helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier...