Expert Rater – AI Model Evaluation
4 days ago
Position: Expert Rater – AI Model Evaluation & Code QualityEmail- nancy.singh@truelancer.comFill up this form- https://forms.gle/RELmAdij16e9jyFF8We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems.If you enjoy analyzing AI-generated content, evaluating technical accuracy, and working with cutting-edge tools — this role is calling your name.🔍 About the RoleAs an Expert Rater, you will evaluate AI model responses across programming, machine learning, and general technical reasoning. Your feedback will directly influence the accuracy, safety, and performance of AI systems used worldwide.This role is perfect for software engineers, ML/AI practitioners, tech reviewers, or anyone who loves deep technical problem-solving.🧠 What You’ll DoModel Quality AssessmentEvaluate AI-generated responses involving code, ML/AI concepts, and technical workflowsIdentify errors, inefficiencies, vulnerabilities, and deviations from best practicesEnsure outputs meet strict quality guidelinesCode Annotation & LabelingAnnotate code snippets, algorithms, and documentationApply project-specific labeling frameworks accuratelyReview & FeedbackProvide structured, actionable feedback to improve AI behaviorSpot correctness issues, edge cases, and quality gapsComparative AnalysisCompare multiple AI outputs and rank them based on correctness, clarity, and efficiencyData ValidationValidate, clean, and correct datasets used in training and evaluationCollaborationWork alongside data scientists and engineersContribute to refining rating and annotation guidelines✅ Required QualificationsTechnical BackgroundStrong foundation in software engineering, computer science, ML/AI, or related fieldsExcellent attention to detail and passion for data qualityProgramming ExpertiseMust-have:PythonPlus at least one of the following:JavaScript, Rust, Node.js, TypeScript, C, C++, ShellBonus languages:Go, Ruby, Swift, PHP, Kotlin, Rust (extra points), ShellWeb TechnologiesAPIs, web scrapingHTML/CSS/JavaScriptWeb app development (Flask, Node.js, React, etc.)ML & AI KnowledgeMachine Learning fundamentalsDeep Learning frameworks (TensorFlow, PyTorch, JAX, Keras)NLP, CV, RL conceptsUnderstanding of transformer architectures, CNNs, RNNs, LSTMsData Science & EngineeringPandas, NumPy, visualization librariesSQL/NoSQL databasesAlgorithms & MathStrong understanding of algorithms (e.g., A*, MCTS, optimization, combinatorics)Software Engineering PracticesVersion control (Git/GitHub)Clean code principlesDebugging & problem-solvingAbility to follow complex multi-step instructionsSoft SkillsExcellent written communicationAnalytical mindsetProactive, detail-oriented, and willing to challenge assumptions⭐ Preferred QualificationsExperience with LLMs or AI-driven code generationFamiliarity with multiple programming paradigmsPrior experience reviewing code (professional or academic)Background in annotation, QA, or technical evaluation
-
Expert Rater
5 days ago
bangalore, India MyRemoteTeam Inc Full timeWe’re expanding our technical evaluation team and looking for Expert Raters to review AI-generated code, machine learning outputs, and technical reasoning. This contract role is ideal for software engineers, ML practitioners, and data professionals who enjoy code review, debugging, and working with advanced AI systems. Responsibilities: Review AI-generated...
-
STEM Rater
6 days ago
bangalore, India MyRemoteTeam Inc Full timeAbout Us MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better. Job Title: STEM Rater for GenAI Data (Math, Physics, Chemistry, Biology) Engagement:...
-
STEM Rater for GenAI Data
1 week ago
bangalore, India MyRemoteTeam Inc Full timeAbout UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Job Title: STEM Rater for GenAI Data (Math, Physics, Chemistry, Biology)Engagement: Independent...
-
STEM Rater
2 weeks ago
bangalore, India MyRemoteTeam Inc Full timeAbout UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Role Overview:As a STEM Rater for Math, Physics, Chemistry, and Biology, you will play a...
-
Professors - STEM + Non-STEM(IIT)
17 hours ago
bangalore, India 2coms Full timeJob Title: STEM Rater – GenAI Data Overview: We are seeking subject experts in Maths, Physics, Chemistry, Biology, Coding, or Finance to evaluate and refine AI -generated educational content. As a STEM Rater, you will ensure the accuracy, clarity, and pedagogical quality of AI responses, helping improve how millions learn through technology.Key...
-
Professors - STEM + Non -STEM(IIT)
2 weeks ago
Bangalore North, Karnataka, , India 2coms Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Title: STEM Rater – GenAI Data Overview: We are seeking subject experts in Maths, Physics, Chemistry, Biology, Coding, or Finance to evaluate and refine AI -generated educational content. As a STEM Rater, you will ensure the accuracy, clarity, and pedagogical quality of AI responses, helping improve how millions learn through technology.Key...
-
Language Specialist
2 weeks ago
bangalore, India Innodata Inc. Full timeInnodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine. By...
-
AI Evaluator
2 weeks ago
bangalore, India Muenot Full timeAbout the Role:We’re seeking subject-matter experts from diverse academic and research backgrounds to join our AI Evaluation Team. Your mission: Review and Assess AI-generated responses for accuracy, depth, and clarity — and flag any factual or conceptual errors with clear, concise feedback in the comment box.If you have a sharp academic eye, love...
-
AI Evaluator
2 weeks ago
bangalore, India Muenot Full timeAbout the Role: We’re seeking subject-matter experts from diverse academic and research backgrounds to join our AI Evaluation Team. Your mission: Review and Assess AI-generated responses for accuracy, depth, and clarity — and flag any factual or conceptual errors with clear, concise feedback in the comment box. If you have a sharp academic eye, love...
-
AI Evaluator
2 weeks ago
Bangalore, India Muenot Full timeAbout the Role: We're seeking subject-matter experts from diverse academic and research backgrounds to join our AI Evaluation Team. Your mission: Review and Assess AI-generated responses for accuracy, depth, and clarity - and flag any factual or conceptual errors with clear, concise feedback in the comment box. If you have a sharp academic eye, love...
