Expert Rater – AI Model Evaluation
3 days ago
Position: Expert Rater – AI Model Evaluation & Code QualityEmail- nancy.singh@truelancer.comFill up this form- https://forms.gle/RELmAdij16e9jyFF8We're expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems.If you enjoy analyzing AI-generated content, evaluating technical accuracy, and working with cutting-edge tools — this role is calling your name. About the RoleAs an Expert Rater, you will evaluate AI model responses across programming, machine learning, and general technical reasoning. Your feedback will directly influence the accuracy, safety, and performance of AI systems used worldwide.This role is perfect for software engineers, ML/AI practitioners, tech reviewers, or anyone who loves deep technical problem-solving. What You'll DoModel Quality AssessmentEvaluate AI-generated responses involving code, ML/AI concepts, and technical workflowsIdentify errors, inefficiencies, vulnerabilities, and deviations from best practicesEnsure outputs meet strict quality guidelinesCode Annotation & LabelingAnnotate code snippets, algorithms, and documentationApply project-specific labeling frameworks accuratelyReview & FeedbackProvide structured, actionable feedback to improve AI behaviorSpot correctness issues, edge cases, and quality gapsComparative AnalysisCompare multiple AI outputs and rank them based on correctness, clarity, and efficiencyData ValidationValidate, clean, and correct datasets used in training and evaluationCollaborationWork alongside data scientists and engineersContribute to refining rating and annotation guidelines Required QualificationsTechnical BackgroundStrong foundation in software engineering, computer science, ML/AI, or related fieldsExcellent attention to detail and passion for data qualityProgramming ExpertiseMust-have:PythonPlus at least one of the following:JavaScript, Rust, Node.js, TypeScript, C, C++, ShellBonus languages:Go, Ruby, Swift, PHP, Kotlin, Rust (extra points), ShellWeb TechnologiesAPIs, web scrapingHTML/CSS/JavaScriptWeb app development (Flask, Node.js, React, etc.)ML & AI KnowledgeMachine Learning fundamentalsDeep Learning frameworks (TensorFlow, PyTorch, JAX, Keras)NLP, CV, RL conceptsUnderstanding of transformer architectures, CNNs, RNNs, LSTMsData Science & EngineeringPandas, NumPy, visualization librariesSQL/NoSQL databasesAlgorithms & MathStrong understanding of algorithms (e.g., A*, MCTS, optimization, combinatorics)Software Engineering PracticesVersion control (Git/GitHub)Clean code principlesDebugging & problem-solvingAbility to follow complex multi-step instructionsSoft SkillsExcellent written communicationAnalytical mindsetProactive, detail-oriented, and willing to challenge assumptions Preferred QualificationsExperience with LLMs or AI-driven code generationFamiliarity with multiple programming paradigmsPrior experience reviewing code (professional or academic)Background in annotation, QA, or technical evaluation
-
Expert Rater
3 days ago
India MyRemoteTeam Inc Full timePosition: Expert Rater – AI Model Evaluation & Code Quality Email- Fill up this form- We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems. If you enjoy analyzing AI-generated content, evaluating technical accuracy, and...
-
Expert Rater – AI Model Evaluation
4 days ago
India MyRemoteTeam Inc Full timePosition: Expert Rater – AI Model Evaluation & Code Quality Email- Fill up this form- We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems. If you enjoy analyzing AI-generated content, evaluating technical accuracy, and...
-
Expert Rater – AI Model Evaluation
5 days ago
India MyRemoteTeam Inc Full timePosition: Expert Rater – AI Model Evaluation & Code QualityEmail- nancy.singh@truelancer.comFill up this form- https://forms.gle/RELmAdij16e9jyFF8We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems.If you enjoy analyzing...
-
Expert Rater
3 days ago
India MyRemoteTeam Inc Full timeWe’re expanding our technical evaluation team and looking for Expert Raters to review AI-generated code, machine learning outputs, and technical reasoning. This contract role is ideal for software engineers, ML practitioners, and data professionals who enjoy code review, debugging, and working with advanced AI systems. Responsibilities: Review AI-generated...
-
Expert Rater – AI Model Evaluation
4 days ago
India MyRemoteTeam Inc Full timeWe’re expanding our technical evaluation team and looking for Expert Raters to review AI-generated code, machine learning outputs, and technical reasoning. This contract role is ideal for software engineers, ML practitioners, and data professionals who enjoy code review, debugging, and working with advanced AI systems. Responsibilities: Review AI-generated...
-
Expert Rater – AI Model Evaluation
5 days ago
India MyRemoteTeam Inc Full timeWe’re expanding our technical evaluation team and looking for Expert Raters to review AI-generated code, machine learning outputs, and technical reasoning. This contract role is ideal for software engineers, ML practitioners, and data professionals who enjoy code review, debugging, and working with advanced AI systems.Responsibilities:Review AI-generated...
-
Expert Rater
2 weeks ago
India Welocalize Full time US$ 1,04,000 - US$ 1,30,878 per yearLocation: Remote – Based in India Languages Required: Native English Job Type: Full-time (Fixed-term contract) Start Date: ASAP About the Opportunity At Welo Data, we are on a mission to shape the future of AI and digital experiences. As one of the world's leading localization and data transformation companies, we run one of the largest Ads Rating...
-
STEM Rater
1 week ago
India MyRemoteTeam Inc Full timeAbout UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Job Title: STEM Rater for GenAI Data (Math, Physics, Chemistry, Biology)Engagement: Independent...
-
Expert Rater
2 weeks ago
India Welocalize Full time ₹ 2,00,000 - ₹ 4,00,000 per yearLocation: Remote – Based in India Languages Required: Native English Job Type: Full-time (Fixed-term contract) Start Date: ASAP About the Opportunity At Welo Data, we are on a mission to shape the future of AI and digital experiences. As one of the world's leading localization and data transformation companies, we run one of the largest Ads...
-
STEM Rater
1 week ago
India MyRemoteTeam Inc Full timeAbout Us MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better. Job Title: STEM Rater for GenAI Data (Math, Physics, Chemistry, Biology) Engagement:...
