Current jobs related to Expert Rater – AI Model Evaluation - India - MyRemoteTeam Inc
-
Expert Rater
3 days ago
India Welocalize Full timeLocation Remote - Based in India Languages Required Native English Job Type Full-time Fixed-term contract Start Date ASAP About the Opportunity At Welo Data we are on a mission to shape the future of AI and digital experiences As one of the world s leading localization and data transformation companies we run one of the largest Ads Rating Programs in the...
-
Stem Rater
2 weeks ago
India Aceolution Full timeSTEM Raters for GenAI Data – Job DescriptionRole OverviewThis is a Freelance, Remote role.As a STEM Rater for Maths / Physics / Chemistry / Biology / Coding / Finance, you will play a key role in developing and improving AI learning systems. You will evaluate and refine high-quality STEM content to ensure AI responses are accurate, well-structured, and...
-
Transcription Evaluation Rater
5 days ago
Noida, India MAVY EduSolutions Full timeJob Description Company Description MAVY EduSolutions is a fast-growing provider of high-quality online content solutions with ISO certification and a team of over 75 experts serving clients globally. Specializing in supporting EdTech companies, schools, colleges, and publishing firms, MAVY EduSolutions offers a diverse array of services, including content...
-
Stem Rater
2 weeks ago
india, IN Aceolution India Full timeSTEM Raters for GenAI Data Role OverviewAs a STEM Rater for [Maths/Physics/Chemistry/Biology/Coding/Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine high-quality data. This involves evaluating AI...
-
Stem Rater
2 weeks ago
India Aceolution Full timeSTEM Raters for GenAI Data – Job Description Role Overview This is a Freelance, Remote role. As a STEM Rater for Maths / Physics / Chemistry / Biology / Coding / Finance, you will play a key role in developing and improving AI learning systems. You will evaluate and refine high-quality STEM content to ensure AI responses are accurate, well-structured, and...
-
Stem Rater
1 week ago
India Aceolution Full timeSTEM Raters for GenAI Data – Job Description Role Overview This is a Freelance, Remote role. As a STEM Rater for Maths / Physics / Chemistry / Biology / Coding / Finance , you will play a key role in developing and improving AI learning systems. You will evaluate and refine high-quality STEM content to ensure AI responses are accurate, well-structured, and...
-
Stem Rater
4 weeks ago
India Aceolution Full timeSTEM Raters for GenAI DataRole OverviewAs a STEM Rater for [Maths/Physics/Chemistry/Biology/Coding/Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine high-quality data. This involves evaluating AI...
-
Stem Rater
3 weeks ago
india, IN Aceolution Full timeSTEM Raters for GenAI DataRole OverviewAs a STEM Rater for [Maths/Physics/Chemistry/Biology/Coding/Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine high-quality data. This involves evaluating AI...
-
Stem Rater
3 weeks ago
India Aceolution Full timeSTEM Raters for GenAI Data Role Overview As a STEM Rater for [Maths/Physics/Chemistry/Biology/Coding/Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine high-quality data. This involves evaluating AI...
-
Stem Rater
3 weeks ago
India Aceolution Full timeSTEM Raters for GenAI Data Role Overview As a STEM Rater for (Maths/Physics/Chemistry/Biology/Coding/Finance), you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine high-quality data. This involves evaluating AI...
Expert Rater – AI Model Evaluation
1 month ago
Position: Expert Rater – AI Model Evaluation & Code QualityEmail- nancy.singh@truelancer.comFill up this form- https://forms.gle/RELmAdij16e9jyFF8We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems.If you enjoy analyzing AI-generated content, evaluating technical accuracy, and working with cutting-edge tools — this role is calling your name.🔍 About the RoleAs an Expert Rater, you will evaluate AI model responses across programming, machine learning, and general technical reasoning. Your feedback will directly influence the accuracy, safety, and performance of AI systems used worldwide.This role is perfect for software engineers, ML/AI practitioners, tech reviewers, or anyone who loves deep technical problem-solving.🧠 What You’ll DoModel Quality AssessmentEvaluate AI-generated responses involving code, ML/AI concepts, and technical workflowsIdentify errors, inefficiencies, vulnerabilities, and deviations from best practicesEnsure outputs meet strict quality guidelinesCode Annotation & LabelingAnnotate code snippets, algorithms, and documentationApply project-specific labeling frameworks accuratelyReview & FeedbackProvide structured, actionable feedback to improve AI behaviorSpot correctness issues, edge cases, and quality gapsComparative AnalysisCompare multiple AI outputs and rank them based on correctness, clarity, and efficiencyData ValidationValidate, clean, and correct datasets used in training and evaluationCollaborationWork alongside data scientists and engineersContribute to refining rating and annotation guidelines✅ Required QualificationsTechnical BackgroundStrong foundation in software engineering, computer science, ML/AI, or related fieldsExcellent attention to detail and passion for data qualityProgramming ExpertiseMust-have:PythonPlus at least one of the following:JavaScript, Rust, Node.js, TypeScript, C, C++, ShellBonus languages:Go, Ruby, Swift, PHP, Kotlin, Rust (extra points), ShellWeb TechnologiesAPIs, web scrapingHTML/CSS/JavaScriptWeb app development (Flask, Node.js, React, etc.)ML & AI KnowledgeMachine Learning fundamentalsDeep Learning frameworks (TensorFlow, PyTorch, JAX, Keras)NLP, CV, RL conceptsUnderstanding of transformer architectures, CNNs, RNNs, LSTMsData Science & EngineeringPandas, NumPy, visualization librariesSQL/NoSQL databasesAlgorithms & MathStrong understanding of algorithms (e.g., A*, MCTS, optimization, combinatorics)Software Engineering PracticesVersion control (Git/GitHub)Clean code principlesDebugging & problem-solvingAbility to follow complex multi-step instructionsSoft SkillsExcellent written communicationAnalytical mindsetProactive, detail-oriented, and willing to challenge assumptions⭐ Preferred QualificationsExperience with LLMs or AI-driven code generationFamiliarity with multiple programming paradigmsPrior experience reviewing code (professional or academic)Background in annotation, QA, or technical evaluation
