Expert Rater – AI Model Evaluation
3 days ago
Position:Expert Rater – AI Model Evaluation & Code QualityEmail- Fill up this form- expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems.If you enjoy analyzing AI-generated content, evaluating technical accuracy, and working with cutting-edge tools — this role is calling your name.About the RoleAs an Expert Rater, you will evaluate AI model responses across programming, machine learning, and general technical reasoning. Your feedback will directly influence the accuracy, safety, and performance of AI systems used worldwide.This role is perfect for software engineers, ML/AI practitioners, tech reviewers, or anyone who loves deep technical problem-solving.What You’ll DoModel Quality AssessmentEvaluate AI-generated responses involving code, ML/AI concepts, and technical workflowsIdentify errors, inefficiencies, vulnerabilities, and deviations from best practicesEnsure outputs meet strict quality guidelinesCode Annotation & LabelingAnnotate code snippets, algorithms, and documentationApply project-specific labeling frameworks accuratelyReview & FeedbackProvide structured, actionable feedback to improve AI behaviorSpot correctness issues, edge cases, and quality gapsComparative AnalysisCompare multiple AI outputs and rank them based on correctness, clarity, and efficiencyData ValidationValidate, clean, and correct datasets used in training and evaluationCollaborationWork alongside data scientists and engineersContribute to refining rating and annotation guidelines✅Required QualificationsTechnical BackgroundStrong foundation in software engineering, computer science, ML/AI, or related fieldsExcellent attention to detail and passion for data qualityProgramming ExpertiseMust-have:PythonPlus at least one of the following:JavaScript, Rust, Node.js, TypeScript, C, C++, ShellBonus languages:Go, Ruby, Swift, PHP, Kotlin, Rust (extra points), ShellWeb TechnologiesAPIs, web scrapingHTML/CSS/JavaScriptWeb app development (Flask, Node.js, React, etc.)ML & AI KnowledgeMachine Learning fundamentalsDeep Learning frameworks (TensorFlow, PyTorch, JAX, Keras)NLP, CV, RL conceptsUnderstanding of transformer architectures, CNNs, RNNs, LSTMsData Science & EngineeringPandas, NumPy, visualization librariesSQL/NoSQL databasesAlgorithms & MathStrong understanding of algorithms (e.g., A*, MCTS, optimization, combinatorics)Software Engineering PracticesVersion control (Git/GitHub)Clean code principlesDebugging & problem-solvingAbility to follow complex multi-step instructionsSoft SkillsExcellent written communicationAnalytical mindsetProactive, detail-oriented, and willing to challenge assumptions⭐Preferred QualificationsExperience with LLMs or AI-driven code generationFamiliarity with multiple programming paradigmsPrior experience reviewing code (professional or academic)Background in annotation, QA, or technical evaluation
-
Expert Rater – AI Model Evaluation
5 days ago
Delhi, India MyRemoteTeam Inc Full timeWe’re expanding our technical evaluation team and looking for Expert Raters to review AI-generated code, machine learning outputs, and technical reasoning. This contract role is ideal for software engineers, ML practitioners, and data professionals who enjoy code review, debugging, and working with advanced AI systems. Responsibilities: - Review...
-
Expert Rater – AI Model Evaluation
3 days ago
Delhi, India MyRemoteTeam Inc Full timeWe’re expanding our technical evaluation team and looking for Expert Raters to review AI-generated code, machine learning outputs, and technical reasoning. This contract role is ideal for software engineers, ML practitioners, and data professionals who enjoy code review, debugging, and working with advanced AI systems.Responsibilities:- Review AI-generated...
-
Expert Rater – AI Model Evaluation
3 days ago
New Delhi, India MyRemoteTeam Inc Full timeWe’re expanding our technical evaluation team and looking for Expert Raters to review AI-generated code, machine learning outputs, and technical reasoning. This contract role is ideal for software engineers, ML practitioners, and data professionals who enjoy code review, debugging, and working with advanced AI systems.Responsibilities:- Review AI-generated...
-
STEM Rater
1 week ago
Delhi, India MyRemoteTeam Inc Full timeAbout Us MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better. Job Title: STEM Rater for GenAI Data (Math, Physics, Chemistry, Biology) Engagement:...
-
STEM Rater
7 days ago
New Delhi, India MyRemoteTeam Inc Full timeAbout UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Job Title: STEM Rater for GenAI Data (Math, Physics, Chemistry, Biology)Engagement: Independent...
-
STEM Rater for GenAI Data
6 days ago
Delhi, India MyRemoteTeam Inc Full timeAbout UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Job Title: STEM Rater for GenAI Data (Math, Physics, Chemistry, Biology)Engagement: Independent...
-
STEM Rater for GenAI Data
7 days ago
Delhi, India MyRemoteTeam Inc Full timeAbout UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Job Title: STEM Rater for GenAI Data (Math, Physics, Chemistry, Biology)Engagement: Independent...
-
STEM Rater for GenAI Data
7 days ago
Delhi, India MyRemoteTeam Inc Full timeAbout UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Job Title: STEM Rater for GenAI Data (Math, Physics, Chemistry, Biology)Engagement: Independent...
-
STEM Rater for GenAI Data
5 days ago
Delhi, India MyRemoteTeam Inc Full timeAbout UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Job Title: STEM Rater for GenAI Data (Math, Physics, Chemistry, Biology)Engagement: Independent...
-
STEM Rater for GenAI
2 weeks ago
Delhi, India Synstack Technologies Full timeSTEM Raters for GenAI DataFreelancing & RemotePart time (25 Hours a MUST)Role OverviewAs a STEM Rater for (Maths/Physics/Chemistry/Biology/Coding/Finance), you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine...
