Expert rater – ai model evaluation
2 days ago
Position: Expert Rater – AI Model Evaluation & Code Quality Email- Fill up this form- Adij16e9jy FF8 We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems. If you enjoy analyzing AI-generated content, evaluating technical accuracy, and working with cutting-edge tools — this role is calling your name. ???? About the Role As an Expert Rater, you will evaluate AI model responses across programming, machine learning, and general technical reasoning. Your feedback will directly influence the accuracy, safety, and performance of AI systems used worldwide. This role is perfect for software engineers, ML/AI practitioners, tech reviewers, or anyone who loves deep technical problem-solving. ???? What You’ll Do Model Quality Assessment Evaluate AI-generated responses involving code, ML/AI concepts, and technical workflows Identify errors, inefficiencies, vulnerabilities, and deviations from best practices Ensure outputs meet strict quality guidelines Code Annotation & Labeling Annotate code snippets, algorithms, and documentation Apply project-specific labeling frameworks accurately Review & Feedback Provide structured, actionable feedback to improve AI behavior Spot correctness issues, edge cases, and quality gaps Comparative Analysis Compare multiple AI outputs and rank them based on correctness, clarity, and efficiency Data Validation Validate, clean, and correct datasets used in training and evaluation Collaboration Work alongside data scientists and engineers Contribute to refining rating and annotation guidelines ✅ Required Qualifications Technical Background Strong foundation in software engineering, computer science, ML/AI, or related fields Excellent attention to detail and passion for data quality Programming Expertise Must-have: Python Plus at least one of the following: Java Script, Rust, Node.js, Type Script, C, C++, Shell Bonus languages: Go, Ruby, Swift, PHP, Kotlin, Rust (extra points), Shell Web Technologies APIs, web scraping HTML/CSS/Java Script Web app development (Flask, Node.js, React, etc.) ML & AI Knowledge Machine Learning fundamentals Deep Learning frameworks (Tensor Flow, Py Torch, JAX, Keras) NLP, CV, RL concepts Understanding of transformer architectures, CNNs, RNNs, LSTMs Data Science & Engineering Pandas, Num Py, visualization libraries SQL/No SQL databases Algorithms & Math Strong understanding of algorithms (e.g., A*, MCTS, optimization, combinatorics) Software Engineering Practices Version control (Git/Git Hub) Clean code principles Debugging & problem-solving Ability to follow complex multi-step instructions Soft Skills Excellent written communication Analytical mindset Proactive, detail-oriented, and willing to challenge assumptions ⭐ Preferred Qualifications Experience with LLMs or AI-driven code generation Familiarity with multiple programming paradigms Prior experience reviewing code (professional or academic) Background in annotation, QA, or technical evaluation
-
STEM Rater for GenAI Data
7 days ago
Jaipur, India MyRemoteTeam Inc Full timeAbout UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Job Title: STEM Rater for GenAI Data (Math, Physics, Chemistry, Biology)Engagement: Independent...
-
Technical Writer
14 hours ago
Jaipur, India Aceolution Full timeFreelance Opportunity: Technical WriterWe’re seeking an experienced Technical Writer for an independent contract (freelance) role, focused on GenAI and Human-in-the-Loop (HITL) programs. This is a remote opportunity offering the flexibility to collaborate globally with AI researchers, engineers, and data teams.About the RoleAs a Technical Writer , you will...
-
AI Researcher
7 days ago
jaipur, India Weekday AI Full timeThis role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 8-15 LPA)Min Experience: 2 yearsLocation: Pune, Mumbai, Rajasthan, GUJRAT, AhmedabadJobType: full-timeRequirementsWhat You'll Do Explore Emerging AI Models: Continuously assess cutting-edge LLMs and multimodal systems—including next-gen interaction models like voice interfaces, agentic...
-
AI Researcher
2 weeks ago
Jaipur, Rajasthan, India Weekday AI (YC W21) Full time ₹ 80,00,000 - ₹ 1,50,00,000 per yearThis role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 8-15 LPA)Min Experience: 2 yearsLocation: Pune, Mumbai, Rajasthan, GUJRAT, AhmedabadJobType: full-timeRequirementsWhat You'll DoExplore Emerging AI Models: Continuously assess cutting-edge LLMs and multimodal systems—including next-gen interaction models like voice interfaces, agentic...
-
AI Architect
4 days ago
Jaipur, Rajasthan, India Atrium AI Full time ₹ 12,00,000 - ₹ 36,00,000 per yearTake your career to the next level with the only consulting firm born in AI and delivering with AI.At Atrium, we�re not simply adapting to an AI-driven world � we�ve helped define it since we were founded. Our clients partner with us because we turn potential into measurable impact, reshaping industries, realizing exponential value, and empowering...
-
Jaipur, Rajasthan, India Uplatz AI Full time ₹ 3,00,000 - ₹ 6,00,000 per yearHiring: Python / AI / ML Developer (1–3 Years Experience) Location:Jaipur, Rajasthan (On-site, Full-time)Company:Pazit Infotech Pvt. Ltd.Address:Third Floor, ABS Plaza, Near Khatu Shyam Ji Circle, Jagatpura, JaipurSalary Range:₹15,000 – ₹50,000 per month (Based on skills & experience)About the RolePazit Infotech Pvt. Ltd. is looking for a passionate...
-
Research Intern
1 day ago
Jaipur, India Shodh AI Full timeThe OpportunityWe are seeking a highly driven Research Intern (Machine Learning – Materials Science) to join our scientific computing team. This role is ideal for someone who wants to work at the intersection of machine learning, deep learning, and computational materials research.You will work directly with our research engineers and scientists to design,...
-
Research Intern
1 day ago
Jaipur, India Shodh AI Full timeThe OpportunityWe are seeking a highly driven Research Intern (Machine Learning – Materials Science) to join our scientific computing team. This role is ideal for someone who wants to work at the intersection of machine learning, deep learning, and computational materials research.You will work directly with our research engineers and scientists to design,...
-
Research Intern
1 day ago
Jaipur, India Shodh AI Full timeThe OpportunityWe are seeking a highly driven Research Intern (Machine Learning – Materials Science) to join our scientific computing team. This role is ideal for someone who wants to work at the intersection of machine learning, deep learning, and computational materials research.You will work directly with our research engineers and scientists to design,...
-
Research Intern
24 hours ago
Jaipur, India Shodh AI Full timeThe Opportunity We are seeking a highly driven Research Intern (Machine Learning – Materials Science) to join our scientific computing team. This role is ideal for someone who wants to work at the intersection of machine learning, deep learning, and computational materials research. You will work directly with our research engineers and scientists to...
