Expert rater – ai model evaluation

2 weeks ago

Mount Abu, India MyRemoteTeam Inc Full time

Position: Expert Rater – AI Model Evaluation & Code Quality Email- Fill up this form- Adij16e9jy FF8 We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems. If you enjoy analyzing AI-generated content, evaluating technical accuracy, and working with cutting-edge tools — this role is calling your name. ???? About the Role As an Expert Rater, you will evaluate AI model responses across programming, machine learning, and general technical reasoning. Your feedback will directly influence the accuracy, safety, and performance of AI systems used worldwide. This role is perfect for software engineers, ML/AI practitioners, tech reviewers, or anyone who loves deep technical problem-solving. ???? What You’ll Do Model Quality Assessment Evaluate AI-generated responses involving code, ML/AI concepts, and technical workflows Identify errors, inefficiencies, vulnerabilities, and deviations from best practices Ensure outputs meet strict quality guidelines Code Annotation & Labeling Annotate code snippets, algorithms, and documentation Apply project-specific labeling frameworks accurately Review & Feedback Provide structured, actionable feedback to improve AI behavior Spot correctness issues, edge cases, and quality gaps Comparative Analysis Compare multiple AI outputs and rank them based on correctness, clarity, and efficiency Data Validation Validate, clean, and correct datasets used in training and evaluation Collaboration Work alongside data scientists and engineers Contribute to refining rating and annotation guidelines ✅ Required Qualifications Technical Background Strong foundation in software engineering, computer science, ML/AI, or related fields Excellent attention to detail and passion for data quality Programming Expertise Must-have: Python Plus at least one of the following: Java Script, Rust, Node.js, Type Script, C, C++, Shell Bonus languages: Go, Ruby, Swift, PHP, Kotlin, Rust (extra points), Shell Web Technologies APIs, web scraping HTML/CSS/Java Script Web app development (Flask, Node.js, React, etc.) ML & AI Knowledge Machine Learning fundamentals Deep Learning frameworks (Tensor Flow, Py Torch, JAX, Keras) NLP, CV, RL concepts Understanding of transformer architectures, CNNs, RNNs, LSTMs Data Science & Engineering Pandas, Num Py, visualization libraries SQL/No SQL databases Algorithms & Math Strong understanding of algorithms (e.g., A*, MCTS, optimization, combinatorics) Software Engineering Practices Version control (Git/Git Hub) Clean code principles Debugging & problem-solving Ability to follow complex multi-step instructions Soft Skills Excellent written communication Analytical mindset Proactive, detail-oriented, and willing to challenge assumptions ⭐ Preferred Qualifications Experience with LLMs or AI-driven code generation Familiarity with multiple programming paradigms Prior experience reviewing code (professional or academic) Background in annotation, QA, or technical evaluation

  • Model Validation

    2 weeks ago

    Mount Abu, India Tata Consultancy Services Full time

    Role name: Quant Analytics Sr. Associate- Model Risk Year of Experience- 6 to 15 YearsLocation-Bangalore, Hyderabad, Chennai, Pune, Kolkata About The Job As a Senior Quantitative Analytics Associate, you will be responsible for leading independent validations and reviews of the bank's various risk models. This role ensures that models are functioning as...

  • Model Validation

    2 weeks ago

    Mount Abu, India Tata Consultancy Services Full time

    Role name: Quant Analytics Sr. Associate- Model Risk Year of Experience- 6 to 15 YearsLocation-Bangalore, Hyderabad, Chennai, Pune, Kolkata About The Job As a Senior Quantitative Analytics Associate, you will be responsible for leading independent validations and reviews of the bank's various risk models. This role ensures that models are functioning as...

  • AI Engineer

    3 weeks ago

    Mount Abu, India Client of Prasha Consultancy Services Private Limited Full time

    Immediate or early Joiners preferred.A US Based IT MNC is looking for a seasoned AI Engineer with hands-on experience in building and optimizing voice models, for one its Reputed client in Enterprise class voice solution domain. Candidate will be working on developing, training, and refining AI models for voice synthesis, voice cloning, speech recognition,...

  • Generative ai engineer

    4 weeks ago

    Mount Abu, India Sesheng Company Full time

    Gen AI Engineer (Semantic Search & RAG Systems) Location: Remote in India (to work in US Time zone) Sesheng Company is looking for a skilled and driven Gen AI Engineer to join our team on a contract basis. You will be instrumental in designing and deploying a cutting-edge semantic search capability to power our next generation of enterprise AI applications....

  • Dermatology Consultant – 50421

    3 weeks ago

    Mount Abu, India Turing Full time

    Role Overview:We are seeking an experienced Dermatologist to help evaluate and enhance large language model (LLM) outputs in the medical domain. You’ll assess AI-generated clinical content for dermatological accuracy, safety, and relevance — contributing to the development of responsible AI in healthcare.No AI experience required.What You'll Do...

  • AI Full Stack Developer

    3 weeks ago

    Mount Abu, India Techlerator Full time

    Ready to Techlerate?Full Stack Engineer - AI DevelopmentLocation: Remote for now! Hybrid (2 days in the office)Employment Type: Full-TimeSalary: 2.5 lakhs per yearTechlerator is a premier educational platform dedicated to transforming tech enthusiasts into world-class experts. We offer hands-on learning experiences, industry mentorship, and real-world...

  • Data Scientist

    3 weeks ago

    Mount Abu, India Scienaptic AI Full time

    Company DescriptionScienaptic AI is dedicated to expanding access to credit by transforming the technology behind credit decision-making. With over 150 years of credit expertise built into its AI-powered platform, Scienaptic helps financial institutions like banks, credit unions, fintech companies, and other lenders improve their underwriting decisions. The...

  • Subject matter Expert

    1 week ago

    Mount Abu, India Smart Source Full time

    Role Name: Manager- Subject Matter Expert Manager Reporting to: GM – L&D Work Location : Mumbai Marol Working Days : 5 Days "Only Mumbai candidates can apply " "Software Developers with Java & Python Experience" ABOUT THE ROLE Purpose of the Role: To design, develop, and deliver high-quality, industry-aligned learning content for emerging digital and...

  • Mathematics Specialist

    3 weeks ago

    Mount Abu, India Turing Full time

    Job Description:Remote contract for PhDs in Mathematics, Statistics, or related fields. Work on cutting-edge projects with top AI labs while earning $50+/hour, fully remote, with flexible weekly hours. No AI experienc required.Role Overview:Help fine-tune large language models (like ChatGPT) using your math and analytical skills. You’ll design problems,...

  • Mathematics Specialist

    3 weeks ago

    Mount Abu, India Turing Full time

    Job Description:Remote contract for PhDs in Mathematics, Statistics, or related fields. Work on cutting-edge projects with top AI labs while earning $50+/hour, fully remote, with flexible weekly hours. No AI experienc required.Role Overview:Help fine-tune large language models (like ChatGPT) using your math and analytical skills. You’ll design problems,...