Expert Rater – AI Model Evaluation

2 days ago

Meerut, India MyRemoteTeam Inc Full time

Position: Expert Rater – AI Model Evaluation & Code QualityEmail- nancy.singh@truelancer.comFill up this form- https://forms.gle/RELmAdij16e9jyFF8We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems.If you enjoy analyzing AI-generated content, evaluating technical accuracy, and working with cutting-edge tools — this role is calling your name.🔍 About the RoleAs an Expert Rater, you will evaluate AI model responses across programming, machine learning, and general technical reasoning. Your feedback will directly influence the accuracy, safety, and performance of AI systems used worldwide.This role is perfect for software engineers, ML/AI practitioners, tech reviewers, or anyone who loves deep technical problem-solving.🧠 What You’ll DoModel Quality AssessmentEvaluate AI-generated responses involving code, ML/AI concepts, and technical workflowsIdentify errors, inefficiencies, vulnerabilities, and deviations from best practicesEnsure outputs meet strict quality guidelinesCode Annotation & LabelingAnnotate code snippets, algorithms, and documentationApply project-specific labeling frameworks accuratelyReview & FeedbackProvide structured, actionable feedback to improve AI behaviorSpot correctness issues, edge cases, and quality gapsComparative AnalysisCompare multiple AI outputs and rank them based on correctness, clarity, and efficiencyData ValidationValidate, clean, and correct datasets used in training and evaluationCollaborationWork alongside data scientists and engineersContribute to refining rating and annotation guidelines✅ Required QualificationsTechnical BackgroundStrong foundation in software engineering, computer science, ML/AI, or related fieldsExcellent attention to detail and passion for data qualityProgramming ExpertiseMust-have:PythonPlus at least one of the following:JavaScript, Rust, Node.js, TypeScript, C, C++, ShellBonus languages:Go, Ruby, Swift, PHP, Kotlin, Rust (extra points), ShellWeb TechnologiesAPIs, web scrapingHTML/CSS/JavaScriptWeb app development (Flask, Node.js, React, etc.)ML & AI KnowledgeMachine Learning fundamentalsDeep Learning frameworks (TensorFlow, PyTorch, JAX, Keras)NLP, CV, RL conceptsUnderstanding of transformer architectures, CNNs, RNNs, LSTMsData Science & EngineeringPandas, NumPy, visualization librariesSQL/NoSQL databasesAlgorithms & MathStrong understanding of algorithms (e.g., A*, MCTS, optimization, combinatorics)Software Engineering PracticesVersion control (Git/GitHub)Clean code principlesDebugging & problem-solvingAbility to follow complex multi-step instructionsSoft SkillsExcellent written communicationAnalytical mindsetProactive, detail-oriented, and willing to challenge assumptions⭐ Preferred QualificationsExperience with LLMs or AI-driven code generationFamiliarity with multiple programming paradigmsPrior experience reviewing code (professional or academic)Background in annotation, QA, or technical evaluation

  • Stem rater

    3 days ago

    Meerut, India MyRemoteTeam Inc Full time

    About Us My Remote Team, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better. Job Title: STEM Rater for Gen AI Data (Math, Physics, Chemistry, Biology) Engagement:...

  • Business Strategy Executive

    2 weeks ago

    Meerut Division, India NetZeroX AI Full time

    NetZeroX AI is an international consulting and practitioner-led training platform at the intersection of Energy Transition and Artificial Intelligence . We design and deliver industry-focused training and corporate learning programs , connecting universities, companies, and professionals to prepare them for the net-zero and AI-driven future . Our flagship...

  • Urdu Language Expert

    2 weeks ago

    Meerut, India iMerit Technology Full time

    ob Description – Urdu Language Expert Job Title:Urdu Language Expert Location:Remote Job Type:Full-time / Contract About the Role We are seeking a highly skilledUrdu Language Expertto support the development of AI models by ensuring linguistic accuracy, cultural relevance, and creative adaptability in Urdu . In this role, you will craft high-quality...

  • AI/ML Architect

    6 days ago

    Meerut, India Transnational AI Private Limited Full time

    About the CompanyTransnational AI Private Limited is a deep-tech organization building intelligent digital platforms that combine modern event-driven architecture, cloud-native systems, and AI/ML-powered intelligence.Job RoleWe are hiring a senior Technical Architect to design and lead the backend development and system design for real-time, event-driven...

  • Artificial Intelligence Engineer

    4 weeks ago

    Meerut, India Debales AI Full time

    About Debales AI Debales AI builds autonomous AI Agents that seamlessly integrate into existing systems — no new dashboards, no added workflow overhead. With 100+ integrations and 80+ specialized AI Agents, we streamline high-volume operations across Logistics, E-Commerce, and Education, helping teams scale efficiency without scaling headcount.Role...

  • Generative Ai Engineer

    4 weeks ago

    Meerut, India Whatjobs IN C2 Full time

    Job Title: Generative AI Engineer (LLM Expert) Location: Remote Employment Type: Ongoing Contract About BigRio BigRio is a Boston-based, remote-first technology consulting firm specializing in advanced data and software solutions. We partner with forward-thinking organizations to deliver scalable, cost-effective, and innovative technology, with particular...

  • Language Annotation Expert

    3 weeks ago

    Meerut, India Rime Full time

    Language Annotation Expert - HindiAbout Us Rime AI is building next-generation voice technology to make human–computer interactions more natural, accurate, and expressive. Our platform powers high-quality speech experiences across industries, and we’re looking for passionate language experts to help us improve the way our AI understands and speaks the...

  • Mathematics Expert

    1 week ago

    Meerut Division, India Turing Full time

    Job Description: Remote contract for PhDs in Mathematics, Statistics, or related fields. Work on cutting-edge projects with top AI labs while earning $50+/hour , fully remote, with flexible weekly hours . No AI experienc required Role Overview: Help fine-tune large language models (like ChatGPT) using your math and analytical skills. You’ll design...

  • Agentic AI Engineer

    4 days ago

    Meerut, India BeGig Full time

    Position: Agentic AI Engineer – Real Estate & ConstructionJob Type: Full-timeLocation: Remote (Quarterly Meet-ups)About the Role:We are seeking a talented engineer to drive the design, deployment, and continuous improvement of agentic AI applications in real estate and construction. You will own the full lifecycle of agent frameworks, including toolchain...

  • AI/ML Engineer

    5 days ago

    Meerut Division, India XTEN-AV Full time

    About XTEN-AV XTEN-AV is the worlds first and only AI powered professional AV design platform which automates multiple types of drawings and documents which lets AV designers, integrators and manufacturers replace legacy methods of design & documentation and increase their efficiency and productivity by 10X Role Overview As an AI Engineer at XTEN-AV, you...