Expert Rater – AI Model Evaluation
4 weeks ago
Position: Expert Rater – AI Model Evaluation & Code QualityEmail- nancy.singh@truelancer.comFill up this form- https://forms.gle/RELmAdij16e9jyFF8We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, debugging tricky problems, and shaping the next generation of AI systems.If you enjoy analyzing AI-generated content, evaluating technical accuracy, and working with cutting-edge tools — this role is calling your name.🔍 About the RoleAs an Expert Rater, you will evaluate AI model responses across programming, machine learning, and general technical reasoning. Your feedback will directly influence the accuracy, safety, and performance of AI systems used worldwide.This role is perfect for software engineers, ML/AI practitioners, tech reviewers, or anyone who loves deep technical problem-solving.🧠 What You’ll DoModel Quality AssessmentEvaluate AI-generated responses involving code, ML/AI concepts, and technical workflowsIdentify errors, inefficiencies, vulnerabilities, and deviations from best practicesEnsure outputs meet strict quality guidelinesCode Annotation & LabelingAnnotate code snippets, algorithms, and documentationApply project-specific labeling frameworks accuratelyReview & FeedbackProvide structured, actionable feedback to improve AI behaviorSpot correctness issues, edge cases, and quality gapsComparative AnalysisCompare multiple AI outputs and rank them based on correctness, clarity, and efficiencyData ValidationValidate, clean, and correct datasets used in training and evaluationCollaborationWork alongside data scientists and engineersContribute to refining rating and annotation guidelines✅ Required QualificationsTechnical BackgroundStrong foundation in software engineering, computer science, ML/AI, or related fieldsExcellent attention to detail and passion for data qualityProgramming ExpertiseMust-have:PythonPlus at least one of the following:JavaScript, Rust, Node.js, TypeScript, C, C++, ShellBonus languages:Go, Ruby, Swift, PHP, Kotlin, Rust (extra points), ShellWeb TechnologiesAPIs, web scrapingHTML/CSS/JavaScriptWeb app development (Flask, Node.js, React, etc.)ML & AI KnowledgeMachine Learning fundamentalsDeep Learning frameworks (TensorFlow, PyTorch, JAX, Keras)NLP, CV, RL conceptsUnderstanding of transformer architectures, CNNs, RNNs, LSTMsData Science & EngineeringPandas, NumPy, visualization librariesSQL/NoSQL databasesAlgorithms & MathStrong understanding of algorithms (e.g., A*, MCTS, optimization, combinatorics)Software Engineering PracticesVersion control (Git/GitHub)Clean code principlesDebugging & problem-solvingAbility to follow complex multi-step instructionsSoft SkillsExcellent written communicationAnalytical mindsetProactive, detail-oriented, and willing to challenge assumptions⭐ Preferred QualificationsExperience with LLMs or AI-driven code generationFamiliarity with multiple programming paradigmsPrior experience reviewing code (professional or academic)Background in annotation, QA, or technical evaluation
-
Stem rater
4 weeks ago
Meerut, India MyRemoteTeam Inc Full timeAbout Us My Remote Team, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better. Job Title: STEM Rater for Gen AI Data (Math, Physics, Chemistry, Biology) Engagement:...
-
Language Technology Expert
2 weeks ago
meerut, India beBeeTrainer Full timeAre you passionate about language and technology? Do you enjoy analyzing complex concepts and providing actionable feedback? We're seeking a highly skilled professional to join our team as a Rater/AI Trainer.Job DescriptionAs a Rater/AI Trainer, your primary responsibility will be to evaluate AI-generated content for technical accuracy and relevance. This...
-
Energy Sector Expert
2 days ago
meerut, India beBeeUtilities Full timeSenior Support Professional – Utilities / Energy Sector (AI Model Evaluation)We seek an expert in utilities energy customer support operations to validate and optimize AI models for major utilities providers.Your expertise will ensure AI systems reflect real-world operations, focusing on billing disputes outage reporting service requests and regulatory...
-
meerut, India beBeeArtificial Full timeJob TitleAI Specialist seeks a dynamic role to develop and refine AI-assisted grant evaluation systems, enhancing the success of Clinical Education Alliance's initiatives through data-driven insights.Key Responsibilities:Grant Evaluation System Development:Design and optimize scoring rubrics for accurate and precise evaluation of grant executive...
-
AI Model Refinement Specialist
2 weeks ago
meerut, India beBeeArtificial Full timeMedical AI Training OpportunityWe are seeking medical professionals to contribute to the refinement and enhancement of cutting-edge artificial intelligence models in a fully remote setting. You will leverage your clinical expertise to augment AI's ability to perform diagnostic and analytical tasks with precision and accuracy.Main Responsibilities:Creating...
-
Expert Voice Model Developer
3 days ago
meerut, India beBeeLanguage Full timeSpeech Model SpecialistA seasoned AI expert with hands-on experience in designing and refining voice models is required.The ideal candidate will work on developing, training, and fine-tuning deep learning models for voice synthesis, speech recognition, and/or voice transformation.Key ResponsibilitiesDesign and develop neural network architectures such as...
-
meerut, India beBeephpdeveloper Full timeJob OpportunityWe are seeking a skilled PHP developer to join our team and contribute to the development of large language models (LLMs) for coding tasks. This is a remote contract role that requires expertise in creating high-quality, contextually relevant code, curating datasets, and evaluating code outputs for fine-tuning models.ResponsibilitiesCreate...
-
AI Model Developer
1 week ago
meerut, India beBeeai Full timeJob RoleWe are seeking a skilled AI Model Developer to design, develop, test, and deploy AI/ML models and applications.Develop data pipelines for preprocessing, cleaning, and transforming large datasets.Train, evaluate, and fine-tune machine learning models for production use.Integrate AI models into applications and production systems.Responsibilities...
-
AI Model Developer
4 days ago
meerut, India beBeeMachineLearning Full timeJob OpportunityAs a skilled professional, you will be part of an innovative research team working on cutting-edge AI and machine learning projects. With expertise in transformer architectures and fundamentals in model training, fine-tuning, and optimization, you will excel in this role.Main Responsibilities:Develop and fine-tune transformer-based models for...
-
Generative AI Model Developer
1 week ago
meerut, India beBeeModel Full timeGenerative AI Model DeveloperWe are seeking an experienced Generative AI Model Developer to join our team.This role requires expertise in designing, developing and implementing generative AI models and algorithms for enterprise use cases.Key Responsibilities:Design, prototype and deploy Generative AI models (LLMs, Transformers, Diffusion models) for...
