ai evaluation engineer

Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale — unleashing the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to enable everyone to accelerate the...

DescriptionGramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.Role OverviewWe are looking for experienced...

Job Overview We are seeking analytical and technically skilled AI/ML Evaluators to review and evaluate complex AI system behaviour using expert human judgment. In this role, you will analyse AI system outputs, system telemetry, and other relevant technical signals to evaluate patterns of behaviour. A key part of the role will involve helping distinguish...

Data Scientist Position: Data Scientist Type: Contractor Compensation: $245–$280/hour Location: Remote About the Opportunity micro1 is partnering with a leading AI lab to engage experienced Data Scientists and quantitative professionals from top companies. In this role, you will apply your expertise in statistics, machine learning, experimentation,...

Job Details - Role Type: Full- Time Contractual Role - Work Mode: Work From Home - System Requirement: Personal laptop with Windows 11 - Qualification: Bachelor’s degree - Joining Date: Immediate Role Overview We are looking for AI Data Annotation & Evaluation Specialists to support a variety of AI/LLM and multimodal AI projects. The role will be...

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: iOS Engineer (Coding Agent Experience) Type: Contract Compensation: $85/hour Location: Remote Role...

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type: Contract Compensation: $80/hour Location: Remote Role...

Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products.Audio Quality Evaluation Specialist/AI Audio Specialist/Audio Engineer – AI EvaluationProject Type: Short-Term ContractNumber of Openings: 3Rate: $20 per completed taskWork Mode: RemoteAbout the ProjectWe are looking for experienced Audio...

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type: Contract Compensation: $80/hour Location: Remote Role...

Kannada AI Product Evaluator🎯 The ProjectProductive Playhouse is building a talent pool of Kannada speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S.   This is more than one job....

Tamil AI Product EvaluatorThe ProjectProductive Playhouse is building a talent pool of Tamil speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S.   This is more than one job. Apply...

DescriptionGramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.Role OverviewWe are looking for experienced legal...

Marathi AI Product Evaluator🎯 The ProjectProductive Playhouse is building a talent pool of Marathi speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S.   This is more than one job....

Speech & Audio AI Evaluation Specialist Experience: 2+ Years Employment: 3-Month Contract (Full-Time) Work Mode: Work from Office Language: C2 / Near-Native English We are looking for experienced International Voice professionals to evaluate next-generation AI voice and conversational systems. Key Responsibilities - Evaluate AI-generated speech for...

Sales Expert (QuickBooks experience) — AI Model Evaluation Contract · Remote · $120/hr Role Overview Huzzle is seeking experienced sales professionals to test how well frontier AI systems handle real sales work. You will write realistic sales prompts that are difficult enough to make a frontier model fail, and then write a rubric for each one that...

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI/ML Evaluator - English based in India. As an AI/ML Evaluator, you will use analytical reasoning and technical expertise to evaluate complex AI system behavior.You will analyze system outputs, telemetry, event data, and...

Hindi AI Product EvaluatorThe ProjectProductive Playhouse is building a talent pool of Hindi speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S.   This is more than one job. Apply...

Company DescriptionQAD is building a world-class SaaS company, and we are growing. We are looking for talented individuals who want to join us on our mission to help solve relevant real-world problems in manufacturing and the supply chain. This hybrid position requires candidates to be based in Pune with 3-4 days of in-office collaboration per week.Job...

Malayalam AI Product EvaluatorThe ProjectProductive Playhouse is building a talent pool of Malayalam speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S.   This is more than one job....

Telugu AI Product Evaluator🎯 The ProjectProductive Playhouse is building a talent pool of Telugu speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S.   This is more than one job....