AI Model Benchmarking Specialist

2 weeks ago


Delhi, Delhi, India Mercor Full time

At Mercor, we're seeking a skilled AI Model Benchmarking Specialist to join our team in a research project with leading AI labs.

The role is fully remote and asynchronous, allowing you to work according to your own schedule. You'll have the flexibility to work part-time (~10-20 hours per week) while maintaining a high level of Quality Control.

Your primary responsibility will be Maintaining Service Level Agreement (SLA) standards required by our customer contracts. Additionally, you'll play a crucial role in Error and Hallucination Detection, identifying inaccuracies or hallucinations in LLM responses based on reference documents.

If you have extensive experience, you may be assigned as the QA lead for candidates already working on the project.

We offer an hourly rate of $30 USD/hr, commensurate with your years of experience. As an independent contractor, you'll work closely with our team based in San Francisco, CA.

Our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. We specialize in recruiting experts for top AI labs and are excited about the opportunity to bring your skills to this exciting project.



  • Delhi, Delhi, India Quickads Full time

    About the RoleThis is an exciting opportunity to join Quickads as a skilled AI Model Optimization Specialist.Responsibilities:Develop and optimize AI pipelines for generating high-quality images using Stable Diffusion.Build and fine-tune Language-Oriented Representations of Attention (LORAs) to enhance model performance for specific use cases.Design and...


  • Delhi, Delhi, India Mercor Full time

    About MercorMercor is a San Francisco-based company that specializes in recruiting experts for top AI labs.Our InvestorsWe are backed by prominent investors, including Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.Job DescriptionWe are seeking a skilled Data Scientist to assist us in a research project with leading...

  • AI Model Developer

    6 days ago


    Delhi, Delhi, India PVAR SERVICES Full time

    PVAR SERVICES is seeking an experienced AI Model Developer to join our team. This role involves developing, optimizing, and deploying Generative AI models using cutting-edge frameworks such as GPT, BERT, T5, and Anthropic.The ideal candidate will have a strong background in AI engineering, focusing on Large Language Models (LLMs) and Generative AI. They...


  • Delhi, Delhi, India Pixis Full time

    Pixis: Empowering Performance Marketing with AIWe are seeking an experienced AI Optimization Specialist to join our team at Pixis, a US-based codeless technology company that develops accessible AI to empower brands to scale their performance marketing efforts and augment their decision-making seamlessly. With a total funding of $209M across Series A, B, C,...


  • Delhi, Delhi, India Mercor Full time

    Job OverviewWe are seeking highly skilled professionals to collaborate with leading AI labs on a research project focused on benchmarking and enhancing current AI models.Key Responsibilities:Maintain Service Level Agreement (SLA) standards required by customer contracts.Identify inaccuracies or hallucinations in Large Language Model (LLM) responses based on...


  • Delhi, Delhi, India RightHome AI Full time

    Unlock Your Potential in AI-Driven DevelopmentWe are seeking an ambitious Ai and Chatbot Integration Specialist to join our dynamic team at RightHome AI, a pioneering PropTech startup that harnesses the power of Artificial Intelligence to revolutionize the property search experience.About the Role:You will be responsible for designing and integrating...


  • Delhi, Delhi, India InvokHR Solutions Full time

    About InvokHR SolutionsWe are a leading AI-driven organization that provides scalable data annotation and labeling solutions for machine learning applications.Job OpportunityWe are looking for an AI freelance data specialist to join our team and contribute to the development of high-quality AI models. The role involves collecting, curating, and annotating AI...


  • Delhi, Delhi, India ABC Worldwide (AKA BRIP Careers Worldwide) Full time

    About ABC Worldwide (AKA BRIP Careers Worldwide)We are a leading provider of Business Process Outsourcing (BPO) services with a commitment to creating a dynamic and inclusive workplace.Job Title: Compensation SpecialistLocation: IndiaJob Description:We seek a skilled Compensation Specialist to join our HR team, responsible for designing, implementing, and...

  • AI Model Architect

    2 weeks ago


    Delhi, Delhi, India Batish technologies Pvt Ltd Full time

    Join Batish technologies Pvt Ltd as an AI Model Architect and drive innovation in the field of generative AI. We are seeking a skilled professional to design, develop, and deploy advanced AI models that solve complex business problems.About the RoleThis is a unique opportunity to work on cutting-edge projects and collaborate with cross-functional teams to...


  • Delhi, Delhi, India Steps AI Full time

    We are seeking a driven Business Development & Sales Specialist to expand our presence in North America and Europe. This role involves sourcing projects, securing clients, and managing partnerships using tools like LinkedIn Sales Navigator, ZoomInfo, Apollo.io, and CRM systems.About the RoleSourcing and engaging potential clients on platforms like Linkedin,...


  • Delhi, Delhi, India Caimera AI Full time

    About Caimera AICaimera AI is a revolutionary company that's changing the game with its cutting-edge gen AI technology. Our next-generation cameras, Caimera, create hyper-realistic AI images that are redefining the world of digital advertising.With our innovative technology, we're helping some of the largest fashion brands create stunning images that move...


  • Delhi, Delhi, India Maritime Stealth Startup Full time

    Company OverviewInnovative Maritime Stealth Startup is a pioneering tech company revolutionizing the maritime industry with cutting-edge AI solutions. Our Canada-based operations combined with India-based development team enable us to push boundaries and drive innovation.Salary Range$120,000 - $180,000 per year, depending on experience and qualifications.Job...


  • Delhi, Delhi, India Recro Full time

    We're Recro, a trailblazing EdTech company transforming the learning experience through cutting-edge tech. Our platform utilizes AI and machine learning to deliver personalized learning experiences, empowering students to achieve their educational goals efficiently.Job Role: As an AI Innovation Specialist, you'll play a pivotal role in enhancing our...


  • Delhi, Delhi, India AISEO Full time

    We are seeking an exceptional AI Content Optimization Specialist to maximize the potential of existing AI models and create innovative applications.About UsAISEO is a rapidly growing SaaS company revolutionizing the content creation landscape through cutting-edge AI technology.Job DescriptionThe ideal candidate will excel at implementing and optimizing...


  • Delhi, Delhi, India AISEO Full time

    Company OverviewAISEO.ai is a rapidly growing SaaS company revolutionizing the content creation landscape through cutting-edge AI technology. Our platform empowers content creators, marketers, and entrepreneurs worldwide to generate SEO-optimized content efficiently and effectively.Job DescriptionWe are seeking an exceptional Generative AI Engineer to...


  • Delhi, Delhi, India Outlier Full time

    About the OpportunityWe are seeking an experienced mathematician to join our team as a freelance expert. As a mathematical specialist, you will work on improving the training of our AI models by leveraging your knowledge in mathematics.The project is remote, and you can work at your own pace. Your expertise will be utilized in various ways:Evaluating the...


  • Delhi, Delhi, India Kookar AI Full time

    About Kookar AI, a cutting-edge startup founded by IIT Bombay and IIT Delhi alumni.Job OverviewWe are looking for an experienced Graphic Designer to join our team as a Creative Visual Content Specialist. In this role, you will be responsible for creating engaging visual content for marketing and communication channels.This is a full-time position that...


  • Delhi, Delhi, India Hyperion AI Full time

    About Hyperion AI:We are a cutting-edge blockchain quantitative firm based in Palo Alto, California. Our mission is to revolutionize the future of investment by harnessing the power of blockchain technology and delivering automated high-yield opportunities to everyone at scale.As a Senior Quantitative Developer, you will be responsible for developing and...

  • AI Innovator

    1 week ago


    Delhi, Delhi, India VSERVE EBUSINESS SOLUTIONS Full time

    Job Title: AI Innovator - Generative ModelsVserve Ebusiness Solutions is a pioneering company in the field of e-business solutions. We are seeking an experienced and skilled Generative AI Subject Matter Expert (SME) to lead the development and deployment of advanced AI-driven models and solutions.We offer a competitive salary of approximately $120,000 per...


  • Delhi, Delhi, India Trinity Consulting Services ("TRINITY") Full time

    **Generative AI Engineer Role at Trinity Consulting ServicesAbout the Position:We are seeking an experienced Generative AI Engineer to join our team at Trinity Consulting Services (TRINITY). As a key member of our AI/ML group, you will be responsible for designing, developing, and implementing cutting-edge generative AI models that transform data into...