AI Model Evaluator

21 hours ago


India beBeeEvaluator Full time ₹ 5,00,000 - ₹ 10,00,000
Job Description

We're seeking a highly skilled professional to join our team as an AI Model Evaluator. In this role, you will be responsible for evaluating the performance of various AI models in order to ensure their relevance, correctness, and completeness.

Your primary tasks will include:

  • Performing straightforward annotation related tasks across multiple data process areas
  • Collaborating with cross-functional teams to determine the right task or procedure to achieve desired outcomes
  • Acting as a point of contact for simple annotation tasks in a given ML data process area and ensuring the quality of execution
Key Responsibilities

In addition to your primary tasks, you will also be responsible for:

  • Structuring data collection, analyzing results, and sharing inputs for SOP changes
  • Collaborating with stakeholders to track and report progress on key metrics specific to your functional area
  • Identifying operational issues related to process and tooling and recommending suggestions to improve key project metrics such as productivity and quality
Requirements

To be successful in this role, you will need:

  • A Bachelor's degree
  • Strong verbal and written communication skills in English
  • Technical proficiency in MS Excel, basic understanding of SQL, and Python programming
  • Experience with Microsoft Office products and applications
Benefits

We offer a competitive salary and benefits package, including:

  • Ongoing training and development opportunities
  • A collaborative and inclusive work environment
  • The chance to work with a talented team of professionals
About Us

We are committed to creating a workplace culture that empowers our employees to deliver exceptional results for our customers. If you have a disability and require an accommodation during the application and hiring process, please visit our website for more information.


  • AI Model Evaluator

    6 days ago


    India beBeeAI Full time ₹ 20,00,000 - ₹ 30,00,000

    Artificial Intelligence TesterWe are seeking a skilled and detail-oriented Artificial Intelligence Tester with expertise in AI model evaluation to join our organization.


  • India beBeeMedical Full time ₹ 5,00,000 - ₹ 8,00,000

    Job Title: Medical Specialist for AI Model EvaluationKey Responsibilities:Evaluate AI-generated medical content to ensure accuracy and safety.Assess patient scenarios, determining likely diagnoses and treatment plans.Review summaries of medical conversations generated by AI models.Perform various text-based medical evaluation...

  • Data Scientist

    5 days ago


    India beBeeMachineLearning Full time ₹ 20,00,000 - ₹ 30,00,000

    About Innodata, a leading data engineering company serving over 2,000 customers worldwide, we are looking for highly analytical and detail-oriented scientific experts to support our AI training and model evaluation initiatives.Job DescriptionWe are seeking scientists who have a passion for research, critical thinking, and applying domain-specific knowledge...


  • India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    About the Role We are seeking a Senior Data Scientist – AI to lead the design and development of machine learning and generative AI models that enhance our threat modeling platform. The successful candidate will work closely with engineers, product managers, and cybersecurity SMEs to innovate how we analyze architectures, assess risks, and automate threat...


  • India beBeeArtificialIntelligence Full time ₹ 70,00,000 - ₹ 1,00,00,000

    Artificial Intelligence Developer PositionDevelop foundational skills in AI model development, data handling, and intelligent system design through hands-on projects.Key ResponsibilitiesDevelop AI models using Python and libraries such as TensorFlow, PyTorch, or KerasPreprocess and analyze structured and unstructured dataImplement supervised and unsupervised...

  • AI Model Developer

    6 days ago


    India beBeeProgramming Full time ₹ 18,00,000 - ₹ 25,00,000

    Key AI Roles:Developing and refining large language models using Python.Generating and refining datasets for Supervised Fine-Tuning (SFT) and contributing to Reinforcement Learning with Human Feedback (RLHF) workflows.Evaluating model performance using Evals.Assessing and ranking model outputs, providing clear feedback.Collaborating with researchers and...

  • AI Model Developer

    7 days ago


    India beBeeDeveloper Full time US$ 1,04,000 - US$ 1,30,878

    Job OpportunityWe are seeking a skilled and motivated developer to join our team in support of cutting-edge AI models.The role involves working on dataset generation, model evaluation, and Python development. You will play a key part in Supervised Fine-Tuning (SFT), Reinforcement Learning with Human Feedback (RLHF), and benchmarking AI systems.Key...

  • AI Model Developer

    2 days ago


    India beBeeMachineLearning Full time ₹ 6,00,000 - ₹ 8,00,000

    Machine Learning Engineer Role SummaryWe are seeking an experienced Machine Learning Engineer to join our team. This is an exciting opportunity to work on cutting-edge projects in a fast-paced environment.Design and develop scalable ML models for real-world applications.Develop and optimize end-to-end ML pipelines using PySpark and MLflow.Process structured...


  • India beBeeResearch Full time ₹ 40,00,000 - ₹ 50,00,000

    Research Scientist - Multimodal Large Language ModelsWe are seeking a highly motivated Research Scientist with expertise in developing and deploying cutting-edge multimodal large language models (m-LLMs) for interactive systems.The ideal candidate will have a strong background in natural language processing, deep learning, and TTS technologies. They will...


  • India beBeeAIENGINEER Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Research Opportunity:We are seeking a highly skilled Research Engineer to engage in cutting-edge research and development of AI solutions that integrate various data modalities.Main Responsibilities:Multimodal Research:Develop state-of-the-art LARGE LANGUAGE MODELS and generative AI models that process and integrate multiple data modalities, including text,...