Responsible AI Model Evaluator

2 weeks ago

bangalore, India beBeeEvaluator Full time

We are seeking a skilled evaluator to assess and ensure the ethical development and deployment of AI models.The ideal candidate should have deep technical expertise with a firm grasp of ethical frameworks, regulatory requirements, and responsible AI principles.You will evaluate AI/ML, LLM, and GenAI models for bias, fairness, explainability, and robustness, and perform red-teaming, safety testing, and adversarial analysis across AI pipelines.Key responsibilities include:Evaluating AI/ML models for bias and fairnessAssessing model explainability and robustnessPerforming red-teaming and safety testingConducting adversarial analysis across AI pipelinesRequired skills and qualifications include:5+ years of experience in AI/ML evaluation, testing, or assurance rolesProven experience with Large Language Models (LLMs) and generative AI systemsStrong knowledge of fairness, bias detection, differential privacy, red-teaming, model transparency techniquesFamiliarity with cloud platforms and deploying/evaluating AI services in distributed architecturesProficiency in Python and libraries such as scikit-learn, Transformers, LangChain, MLflow, PyTorch, etc.This is an exciting opportunity to shape a safer and more accountable AI future.

  • Responsible AI

    2 weeks ago

    bangalore, India EXL Full time

    About the Role: We are seeking a highly skilled and principled Responsible AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise. This role spans traditional ML models, Large Language Models (LLMs), and Generative AI systems, with a strong focus on fairness, transparency, privacy, security, and...

  • Responsible AI

    1 week ago

    bangalore, India EXL Full time

    About the Role: We are seeking a highly skilled and principled Responsible AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise. This role spans traditional ML models, Large Language Models (LLMs), and Generative AI systems, with a strong focus on fairness, transparency, privacy, security, and...

  • Content Professional

    1 day ago

    bangalore, India beBeeEvaluator Full time

    Evaluators WantedWe are seeking skilled professionals to review and compare AI-generated responses in various Indic languages. The role involves identifying toxic or harmful content, assessing model performance, and evaluating the accuracy of outputs.Key Responsibilities:Evaluate AI model outputs in multiple Indian languages (native scripts and...

  • AI Content Evaluator

    1 day ago

    bangalore, India Innodata Inc. Full time

    Work Mode: Remote Engagement: Freelance / Flexible Hours Overview We are seeking skilled AI Content Evaluators with proficiency in one or more Indian languages to assess, review, and compare AI-generated responses. This role involves identifying toxic or harmful content, understanding linguistic nuances, and ensuring high-quality model performance across...

  • AI Content Evaluator

    3 hours ago

    bangalore, India Innodata Inc. Full time

    Work Mode: RemoteEngagement: Freelance / Flexible HoursOverviewWe are seeking skilled AI Content Evaluators with proficiency in one or more Indian languages to assess, review, and compare AI-generated responses. This role involves identifying toxic or harmful content, understanding linguistic nuances, and ensuring high-quality model performance across...

  • AI Content Evaluator

    2 weeks ago

    bangalore, India beBeeRater Full time

    Role Summary:Innodata's team needs a Rater / AI Trainer to evaluate and annotate Large Language Model outputs.This position requires deep technical knowledge, excellent written communication skills, and native or near-native English fluency.Evaluate LLM outputs for correctness, coherence, and relevance;Assess and annotate AI responses for logical consistency...

  • AI Evaluation Specialist

    1 week ago

    bangalore, India beBeeEvaluation Full time

    As a specialist in AI evaluation, you will be responsible for assessing the accuracy and effectiveness of responses generated by artificial intelligence. You will work closely with a lead to develop, review, and refine high-quality data that enhances the ability of AI models to teach at scale.Main Responsibilities:Develop detailed solutions and explanations...

  • Senior Ai Engineer

    1 week ago

    Bangalore, Karnataka, India Sumeru Solutions Full time

    Senior AI Engineer Regression Evaluation Model Quality Systems Location Flexible India Type Full-time Company Zscaler About Zscaler For over a decade Zscaler has been redefining cloud security by delivering a globally distributed cloud-native platform that secures users applications and data across 185 countries Protecting more than 7 000 enterprises and...

  • AI Content Evaluator – Malayalam

    3 days ago

    bangalore, India Innodata Inc. Full time

    Job Title: AI Content Evaluator – Malayalam Work Mode: Remote Engagement: Freelance / Flexible Hours Overview We are seeking skilled AI Content Evaluators with proficiency in Malayalam to assess, review, and compare AI-generated responses. This role involves identifying harmful or toxic content, understanding cultural and linguistic nuances, and ensuring...

  • AI Content Evaluator – Malayalam

    3 days ago

    bangalore, India Innodata Inc. Full time

    Job Title: AI Content Evaluator – Malayalam Work Mode: Remote Engagement: Freelance / Flexible Hours Overview We are seeking skilled AI Content Evaluators with proficiency in Malayalam to assess, review, and compare AI-generated responses. This role involves identifying harmful or toxic content, understanding cultural and linguistic nuances, and ensuring...