Lead Responsible AI Evaluator

1 week ago

ballari, India beBeeEthics Full time

Responsible AI EvaluatorAbout the Role:We are seeking a skilled and principled professional to assess, audit, and ensure the ethical development and deployment of AI models across our enterprise. This role spans traditional ML models, Large Language Models (LLMs), and Generative AI systems, with a focus on fairness, transparency, privacy, security, and accountability.The ideal candidate combines technical expertise with a grasp of ethical frameworks, regulatory requirements, and responsible AI principles.Main Responsibilities:Evaluate AI/ML, LLM, and GenAI models for bias, fairness, explainability, and robustness.Conduct red-teaming, safety testing, and adversarial analysis across AI pipelines.Perform pre-deployment, post-deployment, and continuous model audits.The candidate will operationalize and implement RAI principles based on NIST AI RMF, OECD, ISO/IEC 42001, and industry standards. They will collaborate with data scientists, legal, compliance, and product teams to enforce responsible AI lifecycle checkpoints.Key Requirements:Experience with AI/ML evaluation, testing, or assurance roles.Proven experience with LLMs and generative AI.Strong knowledge of fairness, bias detection, differential privacy, red-teaming, model transparency techniques.Familiarity with AI regulation and governance.Proficiency in Python and libraries such as scikit-learn, Transformers, LangChain, MLflow, PyTorch, etc.This is an opportunity to apply your skills and passion for AI ethics to drive meaningful impact in a dynamic environment.

  • Malayalam Content Evaluator

    3 days ago

    ballari, India beBeeContentEvaluator Full time

    Job OverviewWe are seeking skilled professionals to evaluate AI-generated content in Malayalam, focusing on assessing quality, accuracy, and cultural sensitivity.Evaluate AI responses for Malayalam (native script and transliterated formats like Manglish).Identify and flag harmful or toxic content, including subtle cases.Compare model responses based on...

  • Telegu Language Evaluator

    6 days ago

    ballari, India beBeeEvaluator Full time

    We are seeking a skilled evaluator to review and compare AI-generated responses in Telegu.Key Responsibilities:Evaluate AI model outputs in Telegu.Flag toxic, harmful or hate-based content, including subtle or context-dependent cases.Compare model responses and provide performance assessments based on predefined criteria.Classify the type and severity of...

  • Technical Content Evaluator

    2 weeks ago

    ballari, India beBeeEvaluator Full time

    Job SummaryEvaluate AI-generated content, ensuring correctness, coherence, and relevance in technical areas.About the RoleEvaluate LLM outputs for accuracy, consistency, and logical reasoning.Annotate AI responses to identify bugs, inefficiencies, or misleading explanations.Develop challenging prompts for Large Language Models (LLMs).Evaluate LLM output for...

  • Leading Applied AI/ML Researcher

    6 days ago

    ballari, India beBeeDataAnalyst Full time

    Data Analyst PositionWe are seeking a highly skilled professional to lead our applied AI/ML research efforts and develop innovative solutions using transformer architectures.To be successful in this role, you will require deep expertise in model training, fine-tuning, and optimization.Key responsibilities include running end-to-end experiments on...

  • Lead Mortgage Evaluator

    5 days ago

    ballari, India beBeeAnalytical Full time

    We are seeking experienced professionals to fill the role of Live Underwriter in our expanding US Mortgage team.Position Requirements:Years of Experience: 2 to 10Work Mode: Remote (Except for Bengaluru and Chennai Candidates)Key Skills & Qualifications:Proficiency in US Mortgage ProcessesExpertise in Live Underwriting with a Focus on Credit, Capacity,...

  • Technical Content Evaluator

    2 weeks ago

    ballari, India beBeeLanguageModelEvaluator Full time

    Job Title: Technical Content EvaluatorIn this role, you will be responsible for evaluating the accuracy and precision of large language models (LLMs) in technical areas such as programming, algorithms, data science, software engineering, systems design, and theoretical computer science.Evaluate LLM outputs for correctness, coherence, and relevance in...

  • Senior Content Evaluator

    6 days ago

    ballari, India beBeeContentEvaluator Full time

    Job OpportunityWe are seeking a highly skilled Content Evaluator to join our team.Evaluate AI model outputs in various languages, identifying and flagging toxic or harmful content.Assess model performance based on predefined criteria and classify the type and severity of toxicity.The role focuses on ensuring consistency, accuracy, and adherence to project...

  • Lead AI Architect

    2 weeks ago

    ballari, India beBeeArtificialIntelligence Full time

    We are seeking a highly skilled and experienced AI Expert to guide our teams in building advanced systems based on Large Language Models.Design high-performing, scalable LLM applications in cloud environments.Mentor the development team, conduct code reviews, and implement engineering best practices.Collaborate with AI Engineering and Data Science teams to...

  • AI Development Lead

    2 weeks ago

    ballari, India beBeeArtificial Full time

    About Our AI Engineering OpportunityWe are seeking a highly skilled Senior AI Engineer to lead the development and scaling of cutting-edge AI solutions involving large language models, retrieval-augmented generation systems, AI agents, and autonomous workflows.Develop and architect scalable LLM-powered applications, including chatbots, RAG systems, and AI...

  • Leading AI Expert

    6 days ago

    ballari, India beBeeArtificial Full time

    We are seeking a visionary AI Expert to spearhead innovation in cutting-edge Generative AI and Large Language Model (LLM) solutions.This role involves driving the architecture and deployment of large-scale AI systems, defining the AI vision and technical direction for the team.Technical Leadership: Develop and execute a comprehensive strategy for AI-driven...