AI Evaluation Specialist

3 days ago

Lucknow, Uttar Pradesh, India beBeeResponsible Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

About Us:

We are seeking a highly skilled and principled AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise.

This role spans traditional ML models, Large Language Models (LLMs), and Generative AI systems, with a strong focus on fairness, transparency, privacy, security, and accountability across multi-cloud environments.

The ideal candidate combines deep technical expertise with a firm grasp of ethical frameworks, regulatory requirements, and responsible AI principles.

Key Responsibilities:

  • Evaluate AI/ML, LLM, and GenAI models for bias, fairness, explainability, and robustness.
  • Conduct red-teaming, safety testing, and adversarial analysis across AI pipelines.
  • Perform pre-deployment, post-deployment, and continuous model audits.

Achieving these objectives requires

  • Fairness and Bias Detection: Evaluate AI models for fairness and detect potential biases in data, algorithms, or model outputs.
  • Explainability and Transparency: Develop techniques to provide clear explanations of AI-driven decisions and outcomes.
  • Privacy and Security: Ensure the confidentiality, integrity, and availability of sensitive data processed by AI systems.
  • Accountability and Governance: Implement processes for tracking and evaluating AI performance, addressing issues, and mitigating risks.

We value experience in AI/ML evaluation, testing, or assurance roles, as well as proven skills in working with LLMs and generative AI.

Required Skills:

  • 5+ years of experience in AI/ML evaluation, testing, or assurance roles.
  • Proven experience with LLMs (e.g., GPT, Claude, LLaMA) and generative AI (e.g., DALL·E, Midjourney, custom diffusion models).
  • Strong knowledge of fairness, bias detection, differential privacy, red-teaming, model transparency techniques.

Preferred Skills:

  • Master's or PhD in Computer Science, Data Science, Ethics, or related field.
  • Prior work with model evaluation benchmarks and large-scale LLM testing frameworks.

  • AI Ethics and Assurance Specialist

    5 days ago

    Lucknow, Uttar Pradesh, India beBeeResponsible Full time US$ 1,50,000 - US$ 2,00,000

    AI Ethics and Assurance SpecialistAbout the Role:We are seeking a highly skilled AI Ethics and Assurance Specialist to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise.The ideal candidate combines deep technical expertise with a firm grasp of ethical frameworks, regulatory requirements, and responsible AI...

  • AI Design Specialist

    24 hours ago

    Lucknow, Uttar Pradesh, India beBeeArtificialIntelligence Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a highly skilled professional to design and deploy AI models using Python, Langchain, and Azure Cloud.Key ResponsibilitiesDevelop and implement Natural Language Processing (NLP) algorithms and work with Vector Databases.Train AI models for Generative AI applications.Evaluate model performance and ensure adherence to AI ethics and...

  • AI Innovation Specialist

    11 hours ago

    Lucknow, Uttar Pradesh, India beBeeArtificial Full time US$ 1,60,000 - US$ 2,00,000

    AI Model DeveloperThe role involves creating and implementing artificial intelligence models that can be integrated into various applications. This is an excellent opportunity to work with cutting-edge technology and contribute to innovative solutions.The ideal candidate will have expertise in developing machine learning algorithms and deploying them on...

  • AI Infrastructure Specialist

    4 days ago

    Lucknow, Uttar Pradesh, India beBeeInfrastructures Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Overview:We're seeking a skilled AI Infrastructure Specialist to design and develop a scalable backend system for multi-agent workflows.Key Responsibilities:Build and scale a FastAPI backend powering multi-agent workflows.Design workflow orchestration pipelines with Temporal or similar to plan multi-step actions, handle fallbacks, and reason over user...

  • Senior AI Automation Professional

    24 hours ago

    Lucknow, Uttar Pradesh, India beBeeAutomation Full time US$ 1,00,000 - US$ 1,25,000

    AI ToolsPosition: AI Automation SpecialistThis is an exciting opportunity to lead the adoption and implementation of AI-driven tools across various departments.The ideal candidate will combine technical expertise with business acumen to drive efficiency, scalability, and innovation.We are seeking a highly skilled professional with exceptional problem-solving...

  • AI Innovation Leader

    4 days ago

    Lucknow, Uttar Pradesh, India beBeeInnovation Full time ₹ 19,31,800 - ₹ 23,13,400

    As a seasoned AI professional, you will be responsible for designing and implementing cutting-edge AI solutions that drive business growth. With a strong background in machine learning, data analysis, and software development, you will lead cross-functional teams to identify AI opportunities and develop strategic plans.Key ResponsibilitiesDevelop and...

  • AI Expertise Leader

    24 hours ago

    Lucknow, Uttar Pradesh, India beBeeArtificialIntelligence Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We're seeking a seasoned AI expert to contribute to the development of cutting-edge artificial intelligence solutions. The ideal candidate will have expertise in custom model creation and scalable pipeline design.This role involves collaborating with a global team to drive impactful AI initiatives. Strong programming skills in Python and frameworks like...

  • Generative AI Security Professional

    12 hours ago

    Lucknow, Uttar Pradesh, India beBeeRedTeamer Full time US$ 40,000 - US$ 80,000

    Red Teaming SpecialistWe are seeking skilled specialists to fill a key role within our organization.In this position, you will be entrusted with a range of responsibilities, including identifying and addressing vulnerabilities in generative AI systems. You will also receive extensive training on AI/ML technologies, LLMs, and jailbreaking techniques.Craft...

  • AI Data Specialist

    2 days ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 5,00,000 - ₹ 10,00,000

    Enhance AI model accuracy by creating high-quality training data sets that align with human values.Job Role:The position involves developing large-scale datasets for AI models, ensuring their fluency, coherence, and voice match human standards. You will work closely with cross-functional teams to refine and iterate datasets.Develop and maintain extensive...

  • Highly Skilled AI Developer Wanted

    21 hours ago

    Lucknow, Uttar Pradesh, India beBeeArtificial Full time US$ 1,00,000 - US$ 1,50,000

    AI Software Engineer PositionWe are looking for skilled software engineers to join our team working on cutting-edge AI research and commercial applications.This role is ideal for engineers who enjoy solving complex problems, writing clean code, and contributing to advancements in AI. You'll collaborate with leading companies building next-generation AI...