AI Model Assurance Specialist

15 hours ago

Varanasi, Uttar Pradesh, India beBeeEvaluator Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Title:

AI Evaluator and Assurance Specialist

Job Description:

We are seeking a highly skilled and principled AI evaluator to assess, audit, and ensure the ethical development and deployment of AI models across our organization.

This role spans traditional ML models, Large Language Models (LLMs), and Generative AI systems, with a strong focus on fairness, transparency, privacy, security, and accountability across multi-cloud environments.

The ideal candidate combines deep technical expertise with a firm grasp of ethical frameworks, regulatory requirements, and responsible AI principles.

  • Evaluate AI/ML, LLM, and GenAI models for bias, fairness, explainability, and robustness.

  • Conduct red-teaming, safety testing, and adversarial analysis across AI pipelines.

  • Perform pre-deployment, post-deployment, and continuous model audits.

The AI Evaluator will be responsible for:

  • Model Evaluation & Auditing
  • Responsible AI Frameworks
  • Multi-Cloud Deployment Compliance
  • Tooling & Automation
  • Documentation & Reporting
Required Skills and Qualifications:

The ideal candidate should have:

  • 5+ years of experience in AI/ML evaluation, testing, or assurance roles.
  • Proven experience with LLMs and generative AI.
  • Strong knowledge of fairness, bias detection, differential privacy, red-teaming, and model transparency techniques.
  • Familiarity with AI regulation and governance.
  • Experience with cloud platforms and deploying/evaluating AI services in distributed architectures.
  • Proficiency in Python and libraries such as scikit-learn, Transformers, LangChain, MLflow, PyTorch, etc.
Benefits:

The successful candidate will join a dynamic team and have opportunities for growth and development in a rapidly evolving field.

  • AI Model Developer

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeModel Full time ₹ 50,00,000 - ₹ 1,00,00,000

    AI Model DeveloperJob Summary:A dynamic and experienced AI/ML developer is required to develop, implement, and maintain AI models using Azure AI Foundry.Key Responsibilities:Design, develop, and deploy large language models (LLMs) and prompt designs for seamless AI integration.Collaborate with cross-functional teams to identify, analyze, and solve complex...

  • AI Model Operations Specialist

    13 hours ago

    Varanasi, Uttar Pradesh, India beBeeMachineLearning Full time ₹ 15,00,000 - ₹ 25,00,000

    Transforming Business with AI and Machine LearningOur organization is seeking an experienced professional to assume the role of AIML Operations Engineer. The ideal candidate will possess a strong foundation in machine learning, AI, and software engineering.Key Responsibilities:Data Management: Prepare, clean, and process large datasets; build and maintain...

  • AI Model Architect

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeAIResearch Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior AI Research ScientistThis role involves leading the design, development, and deployment of cutting-edge machine learning models with a focus on Generative AI and Retrieval-Augmented Generation (RAG).Develop and implement scalable ML solutions using large language models (LLMs) and RAG architecture.Design and optimize prompt engineering, embeddings,...

  • AI/ML Specialist

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeArtificialintelligence Full time US$ 1,20,000 - US$ 1,60,000

    Job Opportunity: AI/ML SpecialistUnicorn Labs is seeking a skilled AI/ML Specialist to join their global team.About the Role:The successful candidate will design and develop custom machine learning and deep learning models for business-specific problems, build and maintain scalable AI/ML pipelines, collaborate with cross-functional teams, and ensure...

  • AI Specialist

    14 hours ago

    Varanasi, Uttar Pradesh, India beBeeGenerative Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Gen AI Engineer Job Description:We are seeking an experienced AI engineer to join our team. The successful candidate will have a strong background in machine learning, deep learning, and AI research, with a focus on generative models.The ideal candidate will have hands-on experience in building data applications using Streamlit or similar tools...

  • AI Model Developer for Large Language Models

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeDevOps Full time US$ 1,25,000 - US$ 2,50,000

    Job Title: AI Developer for LLM ProjectDevelop cutting-edge AI models and contribute to the development of large language models.The Role:Hiring Python Developers to support foundational LLM companies working on next-generation AI models. Your work will directly influence how these models are trained, evaluated, and refined.This role focuses on dataset...

  • AI/ML Model Developer

    22 hours ago

    Varanasi, Uttar Pradesh, India beBeeArtificialIntelligence Full time ₹ 40,00,000 - ₹ 70,00,000

    AI/ML Model Developer PositionWe are seeking a skilled AI/ML Model Developer to join our team. As an expert in artificial intelligence and machine learning, you will design, build, and deploy models for financial services applications.This part-time remote position offers excellent growth opportunities and the chance to work directly with a team based in the...

  • Quality Assurance Specialist

    1 hour ago

    Varanasi, Uttar Pradesh, India beBeeQuality Full time ₹ 6,00,000 - ₹ 12,00,000

    Job Opportunity: Quality Assurance SpecialistA quality assurance specialist is responsible for monitoring and evaluating interactions to ensure quality standards are met. This involves closely scrutinizing the performance of team members, identifying process gaps, and suggesting improvements to optimize efficiency.Main Responsibilities:Evaluate performance...

  • AI Pipeline Specialist

    6 days ago

    Varanasi, Uttar Pradesh, India beBeeMachine Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    AI Pipeline SpecialistAs a pivotal member of our team, you will play a critical role in designing, implementing, and deploying cutting-edge Artificial Intelligence (AI) and Machine Learning (ML) pipelines across various cloud environments.Key ResponsibilitiesDesign and develop AI/ML pipelines using AWS services like SageMaker, Fargate, and Bedrock.Apply...

  • Artificial Intelligence Model Developer

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeArtificialintelligence Full time ₹ 10,00,000 - ₹ 30,00,000

    AI Model Integration SpecialistWe are seeking a highly skilled AI engineer to join our organization. As an AI engineer, you will be responsible for designing and building scalable AI models.The ideal candidate will have experience with multiple AI domains and the ability to prototype quickly. They should also be familiar with machine learning frameworks and...