AI Evaluator

5 days ago

anand, India beBeeEthics Full time

AI Evaluator - Ethics and Assurance SpecialistOur organization seeks an expert AI Evaluator to assess, audit, and ensure the ethical development and deployment of artificial intelligence models across the enterprise.The ideal candidate combines in-depth technical expertise with a firm grasp of ethical frameworks, regulatory requirements, and responsible AI principles.Evaluate AI/ML, LLM, and GenAI models for bias, fairness, explainability, and robustness.Conduct red-teaming, safety testing, and adversarial analysis across AI pipelines.Perform pre-deployment, post-deployment, and continuous model audits.Key Responsibilities:Model Evaluation & AuditingResponsible AI FrameworksMulti-Cloud Deployment ComplianceTooling & AutomationDocumentation & ReportingRequired Qualifications:5+ years of experience in AI/ML evaluation, testing, or assurance roles.Proven experience with LLMs (e.g., GPT, Claude, LLaMA) and generative AI (e.g., DALL·E, Midjourney, custom diffusion models).Strong knowledge of fairness, bias detection, differential privacy, red-teaming, model transparency techniques.Familiarity with AI regulation and governance (EU AI Act, FTC guidance, DSA, HIPAA, etc.).Experience with cloud platforms (AWS, Azure, GCP) and deploying/evaluating AI services in distributed architectures.Proficiency in Python and libraries such as scikit-learn, Transformers, LangChain, MLflow, PyTorch, etc.Why Choose This Role?This is a unique opportunity to work on cutting-edge AI projects and develop your skills in a rapidly evolving field. You will have the chance to collaborate with a talented team of experts and contribute to the creation of innovative AI solutions that make a real impact.What We Offer:A competitive salary and benefits package.Ongoing training and professional development opportunities.A dynamic and supportive work environment.The chance to work on diverse and challenging AI projects.

  • AI Content Evaluator

    2 days ago

    anand, India beBeeTechnical Full time

    Job OverviewWe are seeking a skilled professional to join our team as Raters / AI Trainers. In this role, you will leverage your deep technical knowledge to evaluate, annotate, and provide structured feedback on AI-generated content produced by Large Language Models (LLMs).About the RoleEvaluate LLM outputs for correctness, coherence, and relevance in...

  • Senior GenAI Engineer

    2 weeks ago

    Anand, India Mitra AI Full time

    Key Responsibilities:AI System Design & Development: Architect, develop, and deploy large-scale Generative AI, LLM-based systems, including intelligent agents and automation workflows.LLM Integration & Optimization:Integrate and optimize large language models for reasoning, summarization, and structured content generation.Apply prompt design, fine-tuning,...

  • Senior GenAI Engineer

    2 weeks ago

    Anand, India Mitra AI Full time

    Key Responsibilities:AI System Design & Development: Architect, develop, and deploy large-scale Generative AI, LLM-based systems, including intelligent agents and automation workflows.LLM Integration & Optimization:Integrate and optimize large language models for reasoning, summarization, and structured content generation.Apply prompt design, fine-tuning,...

  • AI Strategist

    3 days ago

    anand, India beBeeMachineLearning Full time

    Artificial Intelligence DeveloperThe successful candidate will play a pivotal role in advancing initiatives to improve grant-writing success through AI-assisted scoring, analysis, and content generation.This position requires expertise in refining scoring systems, developing and validating evaluative rubrics, analyzing funded vs. unfunded grant trends, and...

  • AI Innovation Specialist

    3 days ago

    anand, India beBeeGenerative Full time

    Gen AI Engineering OpportunityWe seek a skilled professional to develop and deploy advanced AI/ML solutions with expertise in Generative AI technologies.The ideal candidate will have hands-on experience in RAG systems, Agentic AI, and working with open-source LLMs.Design, build, and deploy enterprise-level Gen AI solutions using RAG pipelines, agent...

  • Ai engineer intern

    1 week ago

    Anand, India Signet Arms Full time

    Company: Signet Arms Location: Remote (India) Type: Paid Internship (Full Time) Duration: 3–6 months (with potential extension) Company Description Signet Arms is an innovative defense technology company. We are building next-generation agentic AI systems, enabling autonomous reasoning, workflow orchestration, and intelligent automation. Our work combines...

  • AI Quality Assurance Specialist

    2 days ago

    anand, India beBeeAutomation Full time

    Job Title: Lead AI Validation and Quality Assurance SpecialistWe are seeking an experienced professional to lead our quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems.This role will involve designing and executing evaluation frameworks for Large Language Models, building Python-based automation frameworks, and integrating...

  • Lead AI Architect

    2 days ago

    anand, India beBeeArtificial Full time

    Large Scale AI Systems EngineerAbout the RoleWe are seeking a highly skilled Large Scale AI Systems Engineer to design and develop intelligent Generative AI systems.Key Responsibilities:Design and Development: Design, develop, and maintain large-scale Generative AI systems, including intelligent agents and automation workflows.LLM Integration: Integrate and...

  • Advanced AI Systems Engineer

    5 days ago

    anand, India beBeeArtificial Full time

    Job DescriptionWe are seeking a highly motivated AI Engineering Intern to support the development, fine-tuning, and deployment of LLM-based agentic systems. You will work closely with our engineering team to prototype, evaluate, and optimize AI agents that integrate with complex technical workflows.Key ResponsibilitiesWork with state-of-the-art LLMs (OpenAI,...

  • AI Researcher

    4 days ago

    anand, India beBeeDataScientist Full time

    Key Roles and ResponsibilitiesJob Description: We are seeking a highly skilled Data Scientist to join our fast-paced R&D team. As a Data Scientist, you will be responsible for developing and fine-tuning AI/ML models.Model Development & Fine-Tuning: Run end-to-end experiments on transformer-based architectures and prototype emerging generative AI...