AI Test Specialist

1 day ago

Rajkot, Gujarat, India beBeeGenerative Full time ₹ 15,00,000 - ₹ 25,00,000
AI Testing Expert

We're seeking a detail-oriented AI testing expert with expertise in Generative AI to ensure accuracy, safety, and performance of AI-driven applications.

Key Responsibilities:

  • Design comprehensive test plans for Generative AI models and applications.
  • Validate AI-generated outputs for accuracy, coherence, bias, ethical considerations, and alignment with business requirements.
  • Develop and maintain automated testing frameworks for AI-based applications.
  • Perform adversarial testing, edge case analysis, and security testing to assess AI vulnerabilities.
  • Collaborate with AI/ML engineers to refine model performance.
  • Monitor AI model drift and ensure consistent performance.
  • Conduct performance testing to evaluate response times and scalability.
  • Document test cases, results, and defects while ensuring compliance with AI governance guidelines.
  • Explore new tools and methodologies to improve AI testing processes.

Required Skills and Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in Quality Assurance, with at least 1-2 years in AI/ML testing or Generative AI applications.
  • Strong understanding of AI/ML concepts, NLP models, LLMs, and deep learning architectures.
  • Experience with AI testing tools and custom AI evaluation frameworks.
  • Proficiency in test automation using Python, Selenium, PyTest, or similar frameworks.
  • Familiarity with model evaluation metrics for AI-generated content.
  • Knowledge of bias detection, adversarial testing, and ethical AI considerations.
  • Experience working with APIs, cloud platforms, and MLOps practices.
  • Strong analytical and problem-solving skills with attention to detail.

Benefits:

  • Opportunity to work on cutting-edge AI products.
  • Collaborate with a team of AI and software experts.
  • Competitive salary and career growth opportunities.

About Us:

  • We're a leading provider of AI solutions.

  • AI Testing Expert

    6 days ago

    Rajkot, Gujarat, India beBeeTesting Full time ₹ 15,00,000 - ₹ 35,00,000

    Quality Assurance SpecialistJob SummaryA Quality Assurance Specialist ensures the accuracy, reliability, and effectiveness of AI-driven applications.Key Responsibilities:Develop comprehensive test strategies for Generative AI models and applications.Validate AI-generated outputs for accuracy, coherence, bias, ethical considerations, and alignment with...

  • AI Security Specialist

    7 days ago

    Rajkot, Gujarat, India beBeeSecurity Full time US$ 80,000 - US$ 1,00,000

    Job Title: AI Security SpecialistWe are seeking skilled and creative professionals to join our team as AI Security Specialists. The ideal candidate will have extensive knowledge of AI/ML, LLMs, and Red Teaming, with the ability to craft clever prompts to test the filters and guardrails on LLMs.Develop and implement effective training programs for AI/ML,...

  • Ethical AI Specialist

    2 weeks ago

    Rajkot, Gujarat, India beBeeResponsible Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Ethical AI Specialist We are seeking an experienced Ethical AI Specialist to assess, audit, and ensure the ethical development and deployment of AI models across our enterprise.This role spans traditional ML models, Large Language Models (LLMs), and Generative AI systems, with a strong focus on fairness, transparency, privacy, security, and...

  • AI Assurance Lead

    2 days ago

    Rajkot, Gujarat, India beBeeQualityAssurance Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:AI Quality Assurance Specialist About the Role:We are seeking an experienced AI Quality Assurance Specialist to lead our quality assurance efforts. The successful candidate will have a strong background in artificial intelligence, machine learning, and deep learning concepts. Key Responsibilities: AI Expertise: Demonstrate in-depth understanding of...

  • AI Psychometrics Expert

    2 days ago

    Rajkot, Gujarat, India beBeePsychometrics Full time ₹ 60,00,000 - ₹ 80,00,000

    Role OverviewWe are seeking a highly skilled professional to fill the role of AI & Psychometrics Specialist.This position combines cutting-edge AI-driven innovation with expert psychometric knowledge to design and improve our assessment tools, while supporting consulting projects for clients worldwide.AI Implementation in R&D:Design and integrate AI-based...

  • Test Assurance Specialist

    8 hours ago

    Rajkot, Gujarat, India beBeeQuality Full time ₹ 18,00,000 - ₹ 24,00,000

    Test Assurance SpecialistWe are seeking a Test Assurance Specialist with experience in both manual and automation testing to join our organization. The ideal candidate will have a strong understanding of functional, regression, UAT, exploratory, negative, and database validation testing methods.Key Responsibilities:Design and implement comprehensive test...

  • Automation Testing Specialist

    1 day ago

    Rajkot, Gujarat, India beBeeAutomation Full time ₹ 12,00,000 - ₹ 24,00,000

    Automation Testing SpecialistThe ideal candidate will design, implement, and maintain automation frameworks aligned with project structures. They will develop and execute automation test scripts for web applications and create well-structured test cases using Azure DevOps or similar tools.In this role, the Automation Testing Specialist will work closely with...

  • AI Development Specialist

    10 hours ago

    Rajkot, Gujarat, India beBeeGenerative Full time ₹ 18,00,000 - ₹ 25,00,000

    Seeking a skilled AI Development Specialist to drive the creation of innovative generative AI models.Key Responsibilities:Develop and fine-tune pre-trained large language models (LLMs) for specific tasks and domains.Design and implement generative AI pipelines using techniques like RAG, transformers, and other relevant approaches.Evaluate and analyze the...

  • Innovative AI Specialist

    23 hours ago

    Rajkot, Gujarat, India beBeeArtificialIntelligence Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a highly skilled and experienced AI specialist to contribute to shaping the future of enterprise AI.As an AI developer, you will play a crucial role in designing and developing innovative solutions using cutting-edge technologies such as Azure OpenAI and Cognitive Search.Key Responsibilities:Design and develop scalable Python backends, APIs,...

  • Chief AI Visionary

    2 days ago

    Rajkot, Gujarat, India beBeeInnovation Full time ₹ 20,00,000 - ₹ 25,00,000

    AI Innovation SpecialistPosition OverviewWe are seeking an experienced AI innovation specialist to join our organization. The ideal candidate will have a strong background in machine learning and experience with modern AI technologies and frameworks.Designing and executing machine learning experiments to evaluate emerging AI technologies and frameworks is...