AI Test Specialist

7 hours ago

Aurangabad, Maharashtra, India beBeeArtificialintelligence Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Title: AI Testing Specialist

Overview

We seek a detail-oriented AI testing specialist with expertise in Generative AI models and applications to refine model performance.

Key Responsibilities
  • Design, develop, and execute comprehensive test plans for Generative AI models and applications.
  • Validate AI-generated outputs for accuracy, coherence, bias, ethical considerations, and alignment with business requirements.
  • Develop and maintain automated testing frameworks for AI-based applications, ensuring scalability and efficiency.
  • Perform adversarial testing, edge case analysis, and security testing to assess AI vulnerabilities.
  • Collaborate with AI/ML engineers, product managers, and developers to refine model performance and mitigate errors.
  • Monitor AI model drift and ensure consistent performance across different inputs and datasets.
  • Conduct performance testing to evaluate response times, scalability, and reliability of AI systems.
  • Document test cases, test results, and defects while ensuring compliance with AI governance and ethical guidelines.
Required Skills and Qualifications
  • Bachelors or Master's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in Quality Assurance, with at least 1-2 years in AI/ML testing or Generative AI applications.
  • Strong understanding of AI/ML concepts, NLP models, LLMs, and deep learning architectures.
  • Experience with AI testing tools such as LangTest, DeepChecks, Trulens, or custom AI evaluation frameworks.
  • Proficiency in test automation using Python, Selenium, PyTest, or similar frameworks.
  • Familiarity with model evaluation metrics such as BLEU, ROUGE, perplexity, and precision-recall for AI-generated content.
  • Knowledge of bias detection, adversarial testing, and ethical AI considerations.
  • Experience working with APIs, cloud platforms (AWS, Azure, GCP), and MLOps practices.
  • Strong analytical and problem-solving skills with attention to detail.
  • Excellent communication and collaboration skills to work in cross-functional teams.

  • AI Content Specialist

    4 days ago

    Aurangabad, Maharashtra, India beBeeDesign Full time ₹ 12,00,000 - ₹ 18,00,000

    AI Content SpecialistWe're seeking a talented professional to join our team as an AI Content Specialist.This role involves crafting visually rich prompts for AI tools to generate high-quality images and videos.Craft detailed prompts for AI tools to produce compelling photo and video content.Translate creative briefs into AI-friendly inputs while retaining...

  • AI Specialist

    5 days ago

    Aurangabad, Maharashtra, India beBeeDataScience Full time ₹ 2,50,000 - ₹ 3,00,000

    Job Title: Artificial Intelligence Specialist">">The AI specialist will design and develop intelligent systems that can learn, reason and interact with humans. They will work on building, training, and validating AI models for real-world applications.">Preprocess, clean, and analyze structured/unstructured datasets to train accurate AI models.">Collaborate...

  • AI/ML Specialist

    12 hours ago

    Aurangabad, Maharashtra, India beBeeArtificial Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job OpportunityWe are seeking a highly skilled professional to join our team as an AI/ML Specialist. As an AI/ML Engineer, you will play a crucial role in developing and deploying cutting-edge artificial intelligence and machine learning models. Your primary responsibilities will include:Key ResponsibilitiesDesigning and implementing AI/ML solutions that...

  • AI Innovation Specialist

    5 days ago

    Aurangabad, Maharashtra, India beBeeInnovation Full time ₹ 18,00,000 - ₹ 22,00,000

    Job Title: AI Innovation SpecialistAs an AI innovation specialist, you will be working on developing and implementing LLM-powered applications. This role requires strong expertise in working with LLMs, agentic workflows, and RAG systems.The ideal candidate should have a solid foundation in Python programming language and hands-on experience in building...

  • AI Engineer

    5 days ago

    Aurangabad, Maharashtra, India beBeeLlmApplications Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    AI Engineer - LLM Applications SpecialistWe're seeking an experienced software developer to specialize in Large Language Model (LLM) applications. The ideal candidate will have hands-on experience with AI/ML application development and a strong focus on integrating external LLM APIs into scalable platforms.Key ResponsibilitiesDesign, develop, test, and...

  • Test Automation Engineer

    1 week ago

    Aurangabad, Maharashtra, India beBeeAutomation Full time ₹ 30,00,000 - ₹ 50,00,000

    Software Quality Assurance SpecialistThe ideal candidate will have a solid understanding of software development lifecycle and be skilled in automation testing. Strong knowledge of Linux, bash scripting, JavaScript, HTML5, CSS, Ruby, and Git is essential.Key Responsibilities:Maintain and improve automated test coverage.Provide guidance to the engineering...

  • Test Development Specialist

    2 days ago

    Aurangabad, Maharashtra, India beBeesemiconductor Full time ₹ 18,00,000 - ₹ 21,60,000

    A leading organization is seeking a skilled engineer to fill the role of Test Development Specialist.

  • Automated Testing Specialist

    3 days ago

    Aurangabad, Maharashtra, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 21,00,000

    Job Title: Software Test Automation SpecialistJob Overview:We seek an experienced software test automation specialist to drive our automated testing efforts forward. The ideal candidate will have a strong background in Playwright, leveraging its capabilities to streamline and enhance our testing processes.Key Responsibilities:Develop and maintain automated...

  • AI Systems Analyst Job Opportunity

    1 day ago

    Aurangabad, Maharashtra, India beBeeAgile Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Opportunity: Systems Analyst - AI Integration SpecialistWe are seeking a highly skilled professional to join our organization in the role of Systems Analyst - AI Integration Specialist. The ideal candidate will have expertise in gathering requirements, designing screen layouts, and creating testing plans for ERP web and mobile application modules.This...

  • Creative AI Specialist

    3 days ago

    Aurangabad, Maharashtra, India beBeeai Full time ₹ 3,60,000

    Job Title: Creative AI SpecialistWe are a leading firm in the realm of digital marketing, creative advertising, and branding.We are now transitioning towards AI production, focusing on creating a positive impact in the advertising and marketing sector.Key Responsibilities:AI Image and Video Generation: Develop innovative models for image and video creation...