AI Testing Specialist

2 days ago

Aligarh, Uttar Pradesh, India beBeeAI Full time ₹ 1,75,00,000 - ₹ 2,25,00,000

Job Title: AI Testing Specialist

We are seeking a skilled and detail-oriented AI testing specialist to ensure the accuracy, safety, and performance of AI-driven applications. In this role, you will be responsible for designing and executing test strategies, developing automation frameworks, and validating AI outputs to maintain high-quality user experiences.

You will design comprehensive test plans for AI models and applications, validate AI-generated outputs for accuracy and coherence, develop automated testing frameworks for AI-based applications, and perform adversarial testing to assess AI vulnerabilities.

Main Responsibilities:

  • Design, develop, and execute comprehensive test plans for Generative AI models and applications.
  • Validate AI-generated outputs for accuracy, coherence, bias, ethical considerations, and alignment with business requirements.
  • Develop and maintain automated testing frameworks for AI-based applications, ensuring scalability and efficiency.
  • Perform adversarial testing, edge case analysis, and security testing to assess AI vulnerabilities.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Three years of experience in Quality Assurance, with at least one to two years in AI/ML testing or Generative AI applications.
  • Strong understanding of AI/ML concepts, NLP models, LLMs, and deep learning architectures.
  • Experience with AI testing tools such as LangTest, DeepChecks, Trulens, or custom AI evaluation frameworks.
  • Proficiency in test automation using Python, Selenium, PyTest, or similar frameworks.
  • Familiarity with model evaluation metrics such as BLEU, ROUGE, perplexity, and precision-recall for AI-generated content.
  • Knowledge of bias detection, adversarial testing, and ethical AI considerations.
  • Experience working with APIs, cloud platforms (AWS, Azure, GCP), and MLOps practices.
  • Strong analytical and problem-solving skills with attention to detail.
  • Excellent communication and collaboration skills to work in cross-functional teams.

  • AI Testing Specialist

    4 days ago

    Aligarh, Uttar Pradesh, India beBeeArtificial Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job Title: Quality Assurance EngineerWe are seeking a highly skilled and detail-oriented Quality Assurance Engineer with expertise in Generative AI Testing. In this role, you will be responsible for ensuring the accuracy, safety, and performance of AI-driven applications.Key Responsibilities:Design and develop comprehensive test plans for Generative AI...

  • Generative AI Test Engineer

    7 days ago

    Aligarh, Uttar Pradesh, India beBeeArtificialintelligence Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Generative AI Quality Assurance SpecialistWe are seeking a skilled and detail-oriented QA Engineer with expertise in Generative AI Testing to join our team.In this role, you will be responsible for ensuring the accuracy, safety, and performance of AI-driven applications, particularly in the field of Generative AI. You will design and execute test...

  • AI/Machine Learning Automation Specialist

    5 days ago

    Aligarh, Uttar Pradesh, India beBeeAutomation Full time ₹ 20,00,000 - ₹ 25,00,000

    Machine Learning Automation SpecialistWe are seeking a skilled Machine Learning Automation Specialist to join our team.About the RoleThis is an exciting opportunity for a highly motivated and experienced professional to work with us on a variety of machine learning projects. The successful candidate will have strong expertise in designing automation...

  • Test Operations Specialist

    1 day ago

    Aligarh, Uttar Pradesh, India beBeeTest Full time ₹ 9,00,000 - ₹ 12,00,000

    Test Operations SpecialistWe are seeking a Test Operations Specialist to oversee all aspects of test administration.The ideal candidate will be responsible for coordinating test schedules, managing classroom and seating arrangements, supervising test invigilation, and ensuring the smooth and efficient execution of all test-related activities.

  • Highly Skilled AI Psychometrics Developer

    1 day ago

    Aligarh, Uttar Pradesh, India beBeeAI Full time ₹ 6,00,000 - ₹ 8,00,000

    Job DescriptionOur organisation is seeking a highly skilled AI & Psychometrics Specialist to join our R&D and Consulting department.This role combines AI-driven innovation with psychometric expertise to design and improve our assessment tools, while supporting our consulting projects for clients worldwide.As an AI & Psychometrics Specialist, you will be...

  • Test Automation Engineer

    3 days ago

    Aligarh, Uttar Pradesh, India beBeeSoftware Full time ₹ 20,00,000 - ₹ 30,00,000

    Quality Assurance Specialist RoleWe are seeking a skilled Quality Assurance Specialist to join our team. As a Quality Assurance Specialist, you will be responsible for ensuring the quality of software products by identifying and reporting defects.Key Responsibilities:Develop comprehensive test plans to identify defects in software applicationsCollaborate...

  • Automation Testing Specialist

    3 days ago

    Aligarh, Uttar Pradesh, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 20,00,000

    Automation Testing SpecialistThe role requires expertise in designing and implementing automation testing frameworks to enhance the efficiency and quality of software development.Key Responsibilities:Develop and execute automated test scripts using JavaScript or TypeScript.Collaborate with cross-functional teams to identify and prioritize testing...

  • Test Automation Specialist

    24 hours ago

    Aligarh, Uttar Pradesh, India beBeeAutomation Full time ₹ 10,00,000 - ₹ 25,00,000

    Job Role: Test Automation SpecialistWe are looking for an experienced Test Automation Specialist who can help us build reliable test automation.Key Responsibilities:Design and maintain automation scripts using Python + Selenium + Pytest.Run tests across browsers and ensure our CI/CD pipelines remain green.Log and track bugs in JIRA, working closely with...

  • High-Performance AI Engineer

    3 days ago

    Aligarh, Uttar Pradesh, India beBeeOptimization Full time ₹ 15,00,000 - ₹ 25,00,000

    AI Model Optimization SpecialistWe are seeking a skilled AI Model Optimization Specialist to join our team. The successful candidate will be responsible for designing, developing, and maintaining efficient, high-quality Python code to train and optimize AI models.The ideal candidate will have experience with Python programming language concepts, including...

  • Automated Testing Specialist

    1 week ago

    Aligarh, Uttar Pradesh, India beBeeAutomation Full time ₹ 9,00,000 - ₹ 15,00,000

    Automation Engineer PositionWe are seeking a skilled Automation Engineer with expertise in Tricentis Tosca to automate testing for SAP S/4HANA modules.The ideal candidate will have hands-on experience in SAP testing, Tosca automation, and a strong understanding of business processes and testing methodologies.Key Responsibilities:Design, develop, and maintain...