AI Quality Assurance Specialist

2 days ago

India beBeeArtificialIntelligence Full time ₹ 1,04,000 - ₹ 1,30,878

Job Title: AI Quality Assurance Specialist

About the Role

We are seeking a skilled and detail-oriented QA Engineer with expertise in Generative AI Testing to join our team.

In this role, you will be responsible for ensuring the accuracy, safety, and performance of AI-driven applications, particularly in the field of Generative AI.

You will design and execute test strategies, develop automation frameworks, and validate AI outputs to maintain high-quality user experiences.

Key Responsibilities:

  • Design, develop, and execute comprehensive test plans for Generative AI models and applications.
  • Validate AI-generated outputs for accuracy, coherence, bias, ethical considerations, and alignment with business requirements.
  • Develop and maintain automated testing frameworks for AI-based applications, ensuring scalability and efficiency.
  • Perform adversarial testing, edge case analysis, and security testing to assess AI vulnerabilities.
  • Collaborate with AI/ML engineers, product managers, and developers to refine model performance and mitigate errors.
  • Monitor AI model drift and ensure consistent performance across different inputs and datasets.
  • Conduct performance testing to evaluate response times, scalability, and reliability of AI systems.
  • Document test cases, test results, and defects while ensuring compliance with AI governance and ethical guidelines.
  • Continuously explore new tools and methodologies to improve AI testing processes.
Requirements

To succeed in this role, you must have:

  • Bachelors or Master's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in Quality Assurance, with at least 1-2 years in AI/ML testing or Generative AI applications.
  • Strong understanding of AI/ML concepts, NLP models, LLMs, and deep learning architectures.
  • Experience with AI testing tools such as LangTest, DeepChecks, Trulens, or custom AI evaluation frameworks.
  • Proficiency in test automation using Python, Selenium, PyTest, or similar frameworks.
  • Familiarity with model evaluation metrics such as BLEU, ROUGE, perplexity, and precision-recall for AI-generated content.
  • Knowledge of bias detection, adversarial testing, and ethical AI considerations.
  • Experience working with APIs, cloud platforms (AWS, Azure, GCP), and MLOps practices.
  • Strong analytical and problem-solving skills with attention to detail.
  • Excellent communication and collaboration skills to work in cross-functional teams.
Benefits

We offer:

  • Opportunity to work on cutting-edge AI products.
  • Collaborate with a team of AI and software experts.
Why Work With Us?

This is an excellent opportunity to advance your career in AI testing and contribute to the development of innovative AI solutions.

  • Quality Assurance Specialist

    17 hours ago

    India beBeeQuality Full time ₹ 24,00,000 - ₹ 48,00,000

    Job Summary:We are seeking a Quality Assurance Specialist to conduct quality audits and call monitoring to ensure adherence to quality standards.Key Responsibilities:Develop and maintain process documentation for quality control procedures.Analyze data using quality control tools such as 7QC, CSAT, Pareto charts, histograms, and fishbones to identify areas...

  • AI Systems Quality Assurance and Automation Specialist

    1 day ago

    India beBeeAutomation Full time ₹ 18,00,000 - ₹ 25,00,000

    About This PositionWe are seeking a skilled Quality Assurance and Automation Specialist to ensure the reliability, efficiency, and robustness of our AI systems and services.Main ResponsibilitiesComprehensive Testing: Conduct thorough testing across all layers, including server load, integration points, and output quality.Test-Driven Development: Apply TDD...

  • ServiceNow Quality Assurance Specialist

    1 week ago

    India beBeeQuality Assurance Full time ₹ 30,00,000 - ₹ 45,00,000

    Job OpportunityWe are seeking a highly skilled ServiceNow QA Specialist to join our team. As a key member of our organization, you will play a crucial role in ensuring the quality and reliability of our ServiceNow applications.This position involves all phases of the software development lifecycle, including design, development, documentation, testing,...

  • Quality Assurance Specialist

    21 hours ago

    India beBeeQuality Full time ₹ 5,00,000 - ₹ 20,00,000

    Job SummaryThis is an exciting opportunity for a highly skilled Quality Assurance Specialist to join our team.

  • Quality Assurance Specialist

    4 days ago

    India beBeeQualityControl Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Quality Assurance Specialist">The ideal candidate will possess a solid foundation in quality assurance principles and be able to implement effective strategies to ensure compliance with industry standards and project requirements.">Develop and manage quality control programs for mechanical, electrical, and plumbing systemsConduct regular site...

  • Software Quality Assurance Specialist

    3 days ago

    India beBeeAutomation Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Software Quality Assurance SpecialistWe are seeking a highly skilled and experienced Software Quality Assurance Specialist to join our team.About the Role:This is an exciting opportunity for a motivated and detail-oriented professional to lead the development and execution of quality assurance strategies and plans. The successful candidate will be...

  • Salesforce Quality Assurance Specialist

    15 hours ago

    India RGP Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    RGP is looking for an experienced and talented quality assurance specialist to join our growing Enterprise Applications IT team. Working closely with RGP's Enterprise Applications team you will support the testing of our Salesforce applications as well as other supporting processes and systems. In this role, the Quality Assurance specialist will be fully...

  • Quality Assurance Automation

    1 day ago

    India Weekday AI Full time ₹ 35,00,000 - ₹ 55,00,000

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 35-55 LPA)Min Experience: 4 yearsJobType: full-timeWe are seeking a highly skilled and detail-oriented Quality Assurance (QA) Automation Engineer with 4–11 years of professional experience in software testing and automation. The ideal candidate will bring strong expertise in designing,...

  • Senior Quality Assurance Specialist

    3 days ago

    India beBeeQuality Full time ₹ 30,00,000 - ₹ 60,00,000

    Job OverviewWe are seeking a highly motivated and detail-oriented Quality Assurance Specialist to join our team. As a QA Specialist, you will play a key role in establishing and evolving formal quality assurance processes.Key ResponsibilitiesEstablishing Quality Processes: Lead the team in the establishment and evolution of formal quality assurance...

  • Senior Quality Assurance Specialist

    1 day ago

    India beBeeQuality Full time ₹ 1,29,60,000 - ₹ 2,16,00,000

    Senior Quality Assurance SpecialistWe are seeking a Senior Quality Assurance Specialist to oversee the implementation of quality processes for major ETO projects from order to handover. This role will ensure close coordination with local Service organizations and central functions (R&D, Marketing, Service, and Quality) to understand customer requirements and...