AI Testing and Validation Expert

5 hours ago

Varanasi, Uttar Pradesh, India beBeeGenerativeai Full time ₹ 15,00,000 - ₹ 20,00,000

Job Title: AI Testing Specialist

\

Description: We are seeking a skilled and detail-oriented testing specialist with expertise in Generative AI to ensure the accuracy, safety, and performance of AI-driven applications.
The ideal candidate will have experience in designing, developing, and executing comprehensive test plans for Generative AI models and applications.

\
  • Key Responsibilities:\
  • Design, develop, and execute comprehensive test plans for Generative AI models and applications.\
  • Validate AI-generated outputs for accuracy, coherence, bias, ethical considerations, and alignment with business requirements.\
  • Develop and maintain automated testing frameworks for AI-based applications, ensuring scalability and efficiency.\
  • Perform adversarial testing, edge case analysis, and security testing to assess AI vulnerabilities.\
  • Collaborate with AI/ML engineers, product managers, and developers to refine model performance and mitigate errors.\
  • Monitor AI model drift and ensure consistent performance across different inputs and datasets.\
  • Conduct performance testing to evaluate response times, scalability, and reliability of AI systems.\
  • Document test cases, test results, and defects while ensuring compliance with AI governance and ethical guidelines.\
  • Continuously explore new tools and methodologies to improve AI testing processes.
\

Requirements:

\
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.\
  • 3+ years of experience in Quality Assurance, with at least 1-2 years in AI/ML testing or Generative AI applications.\
  • Strong understanding of AI/ML concepts, NLP models, LLMs, and deep learning architectures.\
  • Experience with AI testing tools such as LangTest, DeepChecks, Trulens, or custom AI evaluation frameworks.\
  • Proficiency in test automation using Python, Selenium, PyTest, or similar frameworks.\
  • Familiarity with model evaluation metrics such as BLEU, ROUGE, perplexity, and precision-recall for AI-generated content.\
  • Knowledge of bias detection, adversarial testing, and ethical AI considerations.\
  • Experience working with APIs, cloud platforms (AWS, Azure, GCP), and MLOps practices.\
  • Strong analytical and problem-solving skills with attention to detail.\
  • Excellent communication and collaboration skills to work in cross-functional teams.

  • AI Expert

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeArtificialIntelligence Full time ₹ 20,00,000 - ₹ 25,00,000

    Expertise in Artificial IntelligenceI am excited to share this exceptional opportunity with you, leveraging your impressive experience as an expert in AI.Role: AI ExpertLocation: Nationwide Mode: Full Time Technical Skill Set Required:Proficient in Python, API development, Knowledge on cloud technologies (e.g., Azure/GCP/AWS services). Experienced with...

  • AI Expert

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeExpert Full time ₹ 1,50,00,000 - ₹ 1,80,00,000

    Artificial Intelligence ExpertWe are seeking a highly skilled and experienced expert in the field of Artificial Intelligence to join our organization.This role involves designing, developing, and deploying AI/ML models in areas such as natural language processing, computer vision, and large language models.Main Responsibilities:Design and develop AI/ML...

  • AI Data Management Engineer

    7 days ago

    Varanasi, Uttar Pradesh, India beBeeDataStorage Full time ₹ 15,00,000 - ₹ 25,00,000

    This is a unique opportunity to be part of a pioneering team shaping the future of AI and data management.Job Overview:As a software development engineer in test (SDET/Sr.SDET), you will work on validating high-performance storage solutions for HPC and AI markets.Key Responsibilities:Design and develop automated and manual test cases to validate product...

  • AI System Developer

    4 days ago

    Varanasi, Uttar Pradesh, India beBeeAI Full time ₹ 30,00,000 - ₹ 40,00,000

    **Job Title:** Senior AI SpecialistJob DescriptionWe're looking for a seasoned professional to lead the development of industrial-grade AI systems that transform complex data into actionable insights.The ideal candidate will have extensive experience designing and implementing large-scale AI/ML solutions, with expertise in Python 3.11+, SQL, and strong...

  • Chief AI Innovation Officer

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeArtificialIntelligence Full time US$ 1,50,000 - US$ 2,00,000

    AI ArchitectWe are seeking a visionary AI Architect with 15–18 years of experience in enterprise-scale AI solutions, including deep expertise in fine-tuning foundational models.Lead the design and architecture of AI solutions using Large Language Models (LLMs) and advanced conversational AI frameworks.Fine-tune LLMs and Sequence Learning Models (SLMs)...

  • Financial Process Validator

    8 hours ago

    Varanasi, Uttar Pradesh, India beBeeTransformation Full time ₹ 10,00,000 - ₹ 20,00,000

    Finance Transformation SpecialistWe are seeking a highly skilled Finance Transformation Specialist to join our team. This role will focus on validating end-to-end financial processes, with a strong emphasis on penny testing, subledger reconciliation, and cash lifecycle testing (bank statement matching, AR/AP, treasury payments).Develop and execute test cases...

  • Advanced MES Validation Specialist

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeManufacturing Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: MES Support TestingWe are seeking a seasoned Manufacturing Execution Systems (MES) specialist to validate and support the implementation of MES in pharmaceutical manufacturing environments.Main Responsibilities:Develop comprehensive test strategies, execute test plans, test cases, and scripts for MES implementations.Verify electronic batch...

  • Junior AI Officer

    2 weeks ago

    Varanasi, Uttar Pradesh, India Webflowing Full time

    We're Hiring: Junior AI Officer (m/f/d) Location: Remote / Hybrid (HQ) Start date: As soon as possible Company: Webflowing – AI-driven innovation for the next generation of workflows About Us At Webflowing, we're building AI-powered solutions that help teams work smarter, automate repetitive tasks, and unlock new ways of collaborating. As a...

  • AI Foundations Assessment Specialist

    1 day ago

    Varanasi, Uttar Pradesh, India beBeeExpert Full time US$ 1,00,000 - US$ 1,20,000

    Subject Matter Expert for Generative AI FoundationsWe are seeking a highly skilled Subject Matter Expert (SME) to develop high-quality assessment items for a certification course focused on Generative AI Foundations. The SME will collaborate with a cross-functional team to create clear, standards-aligned assessment items that help students master key...

  • Playwright Automation Testing Expert

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeplaywright Full time ₹ 18,00,000 - ₹ 24,00,000

    Automation Tester - Playwright Expert Wanted Are you passionate about software testing and automation? We are seeking an experienced Automation Tester with expertise in Playwright to join our team.Job Description Greetings from our esteemed organization! We are hiring for an Automation Tester with a focus on Playwright. As an Automation Tester, you will be...