AI Assurance Specialist

19 hours ago

Surat, Gujarat, India beBeeAssurance Full time ₹ 80,00,000 - ₹ 1,50,00,000

Job Title: AI Assurance Specialist

Location: Flexible - Remote or Hybrid

Job Type: Full-time

Job Description:

We are seeking a skilled and detail-oriented AI Assurance Specialist to ensure the accuracy, safety, and performance of AI-driven applications. In this role, you will be responsible for designing, developing, and executing comprehensive test plans for Generative AI models and applications.

Key Responsibilities:

  • Validate AI-generated outputs for accuracy, coherence, bias, ethical considerations, and alignment with business requirements.
  • Develop and maintain automated testing frameworks for AI-based applications, ensuring scalability and efficiency.
  • Perform adversarial testing, edge case analysis, and security testing to assess AI vulnerabilities.
  • Collaborate with AI/ML engineers, product managers, and developers to refine model performance and mitigate errors.
  • Monitor AI model drift and ensure consistent performance across different inputs and datasets.
  • Conduct performance testing to evaluate response times, scalability, and reliability of AI systems.
  • Document test cases, test results, and defects while ensuring compliance with AI governance and ethical guidelines.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in Quality Assurance, with at least 1-2 years in AI/ML testing or Generative AI applications.
  • Strong understanding of AI/ML concepts, NLP models, LLMs, and deep learning architectures.
  • Experience with AI testing tools such as LangTest, DeepChecks, Trulens, or custom AI evaluation frameworks.
  • Proficiency in test automation using Python, Selenium, PyTest, or similar frameworks.
  • Familiarity with model evaluation metrics such as BLEU, ROUGE, perplexity, and precision-recall for AI-generated content.
  • Knowledge of bias detection, adversarial testing, and ethical AI considerations.
  • Experience working with APIs, cloud platforms (AWS, Azure, GCP), and MLOps practices.
  • Strong analytical and problem-solving skills with attention to detail.
  • Excellent communication and collaboration skills to work in cross-functional teams.

Benefits:

  • Opportunity to work on cutting-edge AI products.
  • Collaborate with a team of AI and software experts.
  • Competitive salary, benefits, and career growth opportunities.

  • Software Quality Assurance Specialist

    1 day ago

    Surat, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 23,00,000

    Job Opportunity:Software Quality Assurance SpecialistWe are seeking an experienced professional to fill the role of Software Quality Assurance Specialist. The ideal candidate will have a strong background in software testing and experience with data reconciliation.The successful candidate will possess excellent analytical skills, be able to work...

  • Assurance Compliance Professional

    2 days ago

    Surat, Gujarat, India beBeeRegulatory Full time ₹ 6,00,000 - ₹ 15,00,000

    Quality Assurance SpecialistJob Description:The Quality Assurance Specialist will oversee the implementation and maintenance of quality management systems across all stages of research and laboratory operations. This involves monitoring, reviewing, and ensuring compliance with regulatory guidelines, internal quality standards, and client...

  • AI Software Developer

    2 days ago

    Surat, Gujarat, India beBeeDataScience Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Artificial Intelligence SpecialistJob Summary:We are seeking a highly skilled Artificial Intelligence Specialist to join our team. As an AI specialist, you will design, develop, and test AI software to effectively process large datasets and achieve optimal results.Responsibilities:Design, develop, and test AI software using programming languages such as...

  • Generative AI Python Senior Specialist

    2 weeks ago

    Surat, Gujarat, India Coforge Full time

    Job Title: Generative AI Python Senior SpecialistLocation: Greater NoidaExperience: 7+ YearsJob Summary:Coforge is seeking a skilled Generative AI Python Senior Specialist to design and implement AI/ML and GenAI solutions. The ideal candidate will have strong programming and statistical skills, with hands-on experience in building and deploying LLM-based...

  • Highly Skilled Quality Assurance Specialist

    5 days ago

    Surat, Gujarat, India beBeeQualityAssurance Full time ₹ 10,00,000 - ₹ 15,00,000

    **Job Description:**We are seeking a highly skilled quality assurance specialist to join our team. In this role, you will be responsible for designing, developing, and executing comprehensive test plans and test cases for Microsoft Dynamics 365 Customer Insights - Data (CI-D) and Journeys (CI-J) implementations.You will validate the integrity, mapping, and...

  • Software Quality Assurance Specialist

    1 day ago

    Surat, Gujarat, India beBeeEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Quality Assurance ExpertWe are seeking a highly skilled Quality Assurance Engineer to ensure the quality and performance of retail search integrations, validate data pipelines, and execute end-to-end testing to guarantee an exceptional customer experience in e-commerce search environments.Key Responsibilities:Design, develop, and execute test cases for...

  • AI Test Automation Specialist

    19 hours ago

    Surat, Gujarat, India beBeeSoftwareDeveloper Full time ₹ 60,00,000 - ₹ 1,50,00,000

    About Our TeamWe are a pioneering industrial-AI start-up accelerating Industry 4.0 adoption by helping manufacturers extract more value from their legacy infrastructure and build Smart Manufacturing Factories.Our Smart Industry platform empowers subject matter experts to create and deploy AI and IIoT applications, increasing productivity and operational...

  • Quality Assurance Specialist

    3 days ago

    Surat, Gujarat, India beBeeSpecialist Full time ₹ 80,00,000 - ₹ 1,20,00,000

    We are looking for a Quality Assurance Specialist to ensure the quality and reliability of our mobile apps, web platform, backend systems, and machine learning-powered features.Becoming a key member of our team, you will be responsible for performing manual functional, regression, and exploratory testing for mobile apps (iOS & Android), web apps, and backend...

  • Optimizing AI Prompts for Financial Applications

    1 day ago

    Surat, Gujarat, India beBeeFinTech Full time ₹ 5,00,000 - ₹ 10,00,000

    FinTech AI Specialist InternWe are looking for a highly motivated and skilled FinTech AI Specialist Intern to join our team. The ideal candidate will have a strong background in artificial intelligence, machine learning, and data analysis.The successful applicant will be responsible for designing, developing, and optimizing AI prompts and workflows to...

  • Product Quality Assurance Professional

    56 minutes ago

    Surat, Gujarat, India beBeeQuality Full time ₹ 60,00,000 - ₹ 1,00,00,000

    Job Title: Quality Assurance Specialist">We are seeking a detail-oriented and passionate individual to fill the role of Quality Assurance Specialist. You will work closely with our technical team to ensure a seamless learning experience for students.">Main Responsibilities:">Develop, execute, and maintain test plans, test cases, and test scripts.">Perform...