Gen Ai Testing

5 days ago

Chennai Tamil Nadu, India Virtusa Full time

Design and execute test strategies for Gen AI models including LLMs image generators and multimodal systems

Create and maintain test cases and prompt libraries to evaluate model output quality eg relevance coherence creativity factual accuracy

Test model behaviour across different scenarios languages and user intents eg hallucinations bias toxicity safety risks

Perform manual and automated testing of Gen AI APIs chatbots and content generation tools

Validate input output behaviour prompt testing response evaluation token level analysis

Collaborate with engineering teams to implement prompt evaluation frameworks log monitoring and output scoring systems

Track model performance metrics BLEU ROUGE perplexity toxicity score etc and suggest areas for improvement

Conduct fairness bias and safety testing to ensure compliance with ethical and regulatory guidelines

Assist in evaluating AB experiments and fine tuning model behaviours

Document issues clearly and contribute to root cause analysis with dev teams

** About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Gen AI Testing

    2 weeks ago

    Bengaluru, Chennai, Hyderabad, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Design and execute test strategies for Gen AI models including LLMs image generators and multimodal systemsCreate and maintain test cases and prompt libraries to evaluate model output quality eg relevance coherence creativity factual accuracyTest model behaviour across different scenarios languages and user intents eg hallucinations bias toxicity safety...

  • AI-First Android

    3 weeks ago

    Chennai, India Gen Full time

    We're more than just a company; we're a global leader in digital safety. With a strong commitment to ensuring that everyone can navigate the digital world securely, we unite the best minds and cutting-edge technology through our family of brands: Norton, Avast, LifeLock, Avira, AVG, ReputationDefender, and CCleaner. Together, we protect over 500 million...

  • Gen AI Testing

    1 week ago

    Chennai, Tamil Nadu, India Wipro Full time ₹ 10,00,000 - ₹ 15,00,000 per year

    Job DescriptionJob Title: Gen AI TestingCity: ChennaiState/Province: Tamil NaduPosting Start Date: 11/25/25Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of...

  • SDET – QA With Gen AI

    4 days ago

    Chennai, Tamil Nadu, India, Tamil Nadu Datum Technologies Group Full time

    Job Details:Job Title: SDET – QA With Gen AIDuration: Contract (On the Payroll of Datum Technology Group)Location: Chennai || Mumbai || Gurugram Interview Process: Virtual (2 Rounds) + 1 Technical screening.Job Description:API testingPythonCloud experience, preferably AzureCI CD tools experience, preferably GH actionsExperience with SQL and NoSQL...

  • AI driven iOS Engineer

    3 days ago

    Chennai, Tamil Nadu, India Gen Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    We're more than just a company; we're a global leader in digital safety. With a strong commitment to ensuring that everyone can navigate the digital world securely, we unite the best minds and cutting-edge technology through our family of brands: Norton, Avast, LifeLock, Avira, AVG, ReputationDefender, and CCleaner. Together, we protect over 500 million...

  • AI driven iOS Engineer

    3 days ago

    Chennai, Tamil Nadu, India Gen Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're more than just a company; we're a global leader in digital safety. With a strong commitment to ensuring that everyone can navigate the digital world securely, we unite the best minds and cutting-edge technology through our family of brands: Norton, Avast, LifeLock, Avira, AVG, ReputationDefender, and CCleaner. Together, we protect over 500 million...

  • Sr. Principal AI Platform Engineer

    2 weeks ago

    Chennai, India Gen Full time

    Who Are We? We’re not just a company; we’re a global force. Fiercely committed to ensuring that everyone, everywhere, can live their lives digitally safe. Our family of brands – Norton, Avast, LifeLock, Avira, AVG, ReputationDefender and CCleaner – unite the brightest minds, the sharpest tech and the most diverse thinking to protect over 500 million...

  • Sr. Principal AI Platform Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Gen Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Who Are We?We're not just a company; we're a global force. Fiercely committed to ensuring that everyone, everywhere, can live their lives digitally safe. Our family of brands – Norton, Avast, LifeLock, Avira, AVG, ReputationDefender and CCleaner – unite the brightest minds, the sharpest tech and the most diverse thinking to protect over 500 million...

  • Princ Penetration Tester

    2 weeks ago

    Chennai, Tamil Nadu, India Gen Digital Full time

    Who Are We? We are a team that brought you Norton, Avast, LifeLock, Avira, AVG, ReputationDefender, and CCleaner, dedicated to providing cybersecurity, privacy, and identity protection to over 500 million users in 150 countries. At Gen, we offer flexible working options, generous time off, and competitive benefits in a diverse and inclusive environment where...

  • SDET - QA With Gen AI

    4 days ago

    Chennai, India Datum Technologies Group Full time

    Job Details: Job Title: SDET - QA With Gen AI Duration: Contract (On the Payroll of Datum Technology Group) Location: Chennai Mumbai Gurugram Interview Process: Virtual (2 Rounds) + 1 Technical screening. Job Description: - API testing - Python - Cloud experience, preferably Azure - CI CD tools experience, preferably GH actions - Experience with SQL and...