Gen AI Testing

6 days ago

Bengaluru Chennai Hyderabad, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Design and execute test strategies for Gen AI models including LLMs image generators and multimodal systems

Create and maintain test cases and prompt libraries to evaluate model output quality eg relevance coherence creativity factual accuracy

Test model behaviour across different scenarios languages and user intents eg hallucinations bias toxicity safety risks

Perform manual and automated testing of Gen AI APIs chatbots and content generation tools

Validate input output behaviour prompt testing response evaluation token level analysis

Collaborate with engineering teams to implement prompt evaluation frameworks log monitoring and output scoring systems

Track model performance metrics BLEU ROUGE perplexity toxicity score etc and suggest areas for improvement

Conduct fairness bias and safety testing to ensure compliance with ethical and regulatory guidelines

Assist in evaluating AB experiments and fine tuning model behaviours

Document issues clearly and contribute to root cause analysis with dev teams

  • AI-First Android

    2 weeks ago

    Chennai, Tamil Nadu, India Gen Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We're more than just a company; we're a global leader in digital safety. With a strong commitment to ensuring that everyone can navigate the digital world securely, we unite the best minds and cutting-edge technology through our family of brands: Norton, Avast, LifeLock, Avira, AVG, ReputationDefender, and CCleaner. Together, we protect over 500 million...

  • Gen AI

    3 days ago

    Hyderabad, Telangana, India GenAILakes Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Gen AI / AI Engineer (Mid-Level)Location: HyderbadJob Description:We are hiring a Gen AI / AI Engineer with 2+ years of experience in building and deploying AI/ML solutions, especially in Generative AI and RAG (Retrieval-Augmented Generation) architectures. You'll work on state-of-the-art models, fine-tuning, and system integration to build...

  • Automation (Playwright) Developer with Gen AI

    2 weeks ago

    Bengaluru, Chennai, Hyderabad, India Cognizant Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Automation Developer Playwright | JavaScript | TypeScript | Gen AILocation: PAN India (Hybrid)Experience: 5-10 YearsNotice Period: Immediate to 60 DaysEmployment Type: Full-TimeJob DescriptionWe are hiring an Automation Developer with strong expertise in Playwright, JavaScript, and TypeScript, along with exposure to Generative AI tools and...

  • python testing with Gen Ai

    15 hours ago

    Bengaluru, India People Prime Worldwide Full time

    About the CompanyOur client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.Title: Python...

  • python testing with Gen Ai

    1 hour ago

    Bengaluru, India People Prime Worldwide Full time

    About the CompanyOur client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.Title: Python...

  • Gen ai test solution architect

    3 weeks ago

    Bengaluru, India Happiest Minds Technologies Full time

    Role – QE Solution ArchitectBrief Description – Happiest Minds is looking for a seasoned QE Architect with 20+ years’ experience for one of its Tech savvy customers to build nextgen QE solutions delivering exceptional value and customer experience.Key Responsibilities:Define Quality Strategy for evolving modern architecturesConceptualize, Design and...

  • Gen AI

    3 days ago

    Hyderabad, Telangana, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    MLE Responsibilities Design, implement, and maintain back-end API endpoints to support Gen AI and RAG (Retrieval-Augmented Generation) applications. Manage and optimize chat history storage in DynamoDB, ensuring scalability and efficient retrieval. Develop and test integrations with front-end UI components for seamless user experience. (React and...

  • AI-First Android

    17 hours ago

    IND - Tamil Nadu, Chennai, India Gen Digital Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're more than just a company; we're a global leader in digital safety. With a strong commitment to ensuring that everyone can navigate the digital world securely, we unite the best minds and cutting-edge technology through our family of brands: Norton, Avast, LifeLock, Avira, AVG, ReputationDefender, and CCleaner. Together, we protect over 500 million...

  • Automation + Gen AI

    3 days ago

    Chennai, Tamil Nadu, India Cognizant Full time ₹ 2,00,000 - ₹ 6,00,000 per year

    Experience: YearsLocation: ChennaiSkills Required:Java, selenium, cucumber, Junit, API Automation, functional testing, SQL , GEN AI

  • Gen AI

    3 days ago

    Hyderabad, Telangana, India Virtusa Full time ₹ 10,000 - ₹ 50,000 per year

    Primary skills \: Gemini Agent space, AI multi cloud experience, Experience in running AI services, vibe coding(Cursor), VertexSecondary skills \: Terraform, Multi cloud experience (AWS) Excellent programming skills and proficiency in at least one of the major programming scripting languages used in Gen AI orchestration such as Python or PySpark or...