Gen AI Tester
4 days ago
Job Title: Gen AI Tester / AI QA Engineer Experience: 6 10 Years Location: (Add Location) Employment Type: Full-time Job Overview We are looking for a skilled Gen AI Tester to validate, evaluate, and ensure the quality and reliability of Generative AI applications and LLM-based solutions. The ideal candidate will have experience in AI/ML testing, prompt testing, model performance evaluation, automation, and validating RAG and LLM workflows. Key Responsibilities Test and validate LLM-based applications , Gen AI workflows, and chatbot interactions Perform prompt testing , scenario testing, hallucination detection, and response validation Validate RAG pipelines including data ingestion, embeddings, vector search, and retrieval accuracy Execute functional, non-functional, and usability testing for Gen AI systems Evaluate model performance using precision, recall, BLEU, ROUGE, and other metrics Create test plans, test cases, and defect reports for AI applications Test APIs, microservices, and backend integrations involving AI models Work closely with data engineers, ML engineers, and developers to improve model output Perform automation testing using Python, PyTest, or similar frameworks Validate guardrails, content safety, and ethical AI compliance Must-Have Skills Strong experience in AI/ML application testing Hands-on knowledge of LLMs, Gen AI tools (OpenAI, Azure OpenAI, Gemini, etc.) Experience with prompt engineering and prompt evaluation Understanding of RAG architecture, embeddings, vector DBs (FAISS, Pinecone, Chroma) Strong knowledge of Python for automation/testing Experience in testing REST APIs Ability to identify hallucinations, bias, toxicity, and response inconsistencies Good to Have Knowledge of Azure ML, AWS Sagemaker, or GCP AI Platform Experience with MLOps tools Familiarity with test automation frameworks Understanding of NLP concepts AI/ML related certifications Education Bachelor's degree in Computer Science, IT, or related field
-
Gen AI Tester
3 weeks ago
Bengaluru, India Talent Worx Full timeJob Summary: We are seeking a skilled and detail-oriented Gen AI Tester to join our team. The ideal candidate will be responsible for ensuring the functionality, usability, and overall quality of artificial intelligence models, including natural language processing (NLP), machine learning (ML) systems, and conversational AI applications. The Gen AI Tester...
-
AI Tester
3 weeks ago
Bengaluru, India People Prime Worldwide Full timeAbout Company Our client is a trusted global innovator of IT and business services. We help clients transform through consulting, industry solutions, business process services, digital & IT modernization and managed services. Our client enables them, as well as society, to move confidently into the digital future. We are committed to our clients’ long-term...
-
AI Tester
3 weeks ago
Bengaluru, India People Prime Worldwide Full timeAbout Company Our client is a trusted global innovator of IT and business services. We help clients transform through consulting, industry solutions, business process services, digital & IT modernization and managed services. Our client enables them, as well as society, to move confidently into the digital future. We are committed to our clients’ long-term...
-
AI Tester
3 weeks ago
Bengaluru, India People Prime Worldwide Full timeAbout Company Our client is a trusted global innovator of IT and business services. We help clients transform through consulting, industry solutions, business process services, digital & IT modernization and managed services. Our client enables them, as well as society, to move confidently into the digital future. We are committed to our clients' long-term...
-
Automation Tester Gen Ai
3 days ago
Bengaluru, Hyderabad, India BB Works Full time ₹ 4,00,000 - ₹ 12,00,000 per yearRole : Automation Tester Gen AiExperience : 5.5 to 9.5 YearsLocation: HyderabadKey Responsibilities:Comprehensive Test Strategy Development: Design, develop, document and execute comprehensive test plans and scenarios for AI chatbots, Agents and tools, focusing on the rigorous validation of output against established business requirements and expected AI...
-
Gen Ai And Copilot Testing
1 day ago
Bengaluru, India Cognizant Full timeLocation : Anywhere in Pan India where Cognizant office is located Work Model : HybridWork Timing : 11 am to 10 pmTotal required Experience : 10 yearsMandatory skills : Gen AI – Copilot Agent Tester (Copilot Studio)Good to have skills : Focus on Generative Answer Validation, Topic & Trigger Logic, Plugin/Action Testing, and Safety/Jailbreak...
-
Gen AI and copilot Testing
3 days ago
Greater Bengaluru Area, India Cognizant Full timeLocation : Anywhere in Pan India where Cognizant office is locatedWork Model : HybridWork Timing : 11 am to 10 pmTotal required Experience : 10 yearsMandatory skills : Gen AI – Copilot Agent Tester (Copilot Studio)Good to have skills : Focus on Generative Answer Validation, Topic & Trigger Logic, Plugin/Action Testing, and Safety/Jailbreak TestingNo of...
-
Gen AI and copilot Testing
2 days ago
Greater Bengaluru Area, India Cognizant Full timeLocation : Anywhere in Pan India where Cognizant office is located Work Model : Hybrid Work Timing : 11 am to 10 pm Total required Experience : 10 years Mandatory skills : Gen AI – Copilot Agent Tester (Copilot Studio) Good to have skills : Focus on Generative Answer Validation, Topic & Trigger Logic, Plugin/Action Testing, and Safety/Jailbreak Testing No...
-
Gen AI and copilot Testing
1 day ago
Greater Bengaluru Area, India Cognizant Full timeLocation : Anywhere in Pan India where Cognizant office is located Work Model : Hybrid Work Timing : 11 am to 10 pm Total required Experience : 10 years Mandatory skills : Gen AI – Copilot Agent Tester (Copilot Studio) Good to have skills : Focus on Generative Answer Validation, Topic & Trigger Logic, Plugin/Action Testing, and Safety/Jailbreak Testing No...
-
Gen AI and copilot Testing
7 hours ago
Greater Bengaluru Area, India Cognizant Full timeLocation : Anywhere in Pan India where Cognizant office is located Work Model : Hybrid Work Timing : 11 am to 10 pm Total required Experience : 10 years Mandatory skills : Gen AI – Copilot Agent Tester (Copilot Studio) Good to have skills : Focus on Generative Answer Validation, Topic & Trigger Logic, Plugin/Action Testing, and Safety/Jailbreak Testing No...
