Gen AI Tester

3 weeks ago

Bengaluru, India Talent Worx Full time

Job Summary: We are seeking a skilled and detail-oriented Gen AI Tester to join our team. The ideal candidate will be responsible for ensuring the functionality, usability, and overall quality of artificial intelligence models, including natural language processing (NLP), machine learning (ML) systems, and conversational AI applications. The Gen AI Tester will work closely with data scientists, AI engineers, and developers to assess the performance of AI systems, identify potential issues, and improve product outcomes. Key Responsibilities: Test AI Models: Conduct rigorous tests on AI systems, including generative models, chatbot platforms, and machine learning algorithms, to assess their effectiveness, accuracy, and usability. Identify Bugs & Errors: Detect and report system defects, bugs, and AI behavior anomalies. Test for AI's response consistency, context understanding, and the ability to generate relevant outputs. Evaluate Model Performance: Assess the performance of models against predefined benchmarks and real-world scenarios. Ensure the model's accuracy, robustness, and generalization capabilities. Conduct Regression Testing: Continuously test updates and improvements to AI systems, ensuring no regression issues or performance drops after model retraining or new version releases. Collaborate with Teams: Work with AI researchers, data scientists, and development teams to understand the AI models' intended behavior, provide feedback on improvements, and ensure quality control throughout the development lifecycle. Document Test Results: Maintain detailed documentation of test plans, cases, results, and any issues identified during testing. Provide clear, actionable insights to the development team. Usability Testing: Evaluate user interfaces (UI) of AI applications, including chatbot dialogues and virtual assistant platforms, to ensure they provide an intuitive and seamless user experience. Train & Validate Models: Assist in training and fine-tuning AI models based on real-world user feedback and test results. Provide validation to ensure ethical AI standards are met. Stay Current with Trends: Keep abreast of the latest advancements in AI technology, machine learning, and testing methodologies to continuously improve testing processes. Skills and Qualifications: Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field. Strong knowledge of AI technologies, machine learning frameworks, and NLP. Experience in testing software applications, including automated and manual testing practices. Familiarity with AI tools and platforms (such as TensorFlow, PyTorch, OpenAI, etc.). Knowledge of programming languages like Python, Java, or similar. Ability to troubleshoot, debug, and identify issues in AI models and algorithms. Strong analytical skills and the ability to work with complex systems and data. Excellent attention to detail and critical thinking skills. Effective communication skills to collaborate with cross-functional teams. Prior experience with Generative AI models (like GPT, DALL-E, etc.) is a plus. Preferred Qualifications: Experience with AI model validation techniques and testing frameworks. Familiarity with cloud-based AI platforms such as AWS, Google Cloud, or Azure. Knowledge of ethical AI principles and bias detection in AI models. Prior experience in user acceptance testing (UAT) for AI systems.

  • Gen AI Tester

    4 days ago

    Bengaluru, India TalentOla Full time

    Job Title: Gen AI Tester / AI QA Engineer Experience: 6 10 Years Location: (Add Location) Employment Type: Full-time Job Overview We are looking for a skilled Gen AI Tester to validate, evaluate, and ensure the quality and reliability of Generative AI applications and LLM-based solutions. The ideal candidate will have experience in AI/ML testing, prompt...

  • AI Tester

    3 weeks ago

    Bengaluru, India People Prime Worldwide Full time

    About Company Our client is a trusted global innovator of IT and business services. We help clients transform through consulting, industry solutions, business process services, digital & IT modernization and managed services. Our client enables them, as well as society, to move confidently into the digital future. We are committed to our clients’ long-term...

  • AI Tester

    3 weeks ago

    Bengaluru, India People Prime Worldwide Full time

    About Company Our client is a trusted global innovator of IT and business services. We help clients transform through consulting, industry solutions, business process services, digital & IT modernization and managed services. Our client enables them, as well as society, to move confidently into the digital future. We are committed to our clients’ long-term...

  • AI Tester

    3 weeks ago

    Bengaluru, India People Prime Worldwide Full time

    About Company Our client is a trusted global innovator of IT and business services. We help clients transform through consulting, industry solutions, business process services, digital & IT modernization and managed services. Our client enables them, as well as society, to move confidently into the digital future. We are committed to our clients' long-term...

  • Automation Tester Gen Ai

    4 days ago

    Bengaluru, Hyderabad, India BB Works Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Role : Automation Tester Gen AiExperience : 5.5 to 9.5 YearsLocation: HyderabadKey Responsibilities:Comprehensive Test Strategy Development: Design, develop, document and execute comprehensive test plans and scenarios for AI chatbots, Agents and tools, focusing on the rigorous validation of output against established business requirements and expected AI...

  • Gen Ai And Copilot Testing

    1 day ago

    Bengaluru, India Cognizant Full time

    Location : Anywhere in Pan India where Cognizant office is located Work Model : HybridWork Timing : 11 am to 10 pmTotal required Experience : 10 yearsMandatory skills : Gen AI – Copilot Agent Tester (Copilot Studio)Good to have skills : Focus on Generative Answer Validation, Topic & Trigger Logic, Plugin/Action Testing, and Safety/Jailbreak...

  • Gen AI and copilot Testing

    3 days ago

    Greater Bengaluru Area, India Cognizant Full time

    Location : Anywhere in Pan India where Cognizant office is locatedWork Model : HybridWork Timing : 11 am to 10 pmTotal required Experience : 10 yearsMandatory skills : Gen AI – Copilot Agent Tester (Copilot Studio)Good to have skills : Focus on Generative Answer Validation, Topic & Trigger Logic, Plugin/Action Testing, and Safety/Jailbreak TestingNo of...

  • Gen AI and copilot Testing

    3 days ago

    Greater Bengaluru Area, India Cognizant Full time

    Location : Anywhere in Pan India where Cognizant office is located Work Model : Hybrid Work Timing : 11 am to 10 pm Total required Experience : 10 years Mandatory skills : Gen AI – Copilot Agent Tester (Copilot Studio) Good to have skills : Focus on Generative Answer Validation, Topic & Trigger Logic, Plugin/Action Testing, and Safety/Jailbreak Testing No...

  • Gen AI and copilot Testing

    1 day ago

    Greater Bengaluru Area, India Cognizant Full time

    Location : Anywhere in Pan India where Cognizant office is located Work Model : Hybrid Work Timing : 11 am to 10 pm Total required Experience : 10 years Mandatory skills : Gen AI – Copilot Agent Tester (Copilot Studio) Good to have skills : Focus on Generative Answer Validation, Topic & Trigger Logic, Plugin/Action Testing, and Safety/Jailbreak Testing No...

  • Gen AI and copilot Testing

    15 hours ago

    Greater Bengaluru Area, India Cognizant Full time

    Location : Anywhere in Pan India where Cognizant office is located Work Model : Hybrid Work Timing : 11 am to 10 pm Total required Experience : 10 years Mandatory skills : Gen AI – Copilot Agent Tester (Copilot Studio) Good to have skills : Focus on Generative Answer Validation, Topic & Trigger Logic, Plugin/Action Testing, and Safety/Jailbreak Testing No...