Gen AI Tester

4 weeks ago

Bengaluru, Karnataka, India Talent Worx Full time

Job Summary: We are seeking a skilled and detail-oriented Gen AI Tester to join our team. The ideal candidate will be responsible for ensuring the functionality, usability, and overall quality of artificial intelligence models, including natural language processing (NLP), machine learning (ML) systems, and conversational AI applications. The Gen AI Tester will work closely with data scientists, AI engineers, and developers to assess the performance of AI systems, identify potential issues, and improve product outcomes.

Key Responsibilities:

  1. Test AI Models: Conduct rigorous tests on AI systems, including generative models, chatbot platforms, and machine learning algorithms, to assess their effectiveness, accuracy, and usability.
  2. Identify Bugs & Errors: Detect and report system defects, bugs, and AI behavior anomalies. Test for AI's response consistency, context understanding, and the ability to generate relevant outputs.
  3. Evaluate Model Performance: Assess the performance of models against predefined benchmarks and real-world scenarios. Ensure the model's accuracy, robustness, and generalization capabilities.
  4. Conduct Regression Testing: Continuously test updates and improvements to AI systems, ensuring no regression issues or performance drops after model retraining or new version releases.
  5. Collaborate with Teams: Work with AI researchers, data scientists, and development teams to understand the AI models' intended behavior, provide feedback on improvements, and ensure quality control throughout the development lifecycle.
  6. Document Test Results: Maintain detailed documentation of test plans, cases, results, and any issues identified during testing. Provide clear, actionable insights to the development team.
  7. Usability Testing: Evaluate user interfaces (UI) of AI applications, including chatbot dialogues and virtual assistant platforms, to ensure they provide an intuitive and seamless user experience.
  8. Train & Validate Models: Assist in training and fine-tuning AI models based on real-world user feedback and test results. Provide validation to ensure ethical AI standards are met.
  9. Stay Current with Trends: Keep abreast of the latest advancements in AI technology, machine learning, and testing methodologies to continuously improve testing processes.

Skills and Qualifications:

  • Bachelor's degree in Computer Science, Engineering, Data Science, or a related field.
  • Strong knowledge of AI technologies, machine learning frameworks, and NLP.
  • Experience in testing software applications, including automated and manual testing practices.
  • Familiarity with AI tools and platforms (such as TensorFlow, PyTorch, OpenAI, etc.).
  • Knowledge of programming languages like Python, Java, or similar.
  • Ability to troubleshoot, debug, and identify issues in AI models and algorithms.
  • Strong analytical skills and the ability to work with complex systems and data.
  • Excellent attention to detail and critical thinking skills.
  • Effective communication skills to collaborate with cross-functional teams.
  • Prior experience with Generative AI models (like GPT, DALL-E, etc.) is a plus.

Preferred Qualifications:

  • Experience with AI model validation techniques and testing frameworks.
  • Familiarity with cloud-based AI platforms such as AWS, Google Cloud, or Azure.
  • Knowledge of ethical AI principles and bias detection in AI models.
  • Prior experience in user acceptance testing (UAT) for AI systems.

  • Gen AI Systems Tester

    5 days ago

    Bengaluru, Karnataka, India Talent Worx Full time

    We are looking for a highly skilled Gen AI Systems Tester to join our team at Talent Worx. As a Gen AI Systems Tester, you will play a critical role in ensuring the functionality, usability, and overall quality of our artificial intelligence models.Responsibilities:Test AI Models: Conduct rigorous tests on AI systems, including generative models, chatbot...

  • Gen AI Tester

    4 weeks ago

    Bengaluru, Karnataka, India Talent Worx Full time

    Job Summary: We are seeking a skilled and detail-oriented Gen AI Tester to join our team. The ideal candidate will be responsible for ensuring the functionality, usability, and overall quality of artificial intelligence models, including natural language processing (NLP), machine learning (ML) systems, and conversational AI applications. The Gen AI Tester...

  • Gen AI Tester

    2 days ago

    Bengaluru, Karnataka, India Talent Worx Full time

    Job DescriptionJob Summary: We are seeking a skilled and detail-oriented Gen AI Tester to join our team. The ideal candidate will be responsible for ensuring the functionality, usability, and overall quality of artificial intelligence models, including natural language processing (NLP), machine learning (ML) systems, and conversational AI applications. The...

  • Gen AI Systems Tester

    1 day ago

    Bengaluru, Karnataka, India Talent Worx Full time

    Job SummaryAs a Gen AI Tester at Talent Worx, you will be responsible for testing and validating our AI systems to ensure they meet the highest standards of quality and performance.Test AI Models: Conduct rigorous tests on AI systems, including generative models, chatbot platforms, and machine learning algorithms, to assess their effectiveness, accuracy, and...

  • Gen AI Performance Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Talent Worx Full time

    Talent Worx is seeking a highly skilled Gen AI Tester to join our team. The ideal candidate will be responsible for ensuring the quality and reliability of artificial intelligence models.Job Description:Test AI Models: Conduct rigorous tests on AI systems to assess their effectiveness, accuracy, and usability.

  • AI Tester

    4 weeks ago

    Bengaluru, Karnataka, India Qualitest Group Full time

    Level- AI Tester Experience: 5 to 7 years Location : Bangalore/ Hyderabad/ Chennai & Noida Website : https://www.qualitestgroup.com/  Job Description:Ready to make a difference? Join our dynamic and forward-thinking teamModel Evaluation & Testing: Design and execute comprehensive test cases to evaluate generative AI models for accuracy, relevance, bias,...

  • gen ai

    2 days ago

    Bengaluru, Karnataka, India Virtusa Full time

    GEN AI - CREQ185678 Description Gen AI Integration Developer: Extensive implementation experience in data analytics space or a senior developer role in one of the modern technology stack Excellent programming skills and proficiency in at least one of the major programming scripting languages used in Gen AI orchestration such as Python or PySpark or Java...

  • Gen AI

    2 days ago

    Bengaluru, Karnataka, India Commonwealth Bank Full time

    Organization: At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and...

  • Gen AI

    2 days ago

    Bengaluru, Karnataka, India Commonwealth Bank Full time

    Organization: At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and...

  • Gen AI

    2 days ago

    Bengaluru, Karnataka, India Commonwealth Bank Full time

    Organization: At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas and energy...

  • Gen AI

    2 days ago

    Bengaluru, Karnataka, India Virtusa Full time

    Gen AI - CREQ185679 Description Gen AI Extensive implementation experience in data analytics space or a senior developer role in one of the modern technology stack Excellent programming skills and proficiency in at least one of the major programming scripting languages used in Gen AI orchestration such as Python or PySpark or Java Ability to build API...

  • Gen AI Architect

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Gen AI ArchitectSound knowledge of Gen AI Landscape, Llama models, Nova models, Titan Models, Claude models, GPT models, Langchain, Embedding, knowledge Graph, Lang graph, Bedrock, Sage maker, Polly, Lex, Vector DB, Embedding and KendraKnowledge of Core AWS Services such as EC2, S3, Lambda, Kinesis, API Gateway, DynamoDB, IAM, Redshift, GlueExperience in...

  • Gen ai engineer

    2 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    LTIMindtree is looking for Gen AI EngineerTotal Experience- 5 to 8 YearsJob Location- Pan IndiaJob Summary:AI Engineer, Gen AI, NLP, Python, RAG, Azure, ML, Deep Learning• AI Engineer, Python and Gen AI• Developed multiple products features Deep Learning, NLP, Graph analytics, Cognitive search, Image processing Process Automation, Lang Graph and Lang...

  • gen ai

    3 weeks ago

    Bengaluru, Karnataka, India HCLTech Full time

    About the jobGreetings HCL TECHWalkin Interview for GEN AI roleDate: 1st March, 2025Walkin Time: 9:30 AM to 5:00 PMDrive Venue: Kochi, Kerala, 682030Role: GEN AIJob Location: Bangalore, IndiaJob Details:Mandatory Skills: AI/ ML, NLP, Python, SQLRDBMS: Basic Table structure, data types, keys, data integrity, E-R diagrams and data normalizationSQL Basics:...

  • Gen AI Model Architect

    11 hours ago

    Bengaluru, Karnataka, India Wipro Limited Full time

    **Job Description**We are looking for a highly skilled Deep Learning Engineer to join our team and contribute to the development of advanced gen AI models and algorithms.The ideal candidate will have solid experience in developing and implementing gen AI models, with a strong understanding of deep learning techniques such as GPT, VAE, and...

  • Gen AI Engineer

    2 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    LTIMindtree is looking for Gen AI EngineerTotal Experience- 5 to 8 YearsJob Location- Pan IndiaJob Summary:AI Engineer, Gen AI, NLP, Python, RAG, Azure, ML, Deep Learning• AI Engineer, Python and GenAI• Developed multiple products features Deep Learning, NLP, Graph analytics, Cognitive search, Image processing Process Automation, LangGraph and...

  • Gen AI Engineer

    5 days ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    LTIMindtree is looking for Gen AI EngineerTotal Experience- 5 to 8 YearsJob Location- Pan IndiaJob Summary:AI Engineer, Gen AI, NLP, Python, RAG, Azure, ML, Deep Learning• AI Engineer, Python and GenAI• Developed multiple products features Deep Learning, NLP, Graph analytics, Cognitive search, Image processing Process Automation, LangGraph and...

  • Gen AI Technical Lead

    5 days ago

    Bengaluru, Karnataka, India Tessolve Semiconductor Private Limited Full time

    About the RoleWe are looking for a talented Gen AI Technical Lead to join our team at Tessolve Semiconductor Private Limited. As a key member of our team, you will be responsible for designing and building advanced Gen AI plugins and services that streamline workflows and develop novel solutions to tackle complex challenges.Your expertise in Microsoft Gen AI...

  • Microsoft Azure Gen AI Specialist

    5 days ago

    Bengaluru, Karnataka, India Tessolve Semiconductor Private Limited Full time

    Job DescriptionTessolve Semiconductor Private Limited is seeking a highly skilled Microsoft Azure Gen AI Specialist to join our team. As a specialist in Gen AI, you will be responsible for leading the development of innovative Gen AI solutions using Microsoft Azure. Your extensive experience in designing and building advanced Gen AI plugins and services will...

  • Gen AI Engineer

    4 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    LTIMindtree is looking for Gen AI EngineerTotal Experience- 5 to 8 YearsJob Location- Pan IndiaJob Summary:AI Engineer, Gen AI, NLP, Python, RAG, Azure, ML, Deep Learning• AI Engineer, Python and GenAI• Developed multiple products features Deep Learning, NLP, Graph analytics, Cognitive search, Image processing Process Automation, LangGraph and...