Gen AI Tester

1 week ago

Bengaluru, Karnataka, India Talent Worx Full time ₹ 1,04,000 - ₹ 1,30,878 per year

Job Summary: We are seeking a skilled and detail-oriented Gen AI Tester to join our team. The ideal candidate will be responsible for ensuring the functionality, usability, and overall quality of artificial intelligence models, including natural language processing (NLP), machine learning (ML) systems, and conversational AI applications. The Gen AI Tester will work closely with data scientists, AI engineers, and developers to assess the performance of AI systems, identify potential issues, and improve product outcomes.

Key Responsibilities:

  1. Test AI Models: Conduct rigorous tests on AI systems, including generative models, chatbot platforms, and machine learning algorithms, to assess their effectiveness, accuracy, and usability.
  2. Identify Bugs & Errors: Detect and report system defects, bugs, and AI behavior anomalies. Test for AI's response consistency, context understanding, and the ability to generate relevant outputs.
  3. Evaluate Model Performance: Assess the performance of models against predefined benchmarks and real-world scenarios. Ensure the model's accuracy, robustness, and generalization capabilities.
  4. Conduct Regression Testing: Continuously test updates and improvements to AI systems, ensuring no regression issues or performance drops after model retraining or new version releases.
  5. Collaborate with Teams: Work with AI researchers, data scientists, and development teams to understand the AI models' intended behavior, provide feedback on improvements, and ensure quality control throughout the development lifecycle.
  6. Document Test Results: Maintain detailed documentation of test plans, cases, results, and any issues identified during testing. Provide clear, actionable insights to the development team.
  7. Usability Testing: Evaluate user interfaces (UI) of AI applications, including chatbot dialogues and virtual assistant platforms, to ensure they provide an intuitive and seamless user experience.
  8. Train & Validate Models: Assist in training and fine-tuning AI models based on real-world user feedback and test results. Provide validation to ensure ethical AI standards are met.
  9. Stay Current with Trends: Keep abreast of the latest advancements in AI technology, machine learning, and testing methodologies to continuously improve testing processes.

Skills and Qualifications:

  • Bachelor's degree in Computer Science, Engineering, Data Science, or a related field.
  • Strong knowledge of AI technologies, machine learning frameworks, and NLP.
  • Experience in testing software applications, including automated and manual testing practices.
  • Familiarity with AI tools and platforms (such as TensorFlow, PyTorch, OpenAI, etc.).
  • Knowledge of programming languages like Python, Java, or similar.
  • Ability to troubleshoot, debug, and identify issues in AI models and algorithms.
  • Strong analytical skills and the ability to work with complex systems and data.
  • Excellent attention to detail and critical thinking skills.
  • Effective communication skills to collaborate with cross-functional teams.
  • Prior experience with Generative AI models (like GPT, DALL-E, etc.) is a plus.

Preferred Qualifications:

  • Experience with AI model validation techniques and testing frameworks.
  • Familiarity with cloud-based AI platforms such as AWS, Google Cloud, or Azure.
  • Knowledge of ethical AI principles and bias detection in AI models.
  • Prior experience in user acceptance testing (UAT) for AI systems.

  • Gen AI Testing Professional

    2 days ago

    Bengaluru, Karnataka, India Wipro Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    JD: GenAI Tester AI-Powered Test AutomationKey ResponsibilitiesConduct testing of GenAI solutions embedded in QA and pricing tools.Design REST API test scenarios and validate outputs.Use Streamlit or similar platforms to build test harnesses or visual test dashboards.Validate LLM-generated responses against defined acceptance criteria.Document bugs,...

  • GEN AI Trainer

    7 days ago

    Bengaluru, Karnataka, India MicroDegree Education Private Limited Full time ₹ 4,20,000 per year

    A Generative AI (Gen AI) Courses Trainer's job description emphasizes strong knowledge of AI concepts, proficiency in programming (Python) and AI frameworks (TensorFlow, PyTorch), excellent communication skills to explain complex topics, and practical experience in building Gen AI applications. The role requires the ability to design and deliver training on...

  • Gen AI Architect

    3 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    I hope you're doing well I came across your profile and was impressed by your extensive experience as an/a (mention role/skill). We have a similar opportunity to join our dynamic team at TCS. Role: Gen AI Architect Location: PAN India MODE; full time 10+ years of experience (5+ years in AI/Gen AI is a must). Required Skills: Proven experience in architecting...

  • Gen AI Testing

    2 days ago

    Bengaluru, Karnataka, India Wipro Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job description:Job DescriptionJD: GenAI Tester – AI-Powered Test AutomationKey Responsibilities• Conduct testing of GenAI solutions embedded in QA and pricing tools.• Design REST API test scenarios and validate outputs.• Use Streamlit or similar platforms to build test harnesses or visual test dashboards.• Validate LLM-generated responses...

  • Gen AI Architect

    2 days ago

    Bengaluru, Karnataka, India GyanSys Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job DescriptionOpportunity for Gen Ai Architect (Data Scientist)Experience: 6+yrs Relevant with Gen AiNotice Period: Immediate - 30 daysRequired:Gen AILLMMLOpsRAGLang ChainEarly joiners preferableIf Interested Please share your updated resume on

  • Gen AI Developer

    5 hours ago

    Bengaluru, Karnataka, India HYRGPT Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    The Gen AI Developer role requires hands-on experience in developing AI agents using Python, agentic AI frameworks, generative AI models, and large language models (LLMs). The candidate will apply problem-solving and critical thinking skills to design, implement, and optimize intelligent systems. Collaboration and effective communication are essential for...

  • Gen AI Developer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Sub:TCS Virtual Drive – Gen AI Developer Greetings from Tata Consultancy Services TCS is hiring for Gen AI Developer Experience : 10-16 years Location: PAN India Job Description- Excellent knowledge in Python programming . Hands on experience in Generative AI Prompt Engineering ,Fine-Tuning, RAG Architecture, Langchain. Knowledge of Agentic AI ...

  • Gen AI Architect

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from TATA Consultancy Services We are Looking for Gen AI Architect Experience: 10-20 Years Work Location: Pan India Job Description: Must Have- Gen AI / LLM /Agentic AI Gen AI Experience in LLMs, Embedding Models, Prompt Engineering Knowledge of statistical programming languages like Python Good applied statistical skills Good knowledge of...

  • Gen AI Architect

    4 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Greetings from TATA Consultancy ServicesWe are Looking forGen AI ArchitectExperience:10-20 YearsWork Location:Pan IndiaJob Description:Must Have- Gen AI / LLM /Agentic AIGen AIExperience in LLMs, Embedding Models, Prompt EngineeringKnowledge of statistical programming languages like PythonGood applied statistical skillsGood knowledge of machine learning...

  • Gen AI Engineer

    4 weeks ago

    Bengaluru, Karnataka, India L&T Technology Services Full time

    Job Title: Gen AI Engineer Location: Mysore, Pune, Bangalore, Mumbai L&T Technology Services is seeking a Gen AI Engineer (Experience range - 6+ years) of experience, proficient in: Develop, fine-tune, and integrate LLMs (GPT, LLaMA, Claude, etc.) into enterprise applications. Implement prompt engineering techniques, embeddings, and RAG (Retrieval Augmented...