Gen AI Tester

2 weeks ago

Bengaluru, Karnataka, India Talent Worx Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Gen AI Tester

Job Title: Generative AI Tester
Experience: 3+ years / 6+ years

Job Description:
We are seeking a detail-oriented Generative AI Tester to validate the quality, reliability, and ethical outputs of AI systems powered by large language models (LLMs). This role focuses on testing prompt responses, evaluating edge cases, and ensuring AI outputs align with business and compliance standards.

Key Responsibilities:

  • Design and execute test cases for Gen AI features and conversational workflows.
  • Validate outputs of LLMs for accuracy, relevance, coherence, and safety.
  • Conduct prompt testing, fine-tuning evaluation, and edge-case scenario validation.
  • Collaborate with AI engineers, product managers, and QA teams to improve test coverage and feedback loops.
  • Document defects, issues, and improvement areas using tools like JIRA or similar.
  • Evaluate AI systems against ethical and fairness benchmarks.

Requirements:

  • 2+ years of experience in QA/testing, with exposure to AI/ML or NLP systems.
  • Familiarity with LLMs (e.g., GPT, Claude, or open-source alternatives).
  • Strong analytical and critical thinking skills for non-deterministic system testing.
  • Experience with test management tools and basic scripting (Python preferred).
  • Good understanding of prompt engineering and model evaluation principles.

Preferred Qualifications:

  • Experience in testing conversational AI, chatbots, or virtual assistants.
  • Understanding of responsible AI practices, including bias and hallucination detection.
  • Exposure to RAG (Retrieval-Augmented Generation) pipelines and vector databases.

  • Gen AI Testing Professional

    2 weeks ago

    Bengaluru, Karnataka, India Wipro Full time US$ 90,000 - US$ 1,20,000 per year

    JD: GenAI Tester AI-Powered Test AutomationKey ResponsibilitiesConduct testing of GenAI solutions embedded in QA and pricing tools.Design REST API test scenarios and validate outputs.Use Streamlit or similar platforms to build test harnesses or visual test dashboards.Validate LLM-generated responses against defined acceptance criteria.Document bugs,...

  • Gen AI Architect

    1 week ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    I hope you're doing well I came across your profile and was impressed by your extensive experience as an/a (mention role/skill). We have a similar opportunity to join our dynamic team at TCS. Role: Gen AI Architect Location: PAN India MODE; full time 10+ years of experience (5+ years in AI/Gen AI is a must). Required Skills: Proven experience in architecting...

  • Gen AI Testing

    2 weeks ago

    Bengaluru, Karnataka, India Wipro Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job description:Job DescriptionJD: GenAI Tester – AI-Powered Test AutomationKey Responsibilities• Conduct testing of GenAI solutions embedded in QA and pricing tools.• Design REST API test scenarios and validate outputs.• Use Streamlit or similar platforms to build test harnesses or visual test dashboards.• Validate LLM-generated responses...

  • Gen AI Developer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Sub:TCS Virtual Drive – Gen AI Developer Greetings from Tata Consultancy Services TCS is hiring for Gen AI Developer Experience : 10-16 years Location: PAN India Job Description- Excellent knowledge in Python programming . Hands on experience in Generative AI Prompt Engineering ,Fine-Tuning, RAG Architecture, Langchain. Knowledge of Agentic AI ...

  • Data Scientist Gen AI

    2 weeks ago

    Bengaluru, Karnataka, India Zensar Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Hi Applicants,We have an urgent demand for Data Scientist Gen AI. Please go through the Job Description below and share your resume if you feel interested. Requirement for Data Scientist Gen AIExperience-5+ YearsLocation-Hyderabad,Pune,BangaloreNotice Period-Immediate to15 daysJob DescriptionDevelop and deploy ML and Gen AI applications using LangChain,...

  • Gen AI Architect

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from TATA Consultancy Services We are Looking for Gen AI Architect Experience: 10-20 Years Work Location: Pan India Job Description: Must Have- Gen AI / LLM /Agentic AI Gen AI Experience in LLMs, Embedding Models, Prompt Engineering Knowledge of statistical programming languages like Python Good applied statistical skills Good knowledge of...

  • Gen AI Architect

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Greetings from TATA Consultancy ServicesWe are Looking forGen AI ArchitectExperience:10-20 YearsWork Location:Pan IndiaJob Description:Must Have- Gen AI / LLM /Agentic AIGen AIExperience in LLMs, Embedding Models, Prompt EngineeringKnowledge of statistical programming languages like PythonGood applied statistical skillsGood knowledge of machine learning...

  • Gen AI Engineer

    1 week ago

    Bengaluru, Karnataka, India L&T Technology Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title: Gen AI EngineerLocation: Mysore, Pune, Bangalore, MumbaiL&T Technology Services is seeking a Gen AI Engineer (Experience range - 6+ years) of experience, proficient in:Develop, fine-tune, and integrate LLMs (GPT, LLaMA, Claude, etc.) into enterprise applications.Implement prompt engineering techniques, embeddings, and RAG (Retrieval Augmented...

  • Gen AI Engineer

    1 week ago

    Bengaluru, Karnataka, India HR Central Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Role: Gen AI Engineer (back-end software development role with a specialization in ML/DL and Generative AI)Company - Supply Chain Management Consulting firmExperience: Candidates must have 5+ years in ML/DL, with a minimum of 2 years specifically in Generative AI solution development.Location: Bangalore (Innovator - ITPL, The HIVE - Mahadevapura, Helios -...

  • Data Science with Gen AI

    2 weeks ago

    Bengaluru, Karnataka, India Dams Consulting Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking a seasoned Data Science with Gen AI Experience and Data Science and Gen AI expertise.