Generative AI Tester

4 weeks ago

Hyderabad, India BB Works Full time

Role Overview :We are seeking a highly skilled Gen AI Tester to design and execute test strategies that ensure the quality, reliability, and accuracy of AI-driven applications, including chatbots, agents, and generative AI tools. This role demands strong expertise in both manual and automated testing, with a focus on validating AI outputs against business requirements and expected behavior.Key Responsibilities :Comprehensive Test Strategy Development :- Design, document, and execute detailed test plans and scenarios for AI chatbots, agents, and tools, ensuring rigorous validation of outputs against defined business rules and AI behavior.- Automated Test Scripting :- Develop, maintain, and enhance automated test scripts using Python, JavaScript, or Bash to streamline and scale testing across AI functionalities.Defect Identification & Documentation :- Proactively identify, log, and track issues within AI models and applications. Provide clear and actionable bug reports with reproducible steps, expected vs. actual outcomes, and severity assessment.Cross-functional Collaboration :- Partner with development, product, and data science teams to align on requirements, validate fixes, and provide feedback across the AI development lifecycle.Continuous Improvement :- Stay updated on emerging tools, techniques, and trends in AI testing and automation. Recommend and implement process improvements to enhance product quality and testing efficiency.Performance & Scalability Testing (Optional) :- Conduct load, stress, and scalability testing on AI models to validate system performance under diverse conditions and user loads.Skills & Qualifications :- Proven AI Testing Experience: Hands-on experience in testing AI-driven applications, conversational AI platforms, or generative AI tools.- Proficient in Scripting & Automation: Strong coding skills in Python, JavaScript, or Bash for test automation.- Analytical Acumen: Ability to interpret complex technical/business requirements and design effective test scenarios.- Testing Expertise: Solid knowledge of manual and automated testing methodologies, including regression, integration, functional, and UAT.- Proactive & Independent: Self-starter with strong ownership, capable of independently identifying testing needs and driving solutions.- Communication Skills: Excellent verbal and written communication, with the ability to provide precise documentation and articulate findings to stakeholders. (ref:hirist.tech)

  • Generative AI Tester

    1 day ago

    Hyderabad, Telangana, India BB works Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role Overview : We are seeking a highly skilled Gen AI Tester to design and execute test strategies that ensure the quality, reliability, and accuracy of AI-driven applications, including chatbots, agents, and generative AI tools. This role demands strong expertise in both manual and automated testing, with a focus on validating AI outputs against...

  • Gen AI Tester

    2 weeks ago

    Hyderabad, Telangana, India Talent Worx Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Gen AI TesterJob Title: Generative AI Tester Experience: 3+ years / 6+ yearsJob Description: We are seeking a detail-oriented Generative AI Tester to validate the quality, reliability, and ethical outputs of AI systems powered by large language models (LLMs). This role focuses on testing prompt responses, evaluating edge cases, and ensuring AI outputs align...

  • QA Tester

    2 weeks ago

    Hyderabad, Telangana, India Soul AI Full time ₹ 9,00,000 - ₹ 10,80,000 per year

    About Us:Soul AI is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize indelivering high-quality human-curated data, AI-first scaled operations services, and more. Based in SF and Hyderabad, we are a young, fast-moving team on a mission to build AI for Good, driving...

  • Ai presales

    3 weeks ago

    Hyderabad, India Multiplier AI Full time

    Role: AI Pre-Sales & Lead Generation Specialist (builds pipeline using content marketing, AI tools, multi channel outreach)Experience : 1 to 4 years Multiplier AI About Multiplier AI Limited Learn to sell AI products You will lead a team reporting to top leadership and founders The KPI is to build a 2m USD pipeline via outreach and marketing. Multiplier AI...

  • Ai presales

    4 weeks ago

    Hyderabad, India Multiplier AI Full time

    Role: AI Pre-Sales & Lead Generation Specialist(builds pipeline using content marketing, AI tools, multi channel outreach)Location : Madhapur, HyderabadExperience : 1 to 4 yearsCompany : Multiplier AIAbout Multiplier AI LimitedGreat opportunity for high learning:Learn to sell AI productsLearn to sell to CXO level in USALearn pharma and healthcare which are...

  • P99Soft - Senior Python Generative AI Tester - Automation Testing

    1 week ago

    Hyderabad, Telangana, India P99SOFT PRIVATE LIMITED Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Title : Sr. Python GenAi TesterExperience : 5+ YearsLocation : Hyderabad (Hybrid)Job Summary : - Test generative AI solutions on AWS, validating LLMs, RAG, prompts, and agentic workflows with n8n and Python libraries like deepchecks and LangChain. Key Requirements (8 Points) : - Test LLM outputs on AWS Bedrock using boto3. - Validate fine-tuned...

  • Generative AI

    2 weeks ago

    Hyderabad, Telangana, India Infoshare soft Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Generative AI EngineerLocation: Hyderabad, IndiaDepartment: Artificial Intelligence / Machine LearningJob Type: Full-time | On-siteExperience Level: Mid-Senior / Senior (48 years preferred)About the Role:We are looking for a talented and passionate Generative AI Engineer to join our AI/ML team in Hyderabad. You will work on cutting-edge projects...

  • Generative AI

    5 days ago

    Hyderabad, Telangana, India KIT Skill HUB Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionJob Title:Generative AI (Gen AI) TrainerLocation:Hyderabad (On-Site)Employment Type:Full-TimeExperience:Minimum 2 years of experience in AI/ML training or industry projects involving Generative AIAbout KIT Skill HubKIT Skill Hub is one of the fastest-growing training and skill development platforms, helping students and professionals build...

  • Generative AI

    1 week ago

    Hyderabad, Telangana, India Criticalriver Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The RoleCriticalRiver is at the forefront of the AI revolution, and we are looking for a visionary Generative & Agentic AI Lead to spearhead our initiatives in this transformative space. You will be responsible for setting the strategy, leading a team of talented engineers, and architecting sophisticated AI solutions that solve complex business problems.This...

  • AI Presales

    4 weeks ago

    Hyderabad, Telangana, India, Telangana Multiplier AI Full time

    Role: AI Pre-Sales & Lead Generation Specialist(builds pipeline using content marketing, AI tools, multi channel outreach)Location: Madhapur, HyderabadExperience: 1 to 4 yearsCompany: Multiplier AIAbout Multiplier AI LimitedGreat opportunity for high learning:Learn to sell AI productsLearn to sell to CXO level in USALearn pharma and healthcare which are one...