Agentic QA Engineer

2 weeks ago

Bengaluru, Karnataka, India Bespoke Technologies Full time ₹ 4,00,000 - ₹ 12,00,000 per year

About the Role

We are looking for an Agentic QA Engineer with 1 - 5 years of experience to test and validate AI agents and automation workflows. The ideal candidate should understand GenAI-based agents, testing methodologies, and quality assurance processes to ensure AI agents perform as expected.

Key Responsibilities

  • Test and validate AI agents to ensure they perform actions accurately and as designed.
  • Develop and execute test cases for different conversational and task-based AI workflows.
  • Analyze test results, identify bugs or performance issues, and collaborate with the engineering team for fixes.
  • Document testing procedures, outcomes, and recommendations for improvement.
  • Ensure that AI agents handle prompts, contexts, and actions correctly.
  • Contribute to the creation of automated QA processes for AI systems.

Required Skills & Qualifications

  • 1 - 5 years of experience in QA, software testing, or AI testing roles.
  • Good understanding of Generative AI, LLM agents, or autonomous AI workflows. Understanding of DeepEval and other AI testing frameworks.
  • Experience with manual testing and familiarity with automation tools.
  • Strong problem-solving, analytical, and communication skills.
  • Ability to work collaboratively with developers, prompt engineers, and data scientists.

Good to Have

  • Exposure to LLM frameworks (LangChain, CrewAI, AutoGen, etc.).
  • Basic programming or scripting knowledge (Java or Python preferred).
  • Understanding of AI evaluation metrics and model performance tuning.Role & responsibilities

  • Senior QA Engineer

    2 weeks ago

    Bengaluru, Karnataka, India DNEG Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Title: Senior QA Engineer – CLEARLocation: BangaloreDepartment: Technology: Product Engineering – CLEARExperience Level: 2-5 yearsRole OverviewWe are seeking a Senior QA Engineer to join the CLEAR product team. In this role, you will be responsible for ensuring the quality and reliability of our enterprise-grade media workflow solutions. You will...

  • Senior QA Engineer

    6 days ago

    Bengaluru, Karnataka, India RemoteEngine Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The RoleWe're looking for a Senior QA Engineer to build our quality assurance, monitoring, and performancetesting infrastructure from the ground up. You'll be our one-stop shop for ensuring product quality across the entire stack—from front-end user experience to backend services to AI agent reasoning.You'll proactively identify issues before they reach...

  • QA Engineer

    1 week ago

    Bengaluru, Karnataka, India Recro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleWe are seeking a highly motivated and detail-oriented Quality Assurance (QA) Engineer to join our team. You will play a key role in ensuring the reliability, accuracy, and user experience of our Conversational AI systems. This role involves testing dialogue models, integrations with NLP/LLM-based backends, and end-to-end conversational...

  • Senior QA Engineer

    2 weeks ago

    Bengaluru, Karnataka, India DNEG Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Title: Senior QA Engineer – CLEARLocation: BangaloreDepartment: Technology: Product Engineering – CLEARExperience Level: 2-5 yearsRole OverviewWe are seeking a Senior QA Engineer to join the CLEAR product team. In this role, you will be responsible for ensuring the quality and reliability of our enterprise-grade media workflow solutions. You will...

  • Agentic AI Quality Assurance Engineer

    2 days ago

    Bengaluru, Karnataka, India Aritone Global Ventures Ltd Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Description : - Location : Bangalore (Work from Office) - Experience : 1- 4 Years Key Responsibilities : - Test and validate AI agents and LLM workflows to ensure correctness and stability. - Design and execute test cases to evaluate agentic behavior, prompt responses, and task accuracy. - Use DeepEval to create and automate evaluation...

  • Senior QA Engineer

    6 hours ago

    Bengaluru, Karnataka, India Tredence Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role descriptionSenior QA Engineer5-8yrsAbout Tredence:Tredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and...

  • Manual QA Engineer

    2 days ago

    Bengaluru, Karnataka, India Metaforms Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    About MetaformsAt Metaforms, we're redefining how market research gets done.Our AI platform empowers the world's leading research agencies to scale 10x faster while maintaining quality. With AI Agents augmenting survey programming, data processing, and project management, we help customers like Dynata, Savanta, and Borderless Access deliver more projects...

  • AI QA Architect

    2 weeks ago

    Bengaluru, Karnataka, India Streamline Healthcare Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience Level: 15+ years in QA, with 3+ years in AI/GenAI solutioningRole OverviewThis role requires a blend of technical depth, AI solution development skills, and architectural vision to drive innovation in Quality Assurance and accelerate intelligent test automation.We are seeking an AI QA Architect with a strong background in Quality Engineering and...

  • Manager, QA Analyst – Agentic AI

    2 days ago

    Bengaluru, Karnataka, India Genpact Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Ready to build the future with AI? At Genpact, we don't just keep up with technology—we set the pace. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how we're scaling advanced technology solutions to help global enterprises work smarter, grow...

  • Senior Manager, QA Analyst – Agentic AI

    3 hours ago

    Bengaluru, Karnataka, India Genpact Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Ready to build the future with AI? At Genpact, we don't just keep up with technology—we set the pace. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how we're scaling advanced technology solutions to help global enterprises work smarter, grow...