QA Engineer AI Agent System

1 day ago

Hyderabad, Telangana, India Everite Solutions Full time ₹ 5,00,000 - ₹ 12,00,000 per year

We're looking for a meticulous QA Engineer to lead testing efforts for our multi-agent AI system that automates crew member matching, onboarding, and job tracking. This is a cross-functional QA role where youll validate everything from AI-generated decisions to backend APIs, UI components, and third-party integrations (voice cloning, Twilio).

Youll create and run test plans for 8+ autonomous agents, including LLM-backed agents, and help ensure every part of the system behaves reliably and ethically before, during, and after deployment.

Key Responsibilities:

Manual & Exploratory Testing

  • Understand agent workflows (Job Matcher, Onboarding Agent).
  • Perform manual testing of workflows across:
  • Web UI interfaces
  • LLM responses and validation triggers
  • Communications (email, SMS, voice)
  • Backend API changes
  • Identify issues in agent decision logic (false positives, incorrect matching, onboarding gaps, etc.).

Automated Testing

  • Design and implement automated test scripts for:
  • API endpoints
  • Event/job creation flows
  • Onboarding and contract handling
  • SMS/Email/Voice triggers and responses
  • Use tools like Postman, Selenium, Playwright, or PyTest for scripting.

Test Planning & Documentation

  • Write and manage:
  • Test cases and scenarios for each AI agent.
  • Test Data and Synthetic data preparation (with support from ML team)
  • Regression, functional, and smoke test plans.
  • Edge-case tests for fallbacks, failed calls, no-shows, etc.
  • Document known issues, test coverage, and agent-specific behavior.

QA Reporting

  • Track bugs and raise detailed Jira tickets for:
  • UI/UX inconsistencies
  • API response mismatches
  • Communication errors
  • Model prediction issues (with support from ML team)
  • Report test progress and bug severity regularly to the engineering team.

Collaboration & Feedback Loops

  • Collaborate closely with:
  • AI Engineers to validate LLM and ML behavior.
  • Backend Devs for API consistency and error handling.
  • Voice & Communication Engineers to validate cloned call quality and integrations.
  • Help define agent success metrics from a QA lens (e.g., no incorrect crew matches, no duplicate invites, etc.).

Required Skills & Qualifications:

  • 3-5+ years in QA Engineering or SDET roles
  • Solid understanding of API and integration testing
  • Experience with test automation tools:
  • Postman / Swagger
  • Selenium
  • Python-based testing frameworks (PyTest preferred)
  • Knowledge of version control (Git/Bitbucket) and issue tracking (Jira Issues)

Preferred (Bonus) Experience:

  • Testing systems with AI/ML components or LLM-based applications
  • Familiarity with voice API testing (e.g., Twilio Voice, ElevenLabs output validation)
  • Worked on event-based or on-demand staffing platforms
  • Understanding of CI/CD and QA automation pipelines

Tools You May Work With:

  • Automation & API Tools: Postman, PyTest, Playwright, Selenium
  • Bug Tracking: GitHub Projects, Jira
  • Monitoring Feedback: Azure Monitor / Log Analytics
  • Voice & Message Validation: Call transcripts, email/SMS message logs
  • Other: Google Sheets (Test tracking), Teams (Internal team comms)

  • Agentic AI Intern

    1 day ago

    Hyderabad, Telangana, India Centella AI Therapeutics Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Centella AI is an AI-first organization addressing the critical challenges of drug discovery such as cost and time. Our AI platform, CASCADE utilizes Large Language Models (LLMs) to design drug-like molecules with improved safety and efficacy while significantly reducing costs. We are looking for passionate Agentic AI intern interested to work at the...

  • AI Engineer

    1 day ago

    Hyderabad, Telangana, India Deccan AI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Location:Hyderabad (On-site/Hybrid)Company:Deccan AIEmployment Type:Full-TimeExperience:1–3 YearsAbout Deccan AIDeccan AI is at the forefront of building advanced AI solutions for real-world applications. We're passionate about pushing the boundaries of artificial intelligence, natural language processing, and intelligent agent systems. Join us and work...

  • ServiceNow AI Agent Engineer

    4 weeks ago

    Hyderabad, Telangana, India Accelyst, LLC Full time

    Accelyst is an innovative AI Consultancy that leverages a unique catalog of industry specific Agents and leading-edge AI platforms to deliver tangible, integrated, secure and ROI-optimized solutions. We combine deep industry and technical expertise to enable rapid deployment of innovative AI-driven capabilities to augment and automate client workflows for...

  • AI Engineer

    3 days ago

    Hyderabad, Telangana, India Helios Core AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Helios-Core | Hyderabad, IndiaAre you an AI engineer with a passion for building conversational and agentic AI systems? Do you want to work on a small, fast-paced team where your contributions have a direct and measurable impact? If so, we want to hear from you.At Helios-Core, we are on a mission to build a more secure and efficient digital world. We're a...

  • Agentic AI Developer

    23 hours ago

    Hyderabad, Telangana, India Subhujo Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About the Role:We are seeking a highly skilled and innovative Agentic AI Developer to join our AI team. The ideal candidate will have hands-on experience building autonomous AI agents and workflows using frameworks like Crew AI, LlamaIndex, LangGraph, Copilot Studio, and other cutting-edge agentic AI technologies. Strong proficiency in Python is essential...

  • Agentic AI Engineer

    4 days ago

    Hyderabad, Telangana, India Techolution Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the job : Are you ready to shape the future of AI? As an Agentic AI Engineer at Techolution, you'll be at the forefront of innovation, fine-tuning cutting-edge LLMs like Gemini, LLaMA, and GPT. Dive deep into the world of Generative AI , vector databases, and deep learning frameworks to create groundbreaking solutions. Your expertise in...

  • Principal - AI/ML Engineer (Agents and Agentic Design)

    4 weeks ago

    Hyderabad, Telangana, India Amgen Inc Full time

    Job DescriptionAmgen is seeking a Principal AI/ML Engineer with deep expertise in multi-agent system design and agentic architectures to drive the next generation of enterprise AI innovation.In this role, you will spearhead the development of scalable, secure, and intelligent agent-based AI/ML platforms, while mentoring teams, setting technical direction,...

  • Lead AI Engineer

    1 week ago

    Hyderabad, Telangana, India Weekday AI Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    This role is for Weekday's client.Role OverviewAs the Lead AI Engineer, you will be responsible for spearheading the design, development, and deployment of AI solutions. You will work with various large language models (LLMs)—both open-source and proprietary—optimizing them through fine-tuning, prompt engineering, agentic frameworks, and...

  • Agentic AI Developer

    1 day ago

    Hyderabad, Telangana, India Prajava Technologies Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Designation - Agentic AI DeveloperWork Location - Hyderabad (Hybrid)Experience - 0 to 2 yearsKey ResponsibilitiesAgentic AI Development:Build, customize, and deploy AI agents using frameworks like LangChain, AutoGen, CrewAI, and Haystack.Enable agent reasoning, planning, and tool-use for complex tasks.RAG Pipeline Design:Implement and optimize RAG pipelines...

  • Agentic AI Engineer

    1 week ago

    Hyderabad, Telangana, India techolution Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Are you ready to shape the future of AI? As anAgentic AI Engineerat Techolution, you'll be at the forefront of innovation, fine-tuning cutting-edge LLMs like Gemini, LLaMA, and GPT. Dive deep into the world of Generative AI , vector databases, and deep learning frameworks to create groundbreaking solutions. Your expertise in Python, LLMs, and Agentic...