QA Engineer AI Agent System

3 days ago

Hyderabad, Telangana, India Everite Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

We're looking for a meticulous QA Engineer to lead testing efforts for our multi-agent AI system that automates crew member matching, onboarding, and job tracking. This is a cross-functional QA role where youll validate everything from AI-generated decisions to backend APIs, UI components, and third-party integrations (voice cloning, Twilio).

Youll create and run test plans for 8+ autonomous agents, including LLM-backed agents, and help ensure every part of the system behaves reliably and ethically before, during, and after deployment.

Key Responsibilities:

Manual & Exploratory Testing

  • Understand agent workflows (Job Matcher, Onboarding Agent).
  • Perform manual testing of workflows across:
  • Web UI interfaces
  • LLM responses and validation triggers
  • Communications (email, SMS, voice)
  • Backend API changes
  • Identify issues in agent decision logic (false positives, incorrect matching, onboarding gaps, etc.).

Automated Testing

  • Design and implement automated test scripts for:
  • API endpoints
  • Event/job creation flows
  • Onboarding and contract handling
  • SMS/Email/Voice triggers and responses
  • Use tools like Postman, Selenium, Playwright, or PyTest for scripting.

Test Planning & Documentation

  • Write and manage:
  • Test cases and scenarios for each AI agent.
  • Test Data and Synthetic data preparation (with support from ML team)
  • Regression, functional, and smoke test plans.
  • Edge-case tests for fallbacks, failed calls, no-shows, etc.
  • Document known issues, test coverage, and agent-specific behavior.

QA Reporting

  • Track bugs and raise detailed Jira tickets for:
  • UI/UX inconsistencies
  • API response mismatches
  • Communication errors
  • Model prediction issues (with support from ML team)
  • Report test progress and bug severity regularly to the engineering team.

Collaboration & Feedback Loops

  • Collaborate closely with:
  • AI Engineers to validate LLM and ML behavior.
  • Backend Devs for API consistency and error handling.
  • Voice & Communication Engineers to validate cloned call quality and integrations.
  • Help define agent success metrics from a QA lens (e.g., no incorrect crew matches, no duplicate invites, etc.).

Required Skills & Qualifications:

  • 3-5+ years in QA Engineering or SDET roles
  • Solid understanding of API and integration testing
  • Experience with test automation tools:
  • Postman / Swagger
  • Selenium
  • Python-based testing frameworks (PyTest preferred)
  • Knowledge of version control (Git/Bitbucket) and issue tracking (Jira Issues)

Preferred (Bonus) Experience:

  • Testing systems with AI/ML components or LLM-based applications
  • Familiarity with voice API testing (e.g., Twilio Voice, ElevenLabs output validation)
  • Worked on event-based or on-demand staffing platforms
  • Understanding of CI/CD and QA automation pipelines

Tools You May Work With:

  • Automation & API Tools: Postman, PyTest, Playwright, Selenium
  • Bug Tracking: GitHub Projects, Jira
  • Monitoring Feedback: Azure Monitor / Log Analytics
  • Voice & Message Validation: Call transcripts, email/SMS message logs
  • Other: Google Sheets (Test tracking), Teams (Internal team comms)

  • Agentic AI Intern

    3 days ago

    Hyderabad, Telangana, India Centella AI Therapeutics Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Centella AI is an AI-first organization addressing the critical challenges of drug discovery such as cost and time. Our AI platform, CASCADE utilizes Large Language Models (LLMs) to design drug-like molecules with improved safety and efficacy while significantly reducing costs. We are looking for passionate Agentic AI intern interested to work at the...

  • Agentic AI Engineer

    3 weeks ago

    Hyderabad, Telangana, India Saicon Full time

    Agentic AI Engineer REMOTE Full Time - Permanent Position We are seeking a talented Agentic AI Engineer to design, develop, and deploy intelligent agent systems that can autonomously reason, plan, and act to achieve complex objectives. You will work at the cutting edge of AI, combining advancements in LLMs, autonomous reasoning frameworks, reinforcement...

  • AI Engineer

    3 days ago

    Hyderabad, Telangana, India Deccan AI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Location:Hyderabad (On-site/Hybrid)Company:Deccan AIEmployment Type:Full-TimeExperience:1–3 YearsAbout Deccan AIDeccan AI is at the forefront of building advanced AI solutions for real-world applications. We're passionate about pushing the boundaries of artificial intelligence, natural language processing, and intelligent agent systems. Join us and work...

  • ServiceNow AI Agent Engineer

    6 days ago

    Hyderabad, Telangana, India Accelyst, LLC Full time

    Accelyst is an innovative AI Consultancy that leverages a unique catalog of industry specific Agents and leading-edge AI platforms to deliver tangible, integrated, secure and ROI-optimized solutions. We combine deep industry and technical expertise to enable rapid deployment of innovative AI-driven capabilities to augment and automate client workflows for...

  • AI Engineer

    3 days ago

    Hyderabad, Telangana, India Helios Core AI Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Helios-Core | Hyderabad, IndiaAre you an AI engineer with a passion for building conversational and agentic AI systems? Do you want to work on a small, fast-paced team where your contributions have a direct and measurable impact? If so, we want to hear from you.At Helios-Core, we are on a mission to build a more secure and efficient digital world. We're a...

  • Senior Agentic AI Engineer

    1 day ago

    Hyderabad, Telangana, India Bradsol Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We're Hiring:Senior Agentic AI Engineer – Azure & Copilot StudioLocation:Hyderabad | OnsiteAre you passionate about the future ofautonomous agents, AI orchestration, and Microsoft's Copilot ecosystem?JoinBRADSOLas aSenior Agentic AI Engineer, where you'll lead the design and development of the next generation ofintelligent, context-aware workflowspowered...

  • AI Systems Engineer

    2 days ago

    Hyderabad, Telangana, India beBeeArtificial Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking skilled professionals to join our team as AI Engineers. This is a fantastic opportunity to gain practical experience working on real-world AI applications.A key aspect of this role is conducting research and development on specific AI problems critical to power system operations, leveraging vast datasets spanning decades.The...

  • Principal - AI/ML Engineer (Agents and Agentic Design)

    1 week ago

    Hyderabad, Telangana, India Amgen Inc Full time

    Job DescriptionAmgen is seeking a Principal AI/ML Engineer with deep expertise in multi-agent system design and agentic architectures to drive the next generation of enterprise AI innovation.In this role, you will spearhead the development of scalable, secure, and intelligent agent-based AI/ML platforms, while mentoring teams, setting technical direction,...

  • Agentic AI Developer

    2 days ago

    Hyderabad, Telangana, India Subhujo Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About the Role:We are seeking a highly skilled and innovative Agentic AI Developer to join our AI team. The ideal candidate will have hands-on experience building autonomous AI agents and workflows using frameworks like Crew AI, LlamaIndex, LangGraph, Copilot Studio, and other cutting-edge agentic AI technologies. Strong proficiency in Python is essential...

  • AI Agent Development Engineer

    3 days ago

    Hyderabad, Telangana, India Smartncode Full time US$ 1,50,000 - US$ 2,00,000 per year

    About the Role:We are seeking a highly motivated and technically proficient AI Agent Development Engineer to join our advanced AI team. In this role, you will design, build, and deploy intelligent, autonomous AI agents that leverage Generative AI, Reinforcement Learning, and Natural Language Processing (NLP) to perform complex, dynamic tasks across diverse...