QA Engineer AI Agent System

2 days ago

Hyderabad, Telangana, India Everite Solutions Full time ₹ 5,00,000 - ₹ 12,00,000 per year

We're looking for a meticulous QA Engineer to lead testing efforts for our multi-agent AI system that automates crew member matching, onboarding, and job tracking. This is a cross-functional QA role where youll validate everything from AI-generated decisions to backend APIs, UI components, and third-party integrations (voice cloning, Twilio).

Youll create and run test plans for 8+ autonomous agents, including LLM-backed agents, and help ensure every part of the system behaves reliably and ethically before, during, and after deployment.

Key Responsibilities:

Manual & Exploratory Testing

  • Understand agent workflows (Job Matcher, Onboarding Agent).
  • Perform manual testing of workflows across:
  • Web UI interfaces
  • LLM responses and validation triggers
  • Communications (email, SMS, voice)
  • Backend API changes
  • Identify issues in agent decision logic (false positives, incorrect matching, onboarding gaps, etc.).

Automated Testing

  • Design and implement automated test scripts for:
  • API endpoints
  • Event/job creation flows
  • Onboarding and contract handling
  • SMS/Email/Voice triggers and responses
  • Use tools like Postman, Selenium, Playwright, or PyTest for scripting.

Test Planning & Documentation

  • Write and manage:
  • Test cases and scenarios for each AI agent.
  • Test Data and Synthetic data preparation (with support from ML team)
  • Regression, functional, and smoke test plans.
  • Edge-case tests for fallbacks, failed calls, no-shows, etc.
  • Document known issues, test coverage, and agent-specific behavior.

QA Reporting

  • Track bugs and raise detailed Jira tickets for:
  • UI/UX inconsistencies
  • API response mismatches
  • Communication errors
  • Model prediction issues (with support from ML team)
  • Report test progress and bug severity regularly to the engineering team.

Collaboration & Feedback Loops

  • Collaborate closely with:
  • AI Engineers to validate LLM and ML behavior.
  • Backend Devs for API consistency and error handling.
  • Voice & Communication Engineers to validate cloned call quality and integrations.
  • Help define agent success metrics from a QA lens (e.g., no incorrect crew matches, no duplicate invites, etc.).

Required Skills & Qualifications:

  • 3-5+ years in QA Engineering or SDET roles
  • Solid understanding of API and integration testing
  • Experience with test automation tools:
  • Postman / Swagger
  • Selenium
  • Python-based testing frameworks (PyTest preferred)
  • Knowledge of version control (Git/Bitbucket) and issue tracking (Jira Issues)

Preferred (Bonus) Experience:

  • Testing systems with AI/ML components or LLM-based applications
  • Familiarity with voice API testing (e.g., Twilio Voice, ElevenLabs output validation)
  • Worked on event-based or on-demand staffing platforms
  • Understanding of CI/CD and QA automation pipelines

Tools You May Work With:

  • Automation & API Tools: Postman, PyTest, Playwright, Selenium
  • Bug Tracking: GitHub Projects, Jira
  • Monitoring Feedback: Azure Monitor / Log Analytics
  • Voice & Message Validation: Call transcripts, email/SMS message logs
  • Other: Google Sheets (Test tracking), Teams (Internal team comms)

  • AI Engineer

    1 day ago

    Hyderabad, Telangana, India Deccan AI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Location:Hyderabad (On-site/Hybrid)Company:Deccan AIEmployment Type:Full-TimeExperience:1–3 YearsAbout Deccan AIDeccan AI is at the forefront of building advanced AI solutions for real-world applications. We're passionate about pushing the boundaries of artificial intelligence, natural language processing, and intelligent agent systems. Join us and work...

  • Agentic AI Engineer

    7 days ago

    Hyderabad, Telangana, India Kyndryl Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Who We AreAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.The RoleAs an...

  • Agentic AI Engineer

    7 days ago

    Hyderabad, Telangana, India Kyndryl Full time ₹ 2,00,00,000 - ₹ 2,50,00,000 per year

    Who We AreAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.The RoleAs an...

  • Senior Qa Engineer

    7 days ago

    Hyderabad, Telangana, India Everite Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    We're looking for a meticulous Sr. QA Engineer to design the testing framework from scratch for our multi-agent AI system that automates crew member matching, onboarding, and job tracking. This is a cross-functional QA role where youll validate everything from AI-generated decisions to backend APIs, UI components, and third-party integrations (voice cloning,...

  • AI Engineer

    1 week ago

    Hyderabad, Telangana, India Transnational Ai Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    • Contribute to planning, building & maintaining agentic AI workflows• Work with LLMs, vector stores, prompt engineering & RAG pipelines.• Integrate agents with internal APIs, external tools, databases, & cloud services. Required Candidate profile• B.Tech / B.E. / M.Tech in Computer Science, AI, Data Science, or related fields.• Strong programming...

  • Agentic AI Developer

    1 day ago

    Hyderabad, Telangana, India Subhujo Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About the Role:We are seeking a highly skilled and innovative Agentic AI Developer to join our AI team. The ideal candidate will have hands-on experience building autonomous AI agents and workflows using frameworks like Crew AI, LlamaIndex, LangGraph, Copilot Studio, and other cutting-edge agentic AI technologies. Strong proficiency in Python is essential...

  • Agentic AI Developer

    1 week ago

    Hyderabad, Telangana, India InterScripts, Inc. Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    We are seeking an experienced Agentic AI Developer to design and deploy advanced AI systems that reason, plan, and act autonomously. The ideal candidate will have hands-on experience integrating leading LLMs (Claude, OpenAI, ChatGPT, Gemini, etc.), developing multi-agent architectures, and working with cloud-based AI platforms such as Azure AI Foundry, AI...

  • Agentic AI Developer

    5 days ago

    Hyderabad, Telangana, India Consultant Prabhu Hari Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Work Timing: 2 PM to 11 PMWork Experience: Minimum 5 to 11 YearsJob Summary:We are seeking an experienced Agentic AI Developer to design and deploy advanced AI systems that reason, plan, and act autonomously. The ideal candidate will have hands-on experience integrating leading LLMs (Claude, OpenAI, ChatGPT, Gemini, etc.), developing multi-agent...

  • Agentic AI Engineer

    3 days ago

    Hyderabad, Telangana, India Techolution Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the job : Are you ready to shape the future of AI? As an Agentic AI Engineer at Techolution, you'll be at the forefront of innovation, fine-tuning cutting-edge LLMs like Gemini, LLaMA, and GPT. Dive deep into the world of Generative AI , vector databases, and deep learning frameworks to create groundbreaking solutions. Your expertise in...

  • Agentic AI Engineer

    1 week ago

    Hyderabad, Telangana, India Brad Contech Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for Agentic AI Developers with 2–3 years of experience in automation and AI development to work onsite from our office. The ideal candidate will have hands-on experience in n8n, LangChain, or similar frameworks, building intelligent agents that integrate APIs, data sources, and enterprise systems. You will contribute to designing and...