
QA Automation Engineer
3 days ago
Designation - QA/Automation
Exp - 2yr - 3yrs
Key Responsibilities
Platform & Workflow QA
Build and maintain automation frameworks (Playwright, Postman, PyTest) for
frontend, API, and workflows
Validate workflows (e.g. in n8n) that use agents, knowledgebases, and
external tools
Ensure business-critical flows are error-free, with auto-healing & test
coverage in CI/CD
Agent Behavior & Prompt Evaluation
Design eval suites to validate prompt reliability, response safety, hallucination
rates, and fallback logic
Align with prompt engineers and agent designers to fine-tune behavior across
business verticals
Create test rubrics for accuracy, tone, response time, and user experience
LLM & Retrieval Evaluation
Test performance of retrieval chains (RAG) across agents and use cases
Design regression tests for memory consistency, tool usage, and voice
readiness
QA Automation, AI Evaluation & Solution Engineer 2
Contribute to eval scoring mechanisms (agent correctness, confidence, intent
coverage, etc.)
Client Enablement & Delivery QA
Collaborate with onboarding team to define and enforce QA checkpoints
during rollout
QA client workflows (lead qualification, support agents, surveys, etc.)
Mentor junior team members executing client-level QA and automation tasks
Strategic Quality Oversight
Report platform-wide quality metrics (pass rates, model failure modes,
workflow issues)
Ensure QA is deeply integrated into Dev, Product, and GTM motions
Continuously evolve quality strategy for an agent-first, AI-native platform
What We're Looking For
Must-Haves
6+ years in QA/Automation, with at least 2 years in a Lead or Senior capacity
Strong hands-on skills in Python, Playwright, Postman, and CI/CD pipelines
Experience with n8n, Zapier, or similar workflow/RPA tools
Familiarity with LLM APIs (OpenAI, Anthropic, etc.) and prompt engineering
basics
Clear understanding of Conversational AI, Voice Agents, or Agent-based
workflows
Ownership mindset with the ability to define structure in a fast-moving product
environment
Bonus
QA Automation, AI Evaluation & Solution Engineer 3
Experience testing AI agents with RAG, vector databases, and
LangChain/LLM orchestration
GitHub profile showcasing automation/test projects, prompt eval frameworks,
or agent logic
Familiarity with STT/TTS, telephony, or voice orchestration frameworks like
LiveKit or Twilio
Job Types: Full-time, Permanent
Pay: ₹60, ₹100,000.00 per month
Benefits:
- Cell phone reimbursement
- Health insurance
- Provident Fund
Work Location: In person
-
QA Automation Engineer
2 weeks ago
Vikhroli, India Techstalwarts Software Development LLP Full timeDesignation - QA/Automation Exp - 2yr - 3yrs Key Responsibilities Platform & Workflow QA Build and maintain automation frameworks (Playwright, Postman, PyTest) for frontend, API, and workflows Validate workflows (e.g. in n8n) that use agents, knowledgebases, and external tools Ensure business-critical flows are error-free, with auto-healing & test coverage...
-
Automation QA Engineer
4 weeks ago
Mumbai, Maharashtra, India Tatras Data Full timeJob Title: Automation QA Engineer About Us: We are building high-quality, scalable, and intelligent platforms, and quality is central to everything we do. We are looking for an Automation QA Engineer who doesn't just test software, but helps build it better—with a mindset to break things early, code automation robustly, and ensure exceptional performance...
-
Qa Automation Engineer
5 days ago
Pune, Maharashtra, India Endava Full timeCompany Description Technology is our how And people are our why For over two decades we have been harnessing technology to drive meaningful change By combining world-class engineering industry expertise and a people-centric mindset we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital...
-
Automation QA
7 days ago
Mumbai, Maharashtra, India NxEev Technologies Full timeRemote Automation QA python SQL 5 year's experience Immediately joiner Key Responsibilities Automation Framework Development: Design and implement robust, scalable, and reusable test automation frameworks using Python. Automate functional, regression, and integration test cases. Database Testing: Write and execute SQL queries to validate data...
-
Automation Tester
1 day ago
Mumbai, Maharashtra, India TESTRIQ QA Lab Full time**Benefits**: **Here are just some of the perks you’ll get as a member of**: **Health Care**: Employee State Insurance **Flexibility**: Flexible work hours, Holidays as per Indian calendar, PL, CL, & paid parental leave. **Commute**: Office No: - 2 & 3, 2nd Floor, Ashley Tower, Beverly Park, adj. to PVR Multiplex, Mira Road East, Thane -...
-
QA Automation Engineer
6 days ago
Mumbai, Maharashtra, India Weassemble Full time ₹ 2,00,000 - ₹ 6,00,000 per yearWe are looking for a highly skilled and motivated QA Automation Engineer with at least 3years of exp to join our dynamic teamThe ideal candidate is proactive, detail-oriented and eager to contribute frm day oneStrong hands-on experience with Playwright (JavaScript)Proven expertise in API testing automation (Postman, REST Assured or equivalent)Experience with...
-
Engineer - QA (Automation)
2 days ago
Mumbai, Maharashtra, India Zensoft Services Full time ₹ 9,00,000 - ₹ 12,00,000 per yearWe are seeking a highly skilled and motivated Engineer - QA, Test Automation to join our team in Mumbai. The ideal candidate will play a crucial role in ensuring the quality and reliability of our software by developing and executing automated test scripts. You will be responsible for contributing effectively to project goals, thereby aligning with and...
-
QA Automation Engineer
2 weeks ago
Mumbai, India WeAssemble Full timeWe are looking for a highly skilled QA Automation Engineer with at least 3 years of experience to join our dynamic team in Mumbai. The ideal candidate should be proactive, detail-oriented, and ready to hit the ground running. Key Responsibilities: Design, develop, and execute automated test scripts using industry-standard tools and frameworks. Collaborate...
-
QA Automation Engineer
3 days ago
Hinjewadi, Pune, Maharashtra, India Qodequay Technologies Pvt ltd Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Title: Quality Analyst (QA – Automation, Mendix Mandatory)Location: Pune, MaharashtraExperience: 4+ YearsEmployment Type: Full-TimeAbout UsAt Qodequay Technologies Pvt. Ltd., we specialize in building next-gen IT solutions leveraging AR, VR, MR, and AI. We deliver scalable digital experiences and enterprise-grade applications with a focus on...
-
QA(Automation)
5 days ago
Mumbai, India Acme Services Full time**Roles and Responsibilities** 1. Resource should have in-depth knowledge of App UI automation with BDD framework, Cucumber, - Selenium, Appium and ADB interface. - 2. Well versed in any programming language namely Core Java or python. - 3. Should be able to create an automation framework from scratch. - 4. should be familiar with build management tool such...