
QA Automation Engineer
1 day ago
Designation - QA/Automation
Exp - 2yr - 3yrs
Key Responsibilities
Platform & Workflow QA
Build and maintain automation frameworks (Playwright, Postman, PyTest) for
frontend, API, and workflows
Validate workflows (e.g. in n8n) that use agents, knowledgebases, and
external tools
Ensure business-critical flows are error-free, with auto-healing & test
coverage in CI/CD
Agent Behavior & Prompt Evaluation
Design eval suites to validate prompt reliability, response safety, hallucination
rates, and fallback logic
Align with prompt engineers and agent designers to fine-tune behavior across
business verticals
Create test rubrics for accuracy, tone, response time, and user experience
LLM & Retrieval Evaluation
Test performance of retrieval chains (RAG) across agents and use cases
Design regression tests for memory consistency, tool usage, and voice
readiness
QA Automation, AI Evaluation & Solution Engineer 2
Contribute to eval scoring mechanisms (agent correctness, confidence, intent
coverage, etc.)
Client Enablement & Delivery QA
Collaborate with onboarding team to define and enforce QA checkpoints
during rollout
QA client workflows (lead qualification, support agents, surveys, etc.)
Mentor junior team members executing client-level QA and automation tasks
Strategic Quality Oversight
Report platform-wide quality metrics (pass rates, model failure modes,
workflow issues)
Ensure QA is deeply integrated into Dev, Product, and GTM motions
Continuously evolve quality strategy for an agent-first, AI-native platform
What We're Looking For
Must-Haves
6+ years in QA/Automation, with at least 2 years in a Lead or Senior capacity
Strong hands-on skills in Python, Playwright, Postman, and CI/CD pipelines
Experience with n8n, Zapier, or similar workflow/RPA tools
Familiarity with LLM APIs (OpenAI, Anthropic, etc.) and prompt engineering
basics
Clear understanding of Conversational AI, Voice Agents, or Agent-based
workflows
Ownership mindset with the ability to define structure in a fast-moving product
environment
Bonus
QA Automation, AI Evaluation & Solution Engineer 3
Experience testing AI agents with RAG, vector databases, and
LangChain/LLM orchestration
GitHub profile showcasing automation/test projects, prompt eval frameworks,
or agent logic
Familiarity with STT/TTS, telephony, or voice orchestration frameworks like
LiveKit or Twilio
Job Types: Full-time, Permanent
Pay: ₹60, ₹100,000.00 per month
Benefits:
- Cell phone reimbursement
- Health insurance
- Provident Fund
Work Location: In person
-
Qa Automation Engineer
4 weeks ago
Pune, Maharashtra, India Endava Full timeCompany Description Technology is our how And people are our why For over two decades we have been harnessing technology to drive meaningful change By combining world-class engineering industry expertise and a people-centric mindset we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital...
-
QA Automation
5 days ago
Mumbai, Maharashtra, India Ingram Micro Full timeIt's fun to work in a company where people truly BELIEVE in what they're doing! **Job Description**: Ingram Micro touches 80% of the technology you use every day with our focus on Technology Solutions, Cloud, and Commerce and Lifecycle Solutions. With $50 billion in revenue, we have become the world’s largest technology distributor with operations in 64...
-
QA Automation Engineer
2 weeks ago
Pune, Maharashtra, India, Maharashtra TransPerfect Full timeOVERVIEW:The ideal candidate is a QA Engineer with experience in both Manual and Automation Testing and demonstrates the ability to: multitask in a fast-paced environment, work well with people from a variety of different backgrounds and cultures, build relationships with co-workers, work independently and as part of a team, take active measures to solve...
-
QA Automation Engineer
2 weeks ago
Mumbai, Maharashtra, India Wärtsilä Corporation Full time ₹ 12,00,000 - ₹ 36,00,000 per yearQA Automation Engineer - Digital Port SolutionsWärtsilä is a world leader in marine technology and leading the industry's transformation towards a decarbonised and sustainable future. With the world's widest portfolio and service network, we – Wärtsilians - deliver efficient, safe and sustainable integrated products and solutions to enhance the business...
-
QA Automation Engineer
7 days ago
Pune, Maharashtra, India, Maharashtra Persistent Systems Full timeAbout Position:We are looking for a skilled QA Automation Engineer with over 4 years of experience to join our team. The ideal candidate will have strong hands-on expertise in automation tools and frameworks, and a passion for delivering high-quality software products.Role: QA Automation EngineerLocation: All Persistent LocationsExperience: 4+ yearsJob Type:...
-
QA Automation Engineer
6 days ago
Mumbai, Maharashtra, India Weassemble Full time ₹ 2,00,000 - ₹ 6,00,000 per yearWe are looking for a highly skilled and motivated QA Automation Engineer with at least 3years of exp to join our dynamic teamThe ideal candidate is proactive, detail-oriented and eager to contribute frm day oneStrong hands-on experience with Playwright (JavaScript)Proven expertise in API testing automation (Postman, REST Assured or equivalent)Experience with...
-
QA Automation Lead
2 weeks ago
Goregaon, Mumbai, Maharashtra, India sportzinteractive Full time ₹ 20,00,000 - ₹ 25,00,000 per yearAbout the Role :As our QA & Automation Lead, you will be at the forefront of shaping and scaling our quality engineering function. Reporting directly to the CDO, you'll take ownership of a talented team of 8–10 QA engineers across delivery units and responsible for maturing and scaling our quality assurance practices his is a strategic role that requires a...
-
QA Automation Testing
2 weeks ago
Mumbai, Maharashtra, India Enrich and Enlight Business Consulting Pvt Ltd Full time**General Description** **Primary Responsibilities** - Development of automation test scripts - Coordination of testing activities - Identify software weakness and target areas - Testing estimation & end to end execution of required testing. - Manual testing **Required Skills**: - More than 6 years of work experience in QA automation testing. -...
-
QA Automation
7 days ago
Mumbai, India Acme Services Full time**Roles and Responsibilities** **3.Cucumber** **4.Junit** **5.Rest API** Role: Software Development - Other - Salary: Not Disclosed by Recruiter - Industry: Software Product - Functional Area: Engineering - Software & QA - Role Category: Software Development - Employment Type: Full Time, Permanent - Key Skills QA Automation - Education - UG: Any...
-
QA Automation Engineer
1 day ago
Hinjewadi, Pune, Maharashtra, India Qodequay Technologies Pvt ltd Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Title: Quality Analyst (QA – Automation, Mendix Mandatory)Location: Pune, MaharashtraExperience: 4+ YearsEmployment Type: Full-TimeAbout UsAt Qodequay Technologies Pvt. Ltd., we specialize in building next-gen IT solutions leveraging AR, VR, MR, and AI. We deliver scalable digital experiences and enterprise-grade applications with a focus on...