QA Automation Engineer

2 days ago


Vikhroli Mumbai Maharashtra, India Techstalwarts Software Development LLP Full time ₹ 10,00,000 - ₹ 12,00,000 per year

Designation - QA/Automation

Exp - 2yr - 3yrs

Key Responsibilities

Platform & Workflow QA

Build and maintain automation frameworks (Playwright, Postman, PyTest) for

frontend, API, and workflows

Validate workflows (e.g. in n8n) that use agents, knowledgebases, and

external tools

Ensure business-critical flows are error-free, with auto-healing & test

coverage in CI/CD

Agent Behavior & Prompt Evaluation

Design eval suites to validate prompt reliability, response safety, hallucination

rates, and fallback logic

Align with prompt engineers and agent designers to fine-tune behavior across

business verticals

Create test rubrics for accuracy, tone, response time, and user experience

LLM & Retrieval Evaluation

Test performance of retrieval chains (RAG) across agents and use cases

Design regression tests for memory consistency, tool usage, and voice

readiness

QA Automation, AI Evaluation & Solution Engineer 2

Contribute to eval scoring mechanisms (agent correctness, confidence, intent

coverage, etc.)

Client Enablement & Delivery QA

Collaborate with onboarding team to define and enforce QA checkpoints

during rollout

QA client workflows (lead qualification, support agents, surveys, etc.)

Mentor junior team members executing client-level QA and automation tasks

Strategic Quality Oversight

Report platform-wide quality metrics (pass rates, model failure modes,

workflow issues)

Ensure QA is deeply integrated into Dev, Product, and GTM motions

Continuously evolve quality strategy for an agent-first, AI-native platform

What We're Looking For

Must-Haves

6+ years in QA/Automation, with at least 2 years in a Lead or Senior capacity

Strong hands-on skills in Python, Playwright, Postman, and CI/CD pipelines

Experience with n8n, Zapier, or similar workflow/RPA tools

Familiarity with LLM APIs (OpenAI, Anthropic, etc.) and prompt engineering

basics

Clear understanding of Conversational AI, Voice Agents, or Agent-based

workflows

Ownership mindset with the ability to define structure in a fast-moving product

environment

Bonus

QA Automation, AI Evaluation & Solution Engineer 3

Experience testing AI agents with RAG, vector databases, and

LangChain/LLM orchestration

GitHub profile showcasing automation/test projects, prompt eval frameworks,

or agent logic

Familiarity with STT/TTS, telephony, or voice orchestration frameworks like

LiveKit or Twilio

Job Types: Full-time, Permanent

Pay: ₹60, ₹100,000.00 per month

Benefits:

  • Cell phone reimbursement
  • Health insurance
  • Provident Fund

Work Location: In person



  • Mumbai, Maharashtra, India Tatras Data Full time

    Job Title: Automation QA Engineer About Us: We are building high-quality, scalable, and intelligent platforms, and quality is central to everything we do. We are looking for an Automation QA Engineer who doesn't just test software, but helps build it better—with a mindset to break things early, code automation robustly, and ensure exceptional performance...


  • Mumbai, Maharashtra, India dMACQ Full time

    Senior QA Engineer –   Playwright/Cypress dMACQ Pvt. Ltd. enables a cutting-edge educational platform that delivers highly personalized learning experiences across web and digital modalities, connecting learners, educators, and content creators worldwide. Seeking a Senior QA Engineer with proven expertise in testing, automating, and assuring the quality...


  • Mumbai, Maharashtra, India Origins AI: Helping you build and scale Full time

    About UsWe are an IT services and AI solutions company helping global clients build reliable, scalable, and high-quality products. We focus on quality and speed, blending deep technical expertise with AI-driven development and testing practices.Role OverviewWe are looking for a skilled QA Automation Engineer (Python) to join our growing engineering team. The...


  • Mumbai, Maharashtra, India Zensoft Services Full time US$ 90,000 - US$ 1,20,000 per year

    We are seeking a highly skilled and motivated Engineer - QA, Test Automation to join our team in Mumbai. The ideal candidate will play a crucial role in ensuring the quality and reliability of our software by developing and executing automated test scripts. You will be responsible for contributing effectively to project goals, thereby aligning with and...

  • QA Automation

    3 days ago


    Mumbai, Maharashtra, India Ingram Micro Full time

    It's fun to work in a company where people truly BELIEVE in what they're doing! **Job Description**: Key Responsibilities: Manual Testing: - Develop and execute comprehensive test plans, test cases, and test scripts to validate software functionality. - Conduct thorough regression testing to ensure the stability of existing features. - Identify, document,...

  • QA Automation

    1 week ago


    Mumbai, India Tejora Technologies Full time

    **Job Category**:QA Automation **Job Type**:Full time WFH **Job Location**:Mumbai **Experience**:5-10 We are hiring a Test Engineer having experience in Automation Testing. **Responsibilities** - Planning and prioritizing testing activities - Coordinating with the Design team to discuss verification protocols - Suggesting automated software test...

  • QA Automation

    6 days ago


    Mumbai, Maharashtra, India Ingram Micro Full time

    It's fun to work in a company where people truly BELIEVE in what they're doing! **Job Description**: Ingram Micro touches 80% of the technology you use every day with our focus on Technology Solutions, Cloud, and Commerce and Lifecycle Solutions. With $50 billion in revenue, we have become the world’s largest technology distributor with operations in 64...

  • Automation QA

    7 days ago


    Mumbai, Maharashtra, India Testriq QA Lab LLP Full time

    **Role**: Automation Test Engineer (Selenium + Playwright) **Experience**: 2 - 3 years **Location**: On-site ( Mira Road, Mumbai) **Work Type**: Full-time **Key Responsibilities**: - Develop and maintain automation test scripts using Selenium and Playwright. - Execute cross-browser and responsive testing. - Integrate automation tests with CI/CD pipelines...

  • Automation Tester

    1 week ago


    Mumbai, Maharashtra, India TESTRIQ QA Lab Full time

    **Benefits**: **Here are just some of the perks you’ll get as a member of**: **Health Care**: Employee State Insurance **Flexibility**: Flexible work hours, Holidays as per Indian calendar, PL, CL, & paid parental leave. **Commute**: Office No: - 2 & 3, 2nd Floor, Ashley Tower, Beverly Park, adj. to PVR Multiplex, Mira Road East, Thane -...


  • Hinjewadi, Pune, Maharashtra, India Qodequay Technologies Pvt ltd Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title: Quality Analyst (QA – Automation, Mendix Mandatory)Location: Pune, MaharashtraExperience: 4+ YearsEmployment Type: Full-TimeAbout UsAt Qodequay Technologies Pvt. Ltd., we specialize in building next-gen IT solutions leveraging AR, VR, MR, and AI. We deliver scalable digital experiences and enterprise-grade applications with a focus on...