QA Automation Engineer

1 day ago


Vikhroli Mumbai Maharashtra, India Techstalwarts Software Development LLP Full time ₹ 6,00,000 - ₹ 12,00,000 per year

Designation - QA/Automation

Exp - 2yr - 3yrs

Key Responsibilities

Platform & Workflow QA

Build and maintain automation frameworks (Playwright, Postman, PyTest) for

frontend, API, and workflows

Validate workflows (e.g. in n8n) that use agents, knowledgebases, and

external tools

Ensure business-critical flows are error-free, with auto-healing & test

coverage in CI/CD

Agent Behavior & Prompt Evaluation

Design eval suites to validate prompt reliability, response safety, hallucination

rates, and fallback logic

Align with prompt engineers and agent designers to fine-tune behavior across

business verticals

Create test rubrics for accuracy, tone, response time, and user experience

LLM & Retrieval Evaluation

Test performance of retrieval chains (RAG) across agents and use cases

Design regression tests for memory consistency, tool usage, and voice

readiness

QA Automation, AI Evaluation & Solution Engineer 2

Contribute to eval scoring mechanisms (agent correctness, confidence, intent

coverage, etc.)

Client Enablement & Delivery QA

Collaborate with onboarding team to define and enforce QA checkpoints

during rollout

QA client workflows (lead qualification, support agents, surveys, etc.)

Mentor junior team members executing client-level QA and automation tasks

Strategic Quality Oversight

Report platform-wide quality metrics (pass rates, model failure modes,

workflow issues)

Ensure QA is deeply integrated into Dev, Product, and GTM motions

Continuously evolve quality strategy for an agent-first, AI-native platform

What We're Looking For

Must-Haves

6+ years in QA/Automation, with at least 2 years in a Lead or Senior capacity

Strong hands-on skills in Python, Playwright, Postman, and CI/CD pipelines

Experience with n8n, Zapier, or similar workflow/RPA tools

Familiarity with LLM APIs (OpenAI, Anthropic, etc.) and prompt engineering

basics

Clear understanding of Conversational AI, Voice Agents, or Agent-based

workflows

Ownership mindset with the ability to define structure in a fast-moving product

environment

Bonus

QA Automation, AI Evaluation & Solution Engineer 3

Experience testing AI agents with RAG, vector databases, and

LangChain/LLM orchestration

GitHub profile showcasing automation/test projects, prompt eval frameworks,

or agent logic

Familiarity with STT/TTS, telephony, or voice orchestration frameworks like

LiveKit or Twilio

Job Types: Full-time, Permanent

Pay: ₹60, ₹100,000.00 per month

Benefits:

  • Cell phone reimbursement
  • Health insurance
  • Provident Fund

Work Location: In person



  • Pune, Maharashtra, India Endava Full time

    Company Description Technology is our how And people are our why For over two decades we have been harnessing technology to drive meaningful change By combining world-class engineering industry expertise and a people-centric mindset we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital...

  • QA Automation

    5 days ago


    Mumbai, Maharashtra, India Ingram Micro Full time

    It's fun to work in a company where people truly BELIEVE in what they're doing! **Job Description**: Ingram Micro touches 80% of the technology you use every day with our focus on Technology Solutions, Cloud, and Commerce and Lifecycle Solutions. With $50 billion in revenue, we have become the world’s largest technology distributor with operations in 64...


  • Pune, Maharashtra, India, Maharashtra TransPerfect Full time

    OVERVIEW:The ideal candidate is a QA Engineer with experience in both Manual and Automation Testing and demonstrates the ability to: multitask in a fast-paced environment, work well with people from a variety of different backgrounds and cultures, build relationships with co-workers, work independently and as part of a team, take active measures to solve...


  • Mumbai, Maharashtra, India Wärtsilä Corporation Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    QA Automation Engineer - Digital Port SolutionsWärtsilä is a world leader in marine technology and leading the industry's transformation towards a decarbonised and sustainable future. With the world's widest portfolio and service network, we – Wärtsilians - deliver efficient, safe and sustainable integrated products and solutions to enhance the business...


  • Pune, Maharashtra, India, Maharashtra Persistent Systems Full time

    About Position:We are looking for a skilled QA Automation Engineer with over 4 years of experience to join our team. The ideal candidate will have strong hands-on expertise in automation tools and frameworks, and a passion for delivering high-quality software products.Role: QA Automation EngineerLocation: All Persistent LocationsExperience: 4+ yearsJob Type:...


  • Mumbai, Maharashtra, India Weassemble Full time ₹ 2,00,000 - ₹ 6,00,000 per year

    We are looking for a highly skilled and motivated QA Automation Engineer with at least 3years of exp to join our dynamic teamThe ideal candidate is proactive, detail-oriented and eager to contribute frm day oneStrong hands-on experience with Playwright (JavaScript)Proven expertise in API testing automation (Postman, REST Assured or equivalent)Experience with...

  • QA Automation Lead

    2 weeks ago


    Goregaon, Mumbai, Maharashtra, India sportzinteractive Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About the Role :As our QA & Automation Lead, you will be at the forefront of shaping and scaling our quality engineering function. Reporting directly to the CDO, you'll take ownership of a talented team of 8–10 QA engineers across delivery units and responsible for maturing and scaling our quality assurance practices his is a strategic role that requires a...

  • QA Automation Testing

    2 weeks ago


    Mumbai, Maharashtra, India Enrich and Enlight Business Consulting Pvt Ltd Full time

    **General Description** **Primary Responsibilities** - Development of automation test scripts - Coordination of testing activities - Identify software weakness and target areas - Testing estimation & end to end execution of required testing. - Manual testing **Required Skills**: - More than 6 years of work experience in QA automation testing. -...

  • QA Automation

    7 days ago


    Mumbai, India Acme Services Full time

    **Roles and Responsibilities** **3.Cucumber** **4.Junit** **5.Rest API** Role: Software Development - Other - Salary: Not Disclosed by Recruiter - Industry: Software Product - Functional Area: Engineering - Software & QA - Role Category: Software Development - Employment Type: Full Time, Permanent - Key Skills QA Automation - Education - UG: Any...


  • Hinjewadi, Pune, Maharashtra, India Qodequay Technologies Pvt ltd Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: Quality Analyst (QA – Automation, Mendix Mandatory)Location: Pune, MaharashtraExperience: 4+ YearsEmployment Type: Full-TimeAbout UsAt Qodequay Technologies Pvt. Ltd., we specialize in building next-gen IT solutions leveraging AR, VR, MR, and AI. We deliver scalable digital experiences and enterprise-grade applications with a focus on...