QA Test Lead

11 hours ago

Bengaluru, Karnataka, India CoRover Private LimitedBharatGPT Full time ₹ 8,00,000 - ₹ 12,00,000 per year

QA Lead (AI Products)

Experience: 36 years in QA (at least 1 year leading/mentoring a small team)

Domain: Conversational AI/LLM chatbots, IVR/telephony, multilingual NLP, API-first microservices

About the role

Youll lead the QA function for our AI-driven products - chatbots (web/app/WhatsApp), IVR voice bots, NLP services, and integrations deployed with enterprise and government clients. Your mandate: build repeatable, data-driven QA practices that keep quality, safety, and compliance high across rapid releases.

What youll do

Own quality strategy & release gates: Define risk-based test plans, traceability to SOW/RFP requirements, and "go/no-go" criteria for every release.

Lead the QA team: Coach testers, run daily QA standups, manage workload in Jira/Zephyr/TestRail, and drive defect triage with Product/Engg.

AI-specific quality:

  • Create & maintain evaluation datasets for intents, entities, RAG responses, OCR accuracy, and IVR call-flows.
  • Track key model/product metrics: intent F1, fallback/containment rate, hallucination rate, toxicity/safety violations, WER/CER for ASR/TTS, latency (p95), and CSAT/deflection.
  • Run prompt regression, red-teaming for prompt injection/safety, and content policy checks.

Multilingual & channel QA: Systematically test Hindi + Indic languages (e.g., Tamil/Telugu), web/app widgets, WhatsApp, IVR (DTMF, ASR/TTS), and SDK/WebView embeds across devices/browsers.

API & microservices testing: Automate API tests (functional, contract, schema), resilience tests, and compatibility across environments; validate third-party integrations.

Performance & reliability: Execute load/stress tests for peak traffic; monitor SLOs/SLA adherence post-release with observability dashboards.

Automation first: Establish and scale automation for UI (Playwright/Cypress) and API (Postman/Newman/PyTest), integrate into CI/CD (GitHub Actions/GitLab/Jenkins), and maintain flake-free pipelines.

Production quality ops: Set up canary/synthetic checks, log-based validations, and rapid rollback playbooks; drive RCA and preventive actions.

Compliance & security basics: Enforce PII redaction, access controls, and audit trails; ensure WCAG 2.1 AA accessibility and alignment with client data/security requirements.

Stakeholder management: Partner with Product, ML, and Engineering; conduct UAT with clients (incl. PSU/enterprise), and present quality reports with clear metrics and risks.

Must-haves

  • 3-6 years in QA with hands-on automation + at least 1 year leading/mentoring testers.
  • Experience testing AI/ML or LLM-based products (chatbots, RAG/NLP pipelines, OCR, or voice bots).
  • Solid with API testing and tools like Postman/Newman, PyTest, JSON schema/contract testing.
  • UI automation using Playwright or Cypress; CI/CD integration experience.
  • Familiarity with performance testing (JMeter/Locust/k6) and reading dashboards/logs (Grafana/ELK/Sentry/DataDog).
  • Strong test design (equivalence, boundary, combinatorial, exploratory), defect triage, and release management.
  • Excellent communication; comfortable leading client-facing UAT.

Good-to-haves

  • Exposure to IVR/telephony QA (SIP/PSTN basics, DTMF/ASR/TTS evaluation, call-flow testing).
  • Multilingual QA experience for Indian languages; knowledge of WER/CER measurement.
  • Understanding of LLM eval frameworks (promptfoo, DeepEval/OpenAI Evals/RAGAS) and safety/red-teaming.
  • Cloud & containers (AWS/Azure/GCP, Docker/K8s) and environment management.
  • Accessibility testing, security testing fundamentals, data privacy (e.g., DPDP/GDPR-aligned practices).
  • Jira, Zephyr/TestRail, Confluence; Browser Stack/device labs.

  • Testing & QA Lead

    13 hours ago

    Bengaluru, Karnataka, India Veralto Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Testing and QA LEADLocation: IndiaDepartment: ERP TransformationStatus: Contingent Worker/Contract Worker Imagine yourself…Growing your expertise and expanding your skillset with every project you take on.Leading and inspiring a team that thrives on precision, collaboration, and continuous improvement.Driving innovation that contributes to smarter, more...

  • Testing & QA Lead

    2 weeks ago

    Bengaluru, Karnataka, India Esko Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    The Testing and QA Lead will be responsible for defining, implementing, and overseeing all quality assurance and testing activities for the upcoming project. This includes managing Systems Integration Testing (SIT), User Acceptance Testing (UAT), and ensuring that all deliverables meet the highest standards of quality, reliability, and usability. The role...

  • Testing & QA Lead

    2 weeks ago

    Bengaluru, Karnataka, India ESKO Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    The Testing and QA Lead will be responsible for defining, implementing, and overseeing all quality assurance and testing activities for the upcoming project. This includes managing Systems Integration Testing (SIT), User Acceptance Testing (UAT), and ensuring that all deliverables meet the highest standards of quality, reliability, and usability. The role...

  • QA Lead/Software Testing Lead

    16 hours ago

    Bengaluru, Karnataka, India Iibc Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Responsibilities:-Prepare the estimations, project plans, test plan, test strategy for testing Functional and Non Functional Requirements.Work closely with Development Teams and other supporting teams to drive quality through design and implementationPrepare Test Cases from requirements source documents and execute cases.Technically guide other team...

  • Qa Lead

    2 weeks ago

    Bengaluru, Karnataka, India Ragaai Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    About Raga AIRaga AI is a VC-backed startup building tools to increase the efficiency of Machine Learning model development processes. We are a growing team of passionate builders and innovators dedicated to improving the reliability and speed of ML systems.Role OverviewAs a QA Lead, you will lead a team of 5+ QA engineers, collaborating closely with the...

  • QA Lead

    4 days ago

    Bengaluru, Karnataka, India LumenData Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    ****Job Title: Lead MDM QA Engineer**Location: Bangalore (Hybrid)**Department: Delivery / Quality Assurance**Company: LumenDataAbout LumenDataLumenData is a global consulting firm specializing in data management, cloud modernization, MDM, data quality, and analytics. We help enterprises build scalable, high-quality data ecosystems using platforms such as...

  • Automation Test Engineer

    4 days ago

    Bengaluru, Karnataka, India Pro - Test Consulting. Full time ₹ 40,00,000 - ₹ 1,20,00,000 per year

    Job DescriptionProven hands-on experience in manual and Test automationStrong knowledge of quality best practices and methodologies for software testingExperience with automation tools such as selenium, cypress, playwright, katalon studio etcManages a group of employees and helps the team achieve its goals effectively.Experience in QA methodology,...

  • QA Lead

    2 days ago

    Bengaluru, Karnataka, India NowWiN International Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description – QA Lead (Digital Agency / E-commerce / CMS)Location:Bangalore (Onsite)Experience:6-8 YearsNotice Period:Immediate to 7 DaysRoles & ResponsibilitiesLead and manage QA delivery for assigned web and mobile application projects.Perform manual & automated testing across web, mobile, CMS platforms, and e-commerce systems.Conduct ...

  • QA Lead

    7 days ago

    Bengaluru, Karnataka, India AskLaila Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced and detail-oriented QA LEAD to join our QA team. The ideal candidate will bring a solid technical background in both Manual and Automation, a passion for quality assurance, and demonstrated expertise in leading automation initiatives. As the Automation QA Lead, you will be responsible for designing, developing, and executing...

  • QA Lead

    2 weeks ago

    Bengaluru, Karnataka, India The Art Of Living HR Full time ₹ 6,47,000 - ₹ 20,48,534 per year

    Location: BangaloreAbout the Role:We are seeking a highly experienced QA Lead to oversee quality assurance for our marketing campaigns.This individual will play a critical role in ensuring flawless execution of digital campaigns, with a special focus on email marketing.The ideal candidate has extensive QA experience in marketing campaign testing, strong...