Qa Lead

2 days ago

Gurugram Noida Pune, India BB Works Full time ₹ 12,00,000 - ₹ 24,00,000 per year
  • Position: QA lead
  • Experience : years
  • Location : Noida, Gurgaon & Bengaluru

Key Responsibilities

  • Quality Strategy & Governance

  • Define QA strategy and test governance for AI/GenAI projects within SDLC and MLOps pipelines.

  • Establish quality metrics for AI outputs (e.g., factual accuracy, precision, recall, hallucination rate).

  • Develop Responsible AI validation guidelines aligned to organizational compliance and ethical frameworks.

  • Test Planning & Execution

  • Design functional, non-functional, and model validation test plans for AI-driven features.

  • Create robust regression suites combining classical QA and AI model testing approaches.
  • Collaborate with data scientists and model developers to define performance and accuracy benchmarks.

  • Validate prompt engineering logic and LLM response consistency across datasets.

  • Automation & Tools Integration

  • Implement automation for test data generation, API validation, and result comparison using Python or Java-based frameworks.

  • Integrate AI testing workflows with CI/CD and MLOps pipelines (e.g., MLflow, Kubeflow, Jenkins).

  • Develop scripts to validate inference latency, model version accuracy, and output reliability.

  • Defect Management & RCA

  • Lead triage and RCA for model anomalies or performance deviations.

  • Track model quality issues through ITSM or defect tracking tools, ensuring closed-loop feedback into retraining cycles.

  • Collaboration & Leadership

  • Mentor QA analysts and test automation engineers on AI test design methodologies.

  • Serve as liaison between QA, Data Science, and DevOps teams.
  • Contribute to governance reviews, audits, and continuous quality improvement programs.

Technical Skills

Category

Required Expertise

QA / Test Automation

Selenium, PyTest, Robot Framework, Postman, REST API testing, JMeter.

AI / ML Fundamentals

Basic understanding of model training, validation, and evaluation metrics (precision, recall, accuracy, F1, ROC).

Generative AI Frameworks

Experience with OpenAI APIs, LangChain, Hugging Face Transformers, or comparable LLM frameworks.

Data Quality & Validation

Data preparation, cleansing, and validation using Python (pandas, NumPy) or Spark.

Performance & Non-functional Testing

Load and stress testing of AI inference APIs and model endpoints.

MLOps / CI-CD Tools

Jenkins, Docker, Kubernetes, MLflow, GitHub Actions.

Monitoring & Logging

APM tools (Dynatrace, Grafana, Prometheus); anomaly detection and drift tracking.

Cloud Platforms

AWS, Azure ML, or Google Vertex AI; handling AI environment configurations.

Scripting

Python (preferred), SQL scripting for data validation.

Model Validation Tools

BLEU/ROUGE scoring, embedding similarity measurement, factual accuracy scoring utilities.

Behavioral & Leadership Skills

  • Strong analytical and problem-solving approach with a focus on data-driven decisions.
  • Excellent communication and documentation skills for stakeholder reporting.
  • Ability to mentor cross-functional QA teams in AI specialties.
  • Experience working within Agile/DevOps environments.
  • Commitment to ethical and responsible AI practices.

Educational & Experience Requirements

  • Bachelors or Master's in Computer Science, Information Technology, or related field.
  • 7–10 years of QA experience, with at least 2 years in AI, ML, or data-centric projects.
  • Hands-on knowledge of automation frameworks, API testing, and cloud-based deployment validation.

  • QA Lead

    15 hours ago

    Gurugram, India Antino Labs Full time

    Job location - Noida Responsibilities: - Lead and manage the QA team, including hiring, training, and mentoring QA engineers. - Establish and implement QA processes, methodologies, and best practices. - Define and execute the QA strategy, including test planning, test case development, and test execution. - Coordinate with development and product teams to...

  • QA Lead

    1 week ago

    Noida, Uttar Pradesh, India Software Engineering Firm Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: QA Lead / QA ManagerExperience: 12+ YearsLocation: Noida (or specify remote/hybrid)Industry: IT Software – Web & Mobile Application DevelopmentEmployment Type: Full-timeAbout the Role:We are seeking an experienced and proactive QA Lead / Manager to head our Quality Assurance function. The role requires deep expertise in managing end-to-end QA...

  • QA Lead

    7 days ago

    Noida, Uttar Pradesh, India The Techgalore Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    QA LeadExperience: 10+Location: RemoteDuration: 1month (Extendable)Mandatory : Typescript experienceJob description: We are looking for an experienced QA Automation Lead to drive our automation testing efforts. The ideal candidate will possess a strong background in software testing and automation, along with excellent leadership and communication skills.Key...

  • QA Lead

    16 hours ago

    Noida, India Crazy Solutions Full time

    QA Lead POSITION: QA Lead Job Type: Full time, Work From Office (5 days)Location: Sector 16A, Film City, NoidaRelevant Experience: Minimum 4+ yearSalary: CompetitiveEducation- BE/ B.Tech or Equivalent We are looking for a skilled QA Lead with 4+ years of experience to manage the quality assurance process for our platform, mobile apps, and websites.. Key...

  • QA Lead

    7 days ago

    Noida, Uttar Pradesh, India Flight Centre Careers Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    We are seeking a hands-on QA Lead who nurtures quality mindset to head our quality assurance team and ensure the delivery of high-quality software products. The QA Lead will be responsible for developing and implementing test strategies, managing the QA team, and collaborating with cross-functional teams to drive continuous improvement of our testing...

  • QA Lead

    15 hours ago

    Pune, India Johnson Controls Full time

    Position Title: QA Lead Location: Pune Experience: 9+ Years What You Will Do Provide technical leadership and mentorship to the QA automation team Design, develop, and maintain scalable test automation frameworks Lead the implementation of best practices for quality assurance and automation Collaborate with development, DevOps, and release teams for seamless...

  • QA Lead

    15 hours ago

    Pune, India Fulcrum Digital Full time

    Job Description Job Summary We are seeking a detail-oriented and experienced QA Lead to oversee the quality assurance process for Web and Progressive Web Applications (PWA) in the Property & Casualty (P&C) insurance domain . The ideal candidate should have a strong background in functional, regression, and end-to-end testing of insurance applications, as...

  • QA Lead

    2 days ago

    Pune, Maharashtra, India Johnson Controls Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Position Title: QA LeadLocation: PuneExperience: 9+ YearsWhat You Will DoProvide technical leadership and mentorship to the QA automation teamDesign, develop, and maintain scalable test automation frameworksLead the implementation of best practices for quality assurance and automationCollaborate with development, DevOps, and release teams for seamless...

  • QA Lead

    4 days ago

    Pune, Maharashtra, India Fulcrum Worldwide Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking a detail-oriented and experienced QA Lead to oversee the quality assurance process for Web and Progressive Web Applications (PWA) in the Property & Casualty (P&C) insurance domain. The ideal candidate should have a strong background in functional, regression, and end-to-end testing of insurance applications, as well as a solid...

  • QA Lead

    1 week ago

    Noida, Uttar Pradesh, India Crazy Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    QA LeadPOSITION: QA LeadJob Type: Full time, Work From Office (5 days)Location: Sector 16A, Film City, NoidaRelevant Experience: Minimum 4+ yearSalary: CompetitiveEducation- BE/ B.Tech or EquivalentWe are looking for a skilled QA Lead with 4+ years of experience to manage the quality assurance process for our platform, mobile apps, and websites..Key...