ai - Quality Assurance Lead - AI Systems

7 days ago

Pune, Maharashtra, India Codvo Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Company Overview :

At Codvo, software and people transformations go hand-in-hand.

We are a global empathy-led technology services company.

Product innovation and mature software engineering are part of our core DNA.

Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each day.

We continue to expand our digital strategy, design, architecture, and product management capabilities to offer expertise, outside-the-box thinking, and measurable results.

About The Role :

We are looking for an experienced QA Lead - AI Systems to lead the validation and quality assurance of AI-powered products, including LLM/RAG systems, Software as a Medical Device (SaMD), and other AI-driven digital solutions.

This is a key leadership role responsible for establishing end-to-end QA frameworks, validation strategies, and compliance processes for AI/ML models across development and deployment pipelines.

The ideal candidate will bridge data science, software engineering, and regulatory QA to ensure AI systems meet performance, safety, and compliance standards.

Key Responsibilities :

- Own and drive QA strategy for AI systems across the model, data, and product lifecycle.

- Lead AI model validation efforts, covering LLM/RAG testing, bias analysis, and performance evaluation.

- Define and implement AI Evaluation Metrics (accuracy, fairness, drift, explainability) aligned with business and regulatory expectations.

- Establish frameworks for Explainability Testing (SHAP, LIME, XAI) and ensure interpretability of AI outcomes.

- Collaborate with Data Science and MLOps teams to validate models within cloud environments (Azure ML, AWS Sagemaker, Vertex AI).

- Drive verification and validation (V&V) for AI models and applications under FDA and SaMD compliance frameworks.

- Ensure test traceability, documentation, and audit readiness in line with ISO 13485, IEC 62304, and ISO 14971.

- Develop Python-based automation for AI testing, data validation, and model evaluation pipelines.

- Provide technical leadership to QA teams, ensuring alignment with AI/ML development best practices.

- Collaborate with cross-functional teams (Product, Data, Regulatory, Engineering) to identify risks, gaps, and opportunities for test optimization.

- Present validation findings, risks, and recommendations to senior stakeholders and regulatory reviewers.

Required Qualifications :

- Bachelors or Masters degree in Computer Science, Data Engineering, Biomedical Engineering, or related field.

years of total QA experience, with 2- 3 years directly in AI/ML or GenAI QA.

- Proven experience in AI Model Validation, LLM/RAG Testing, and AI Evaluation Metrics.

- Strong knowledge of MLOps concepts and cloud platforms (Azure ML, AWS Sagemaker, Vertex AI).

- Understanding of FDA AI/ML Compliance, SaMD testing, and regulated software QA.

- Hands-on expertise in Python automation and testing AI/ML pipelines.

- Excellent documentation and communication skills with ability to produce traceable validation artifacts.

  • Software Architect AI

    2 weeks ago

    Pune, Maharashtra, India Opura AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionOpura Technologies is a Generative AI-driven startup focused on developing AI based products. We aim to help businesses boost conversions, enhance customer engagement, and achieve measurable outcomes, driven by our deep AI expertise and innovation.About the RoleWe are seeking a highly skilledSoftware AI Architectto define and lead the...

  • AI Software Architect

    2 weeks ago

    Pune, Maharashtra, India Opura AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    AI Software ArchitectAbout the RoleWe are seeking a highly skilledAI Software Architectto define and lead the architecture ofAI-powered products. The ideal candidate has deep expertise in designing AI systems end-to-end and a proven track record ofbuilding products from the ground up—from concept and MVP to production and scale.This role offers more than...

  • AI Architect/ VP Engineering

    2 weeks ago

    Pune, Maharashtra, India Opura AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionOpura AI is a Generative AI–driven startup building an AI Shopping Assistant that seamlessly integrates advanced technology with real-world e-commerce solutions. Our platform enhances the shopping experience by helping users discover products quickly through natural, conversational interactions. Opura AI enables businesses to increase...

  • Forward Deployed AI Engineer

    4 days ago

    Pune, Maharashtra, India Weekday AI Full time ₹ 8,00,000 - ₹ 15,00,000

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 8-15 LPA)Min Experience: 2 yearsLocation: Gujarat, Mumbai, PuneJobType: full-timeWe're building the future of agentic commerce — a low/no-code framework that helps enterprises create multimodal AI agents with observability, governance, and real-world customer context built in. As a...

  • Sr. AI Engineer

    11 hours ago

    Pune, Maharashtra, India Vsynergize AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are looking for a talented and driven Sr. AI Engineer with a strong foundation in Python, Natural Language Processing, and experience working with Large Language Models (LLMs). This is an exciting opportunity to be at the forefront of AI development, working on real-world problems involving cutting-edge technologies such as prompt engineering, cloud-based...

  • AI Performance Engineer

    1 week ago

    Pune, Maharashtra, India ArcOne AI Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position Overview:The Performance Engineer will play a critical role in analyzing, optimizing, and scaling ArcOne's data and AI systems, with a focus on revenue management. This role involves deep performance profiling across application, middleware, runtime, and infrastructure layers, developing advanced observability tools, and collaborating with...

  • AI Python Developer

    2 days ago

    Pune, Maharashtra, India Omnibound AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Please Note:Only candidates who are immediate joiners (0–7 days)will be considered This also includes forthose who are already serving notice period, as long as they are available to joinwithin 10-15 days.If you do not have hands-on experience with building AI software, please do not applyAbout us:Omnibound ) is building the AI-based operating system for...

  • QA Lead – AI/ML Systems

    2 days ago

    Pune, Maharashtra, India Codvo Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company OverviewAt Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company. Product innovation and mature software engineering are part of our core DNA. Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each day. We continue to expand our digital...

  • QA Lead – AI/ML Systems

    6 hours ago

    Pune, Maharashtra, India Codvo Full time ₹ 1,80,000 - ₹ 2,40,000 per year

    Company OverviewAt Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company. Product innovation and mature software engineering are part of our core DNA. Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each day.We continue to expand our digital...

  • AI Voice Agent Engineer

    2 days ago

    Pune, Maharashtra, India JobTalk AI Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are building next-generationAI Voice Agents for recruiters. You'll design and implement real-time, low-latency conversational systems that combineLLMs, STT, TTS, RAG, and streaming pipelines. The backend runs inPython, with afrontend. If you have built real-time voice systems that can handle human interruptions and dynamic context, this role fits you.Key...