Generative AI Testing Lead

3 weeks ago

Chennai, Tamil Nadu, India Archimedis Full time

Role Description :

We are seeking an experienced Gen AI Testing Lead to join our team in Chennai. This is a full-time, on-site leadership position responsible for defining, implementing, and executing comprehensive testing strategies for Generative AI applications and Large Language Model (LLM)-based solutions. You will oversee test planning, automation, and execution, ensuring that AI-driven systems meet performance, security, compliance, and functional requirements.

You will work closely with AI/ML engineers, data scientists, product managers, and quality teams to validate AI models, optimize testing frameworks, and maintain robust quality standards across the product lifecycle.

Key Responsibilities :

- Lead the end-to-end testing lifecycle for Gen AI and LLM-based applications, from test strategy definition to execution and reporting.

- Develop, maintain, and optimize manual and automated test cases tailored for AI/ML workloads, model pipelines, and prompt engineering scenarios.

- Conduct functional, performance, security, and compliance testing for LLM deployments.

- Validate AI/ML architecture components, ensuring model outputs meet accuracy, bias, interpretability, and safety benchmarks.

- Implement Gen AI security testing methodologies to detect prompt injection, data leakage, adversarial attacks, and other vulnerabilities.

- Ensure regulatory and ethical compliance for AI systems, particularly in sensitive domains such as Life Sciences.

- Collaborate with AI researchers to assess LLM fine-tuning, model versioning, and inference behavior against expected outcomes.

- Monitor model drift and data quality, recommending improvements to maintain high-performance levels.

- Document testing procedures, results, and lessons learned to support continuous improvement.

Qualifications :

- 6+ years of experience in software testing, with a focus on AI/ML or advanced technology domains.

- Strong analytical skills and problem-solving abilities for complex AI workflows.

- Proven expertise in test case design, execution, and automation frameworks.

- Proficiency in Generative AI, LLM architectures, and prompt engineering methodologies.

- Experience with Gen AI security testing and compliance frameworks for AI governance.

- Hands-on experience with AI/ML architecture validation and model testing.

- Familiarity with Life Sciences domain compliance requirements is a strong plus.

- Excellent verbal and written communication skills for cross-functional collaboration.

- Bachelors degree in Computer Science, Information Technology, or related field; advanced degree preferred.

(ref:hirist.tech)

  • Generative AI Developer

    1 day ago

    Chennai, Tamil Nadu, India beBeeArtificial Full time US$ 80,000 - US$ 1,20,000

    Job OpportunityWe are seeking a highly skilled Subject Matter Expert (SME) to develop high-quality assessment items for a Generative AI Foundations certification course.The SME will work collaboratively with a cross-functional team to create clear, standards-aligned assessment items that help students master key generative AI concepts and practices and...

  • Generative AI Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India MEEDEN LABS PRIVATE LIMITED Full time

    Role Overview :We are seeking highly skilled Generative AI Engineers to join our AI innovation team. The ideal candidate will have hands-on experience in designing, developing, and deploying AI/ML solutions with expertise in cloud platforms (Azure, GCP, or AWS). Candidates with deeper experience in LLMs, RAG, and advanced AI architectures will be considered...

  • Sales Development Representative – Voice AI

    3 weeks ago

    Chennai, Tamil Nadu, India Zudu AI Full time

    About Zudu AIZudu AI is an AI-driven voice automation platform that replaces traditional call centers with self-improving AI voice agents. We integrate seamlessly with CCaaS and CPaaS ecosystems to automate complex customer interactions at scale, delivering human-like conversations that reduce operational costs and improve customer satisfaction.Role...

  • Sales Development Representative – Voice AI

    3 weeks ago

    Chennai, Tamil Nadu, India Zudu AI Full time

    About Zudu AIZudu AI is an AI-driven voice automation platform that replaces traditional call centers with self-improving AI voice agents. We integrate seamlessly with CCaaS and CPaaS ecosystems to automate complex customer interactions at scale, delivering human-like conversations that reduce operational costs and improve customer satisfaction.Role...

  • Sales Development Representative – Voice AI

    2 weeks ago

    Chennai, Tamil Nadu, India Zudu AI Full time

    About Zudu AI Zudu AI is an AI-driven voice automation platform that replaces traditional call centers with self-improving AI voice agents. We integrate seamlessly with CCaaS and CPaaS ecosystems to automate complex customer interactions at scale, delivering human-like conversations that reduce operational costs and improve customer satisfaction. Role...

  • Sales Development Representative – Voice AI

    2 weeks ago

    Chennai, Tamil Nadu, India Zudu AI Full time

    About Zudu AI Zudu AI is an AI-driven voice automation platform that replaces traditional call centers with self-improving AI voice agents. We integrate seamlessly with CCaaS and CPaaS ecosystems to automate complex customer interactions at scale, delivering human-like conversations that reduce operational costs and improve customer satisfaction. Role...

  • Generative Ai Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India BigRio Full time

    Job Title: Generative AI Engineer (Senior / Lead / Principal)- Multiple openings Experience Level: 8+ to 13+ Years Location: Hybrid – Remote (India-based) with onsite every Thursday in Chennai- Travel cost will be reimbursed Industry: AI/ML, Enterprise Applications, Healthcare About Big Rio: Big Rio is a remote-based, technology consulting firm...

  • Generative AI Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Figital Labs LLP Full time

    AI Engineer – Immediate HiringWe're growing fast—very fast—and looking for an experienced AI Engineer to join our team in building cutting-edge AI solutions for the Hospitality and Healthcare sectors.If you have experience in RAG, Multi-Agent Systems, and Voice Agent Architectures, this role is for you. We're currently in stealth mode, live with a...

  • Sr AI/ML Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Botminds AI Full time

    About Botminds :Botminds AI is an enterprise-grade, full-stack Agentic platform built for the next generation of intelligent automation. We empower enterprises to create sophisticated, end-to-end AI solutions—faster than ever before—by combining no-code simplicity with deep AI capabilities. From transforming unstructured content into actionable insights...

  • Senior Generative AI Engineer

    2 days ago

    Chennai, Tamil Nadu, India beBeeAIArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview: We are seeking a skilled AI Architect to design and implement technical architectures for applications that leverage generative AI and Large Language Models (LLMs). The ideal candidate will have hands-on experience in software engineering, machine learning, and working with LLMs. The successful candidate will lead the development of end-to-end...