AI Test Specialist

2 weeks ago

Chennai, Tamil Nadu, India beBeeArtificialIntelligence Full time ₹ 18,00,000 - ₹ 21,00,000
Job Title: AI Test Engineer

We are seeking an experienced AI test engineer to ensure the quality and reliability of our AI models. As a key member of our team, you will play a crucial role in driving innovation and excellence.

About the Role
  • Design and implement AI testing strategies using Large Language Models (LLMs) with a focus on OpenAI or Azure OpenAI technologies.
  • Test multi-agent workflows and agentic frameworks to facilitate collaboration among AI agents.
  • Utilize effective prompting techniques to enhance the performance of AI model tests and ensure optimal outputs.
  • Implement Retrieval-Augmented Generation (RAG) techniques and manage vector databases to improve information retrieval processes.
  • Testing agent tools integration using Model Context Protocol (MCP) for seamless communication and operation of AI agents.
  • Monitor and analyze system performance through observation and telemetry to improve AI model accuracy and reliability.
  • Collaborate with cross-functional teams to test RESTful APIs that support AI functionalities and integrations.
  • Ensure the security of AI applications by testing implementations of security fundamentals, including OAuth2.x authentication methods.
  • Testing SQL databases (SQL Server preferred) to ensure data integrity and accessibility.
Mandatory Skills
  • Proven experience working with Large Language Models (LLMs), with specific experience in OpenAI or Azure OpenAI technologies.
  • Strong understanding of agentic frameworks and multiagent systems.
  • Expertise in effective prompting strategies for AI models.
  • Familiarity with Retrieval Augmented Generation (RAG) and vector databases.
  • Experience with agent tools, particularly Model Context Protocol (MCP).
  • Proficient in monitoring and telemetry techniques for AI applications.
  • Strong programming skills in Python and TypeScript experience with C# is a plus.
  • Knowledge of REST API fundamentals and best practices.
  • Understanding of security fundamentals, including OAuth2.x and secure coding practices.
  • Experience with SQL databases, specifically SQL Server, is highly desirable.
Good to Have Skills
  • TFS, GitHub tool knowledge
  • Framework Design

  • Accounting Automation

    3 days ago

    Chennai, Tamil Nadu, India AI Specialist Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    About Us:We are a dynamic and growing outsourced accounting office located in Chennai, India, specializing in back-office accounting, tax, and audit preparation services for US and Canadian accountants. We are committed to leveraging technology to streamline operations, increase accuracy, and deliver more value to our international clients.Job Overview:We...

  • AI Test Development Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeArtificial Full time ₹ 8,00,000 - ₹ 12,00,000

    AI Test Development SpecialistWe are seeking an experienced AI Test Development Specialist to join our team. As a key member of the team, you will play a pivotal role in ensuring the quality and reliability of AI/ML models.Key Responsibilities:Design, implement, and execute test cases for AI/ML models to ensure they meet the required standards.Conduct...

  • Customer Success Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India DevAssure - AI Test Agent Full time

    Company DescriptionDevAssure is an AI-powered test accelerator platform designed for modern Dev and QA teams focusing on shift-left practices. Our platform provides a unified low-code environment that allows teams to auto-generate and automate test cases, seamlessly integrating into CI pipelines. DevAssure supports cross-platform automation for web, mobile,...

  • Customer Success Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India DevAssure - AI Test Agent Full time

    Company Description DevAssure is an AI-powered test accelerator platform designed for modern Dev and QA teams focusing on shift-left practices. Our platform provides a unified low-code environment that allows teams to auto-generate and automate test cases, seamlessly integrating into CI pipelines. DevAssure supports cross-platform automation for web, mobile,...

  • Customer Success Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India DevAssure - AI Test Agent Full time

    Company DescriptionDevAssure is an AI-powered test accelerator platform designed for modern Dev and QA teams focusing on shift-left practices. Our platform provides a unified low-code environment that allows teams to auto-generate and automate test cases, seamlessly integrating into CI pipelines. DevAssure supports cross-platform automation for web, mobile,...

  • Customer Success Specialist 15h Left

    3 weeks ago

    Chennai, Tamil Nadu, India DevAssure - AI Test Agent Full time

    Company DescriptionDevAssure is an AI-powered test accelerator platform designed for modern Dev and QA teams focusing on shift-left practices. Our platform provides a unified low-code environment that allows teams to auto-generate and automate test cases, seamlessly integrating into CI pipelines. DevAssure supports cross-platform automation for web, mobile,...

  • AI Quality Assurance Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeQuality Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: AI Quality Assurance SpecialistWe are seeking an experienced and detail-oriented professional to lead our AI-driven quality assurance efforts, ensuring the accuracy, reliability, and performance of our cutting-edge applications.Key Responsibilities:Develop comprehensive testing strategies for Generative AI models and applications, leveraging...

  • Test Specialist

    1 week ago

    Chennai, Tamil Nadu, India beBeeArtificialintelligence Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    AI/ML Test EngineerThis role is ideal for a highly skilled and motivated individual who can apply their knowledge of AI and ML to ensure the highest quality software products.Key Responsibilities:Review software requirements, user stories, and design specifications to prepare comprehensive test scenarios and test plans.Design, develop, and execute test cases...

  • Chief AI Test Strategist

    1 week ago

    Chennai, Tamil Nadu, India beBeeGenerativeAI Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Generative AI Testing Lead\Our organization seeks a highly experienced Gen AI Testing Lead to oversee the comprehensive testing strategies for Generative AI applications and Large Language Model (LLM)-based solutions. This full-time, on-site leadership position will be responsible for defining, implementing, and executing test planning,...

  • AI/ML Test Engineer

    1 day ago

    Chennai, Tamil Nadu, India TekWissen Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Overview:TekWissen is a global workforce management provider throughout India and many other countries in the world. The below clientis a global company with shared ideals and a deep sense of family. From our earliest days as a pioneer of modern transportation, we have sought to make the world a better place one that benefits lives, communities and the...