AI Model Testing Specialist

2 days ago


Hyderabad Secunderabad Telangana, India beBeeAutomatedTesting Full time
Job Title

  • Hands-on experience with test automation frameworks (Selenium, Cypress, JUnit, TestNG) within software or AI-focused teams.
  • Hands-on experience with test automation frameworks and tools (Selenium, Cypress, JUnit, TestNG, Postman).
  • Experience or and ability to automate testing of APIs and web interfaces.
  • Familiarity with AI/ML systems and relevant testing methodologies, particularly familiarity with testing AI models, NLP systems, embeddings, and vector-based retrieval systems.
  • Familiarity with common AI model evaluation around NLP, Retrieval-Augmented Generation (RAG), or similar model architectures.
  • Experience conducting root cause analyses, CAPA metrics and methods.
  • Experience with performance testing and load testing tools to validate scalability and reliability of AI services.
  • Excellent analytical processes, and statistical analysis, troubleshooting, and root-cause analysis skills.
  • Strong communication and collaboration
  • Experience with performance and load testing tools (e.g., JMeter, Gatling) to ensure scalability and reliability of AI-driven applications.
  • Knowledge of AI model evaluation metrics (precision, recall, F1-score, accuracy, BLEU, ROUGE, etc.) and techniques for validation.
  • Familiarity with vector databases and embedding-based retrieval technologies (e.g., Pinecone, Weaviate, Chroma).
  • Strong analytical, troubleshooting, and root-cause analysis skills with the ability to systematically address issues and propose effective corrective actions.
  • Excellent communication skills and the ability to collaborate effectively across multidisciplinary teams (engineering, product management, data science).
  • Experience working in agile software development environments (Scrum, Kanban)

Mandatory skills

  • Hands-on experience with test automation frameworks (Selenium, Cypress, JUnit, TestNG) within software or AI-focused teams.
  • Experience or and ability to automate testing of APIs and web interfaces.
  • Familiarity with AI/ML systems and relevant testing methodologies, particularly familiarity with testing AI models, NLP systems, embeddings, and vector-based retrieval systems.
  • Familiarity with common AI model evaluation around NLP, Retrieval-Augmented Generation (RAG), or similar model architectures.
  • Experience with performance testing and load testing tools to validate scalability and reliability of AI services.
  • Desired skills*Knowledge of AI model evaluation metrics (precision, recall, F1-score, accuracy, BLEU, ROUGE, etc.) and techniques for validation.


  • Hyderabad / Secunderabad, Telangana, India beBeeArtificial Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Artificial Intelligence SpecialistRole Description:As an AI specialist, you will be responsible for designing and implementing advanced AI models to drive business growth. This includes developing generative AI algorithms, identifying insights that inform strategic decisions, and working closely with cross-functional teams to align AI project...


  • Hyderabad / Secunderabad, Telangana, India beBeeArtificial Full time ₹ 1,04,000 - ₹ 1,30,878

    Job TitleA Generative AI Specialist is required to play a critical role in designing, developing, fine-tuning, and deploying large language models (LLMs) for real-world applications.


  • Hyderabad / Secunderabad, Telangana, India beBeeInnovation Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: AI Innovation SpecialistThe role of an AI Innovation Specialist involves developing and implementing cutting-edge generative AI solutions, leveraging large language models (LLMs) and retrieval augmented generation (RAG) techniques to solve complex business challenges and drive innovation. The specialist will design and optimize AI agents that...


  • Hyderabad / Secunderabad, Telangana, India beBeeMachine Full time

    Expert AI Developer OpportunityVayuz Technologies seeks a highly skilled and experienced Expert AI Developer with expertise in Python and TensorFlow to join our team. The successful candidate will be instrumental in developing, optimizing, and deploying sophisticated ML models, working with complex datasets, and ensuring the reliability and performance of...


  • Hyderabad / Secunderabad, Telangana, India beBeeAI Full time US$ 1,25,000 - US$ 1,75,000

    We are seeking a highly skilled AI Compiler Engineer to join our team in the rapidly growing field of on-device AI inference acceleration.As an AI Compiler Engineer, you will design and optimize AI compiler stack and tools that enable efficient execution of state-of-the-art open source as well as proprietary AI models such as LLMs, transformer models, etc.,...


  • Hyderabad / Secunderabad, Telangana, India beBeeArtificialIntelligence Full time ₹ 1,04,000 - ₹ 1,30,878

    We are seeking a highly skilled and experienced AI Model Engineer to join our team. The ideal candidate will have a strong background in machine learning, deep learning, and software development.Key Responsibilities:Design and Develop Advanced AI ModelsWork with Complex DatasetsCollaborate with Cross-Functional TeamsImplement and Fine-Tune Generative AI...


  • Mumbai, Kolkata, Hyderabad / Secunderabad, Telangana, India beBeeDevelopment Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Model Development SpecialistWe are seeking an experienced Model Development Specialist to join our team. The successful candidate will be responsible for designing and developing Simulink models, as well as implementing functional changes in accordance with established guidelines.About the Role:Design and develop Simulink models using good...


  • Hyderabad / Secunderabad, Telangana, India beBeeCloudSpecialist Full time

    Transform Your Career with Our Cloud Infrastructure TeamWe're seeking a talented and ambitious individual to enhance our AI platforms cloud infrastructure and data pipeline resilience using AWS and cloud-based technologies.This role involves ensuring the scalability and fault tolerance of AI ML models within cloud environments.The successful candidate will...


  • Hyderabad / Secunderabad, Telangana, India beBeeMachineLearning Full time

    Machine Learning Engineer Role OverviewWe are seeking a highly skilled Machine Learning Engineer to join our team. The ideal candidate will have expertise in Python and a strong understanding of Hadoop and other Big Data technologies.You will be instrumental in developing, optimizing, and deploying sophisticated ML and Deep Learning models, working with...


  • Hyderabad, Telangana, India beBeeGenerative Full time ₹ 1,50,00,000 - ₹ 2,10,00,000

    Job OpportunityAs a Generative AI Engineer, you will be part of an innovative team developing cutting-edge AI projects.Responsibilities include:Develop and fine-tune large language models (LLMs) and generative AI models for natural language processing (NLP), image, or multimodal tasks.Implement and optimize prompts, embeddings, and retrieval-augmented...