AI Test Engineer Position

6 days ago

Palakkad, Kerala, India beBeeArtificialIntelligence Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title: AI Testing Specialist

Location: Hybrid – Hyderabad/Vishakhapatnam, India

Job Type: Full-time

Job Summary:

We are seeking a skilled and detail-oriented AI Testing Specialist with expertise in Generative AI to join our team.

In this role, you will be responsible for ensuring the accuracy, safety, and performance of AI-driven applications, particularly in the field of Generative AI.

You will design and execute comprehensive test plans for Generative AI models and applications, validate AI-generated outputs for accuracy and coherence, develop automated testing frameworks, and perform adversarial testing to assess AI vulnerabilities.

Key Responsibilities:

  • Develop and maintain comprehensive test strategies for AI-based applications.
  • Validate AI-generated outputs for accuracy, coherence, bias, and ethical considerations.
  • Design and implement automated testing frameworks for AI-based applications.
  • Perform security testing and edge case analysis to assess AI vulnerabilities.
  • Collaborate with cross-functional teams to refine model performance and mitigate errors.
  • Conduct performance testing to evaluate response times and scalability of AI systems.

Requirements:

  • Bachelors or Master's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in Quality Assurance, with at least 1-2 years in AI/ML testing or Generative AI applications.
  • Strong understanding of AI/ML concepts, NLP models, LLMs, and deep learning architectures.
  • Experience with AI testing tools such as LangTest, DeepChecks, Trulens, or custom AI evaluation frameworks.
  • Proficiency in test automation using Python, Selenium, PyTest, or similar frameworks.
  • Familiarity with model evaluation metrics such as BLEU, ROUGE, perplexity, and precision-recall for AI-generated content.
  • Knowledge of bias detection, adversarial testing, and ethical AI considerations.
  • Experience working with APIs, cloud platforms (AWS, Azure, GCP), and MLOps practices.
  • Strong analytical and problem-solving skills with attention to detail.
  • Excellent communication and collaboration skills to work in cross-functional teams.

Benefits:

  • Opportunity to work on cutting-edge AI products.
  • Collaborate with a team of AI and software experts.
  • Competitive salary and career growth opportunities.

  • AI-Powered Prompt Engineer

    13 hours ago

    Palakkad, Kerala, India beBeePrompt Full time ₹ 10,00,000 - ₹ 15,00,000

    Prompt Engineering OpportunitiesAs a Prompt Engineer, you will play a pivotal role in designing and developing AI prompts and workflows to enhance our FinTech tools, models, and websites. This includes creating prompt templates, integrating LLM capabilities, testing model outputs, and developing AI-driven features for financial applications.Key...

  • Automation Test Engineer

    2 days ago

    Palakkad, Kerala, India beBeePython Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Software TesterImmediate to 30-day joiners are needed. The ideal candidate will be strong in software development, testing and automation.Key ResponsibilitiesDesign, code, test and manage various applications.Collaborate with the engineering team to establish best practices.Strong experience in Python, Selenium and API testing is required.Exposure to AWS and...

  • AI Engineer

    2 weeks ago

    Palakkad, Kerala, India Universal Software Full time

    About the Role: We are seeking a highly skilled and innovative AI Engineer to join our team. The ideal candidate will design, develop, and deploy AI and machine learning solutions to solve complex business problems. You will work closely with cross-functional teams to integrate AI models into products and services, ensuring scalability, performance, and...

  • Senior AI Engineer

    1 day ago

    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Key ResponsibilitiesThis role entails the design, development, and deployment of AI-driven solutions leveraging the Azure ecosystem. A strong background in machine learning, generative AI, and large language models (LLMs) is essential.Core responsibilities include:Creating end-to-end ML pipelines for data preparation, training, validation, and...

  • Ai/ml engineer

    6 days ago

    Palakkad, Kerala, India Lingaro Full time

    AI/ML Engineer – Senior ConsultantAI Engineering Group is part of Data Science & AI Competency Center and is focusing technical and engineering aspects of DS/ML/AI solutions. We are looking for experienced AI/ML Engineers to join our team to help us bring AI/ML solutions into production, automate processes, and define reusable best practices and...

  • AI Engineer/Developer

    2 days ago

    Palakkad, Kerala, India Repladder Full time

    Company DescriptionRepladder is claygency + workflow automation agency that helps businesses build scalable lead generation engines through data-driven strategies and execution. Our team focuses on cold outreach, custom targeting, and automated workflows to generate pipeline growth efficiently. Whether you're a startup seeking your first customers or a...

  • AI Engineering Leader

    2 days ago

    Palakkad, Kerala, India beBeeInnovator Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock the Future of Technology with Our AI Architect RoleJob DescriptionHiring an experienced Technology Architect to design and develop large-scale software applications, define technology roadmaps, and lead cutting-edge projects.Key ResponsibilitiesDevelop and implement enterprise application architectureLead design and development for large-scale...

  • AI Systems Engineer

    5 days ago

    Palakkad, Kerala, India beBeeArtificial Full time ₹ 20,00,000 - ₹ 30,18,617

    Agentic AI Engineer RoleAt the forefront of innovation, we are seeking a highly skilled Agentic AI Engineer to join our team.As an Agentic AI Engineer, you will be responsible for designing and implementing agentic AI systems with stateful reasoning, memory, and orchestration. You will develop Digital Twin AI Employees using LLMs, SLMs, and custom...

  • Senior Test Automation Specialist

    1 day ago

    Palakkad, Kerala, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 20,00,000

    Automation Tester Role OverviewAs a seasoned Automation Tester, you will play a pivotal role in ensuring the quality and reliability of our software solutions. This challenging position requires expertise in ACCELQ, self-healing test frameworks, and AI-powered testing.Key Responsibilities:Minimum 6+ years of experience in automation testing with a strong...

  • Advanced Test Automation Engineer

    2 days ago

    Palakkad, Kerala, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: C# QA Automation EngineerWe are seeking an experienced QA Automation Engineer to join our team. As a key member of the automation group, you will be responsible for designing and developing automated test frameworks using C#, Selenium and other tools.Key Responsibilities:- Design and develop automated test frameworks using C#, Selenium, and other...