Senior AI Test Engineer

2 weeks ago

Davangere, Karnataka, India beBeeGenerative Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

AI Testing Expert

We are seeking a skilled and detail-oriented professional with expertise in Generative AI testing to ensure the accuracy, safety, and performance of AI-driven applications.

Key Responsibilities:

  • Design, develop, and execute comprehensive test plans for Generative AI models and applications.
  • Validate AI-generated outputs for accuracy, coherence, bias, ethical considerations, and alignment with business requirements.
  • Develop and maintain automated testing frameworks for AI-based applications, ensuring scalability and efficiency.
  • Perform adversarial testing, edge case analysis, and security testing to assess AI vulnerabilities.
  • Collaborate with AI/ML engineers, product managers, and developers to refine model performance and mitigate errors.
  • Monitor AI model drift and ensure consistent performance across different inputs and datasets.
  • Conduct performance testing to evaluate response times, scalability, and reliability of AI systems.
  • Document test cases, test results, and defects while ensuring compliance with AI governance and ethical guidelines.
  • Continuously explore new tools and methodologies to improve AI testing processes.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in Quality Assurance, with at least 1-2 years in AI/ML testing or Generative AI applications.
  • Strong understanding of AI/ML concepts, NLP models, LLMs, and deep learning architectures.
  • Experience with AI testing tools such as LangTest, DeepChecks, Trulens, or custom AI evaluation frameworks.
  • Proficiency in test automation using Python, Selenium, PyTest, or similar frameworks.
  • Familiarity with model evaluation metrics such as BLEU, ROUGE, perplexity, and precision-recall for AI-generated content.
  • Knowledge of bias detection, adversarial testing, and ethical AI considerations.
  • Experience working with APIs, cloud platforms (AWS, Azure, GCP), and MLOps practices.
  • Strong analytical and problem-solving skills with attention to detail.
  • Excellent communication and collaboration skills to work in cross-functional teams.

  • Senior Test Automation Expert

    2 weeks ago

    Davangere, Karnataka, India beBeeSoftwareEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking an experienced Senior Software Development Engineer in Test to lead our automation efforts. This role is instrumental in ensuring the quality and reliability of our software.Key ResponsibilitiesDesign, develop, and maintain robust automation testing frameworks using Java for native mobile apps, web applications, and Progressive Web...

  • Sr. AI/ML Engineer

    3 weeks ago

    Davangere, Karnataka, India QuiqHire Full time

    A leading US-based AI Data Solutions provider is at the forefront of AI and ML innovation. They develop cutting-edge, cloud-native data solutions that tackle complex challenges and drive the future of intelligent technology. Their Hyderabad office is a core innovation hub, and we're looking for brilliant minds to join our mission.The Opportunity:We are...

  • Senior Test Automation Specialist

    2 weeks ago

    Davangere, Karnataka, India beBeeSoftware Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Automation EngineerJob Title: Automation EngineerWe are seeking a skilled automation engineer to join our team. As an automation engineer, you will play a vital role in designing and developing sophisticated automation frameworks and robust test suites for web, mobile, and API applications.Design and develop automation frameworks using Playwright, Selenium,...

  • Senior AI Innovation Lead

    2 weeks ago

    Davangere, Karnataka, India beBeeInnovation Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a visionary Senior AI Innovation Lead to drive solutioning and innovation initiatives within our AI Innovations Lab. This role involves designing, delivering, and scaling AI/ML solutions for clients in the financial services ecosystem.The ideal candidate brings a mix of hands-on technical expertise, strategic thinking, and...

  • Senior AI Strategist

    2 weeks ago

    Davangere, Karnataka, India beBeeArtificialintelligence Full time US$ 18,00,000 - US$ 22,00,000

    Job TitleA Senior AI Strategist will lead the development and execution of our AI strategy, aligning with business objectives and growth targets.Responsibilities:Develop AI Strategy: Develop a comprehensive AI strategy, outlining key initiatives and roadmaps to achieve business goals.Manage AI Projects: Oversee the end-to-end lifecycle of AI projects, from...

  • Senior AI Solutions Developer

    2 weeks ago

    Davangere, Karnataka, India beBeeEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    About the RoleWe are seeking a highly skilled and passionate Senior AI Engineer to join our innovative team. In this role, you will take ownership of the full lifecycle of cutting-edge AI solutions, from architectural design and implementation to successful deployment and ongoing optimization in a production environment.You will be empowered to drive key...

  • Senior Psychometric AI Specialist

    1 week ago

    Davangere, Karnataka, India beBeePsychometrician Full time ₹ 60,00,000 - ₹ 80,00,000

    Job OverviewWe are seeking a highly skilled Senior Psychometric AI Specialist to join our R&D team.This exciting role combines expertise in psychometrics with knowledge of artificial intelligence to design and improve assessment tools, while supporting consulting projects worldwide.Main Responsibilities:Ai Implementation in R&D:Design and integrate AI-based...

  • AI Engineer

    2 weeks ago

    Davangere, Karnataka, India beBeeAI Full time US$ 10,08,000 - US$ 10,80,000

    Job Opportunity: AI EngineerWe are seeking a skilled AI Engineer to join our team remotely in India. This is a temporary contract position with the possibility of extensions.Key Responsibilities:Support Digital Products Teams in the AI Center of Excellence to develop key prioritized Generative AI solutions.Develop expertise in Gen AI development, including...

  • Senior Salesforce Test Expert

    2 weeks ago

    Davangere, Karnataka, India beBeeTestEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    We are seeking a highly skilled Senior Salesforce Test Engineer with extensive expertise in quality assurance and testing, including 4+ years of experience in manual and automation testing.Key Responsibilities:Strong proficiency in manual and automation testingDeep understanding of the Salesforce ecosystem (Sales Cloud, Service Cloud)

  • Automated Test Engineer

    2 weeks ago

    Davangere, Karnataka, India beBeeAutomation Full time ₹ 18,00,000 - ₹ 24,00,000

    Job DescriptionAbout Us:We are a global IT services company with operations in over 50 locations across more than 25 countries. Our team specializes in digital engineering and IT services, helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation.We operate in Asia, Europe, and North America,...