AI QA Engineer

3 days ago

Bengaluru, Karnataka, India GE Vernova Full time ₹ 8,00,000 - ₹ 24,00,000 per year
Job Description SummaryGE Vernova is seeking a highly skilled AI QA Engineer to lead the development of benchmark frameworks for AI systems & use cases deployed. This role is critical to ensuring the accuracy, reliability, safety, and compliance of AI models driving innovation at GE Vernova. The ideal candidate will design and implement rigorous testing frameworks tailored for AI use cases unique to GE Vernova.Job Description
  • Design, develop, and execute comprehensive benchmark frameworks to evaluate AI use cases, prompt performance, robustness, across diverse array of use cases.
  • Develop automated testing suites to validate AI functionalities such as prediction accuracy, response consistency, case handling, bias detection, and model degradation over time.
  • Collaborate closely with Prompt Engineers, AI Agent Engineers and product owners to define quality standards, acceptance criteria, and key performance indicators (KPIs) for AI deployments.
  • Conduct quantitative and qualitative evaluations of AI outputs ensuring alignment with business objectives, regulatory standards, and ethical AI principles.
  • Monitor AI use cases performance in production, systematically identify issues, and recommend improvements to maintain high standards of AI quality and safety.
  • Document testing methodologies, framework designs, quality metrics, and ensure thorough reporting to stakeholders.
  • Support continuous improvement initiatives by incorporating feedback loops and new benchmarking techniques as AI technologies evolve.
  • Provide training and mentorship on AI testing best practices within GE Vernova's Prompt engineering and AI Agent Engineering team.
  • Stay current with emerging AI technologies, contribute to platform and tooling improvements, and share knowledge within the team.

Required Qualifications and Skills:

  • Master's degree in Computer Science, AI Engineering, Data Science, or related field.
  • 3+ years of experience in software quality assurance with at least 2 years focused on AI/ML systems.
  • Proven track record designing and implementing AI benchmark frameworks or quality assurance strategies.
  • Strong programming skills in Python and experience with automated testing frameworks (e.g., pytest, Selenium).
  • Familiarity with RAG systems, vector databases, and GenAI architectures.
  • Deep understanding of machine learning models, LLMs, and AI validation methodologies.
  • Experience with AI fairness, bias detection, and responsible AI practices.
  • Knowledge of cloud environments (AWS, Azure, or GCP), containerization, and deployment pipelines.
  • Ability to analyze complex datasets and performance metrics quantitatively and qualitatively.
  • Strong communication skills with ability to document and present technical information clearly.
  • Hands-on experience with LLMs, prompt engineering, and natural language processing (NLP).
  • Knowledge of agent orchestration platforms and multi-agent systems (e.g., AutogenAI, LangGraph, MCP protocol).
Additional Information

Relocation Assistance Provided: Yes

  • QA Automation Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    This role is for one of the Weekday's clientsMin Experience: 8 yearsLocation: BengaluruJobType: full-timeAs a QA Automation Engineer, you will own end-to-end quality assurance for complex, distributed, and AI-powered systems. You will build robust automation frameworks, strengthen test coverage, and partner closely with engineering, data science, and product...

  • AI QA Architect

    22 hours ago

    Bengaluru, Karnataka, India Streamline Healthcare Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience Level: 15+ years in QA, with 3+ years in AI/GenAI solutioningRole OverviewThis role requires a blend of technical depth, AI solution development skills, and architectural vision to drive innovation in Quality Assurance and accelerate intelligent test automation.We are seeking an AI QA Architect with a strong background in Quality Engineering and...

  • Qa Engineer-Clear AI

    3 days ago

    Bengaluru, Karnataka, India Continuity 1 Full time ₹ 50,00,000 - ₹ 1,20,00,000 per year

    Role & responsibilitiesTitle:Senior QA Engineer CLEAR AIJob Overview:We are looking for a Senior / Lead QA Engineer with hands-on experience in end-to-endtesting of AI/ML-powered and cloud-based media platforms.The ideal candidate is not only technically proficient but also AI-aware in their QAapproach — informed on the latest AI test strategies,...

  • QA Automation Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Weekday AI (YC W21) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    This role is for one of the Weekday's clientsMin Experience: 8 yearsLocation: BengaluruJobType: full-timeAs a QA Automation Engineer, you will own end-to-end quality assurance for complex, distributed, and AI-powered systems. You will build robust automation frameworks, strengthen test coverage, and partner closely with engineering, data science, and product...

  • QA Engineer

    2 weeks ago

    Bengaluru, Karnataka, India AI Squared Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Position OverviewWe are seeking a skilled and proactive QA SDET – 2 to join our distribution team. This isn't your typical "just run the test cases" role. We need someone who can deeply understand our AI ecosystem, take ownership of quality across the product, and drive testing excellence through automation and first-principles thinking. You'll work...

  • QA Engineer

    2 weeks ago

    Bengaluru, Karnataka, India AI Squared Full time ₹ 8 - ₹ 15 per year

     Position OverviewWe are seeking a skilled and proactive QA SDET – 2 to join our distribution team. This isn't your typical "just run the test cases" role. We need someone who can deeply understand our AI ecosystem, take ownership of quality across the product, and drive testing excellence through automation and first-principles thinking. You'll work...

  • Senior QA Engineer – CLEAR AI

    23 hours ago

    Bengaluru, Karnataka, India DNEG Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Job Title: Senior QA Engineer – CLEAR AILocation: Bangalore / HybridRole Overview:We are looking for a Senior / Lead QA Engineer with hands-on experience in end-to-end testing of AI/ML-powered and cloud-based media platforms.The ideal candidate is not only technically proficient but also AI-aware in their QA approach — informed on the latest AI test...

  • Staff Quality Assurance Engineer(QA with AI Expertise)

    2 weeks ago

    Bengaluru, Karnataka, India Findem Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    What is Findem: Experience:15Yrs-15+ years of experience in Quality Assurance / SDET roles with deep expertise in testing, automation, and modern AI-assisted QA processes. About the role: As our products and AI-driven features continue to expand, we're looking for a Staff Quality Assurance Engineer to help us scale QA through AI and automation. You'll...

  • Staff/Senior-Staff/Principal Engineer – Network Switch SDK QA

    1 week ago

    Bengaluru, Karnataka, India Eridu AI Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Position OverviewWe're looking for a Technical Leader for Network SDK QA to own the quality and reliability of our platform software stack and switching SDK that drives our next-generation chassis.This is a hands-on technical leadership role — you'll define QA strategy, design test frameworks, mentor engineers, and directly validate the core SDK...

  • AI engineer

    5 days ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 8-15 LPA)Min Experience: 6 yearsLocation: NOIDA, Bengaluru, NCR, Delhi, GurugramJobType: full-timeWe are seeking a highly skilled and motivated AI Engineer with deep expertise in Generative AI (Gen AI) and Large Language Models (LLMs) to join our innovative AI team. The ideal candidate...