AI Quality Assurance Expert

4 days ago

Hyderabad, Telangana, India beBeeQuality Full time ₹ 55,00,000 - ₹ 82,50,000

Job Opportunity:

As a Senior Quality Assurance Engineer, you will play a crucial role in ensuring the quality of AI-generated content and ML/AI products.

Key Responsibilities:

  • Develop comprehensive test strategies in collaboration with Product and Development teams to drive end-to-end quality deliverables
  • Act as the voice of quality to evaluate the quality, accuracy, performance, and safety of AI-generated content produced by LLMs
  • Create and maintain test automation frameworks to streamline testing processes
  • Lead development of test datasets (synthetic, autogenerated, edge cases) to support accurate model assessment
  • Collect, analyze, and report quality metrics from test execution and create defects based on results patterns
  • Contribute to refining evaluation criteria and methodologies for model assessment to improve AI evaluation frameworks
  • Support engineering organizations in troubleshooting or addressing issues with applications and dev/test environments
  • Stay up to date with latest developments in LLMs and AI ethics to enhance evaluation capabilities

Requirements:

  • 5+ years professional experience in software quality engineering with a focus on AI/Machine learning
  • Hands-on experience with testing machine learning and Generative AI systems, including validation of model predictions and integration testing of end-to-end AI workflows
  • Working knowledge of synthetic data generation techniques and prompt engineering
  • Understanding of core AI principles, including agentic AI, algorithms, models, and ethical considerations
  • Experience working within different automated testing frameworks, including Java, JUnit, Selenium, TestNG and other open-source projects
  • Ability to diagnose issues, come up with a strategy for relief, permanent fix and RCA and implement it
  • Fluency in programming language / scripting in Java and Python
  • Expert working knowledge and ability to use tools (such as IDE, debugger, build tools, source control, ServiceNow instances, profilers, system administration/Unix tools) to assist with daily tasks
  • Experience with the agile methodology for software development teams
  • Experience driving cross-team technical discussions with an understanding of SDLC

Benefits:

  • Opportunity to work on cutting-edge AI and ML projects
  • Collaborative team environment
  • Professional growth and development opportunities
  • Competitive compensation and benefits package

Preferred Qualifications:

  • Experience in leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving

  • AI Quality Assurance Specialist

    6 days ago

    Hyderabad, Telangana, India beBeeGenerative Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job Title: AI Quality Assurance SpecialistWe are seeking a detail-oriented Ai QA Engineer to ensure the accuracy, safety, and performance of AI-driven applications. In this role, you will be responsible for designing and executing test strategies, developing automation frameworks, and validating AI outputs to maintain high-quality user experiences.Key...

  • Innovative Quality Assurance Expert

    4 days ago

    Hyderabad, Telangana, India beBeeQuality Assurance Full time ₹ 1,20,00,000 - ₹ 1,70,00,000

    Software Development Engineer in Test RoleThis is a high-profile position that demands exceptional quality assurance and control expertise to guarantee the excellence of software solutions.The ideal candidate will be part of an autonomous agile team and interact with colleagues on release deliverables, setting up production & QA environments independently,...

  • Quality Assurance Automation Expert

    5 days ago

    Hyderabad, Telangana, India beBeeAutomation Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Quality Assurance Automation ExpertAs a Quality Assurance Automation Expert, you will play a pivotal role in ensuring the delivery of high-quality software products by collaborating with global teams to drive innovation and problem-solving.Responsibilities include planning and executing change management through a formal process, as well as executing manual...

  • Quality Assurance Expert

    14 hours ago

    Hyderabad, Telangana, India beBeeQualityAssurance Full time US$ 1,80,000 - US$ 2,50,000

    Job OpportunityWe are seeking a Quality Assurance expert to join our team. The successful candidate will be responsible for executing QA for enterprise order-to-cash product implementations globally.About the Role:The ideal candidate will have experience in quality assurance functions like test case planning, execution, issue reporting, and regression...

  • AI/ML Quality Assurance Specialist

    4 days ago

    Hyderabad, Telangana, India beBeeQuality Full time ₹ 1,20,00,000 - ₹ 1,60,00,000

    AI/ML Quality Assurance EngineerWe are seeking a talented and detail-oriented AI/ML Quality Assurance Engineer to join our dynamic team. As a key member of our organization, you will play a crucial role in ensuring the quality and reliability of cutting-edge AI and machine learning solutions that transform our industry.Your primary responsibility will be to...

  • Software Quality Assurance Expert

    17 hours ago

    Hyderabad, Telangana, India beBeeAutomation Full time ₹ 12,00,000 - ₹ 25,00,000

    Quality Assurance Automation EngineerAs a seasoned Quality Assurance Automation Engineer, you will play a pivotal role in ensuring the highest quality of our software products. With 8-12 years of experience, you will leverage your expertise to collaborate with global teams of engineers, product managers, and stakeholders.Key ResponsibilitiesDesign and...

  • Senior Quality Assurance Expert

    1 week ago

    Hyderabad, Telangana, India beBeeQuality Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleDevelop a career as a Senior Quality Assurance Expert, focusing on product excellence.Work collaboratively with cross-functional teams to craft high-quality products.Key Requirements:Achieve exceptional results through automation and testing methodologies.Integrate and execute test plans and regression suites effectively.Cultivate continuous quality...

  • Automation Quality Assurance Expert

    6 days ago

    Hyderabad, Telangana, India beBeeAutomation Full time ₹ 5,00,000 - ₹ 10,00,000

    Job Title: Automation Quality Assurance ExpertJob Description:We are seeking a skilled Automation Quality Assurance expert to join our organization. The ideal candidate will have strong testing fundamentals, including test processes, design techniques, defect management, and methodologies.Key Responsibilities:Experience working in agile models, with a...

  • Engineer Quality Assurance

    3 days ago

    Hyderabad, Telangana, India Tungsten Automation Full time

    Job DescriptionManagement and staff in Tungsten Automation&aposs Quality Assurance job family help the company to assure that its products and technology solutions are designed and built in accordance with company standards and customer requirements. The position of Engineer is a core, entry-level departmental role and appointees are expected to perform...

  • Quality Assurance Engineer

    6 days ago

    Hyderabad, Telangana, India beBeeQuality Full time ₹ 15,00,000 - ₹ 17,00,000

    Job Opportunity: Quality Assurance Engineer">We are seeking a highly skilled Quality Assurance (QA) Engineer to join our team. As a QA Engineer, you will play a crucial role in ensuring the quality of our software products.">Mandatory Skills:- Proficiency in Playwright with JavaScriptOptional Skills:- Experience with Salesforce- Knowledge of API automation...