AI Testing Specialist

Job Overview

Software Quality Assurance Engineer III Role:

We are seeking a highly skilled and experienced Software Quality Assurance (SQA) Engineer III to join our innovative team. As a key member of our AI testing group, you will play a crucial role in evaluating the performance, accuracy, and reliability of our generative AI models.

Your Key Responsibilities:

• \
• Design and implement comprehensive testing strategies for generative AI models, focusing on functionality, performance, and usability testing.\
• Develop and maintain test cases, scripts, and testing frameworks tailored for generative AI applications.\
• Conduct thorough performance evaluations and provide detailed reports on model outputs, identifying areas for improvement.\
• Collaborate with cross-functional teams to define testing requirements and ensure alignment with project goals.\
• Analyze and interpret model behavior and outputs, providing feedback to the development team for optimization.\
• Stay up-to-date with the latest advancements in AI and testing methodologies to enhance testing processes.\
• Participate in code reviews and contribute to the overall quality assurance of AI projects.\
• Support data analysts by providing prepped and clean data for accurate analysis.\
• Contribute to reporting and analysis functions enabling data-driven decision-making, supporting business objectives.\
• Work independently or with guidance as needed, demonstrating flexibility and adaptability.\
• Actively participate in software requirement evaluation and review with developers and business system analysts to define complete test plans and scenarios.\
• Create and compose clear, concise test summary reports and weekly status reports offering valuable insights.\
  • \
  • Bachelor's degree in computer science, data science, engineering, or a related field is required.\
    • \
    • 7+ years of experience in software testing, preferably with a focus on AI/ML applications.\
    • Familiarity with generative AI concepts and technologies is desired.\
    • Proficiency in programming languages such as Python, Java, or similar is essential.\
    • Strong analytical skills and attention to detail are necessary.\
    • Excellent communication and collaboration abilities are required.\
    • Experience with testing frameworks and tools like Selenium and PyTest is preferred.\
    • End-to-End Test Automation experience with frontend web apps and non-GUI applications (backend, REST APIs, data) is beneficial.\
    • Knowledge of code versioning tools like GitHub and CI-CD pipelines is advantageous.\
    • Working knowledge of Oracle, MSSQL, AWS S3, and SQL IDEs like SQL Developer/DB Visualizer/Toad is desirable.\
    • Ability to analyze and understand ETL workflows, ensuring reliable and efficient data processes.\
    • Proficiency in Python programming language, enabling efficient data manipulation and analysis.\
    • Familiarity with cloud infrastructure like AWS or Azure and respective cloud storage systems like AWS S3/Azure Blob is beneficial.\
    • Experience in development models such as Agile or waterfall, ensuring successful project execution.\
    • Strong analytical skills, attention to detail, and ability to work both independently and collaboratively.\
    • Experience in backend validation of reports developed using tools like Tableau or POWER BI, ensuring accurate and reliable reporting.\
    • Strong experience in data analytical testing and a good understanding of the data model, enabling data-driven decision-making.\
    • Ability to work in a fast-paced environment with minimal supervision, demonstrating self-motivation and accountability.\
    • Strong technical, problem-solving, project coordination, and analytical skills, ensuring successful project outcomes.\
    • Ability to work on multiple releases and projects simultaneously and in different time zones if required.\
      • \
      • Experienced in NFR testing like load & performance using JMeter/LoadRunner.\

What We Offer:

Our organization offers a dynamic work environment with opportunities for growth and professional development. We value diversity, inclusion, and collaboration, and strive to create a workplace where everyone can thrive.

Join us in shaping the future of AI testing and become a part of a talented team that is passionate about innovation and excellence.