AI Tester

Job Summary:

As a Tester AI Application Development at Emerson, you will be responsible for ensuring the quality and reliability of AI-driven applications by testing, verifying, and validating the software through automated and manual testing methods. You will work closely with data scientists, software engineers, and other collaborators to improve the performance and usability of AI applications.

In this Role, Your Responsibilities Will Be:  

• Design and implement detailed test plans and test cases for AI-based applications to ensure the functionality, performance, and security meet the standards and requirements
• Conduct rigorous tests on AI-based applications, including generative models, AI Assistant/AI agent platforms, and machine learning algorithms, to assess their effectiveness, accuracy, and usability
• Identify, document, and report defects, bugs, and AI behavior anomalies. Test for AI's response consistency, context understanding, and the ability to generate relevant outputs; collaborating with the development team to resolve issues
• Develop and implement automated test scripts for AI models, ensuring scalability and efficiency in testing
• Work with data engineers, data scientists, and development teams to prepare test data for training, validation, and testing of AI models
• Conduct functional testing, regression testing, load testing, and performance testing for AI-powered applications; ensuring no regression issues or performance drops after model retraining or new version releases
• Assist in training and fine-tuning AI models based on real-world user feedback and test results. Provide validation to ensure ethical AI standards are met
• Identify, document, and report defects found during the testing phases, collaborating with the development team to resolve issues
• Analyze and validate the performance of machine learning models and AI outputs critically, identify biases, edge cases through testing and ensure that the application meets the encouraged accuracy, precision, and other performance metrics
• Contribute to improving the overall QA processes and testing frameworks used for AI development
• Maintain detailed documentation of test procedures, test cases, and testing results for accountability and repeatability.
• Perform exploratory testing to uncover potential issues with AI application features and functionality

Who You Are:  

• Cross-functional teammate
• Detailed, organized, flexible, and proactive teammate
• Willing to accept feedback and implement changes quickly and with a positive attitude
• Comfortable working in an Agile development environment

For This Role, You Will Need:

• Bachelor's degree and 2+ years of relevant experience or a master's degree and 1+ year of relevant experience
• Strong knowledge of AI technologies, machine learning frameworks, and NLP, RAG, OCR
• Outstanding English writing and verbal communication skills
• Ability to develop product understanding by working closely with product developers in an Agile development environment
• Ability to design and organize document structure
• Curiosity about hands-on installation, configuration and use of the software to further develop product understanding
• Understanding of accepted technical writing style conventions
• Experience in writing technical documents
• Ability to work collaboratively as part of a team
• Self-motivated and able to work independently
• Ability to simultaneously handle multiple projects and monitor their progress with minimal direction
• Excellent time management skills and ability to meet deadlines
• Strong research skills

  Preferred Qualifications that Set You Apart   

• Bachelor's Degree in Computer Science, Engineering, or a related field.
• 3+ Years experience in Quality Assurance testing for AI-based applications, machine learning models, generative AI models or software development
• Knowledge of ethical AI principles and bias detection in AI models
• Proficiency with automated testing tools e.g., Selenium; AI tools and platforms (such as TensorFlow, PyTorch, OpenAI, GPT, Copilot etc.)