AI Tester

Job Summary:As a Tester AI Application Development at Emerson, you will be responsible for ensuring the quality and reliability of AI-driven applications by testing, verifying, and validating the software through automated and manual testing methods. You will work closely with data scientists, software engineers, and other collaborators to improve the performance and usability of AI applications.In this Role, Your Responsibilities Will Be: Design and implement detailed test plans and test cases for AI-based applications to ensure the functionality, performance, and security meet the standards and requirementsConduct rigorous tests on AI-based applications, including generative models, AI Assistant/AI agent platforms, and machine learning algorithms, to assess their effectiveness, accuracy, and usabilityIdentify, document, and report defects, bugs, and AI behavior anomalies. Test for AI's response consistency, context understanding, and the ability to generate relevant outputs; collaborating with the development team to resolve issuesDevelop and implement automated test scripts for AI models, ensuring scalability and efficiency in testingWork with data engineers, data scientists, and development teams to prepare test data for training, validation, and testing of AI modelsConduct functional testing, regression testing, load testing, and performance testing for AI-powered applications; ensuring no regression issues or performance drops after model retraining or new version releasesAssist in training and fine-tuning AI models based on real-world user feedback and test results. Provide validation to ensure ethical AI standards are metIdentify, document, and report defects found during the testing phases, collaborating with the development team to resolve issuesAnalyze and validate the performance of machine learning models and AI outputs critically, identify biases, edge cases through testing and ensure that the application meets the encouraged accuracy, precision, and other performance metricsContribute to improving the overall QA processes and testing frameworks used for AI developmentMaintain detailed documentation of test procedures, test cases, and testing results for accountability and repeatability.Perform exploratory testing to uncover potential issues with AI application features and functionalityWho You Are: Cross-functional teammateDetailed, organized, flexible, and proactive teammateWilling to accept feedback and implement changes quickly and with a positive attitudeComfortable working in an Agile development environmentFor This Role, You Will Need:Bachelor's degree and 2+ years of relevant experience or a master's degree and 1+ year of relevant experienceStrong knowledge of AI technologies, machine learning frameworks, and NLP, RAG, OCROutstanding English writing and verbal communication skillsAbility to develop product understanding by working closely with product developers in an Agile development environmentAbility to design and organize document structureCuriosity about hands-on installation, configuration and use of the software to further develop product understandingUnderstanding of accepted technical writing style conventionsExperience in writing technical documentsAbility to work collaboratively as part of a teamSelf-motivated and able to work independentlyAbility to simultaneously handle multiple projects and monitor their progress with minimal directionExcellent time management skills and ability to meet deadlinesStrong research skillsPreferred Qualifications that Set You Apart Bachelor's Degree in Computer Science, Engineering, or a related field.3+ Years experience in Quality Assurance testing for AI-based applications, machine learning models, generative AI models or software developmentKnowledge of ethical AI principles and bias detection in AI modelsProficiency with automated testing tools e.g., Selenium; AI tools and platforms (such as TensorFlow, PyTorch, OpenAI, GPT, Copilot etc.)