Gen AI Python Test Engineer

Job Description:

Quality Assurance (QA) Engineer is a professional responsible for ensuring the quality and reliability of software applications by developing, executing, and maintaining automated test scripts. Their primary focus is on using automated testing tools and frameworks to create tests that can be run automatically to validate the functionality, performance, security, and usability of genAI products.

Responsibilities

· Test Automation Development:

o Design, develop, and maintain automated test scripts using various tools and frameworks (e.g., Selenium, Cypress, Appium, JUnit, TestNG).

o Implement automated tests for different aspects of the software, such as functional, regression, integration, and performance testing.

· Conversational Flow Testing:

o Experience in testing GenAI based applications.

o Evaluate the conversational flow and user interactions to ensure natural and intuitive user experiences.

o Analyse model outputs to identify and mitigate potential biases across different demographics and data segments.

· Test Planning & Strategy:

o Collaborate with development and product teams to understand application features and requirements.

o Develop comprehensive test plans and strategies that incorporate both manual and automated testing approaches.

· Framework Development & Maintenance:

o Build and maintain test automation frameworks to support automated testing efforts.

o Ensure that the automation framework is scalable, reusable, and capable of accommodating new features and updates.

· Continuous Integration & Continuous Deployment (CI/CD):

o Integrate automated tests into CI/CD pipelines (Azure DevOps) to ensure that automated tests are executed as part of the build process.

o Work closely with DevOps teams to maintain and optimize automated testing in the deployment cycle.

· Test Execution & Reporting:

o Execute automated test scripts, analyze results, and report any defects or issues found.

o Provide detailed documentation and reports on test coverage, test results, and any identified issues.

· Defect Identification & Analysis:

o Identify, log, and track software defects to resolution.

o Work with development teams to troubleshoot and resolve issues found during automated testing.

· Tool & Technology Evaluation:

o Stay up-to-date with the latest trends in test automation tools and frameworks.

o Evaluate and recommend new tools and practices to improve the efficiency and effectiveness of the testing process.

Technical requirements

· Programming Languages: Proficiency in programming languages such as Python (mandatory), Java, C#, or JavaScript.

· LLM – Azure openAI, Gemini, Llama knowledge, NLP, Must have

· Testing Tools & Frameworks: Experience with automated testing tools and frameworks like Selenium, Appium, Cypress, JUnit, TestNG, and others.

· CI/CD Tools: Familiarity with CI/CD tools like Jenkins, GitLab CI, CircleCI, or Azure DevOps.

· Version Control: Proficiency with version control systems such as Git.

· APIs & Web Services: Experience in testing APIs and web services using tools like Postman or REST Assured.

· Agile Methodology: Understanding of Agile methodologies and experience working in Agile environments.