Quality Assurance Engineer

Position Title: Quality Assurance Engineer

Location: Remote

Position Overview

As a Quality Assurance Engineer specializing in AI/ML Model Validation, you will define and develop comprehensive test plans and test cases within a cross-functional agile team and contribute to the efficient and quality-oriented delivery of AI/ML systems. You will be the quality expert with deep knowledge of machine learning validation techniques, test automation using Playwright, and microservices architecture. Be the go-to person for ensuring AI model accuracy, reliability, and performance working closely with data scientists, ML engineers, and DevOps teams while having a full understanding of the product and its impact on end users.

Responsibilities and Deliverables

• Develop and execute comprehensive testing strategies for AI/ML models
• Design, develop, and maintain end-to-end automated test suites using Playwright (TypeScript/JavaScript) for web applications and API testing
• Validate AI model performance and monitor model drift over time, implementing automated alerts for performance anomalies or degradation
• Conduct data quality assessments and validation to ensure training and inference data integrity, including data collection, preparation, and validation processes
• Implement contract testing and integration testing strategies specifically tailored for microservices architecture
• Work in a Scrum team using Agile best practices and collaborate with data scientists, developers, and product managers throughout the software development lifecycle
• Fully understand defects detected through testing, reproduce issues with clear instruction of how to replicate, troubleshoot defects to manage tracking and resolution processes
• Establish and maintain good working relationships with peers in Development, Data Science, Product Management, Professional Services, and external clients
• Participate as a release coordinator and ensure the release process is followed, integrating automated tests into CI/CD pipelines (GitHub Actions, Jenkins, etc.)
• Participate in improving processes, test automation frameworks, AI/ML validation methodologies, and integration to DevOps culture
• Perform chaos engineering and fault injection testing to validate service resilience in distributed systems
• Create and maintain comprehensive test documentation, automation frameworks, and quality dashboards for stakeholder visibility

Qualifications:

• Bachelor's degree in Computer Science, Software Engineering, Machine Learning, or related technical field, or equivalent practical experience
• 4+ years of experience in software quality assurance with 2+ years focused on test automation using modern frameworks
• 2+ years hands-on experience with Playwright for UI and end-to-end automation testing (TypeScript/JavaScript required)
• 1+ years of experience testing AI/ML systems, data-driven applications, or machine learning models with understanding of ML concepts, algorithms, and model evaluation metrics
• Strong work ethic with a positive attitude and a passion for Quality Assurance in AI/ML domains
• Proficiency in programming languages such as Python, JavaScript/TypeScript for test automation and scripting
• Experience with API testing (REST, GraphQL) using tools like Postman, REST Assured, or similar frameworks
• Knowledge of microservices architecture, containerization (Docker), and orchestration (Kubernetes)
• A continuous learner with motivation to explore industry-leading AI/ML testing techniques and automation tools with the drive to share knowledge with colleagues
• Strong analytical and problem-solving skills with meticulous attention to detail
• Excellent time and risk management skills with ability to prioritize and manage multiple testing activities
• Team player with effective interpersonal and communication skills (written and oral) to collaborate across technical and non-technical teams
• Flexible, self-motivated, and comfortable working with multiple teams in a fast-paced environment
• Strong ability to adapt and be flexible in changing project environment to meet deadlines
• Passionate about understanding customer needs and delivering high-quality, secure, performant products
• Experience with Git version control, CI/CD pipelines, and Agile/Scrum methodologies
• Strong understanding of software QA methodologies, SDLC, STLC, and testing best practices
• Ability to build high-quality, secure, performant solutions and willing to pursue new learning in AI/ML testing domains
• Flexible with mode of communication, whether it be with coworkers in-person or online, able to contribute to an inclusive mindset to promote collaboration

Job Type: Permanent

Pay: ₹800, ₹1,000,000.00 per year

Experience:

• Python: 3 years (Required)
• Playwright: 4 years (Required)

Work Location: Remote