Senior QA Engineer

The Role

We're looking for a Senior QA Engineer to build our quality assurance, monitoring, and performance

testing infrastructure from the ground up. You'll be our one-stop shop for ensuring product quality across the entire stack—from front-end user experience to backend services to AI agent reasoning.

You'll proactively identify issues before they reach production, set up comprehensive monitoring systems, and establish the QA processes that scale with our growth.

What You'll Do

• Design and implement comprehensive QA strategies for our full-stack platform (front-end, back-end, and AI agent systems)
• Proactively test all product aspects across multiple integration points (GitHub, AWS, and various monitoring tools)
• Develop and maintain automated test suites for regression, integration, and end-to-end testing
• Create specialized testing frameworks for AI agent behavior and reasoning accuracy
• Establish QA processes within GitHub PR workflows and CI/CD pipelines
• Build and configure monitoring infrastructure using Sentry, Grafana, LangSmith, and other observability tools
• Design intelligent alerting systems that catch issues before they impact customers
• Create dashboards for real-time system health, performance metrics, and AI reasoning quality
• Set up audit logging and compliance monitoring for SOC2, HIPAA, and GDPR requirements
• Develop performance testing frameworks and establish baseline metrics across all system layers
• Conduct load testing and stress testing for enterprise-scale deployments
• Implement vulnerability scanning and tracking for dependencies and infrastructure
• Integrate security testing into CI/CD workflows
• Build QA processes from scratch with significant influence on our approach to quality
• Establish best practices for test coverage, documentation, and quality metrics
• Integrate QA gates into our Scrum development process
• Champion quality culture across the engineering organization

Required Experience

• 5+ years of QA engineering experience with at least 2 years in a senior role
• Full-stack testing expertise: proven track record testing complex web applications, backend APIs, and distributed systems
• Monitoring tools: hands-on experience with Sentry, Grafana, or similar observability platforms
• CI/CD integration: experience implementing automated testing in GitHub Actions or similar platforms
• Performance testing: experience with load testing tools and performance benchmarking
• Security awareness: familiarity with vulnerability scanning and security testing practices

Technical Skills

• Strong scripting/programming skills (Python, JavaScript, or similar) for test automation
• Experience with testing frameworks (Playwright, Cypress, pytest, Jest, etc.)
• Understanding of cloud infrastructure (AWS) and distributed systems testing
• Familiarity with containerization (Docker, Kubernetes)
• Experience with API testing and REST/GraphQL service validation

AI/ML Testing (Bonus)

• Experience testing AI/ML systems, LLM-based applications, or agent-based architectures
• Familiarity with tools like LangSmith or similar AI observability platforms
• Understanding of non-deterministic system testing and AI accuracy validation

Qualities We Value

• Self-starter: you thrive in ambiguous situations and can build processes from zero
• Proactive: you find problems before they find us
• Systems thinker: you understand how components interact across complex architectures
• Quality advocate: you're passionate about building reliable, high-quality systems

Why Join Us

• Build from scratch: establish QA practices and monitoring infrastructure with significant autonomy
• Enterprise impact: your work directly affects Fortune 500 customers
• Technical challenges: work with cutting-edge AI reasoning technology and complex distributed systems
• Growth opportunity: join a company with meaningful traction and enterprise revenue

Our Stack & Tools

• Languages: Python, JavaScript/TypeScript
• Infrastructure: AWS, Kubernetes, Docker
• Monitoring: Sentry, Grafana, LangSmith, PostHog
• Databases: PostgreSQL, MongoDB
• AI/ML: LangChain, various LLM providers
• Development: GitHub, Scrum methodology

To Apply: Please include examples of monitoring systems or QA processes you've built from scratch, and describe your experience testing AI/ML systems (if applicable)