About the role
We're looking for an AI Quality Engineer with 0-7 years of experience who sits at the intersection of prompt engineering, QA engineering, and rigorous written communication. You should be comfortable working in an IDE, writing and testing prompts, debugging AI systems, and doing lightweight scripting (JavaScript, regex) with AI assistance. You must demonstrate exceptional precision in written communication and critical thinking — think "law clerk meets QA engineer meets AI enthusiast." No formal technical background required, but you must be willing to learn and apply rigorous judgment rather than blindly delegating to AI.
Responsibilities
- Review and debug AI agent outputs – identify issues across transcripts, recordings, and workflows, form hypotheses about root causes, and systematically eliminate possible failure modes
- Document issues rigorously – catalog symptoms, occurrences, and attempted fixes by issue class before escalating to engineers with full context
- Write, refine, and test prompts for AI agents – find edge cases and exceptions, then close quality loops via targeted prompt updates
- Write and validate lightweight scripts – use AI-assisted coding (Cursor) to build regex patterns and simple JavaScript, then critically verify they work before shipping
- Run a continuous quality flywheel – review all instances of a given issue class, implement fixes, and verify resolution end to end
- Collaborate cross-functionally with engineers to escalate and debug complex issues, and with CSMs and account managers to resolve customer-reported problems