About the role
Think Different. Build the Future. 🚀 Our Mission Build everyday AGI. Trustworthy, consumer-grade agents that redefine human–AI collaboration for millions. Software shouldn’t wait for commands; it should partner with you, amplifying what you can do every single day. Why AGI, Inc. We’re a stealth team of elite founders and AI researchers, with backgrounds spanning Stanford, OpenAI, and DeepMind . We’re industry leaders in mobile and computer-use agents, bringing these capabilities to consumer scale. Grounded in years of agent research, our AI is designed with trustworthiness and reliability as core pillars, not afterthoughts. We are supported by tier-1 investors who funded the first generation of AI giants; now they’re backing us to build the next: everyday AGI. (Watch the demo ) If you see possibility where others see limits, read on. You decide what "better" means. Models, agents, and product features all ship behind one question: did this actually get better? Without a strong evals function, the lab ships vibes. With one, every training run, every prompt change, every agent capability moves a number we trust — and
the team makes decisions on real signal, not the loudest opinion in the room. You'll build the eval harness for AGI — across model capability, agentic behavior, on-device performance, and end-user experience. You'll set the bar for what counts as "shipped" and protect it from the gravity of product deadlines. 🤩 Tasks you will own The eval suites that gate every model and agent release — capability, behavior, regressions, and human-rated rubrics that catch what automated evals miss The dashboards and tooling that make researcher experiment loops fast and leadership decisions easy The bar — what counts as ready to ship, and how we know 🤚 Areas where you will assist Research, by making sure what we measure is what we want Product engineers, by instrumenting real-user behavior on real devices Partnerships, by translating "did it get better" into language an OEM partner can hold us to 📚 Skills you'll be expected to teach How to measure non-deterministic systems — agent eval, tool use, long-horizon tasks, multilingual behavior How to push back on a metric that's being gamed without breaking
Amazon Alexa Fund