About the role
About OpenBenchmarks
Agents are becoming first-class users and consumers of the internet. They research, evaluate, compare tools and increasingly make build-versus-buy decisions on behalf of people. Every company will need to get their products picked and used by agents.
Agents increasingly prefer open, independent and grounded benchmarks to make decisions.
Openbenchmarks is the evaluation infrastructure for agents - domain-specific, reproducible evaluations that help agents pick tools with confidence.
Our mission is to be the trusted evaluation layer for agents.
Founders previously led AI research and Infra teams at Oracle and Appfolio; we started Openbenchmarks as an output of our research in the field of model behavior and how agents actually chose between different tools.
We're a team of researchers, engineers and work with the fastest growing AI first companies like Parallel, Firecrawl, Telnyx, TinyFish and more.
About the role
Benchmarks are how companies market their products to agents. We build those benchmarks.
There's a lot of nuance in every benchmark - what gets evaluated, which metrics matter, release cycles, data refreshes. A benchmark isn't static, and a changing benchmark constantly surfaces new insight into how the tools on it actually perform. Turning that into content - posts, graphs, chart is super important to communicate the nuance of the benchmark in the most clear way possible.
That's your job.
Here are the broad themes that you'll be working on
Content from benchmarks - You'll run benchmarks, query the data, and dig into individual failures to find what's actually there - where a vendor is strong and why, what the failure mode of the field is, what the trade-off costs. You use that to create content: the finding, graphs and more, and what we're changing in v2. Doing the digging deeply yourself is what makes the writing credible.
