About the role
What we're looking for
We need an engineer with 1-5 years of experience in RL environments, post-training data or evals who has built environments or benchmarks that a frontier lab trained or evaluated on. You should be comfortable going through real agent traces, figuring out which failures are real, and turning them into environments and benchmarks that labs will accept. You'll do this at an in-person seed-stage startup with high ownership. Bonus points if you've found a real flaw in a widely used benchmark, caught a model reward hacking your grader and fixed it, started a company (YC, SPC, Thiel or similar), or competed at a high level in math, programming, debate or games.
What you'll do
- Build synthetic environments from scratch, including a simulated company with every email, record and file generated, that an agent can work inside for weeks
- Own lab deliverables from start to finish. If you're handed a contract, you scope it, build it and ship what the frontier lab wants without hand-holding
- Go through production traces from Doe's agent platform to find real-world agent failures, then rebuild them as benchmarks and environments
- Build graders that still hold up when the agent knows more than any human reviewer, and harden them against reward hacking
- Simulate software like inboxes and CRMs well enough to survive an agent's tool calls
- Design and check benchmarks so their rankings match how agents actually perform in production
- Work directly with the two founders on what makes an environment or benchmark good versus bad, and on how labs use them in post-training
Compensation: Base salary of $150K-$300K, plus meaningful founding equity. This role also comes with generous bonuses tied to lab deliverables. The engineer receives a large share of the profit from each contract they deliver, so top performers can earn far more than their base.
About Doe
Doe is building a workspace where AI agents do the work and people get augmented. It connects to a company’s internal systems and deploys agents that handle ops, go-to-market and engineering tasks, from triaging invoices to updating Salesforce, all described in plain English. Doe also turns the real-world agent failures it sees into benchmarks and environments for frontier AI labs. Founded in 2025 and based in San Francisco.
Required skills
Other roles at Doe
Refer someone
Know someone great for this role?
Share your link. If they get hired through Standout, you get $3,000.
Job details
Salary
$150,000 - $300,000
Equity
0.25% - 1%
Location
San Francisco, United States
Experience
1+ years
Funding
Last stage
Seed
Investors
Founders
Richard Ou
Co-Founder & CTO
What happens next.
No applications, no recruiter spam. Just the intro.
Confirm the fit
A few questions to make sure this role is the right shape for you. Two minutes.
I pitch you to the company
I write the intro, send it to the founder, and handle the back-and-forth.
A meeting lands on your calendar
If they’re a yes, I book the chat. You show up — that’s the whole job-hunt.
