About the role
We are looking for a Forward Deployed Machine Learning Engineer with 3+ years of experience to be the first MLE dedicated to Protege's Benchmarks and Evaluations vertical. You'll work directly with the GM and researchers to build the technical foundation for AI model evaluation — a critical capability at one of the most exciting data infrastructure companies in AI, backed by a16z, CRV, and others.
What will you be doing?
- Partner with the GM and early customers to define, design, and build benchmarks and evals across different domains and modalities
- Build and own the backend infrastructure: data pipelines, execution environments, storage, and orchestration
- Stand up sandboxed environments for agentic evals requiring tools, code execution, or multi-step tasks
- Own the engineering portion of customer engagements end to end
- Identify repeatable eval patterns and infrastructure gaps to drive product opportunities
Key Requirements
- 4+ years of engineering experience with hands-on ML model evaluation work
- Prior ownership of backend and infrastructure (data pipelines, execution environments)
- Experience building benchmarks, evals, or human data pipelines for LLMs (strongly preferred)
- High ambiguity tolerance and a strong bias to action in fast-moving environments
- Strong written communication skills for customer-facing and cross-functional work