About the role
About the Role
As Applied Research Scientist, you will define how Arcline measures, evaluates, and improves its AI systems. You will own the full research loop — from problem framing and dataset design to running experiments, building evaluation infrastructure, and translating findings into product decisions. This is a role for someone who cares equally about rigorous methodology and shipping work that matters.
You will report directly to the CTO and work closely with AI and product engineers from day one. As the team grows, you will have the opportunity to build and lead a research function.
What You'll Do
Evaluation and Benchmarking
- Design and own evaluation frameworks for Arcline's AI systems — from document drafting quality to retrieval relevance and agent reliability
- Build the benchmarking infrastructure that lets the team run rigorous, reproducible experiments and track model performance over time
- Define what "good" looks like for legal AI outputs, working with lawyers to develop ground truth datasets and human evaluation protocols
Research and Experimentation
- Identify the highest-leverage research problems across agentic search, generation, and structured extraction in the legal domain
- Design and run structured experiments — agentic search architectures, prompting strategies, fine-tuning approaches — and translate results into clear, actionable recommendations
- Stay close to the frontier of LLM and agentic search research and bring relevant advances into Arcline's systems
Research Direction and Cross-functional Impact
- Set the research agenda: decide what problems are worth solving, in what order, and why
- Partner with lawyers and operations to surface failure modes and edge cases that quantitative metrics alone won't catch
