About the role
This role will own the end-to-end migration of LiteLLM from Python to Rust, making it the fastest AI gateway ever built. The engineer will plan the migration directly with the CTO, structure the codebase, and lead a gradual, stability-first rollout. The work is focused on improving performance, latency, and throughput for enterprise customers.
About LiteLLM
LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format
We have raised $1.6M in Seed funding from top investors (Y Combinator, Gravity Fund and Pioneer Fund), generate $10M+ in ARR and growing exponentially, and are meaningfully profitable.
You can find more information on our website, Github and Technical Documentation.
