About the role
We are looking for an Infrastructure/DevOps Engineer with 1 - 4 years of experience to own our release infrastructure and DevOps pipelines. You are a hands-on engineer with a strong background in infrastructure, CI/CD, and release engineering who is comfortable coding in Python. This is a critical role at a high-growth, profitable startup where you will ensure we can ship secure, reliable releases to our large enterprise customers like Adobe, NASA, and Nvidia.
What you will do:
- Own secure, regular releases, including 2 nightly and 1 stable release per week.
- Manage and improve the infrastructure behind our release process, including Helm, Terraform, and CI/CD systems.
- Architect and implement a secure end-to-end release process, from code commit to published artifact.
- Investigate test failures, distinguish real regressions from flaky tests, and improve the overall reliability of the release pipeline.
- Write Python to fix minor test issues, improve release reliability, and support developer workflows.
About LiteLLM
LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format
