LiteLLM Rust - A minimal Rust-based AI Gateway for coding agents

[krrish-berri-2]

Hi everyone,

I'm excited to launch LiteLLM-Rust - A minimal Rust-based AI gateway for coding agents.

Repo: https://github.com/LiteLLM-Labs/litellm-rust

It just does 3 things:

1. It is LiteLLM-compatible - your config.yaml + DB work out of the box.
2. It's fast - Our goal is to provide <1ms overhead latency on claude code calls
3. It's built for autonomous agents - It supports sandboxing (E2B/Daytona), and will soon add durable sessions, memory, artifacts, vault and everything else you need for running cloud agents.

FAQ

Q. Is it open-source?
A. It is 100% open-source and MIT Licensed.

Q. Is it in your existing LiteLLM deployment?
A. It is NOT in your existing deployment. This is a separate repo. Our goal is to explore safely, and bring the learnings from projects to our core project.

Q. How mature is it?
A. This is an early, experimental project. We would love your feedback. Please join our community, and tell us what you think -