v0.2.22

LLM Proxy v0.2.22

Docker Images (Recommended)

Pre-built Docker images are available on GitHub Container Registry:

docker pull ghcr.io/stevelittlefish/llm_proxy:v0.2.22

See the Quick Start with Docker section in the README for usage instructions.

Pre-built Binary (Linux x86_64)

Download the Linux x86_64 archive below.

Note: Pre-built binaries are currently only available for Linux x86_64.
Users on macOS, Windows, or ARM64 should use Docker or build from source. See the README for build instructions.

Installation

1. Download the archive below
2. Extract the archive
3. Edit config.toml to configure your backend
4. Run ./llm_proxy

See README.md for detailed documentation.

Changelog

Other Changes

• 4277c78: Accept numeric Ollama keep_alive values (@stevelittlefish)
• 5806054: Code review (@stevelittlefish)
• 14fd237: Removed old code review doc (@stevelittlefish)

Full Changelog: v0.2.21...v0.2.22

---

Built with GoReleaser