v0.2.18
LLM Proxy v0.2.18
Docker Images (Recommended)
Pre-built Docker images are available on GitHub Container Registry:
docker pull ghcr.io/stevelittlefish/llm_proxy:v0.2.18See the Quick Start with Docker section in the README for usage instructions.
Pre-built Binary (Linux x86_64)
Download the Linux x86_64 archive below.
Note: Pre-built binaries are currently only available for Linux x86_64.
Users on macOS, Windows, or ARM64 should use Docker or build from source. See the README for build instructions.
Installation
- Download the archive below
- Extract the archive
- Edit
config.tomlto configure your backend - Run
./llm_proxy
See README.md for detailed documentation.
Changelog
Other Changes
- 26a6613: Harden SQLite logging concurrency (@stevelittlefish)
Full Changelog: v0.2.17...v0.2.18
Built with GoReleaser