v0.1.2

LLM Proxy v0.1.2

Docker Images (Recommended)

Pre-built Docker images are available on GitHub Container Registry:

docker pull ghcr.io/stevelittlefish/llm_proxy:v0.1.2

See the Quick Start with Docker section in the README for usage instructions.

Pre-built Binary (Linux x86_64)

Download the Linux x86_64 archive below.

Note: Due to CGO requirements for SQLite, pre-built binaries are only available for Linux x86_64.
Users on macOS, Windows, or ARM64 should use Docker or build from source. See the README for build instructions.

Installation

1. Download the archive below
2. Extract the archive
3. Edit config.toml to configure your backend
4. Run ./llm_proxy

See README.md for detailed documentation.

Changelog

Other Changes

• bf771c6: Converted config to toml (@stevelittlefish)
• 344d0b6: Don't log modified system prompt (@stevelittlefish)
• ec6f351: README.md (@stevelittlefish)
• c193199: Removed docker example config (@stevelittlefish)
• 1068055: String injection in system prompt (@stevelittlefish)
• 10bb045: Tool blacklist to filter out annoying tools (@stevelittlefish)
• 39a5fce: Verbosity and logging stuff (@stevelittlefish)

Full Changelog: v0.1.1...v0.1.2

---

Built with GoReleaser