Skip to content

v1.0.0 - Initial release

Choose a tag to compare

View all tags
@crossps crossps released this 31 May 16:43
· 6 commits to main since this release
v1.0.0
788f5b9

First public release of LLM Bridge & Cache — a zero-dependency, bring-your-own-key local API bridge.

Features

  • Multi-provider routing — one OpenAI-compatible endpoint in front of OpenAI & Anthropic; route by model name or explicit provider/model.
  • Prompt-cache keepalive — keeps Anthropic's ~5-min prompt cache warm with minimal max_tokens=1 pings; multi-chat, auto-evicting.
  • Prompt injection — system prepend/append/replace + depth injection.
  • Streaming, tools, and vision translated between OpenAI and Anthropic formats.
  • Multi-key round-robin, CORS, and a /status endpoint that never exposes keys.

Requires Node >= 18.17. npx llm-bridge-cache to run.

Assets 2
Loading