Skip to content

AI-Proxy Desktop 0.3.0

Choose a tag to compare

View all tags
@heshamh96 heshamh96 released this 06 Jul 09:11
· 8 commits to main since this release
desktop-v0.3.0
9ed4e3e

AI-Proxy Desktop 0.3.0 — JSON mode, per-key usage, the on-prem release

Completes the P2 surface on top of 0.2.9's DVT-first-class gateway:

  • response_format: {"type":"json_object"} now actually works — providers ignore it upstream, so the gateway enforces it: instructs the model, validates, strips fences, retries once. Tool-call turns are never touched (agent loops stay intact — adversarially verified).
  • Per-key usage attribution — GET /v1/usage (any valid key) returns per-key request + token totals, keyed by fingerprint (…last6; full keys never stored). Add one key per user/team in api-keys:; optional names via GATEWAY_KEY_NAMES. Counters persist across restarts (atomic writes).
  • On-prem controls — gateway bind address honors host: in config.yaml; guide/08 gains the floor playbook: per-user keys, /health monitoring, launchd/systemd supervision, Caddy/nginx TLS fronting (with the SSE proxy_buffering off gotcha documented).
  • Verified: real usage totals in responses; OpenAI SSE streaming with [DONE]; regression suite now 15 checks — all green.

Install: brew install --cask meta-thinking/tap/ai-proxy · Docs: https://aiproxy.meta-thinking.net/docs
macOS Apple Silicon. (Intel / Windows / Linux ship via CI.)

Assets 4
Loading