Skip to content

v0.1.0 - Agnos Proxy

Choose a tag to compare

@siva010928 siva010928 released this 15 Aug 09:29
· 25 commits to main since this release

First release of Agnos Proxy - the gateway-agnostic control plane for LLM routing, cost-tracking and observability.

  • OpenAI-compatible proxy (/v1/chat/completions, /v1/embeddings) with streaming.
  • Own the control plane + encrypted Fernet key vault in your own infra; swap the translation engine (Bifrost / LiteLLM / Portkey / built-in Direct) per provider, at runtime, behind a compile-time-enforced BackendEngine port.
  • Guardrails (CEL + PII/secret detectors), hierarchical budgets, multi-scope rate limits, routing/fallback, cost attribution, OpenTelemetry + Prometheus, and a live dashboard.

See CHANGELOG.md for details. MIT licensed.