Skip to content

v0.0.1 - Initial Release

Choose a tag to compare

View all tags
@baladithyab baladithyab released this 07 Feb 20:42
· 252 commits to main since this release
v0.0.1
994a40f

RouteIQ Gateway v0.0.1

Production-grade General AI Gateway built on LiteLLM with LLMRouter ML-based routing intelligence.

Highlights

  • 18+ ML routing strategies — KNN, MLP, SVM, ELO, Matrix Factorization, hybrid ensembles
  • MCP gateway — 5 surfaces: JSON-RPC, SSE, REST, parity, proxy
  • A2A protocol — Agent-to-agent communication gateway
  • Plugin system — Extensible with dependency resolution and lifecycle management
  • Policy engine — OPA-style pre-request evaluation
  • Observability — OpenTelemetry traces, metrics, and logs
  • HA support — Redis-based leader election, config sync
  • Config hot-reload — Filesystem watching + S3 ETag-based sync
  • Security — SSRF protection, RBAC, audit logging, secret scrubbing
  • Multi-arch container — linux/amd64 + linux/arm64
  • 938 unit tests passing

Container

docker pull ghcr.io/baladithyab/routeiq:0.0.1

Quick Start

uv sync
uv run python -m litellm_llmrouter.startup --config config/config.yaml --port 4000
Assets 2
Loading