v0.3.0

v0.3.0 — Cognitive Gateway

Theme: The gateway no longer just proxies tokens — it understands reasoning, tools, and agent workflows.

What's new

Cognitive Routing

• Per-provider health probes with SLO rolling window
• Composite scoring (cost × latency × quality × health) with per-team weight overrides
• Cognitive alias mode: gateway picks the highest-scoring eligible provider automatically
• Policy-based fallback on HTTP 429/5xx with configurable chain depth
• Route-decision explain trace: explain_route_trace shows exactly why a request went where it did

Unified AI Semantics

• Reasoning IR: extract and re-emit reasoning content across DeepSeek, Anthropic, GLM, Qwen
• Tool-calls translation: OpenAI ↔ Anthropic function call formats
• Unified finish_reason mapping across all providers

MCP-native Runtime

• MCP resources via lgw:// URI scheme (teams, requests, providers, audit)
• 6 preset MCP prompts for ops workflows (traffic investigation, cost review, provider health, etc.)
• Provider capability registry for eligibility filtering

New Providers

• Qwen / DashScope (OpenAI-compatible, reasoning + tool use confirmed)
• Moonshot / Kimi (OpenAI-compatible)

Trust must-haves

• OpenTelemetry tracing — opt-in via LLM_GATEWAY_OTEL_ENDPOINT (OTLP gRPC)
• Per-team USD budget limits (set_budget, check_budget, list_budgets)
• Multi-key rotation: KEK-wrapped master keys, zero-data-loss rekey_providers
• Helm chart + raw k8s manifests at deploy/helm/llm-gateway/

CEO cherry-picks

• Prompt caching pass-through (cache_control headers forwarded verbatim)
• Tamper-evident audit log: SHA-256 hash chain, verify_audit_chain MCP tool

Migration from v0.2

Drop-in upgrade — schema auto-migrates to v10 on first start. See UPGRADE-v0.2-to-v0.3.md for the full guide.

Stats

• 22 tasks shipped across 4 pillars
• ~120 automated tests, 11 packages
• Binary size: ~12 MB (static, CGO_ENABLED=0)