Repository navigation
Highlights in v0.2.1
8.4 msCold Start &23.7 MiBIdle RSS (14 MBphysical footprint):- Deduplicated all outbound TLS root certificate stores into a single shared
OnceLock<rustls::ClientConfig>(ring+webpki-roots) and converted allreqwest::Clientpools to lazy per-coreOnceLockinitialization (0HTTP pools allocated at boot). - Constructed the 349-route
axum::Routerservice tree once instead ofNtimes across per-core workers, right-sized the outer CLI runtime, and moved initial local-runtime port discovery off the startup critical path. - Lazy-loaded the embedded
models.dev.json.gzcatalog snapshot on first read.
- Deduplicated all outbound TLS root certificate stores into a single shared
- Reproducible Scale Benchmark Suite (
litellm_vs_quixigate_bench):- Added a 3-process apples-to-apples scale benchmark harness (
crates/quixigate-proxy/examples/litellm_vs_quixigate_bench.rs) verifying70,690 req/sstateless JSON,66,605 req/sgoverned virtual-key + budget JSON,3.09M tok/sgoverned SSE streaming, and974,742 tok/sacross1,000concurrent GPU streams in156.9 MiBpeak RSS with0errors.
- Added a 3-process apples-to-apples scale benchmark harness (
- HTTP/1.1 Keep-Alive Hygiene & Production Installers:
- Added
Connection: closeon early413 Payload Too Largerejections per RFC 9112 §9.6. - Native OS installers (
install.sh->/usr/local/bin/quixigateon macOS & Linux;install.ps1->%LOCALAPPDATA%\Programs\QuixiGate\bin\quixigate.exeon Windows) with SHA-256 verification.
- Added
Install / Upgrade
macOS & Linux:
curl -fsSL https://raw.githubusercontent.com/QuixiAI/QuixiGate/main/install.sh | shWindows (PowerShell):
irm https://raw.githubusercontent.com/QuixiAI/QuixiGate/main/install.ps1 | iexFull Changelog: v0.2.0...v0.2.1