Skip to content

QuixiGate v0.2.1

Latest

Choose a tag to compare

@github-actions github-actions released this 14 Nov 12:56

Highlights in v0.2.1

  • 8.4 ms Cold Start & 23.7 MiB Idle RSS (14 MB physical footprint):
    • Deduplicated all outbound TLS root certificate stores into a single shared OnceLock<rustls::ClientConfig> (ring + webpki-roots) and converted all reqwest::Client pools to lazy per-core OnceLock initialization (0 HTTP pools allocated at boot).
    • Constructed the 349-route axum::Router service tree once instead of N times across per-core workers, right-sized the outer CLI runtime, and moved initial local-runtime port discovery off the startup critical path.
    • Lazy-loaded the embedded models.dev.json.gz catalog snapshot on first read.
  • Reproducible Scale Benchmark Suite (litellm_vs_quixigate_bench):
    • Added a 3-process apples-to-apples scale benchmark harness (crates/quixigate-proxy/examples/litellm_vs_quixigate_bench.rs) verifying 70,690 req/s stateless JSON, 66,605 req/s governed virtual-key + budget JSON, 3.09M tok/s governed SSE streaming, and 974,742 tok/s across 1,000 concurrent GPU streams in 156.9 MiB peak RSS with 0 errors.
  • HTTP/1.1 Keep-Alive Hygiene & Production Installers:
    • Added Connection: close on early 413 Payload Too Large rejections per RFC 9112 §9.6.
    • Native OS installers (install.sh -> /usr/local/bin/quixigate on macOS & Linux; install.ps1 -> %LOCALAPPDATA%\Programs\QuixiGate\bin\quixigate.exe on Windows) with SHA-256 verification.

Install / Upgrade

macOS & Linux:

curl -fsSL https://raw.githubusercontent.com/QuixiAI/QuixiGate/main/install.sh | sh

Windows (PowerShell):

irm https://raw.githubusercontent.com/QuixiAI/QuixiGate/main/install.ps1 | iex

Full Changelog: v0.2.0...v0.2.1