Skip to content

v0.2.0

Choose a tag to compare

@ehartford ehartford released this 13 Nov 17:37
· 3 commits to main since this release

Quick Install

macOS & Linux:

curl -fsSL https://raw.githubusercontent.com/QuixiAI/QuixiGate/main/install.sh | sh

Windows (PowerShell):

irm https://raw.githubusercontent.com/QuixiAI/QuixiGate/main/install.ps1 | iex

Highlights

Actix-Style Share-Nothing Per-Core Engine & Polyglot Zero-DOM Cut-Through

  • 67,751 req/s (100% parity with a bare zero-copy Rust TCP pipe, 1.76 ms p99) and 9.47M tok/s (1.56 GiB/s / 13.4 Gbps) SSE streaming throughput on an 18-core machine.
  • Lock-Free In-Memory Data Plane + Batched SQLite WAL Flusher: ArcSwap<ControlSnapshot> + SHA-256 [u8; 32] key indexing + AtomicI64 NanoUSD reservations + linearizable SAVEPOINT WAL write-behind batching (0 SQLite mutex locks on the inference hot path).
  • 3 Native Zero-DOM Cut-Through Lanes: Borrowed envelope peeks (serde::de::IgnoredAny) + SIMD memchr Bytes splicers + CutThroughSseStream (0 tokio::spawn, 0 mpsc, 0 per-token JSON DOM) for:
    • POST /v1/chat/completions -> OpenAI / OpenRouter / Copilot / Qwen / local runtimes
    • POST /v1/responses -> ChatGPT Codex (/responses)
    • POST /v1/messages -> Anthropic (anthropic / anthropic-token) & MiniMax (minimax-portal)
  • Zero-Spawn Polyglot Transcode State Machines: Direct BytesMut Stream drivers across all 5 codecs (openai_chat, openai_responses, anthropic, gemini, vercel_ui), O(1) generation-stamped CachedModelPlan, concrete zero-box Tower middleware, 64 KiB vectored writev Hyper connection builder, Linux SO_REUSEPORT multi-queue listeners, mimalloc, and full Fat LTO (lto = "fat").

100% LiteLLM Endpoint Compatibility (997 / 997 Routes)

  • Drop-in coverage across all 997 LiteLLM route decorators: native inference, embeddings, models, spend/budget management, virtual keys, teams, users, organizations, guardrails, MCP, and health endpoints—or structured 400 responses with actionable zero-paywall DIY migration guidance.

Native Windows (x86_64-pc-windows-msvc) Support

  • First-class native Windows .exe release alongside macOS (aarch64-apple-darwin) and Linux (x86_64-unknown-linux-gnu), including seamless .exe / .cmd / .bat agent shim resolution in quixigate run.

Prebuilt Archives

  • macOS (Apple Silicon): quixigate-aarch64-apple-darwin.tar.gz
  • Linux (x86_64): quixigate-x86_64-unknown-linux-gnu.tar.gz
  • Windows (x86_64 MSVC): quixigate-x86_64-pc-windows-msvc.zip

Full Changelog: v0.1.0...v0.2.0