Live compressed-KV cache quantization (community contribution, PR #1): four new --kv-dtype cache modes — rk8v4, rk4v4, rk4v4-e8, and rk2v4-e8. The E8 modes project keys onto the Conway-Sloane E8 lattice so the K cache runs at 2–4 bits per dimension, making long-context sessions that a full-precision KV cache cannot hold (200k+ context on a 32 GB card) practical. Bundled launchers still default to the full-precision cache; add --kv-dtype to opt in.
OpenAI chat-completions tool messages now accept array content (a mix of text and image_url parts), as allowed by the spec. Tool results carrying a screenshot or other media are no longer rejected with HTTP 400; the media is rendered through the vision pipeline like any other image part. Plain string tool content behaves as before.
Self-contained portable zip: exes, runtime DLLs, per-model launchers (150k baseline), models/ folder, README.txt, SHA256SUMS. Requires Windows 11 x64, RTX 5090 (sm_120a), and a CUDA 13.1-capable NVIDIA driver.