runtime-llama 0.10.0

Python adapters for externally managed llama.cpp servers, with a shared persistent embedding queue engine.

• Async window streams with bounded intake and ordered delivery share the synchronous adapter engine and scheduler.
• Per-replica ready queues form batches at dispatch capacity; exact native token-ID inputs avoid retokenizing prepared text.
• Configurable text/token/byte budgets, isolated cancellation, finite deadlines, identity/topology checks and drained closure. Default coalescing delay is zero; positive coalescing remains optional.
• Existing generation, structured tool calls, discovery and optional Tailscale/Headscale transport remain available.

Validation: 1,372 deterministic tests; package/lint checks; clean public-wheel installation; bounded live checks on two loaded replicas with unchanged numerical thresholds and 511 ordered outputs per run.

Performance boundary: no speedup is established. The exploratory candidate timings were slower than the coalescing baseline while external LLM activity changed. These are client/HTTP/runtime wall times, not GPU time. See the release verification and detailed qualification.

The three optional helper archives reuse unchanged executables originally qualified in 0.6.0, with original provenance and notices. No new native OS or live VPN qualification is claimed.

Download the wheel/source archive and optional helper for your platform. Verify hashes using SHA256SUMS and RELEASE-MANIFEST.json. Distribution: runtime-llama; Python import: runtime_llama. Apache-2.0, copyright Davide Mele; upstream attribution retained.

Versions 0.8.0 and 0.9.0 were local candidates; this is the next public release after 0.7.0. Consumer installations and remote models are unchanged.