strixite v0.2.3

v0.2.2 was tagged but never released; this release carries all of it, plus what came after.

New

• Streamed tool calls. A tool call's arguments now stream as they're generated, instead of arriving in one piece once the call is complete - clients show them as they come. Thanks @TheBeaninator (#5).
• The think-block / tool-call guard. The model sometimes reached for end-of-turn while naming a tag in inline code ("until </tool_call>"), ending a turn mid-thought with an empty reply, or mid tool call. The server now takes end-of-turn off the table inside an open think block or tool call, so the turn goes on to its answer.
• Literal tags. Request text is always plain text: a <tool_call> or <think> written in a message, or in a tool call's arguments, is never read as a control token.

Memory safety (#6)

• The prompt cache never grows into memory that isn't there: it makes room before a save or load allocates, and checks its margin every second in the background, so another process growing between requests is answered within seconds.
• A startup memory check: after loading, the server checks it has room for its margin plus one full-capacity saved conversation. Short of it, it exits with status 4 and names the settings that fit (low-memory = fail, the default); low-memory = adapt starts with its caches turned down instead.
• A lost GPU context exits the process (status 3), so systemd or your supervisor restarts it cleanly instead of every request failing.
• New: Memory - where the 128 GB goes, what the server checks, and recipes for sharing the machine with a desktop or another model.

Changed defaults

• The built-in defaults are the values in deploy/strix-server.conf - 512k context, YaRN, 16k-token prefill chunks: the server runs the same with or without --config.
• The prompt cache's RAM margin is 4 GiB (was 24). The defaults assume a Strix Halo dedicated to strixite - that's where it's fastest. If yours is also a desktop or runs another model, see Memory.

Container

podman pull ghcr.io/shawnshekari/strixite:v0.2.3 (also :latest) - running it.

Contributors: @shawnshekari, @TheBeaninator (#5), @Rose22 (suggested in #3), @enncoded (#6)