Strata v0.1.6

Fix for v0.1.5: the engine could stop at start with "mtp: state init failed" when KV streaming was on.

With KV streaming (64K+ context), the speculative draft layer also keeps a copy of its KV in RAM. That copy is set up after the experts have pinned as much RAM as Windows allows, and on some setups (for example Swift 1.5 at 262K) no pinned RAM was left, so the engine exited. Now the draft layer then simply keeps its KV in VRAM, as before v0.1.5. Everything else is the same as v0.1.5 (KV streaming: Q2_0 at 262K 50.9 -> 62.6 tokens/s; see the v0.1.5 notes).

Updating: get the latest files (git pull or download the repo again), then run START-HERE.bat with the model window closed. It updates the engine by itself before starting. On Linux, ./setup.sh builds the engine from source as before.

The ready-made Strata engine for Windows (RTX 30 / 40 / 50: sm_86, sm_89, sm_120 + PTX), CUDA 13.0.

You don't need to download this yourself: START-HERE.bat fetches it (and NVIDIA's cuBLAS from pip), so no compiler or CUDA Toolkit is needed, only an NVIDIA driver 580 or newer.

Contents: strata.exe (the engine), strata-vision.exe (the optional image encoder), BUILD.json.