0.1.45-poly.5

A new model, Kolibri 1, Gemma 4's QAT file as a size of its own, and faster writing on AMD cards.

What changed since 0.1.45-poly.4

• Kolibri 1 by Aleph Alpha, a model of 19,200 experts that writes German as well as English, runs on strata-poly:
  pick it in START-HERE or run ./setup.sh --family kolibri. Hob-forge's Q4_K_M, Q2_K and Q3_K_M files are 29 to
  48 GB. On an RTX 5090 the Q2_K writes at 189 to 192 tokens/s and reads a 31,676-token prompt at 4,980 to 5,070. It
  has not been run on an 8 GB laptop or on an AMD card yet. By JLSoftwareRL
  (PR 89); its page is
  docs/models/kolibri.md.
• Gemma 4's quantization-aware trained file from Unsloth is a size of its own: --model QAT-UD-Q4_K_XL (15 GB, with
  its own draft model). On the RTX 5090 it writes at 356 to 371 tokens/s and reads a prompt of about 31,000 tokens at
  8,460 to 8,680. It needed no engine change, so UPDATE.bat or ./update.sh brought it before this release.
• On AMD cards the cached experts give a short row a warp of its own, so writing is faster: 18 to 33% on an RX 7800 XT
  by the author's measurements. On by default on AMD. On NVIDIA it stays off; STRATA_SLOTS_WARP=1 turns it on, and
  on an RTX 5090 that wrote about 4% faster with every expert in VRAM and the same otherwise. By
  usmanliaqat97 (PR 94).
• STRATA_HIP_VALUE_SPLIT=1, AMD only and off unless set, splits the decode attention's last step for Qwen3.6 and
  its variants once the context passes 12,288 tokens. On an RX 9070 XT: 48.5 to 52.3 tokens/s at 32K, 36.5 to 44.6
  at 98K. By leakedd (PR 85,
  PR 86).
• STRATA_REQUEST_LINES=1 prints a line per request for the models of PolyStrata's engine too, with the MTP drafts
  accepted. By vehystrix (PR 90).
• strata-poly compiles for Pascal sm_60 (Tesla P100) again with CUDA 12. By festeraeb
  (PR 87).
• Setup changes that UPDATE.bat or ./update.sh brought before this release: --custom-gguf installs a GGUF you
  already have (vehystrix, PR 83); Gemma 4, LFM2.5 and Tiel Coder
  no longer warn that they are untried on AMD, since people have run them on an RX 6700 XT and an RX 7800 XT.

The engine changed, so the zip below is a new ready-made Windows engine. It gives 0.1.45-poly.4's greedy tokens with
Qwen3.6 (with and without --kv q8_0), Gemma 4 (with and without --kv int8), Gemma 4 QAT, LFM2.5, MiniCPM-V,
Flint, GLM 5.3 Flash and DeepSeek V4 Flash on an RTX 5090 under Linux, and Kolibri 1 gives PR 89's own tokens there. On an RTX
4070 laptop under Windows it gives 0.1.45-poly.4's tokens with Gemma 4, and an install of 0.1.45-poly.4 updated to it
with UPDATE.bat and kept its config as it was.

Install

Download the source below, or git clone the repository. Then run START-HERE.bat on Windows or ./setup.sh on
Linux. An earlier install updates with UPDATE.bat or ./update.sh.

Limits

• The ten added models are experimental.
• The ready-made engine is for Windows and CUDA 13 only; CUDA 12 and AMD cards compile on your PC.
• GLM 5.3 Flash and DeepSeek V4 Flash need 70 to 100 GB of RAM, and about 8 GB more than their files in a container.
  A DeepSeek file larger than the RAM runs several times slower than llama.cpp with the same file.
• GLM 5.3 Flash, DeepSeek V4 Flash, Flint and Kolibri 1 have not been tried on an AMD card. On Windows, AMD cards have
  run one strata-poly model (Tiel Coder on an RX 9070 XT).

Most of this project is the work of Strata's author and contributors.

Planned: SSD optimization for strata-poly.