Skip to content

PolyStrata 0.1.42-poly.4

Choose a tag to compare

@VecSzn VecSzn released this 12 Oct 18:35

AMD cards run the smaller models under Linux, as a beta.

What changed since 0.1.42-poly.3

  • The engine of Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and GLM 5.3 Flash compiles for an AMD card under Linux (ROCm from a system install or AMD's wheels), through the same HIP layer as Strata's own engine, with the virtual memory calls mapped onto HIP's. iMilnb wrote the port (#11) and ran it on an RX 7600 (8 GB): Qwen3.6 UD-Q2_K_XL writes 64 tokens/s, Ornith APEX-I-Mini 35. Install as for NVIDIA: ./setup.sh --family qwen36. Windows has no ready-made AMD engine, so setup refuses these models on an AMD card there; images stay off on AMD; Gemma 4, Tiel Coder and GLM have not been tried on an AMD card yet, and setup says so. On NVIDIA nothing changes: the same tokens and the same speed as 0.1.42-poly.3. docs/AMD_HIP.md.
  • GLM 5.3 Flash has run on Windows: a user's report with an RTX 5090 D v2 (24 GB) and 128 GB of RAM, a 1M-token context and a 557K-token prompt read whole (#10). The docs say so.

The engine's sources changed, so the zip below is a new ready-made Windows engine; the installer downloads it and checks its SHA-256.

How fast

The tables did not change: 0.1.42-poly.3, the README and docs/BACKENDS.md.

Install

Download the source below, or git clone the repository. Then run START-HERE.bat on Windows or ./setup.sh on Linux. An earlier install updates with UPDATE.bat or ./update.sh.

Limits

  • The five added models are experimental, measured on two machines, a pair of RTX 3080s and now one RX 7600.
  • The ready-made engine is for Windows and CUDA 13 only; CUDA 12 and AMD cards compile on your PC.
  • GLM 5.3 Flash needs about 100 GB of RAM, and about 8 GB more than its file in a container.
  • AMD cards on Windows run Qwen3.8-Flash-Next only.

Most of this project is the work of Strata's author and contributors.