Repository navigation
PolyStrata 0.1.42-poly.4
AMD cards run the smaller models under Linux, as a beta.
What changed since 0.1.42-poly.3
- The engine of Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and GLM 5.3 Flash compiles for an AMD card under Linux (ROCm from a system install or AMD's wheels), through the same HIP layer as Strata's own engine, with the virtual memory calls mapped onto HIP's. iMilnb wrote the port (#11) and ran it on an RX 7600 (8 GB): Qwen3.6 UD-Q2_K_XL writes 64 tokens/s, Ornith APEX-I-Mini 35. Install as for NVIDIA:
./setup.sh --family qwen36. Windows has no ready-made AMD engine, so setup refuses these models on an AMD card there; images stay off on AMD; Gemma 4, Tiel Coder and GLM have not been tried on an AMD card yet, and setup says so. On NVIDIA nothing changes: the same tokens and the same speed as 0.1.42-poly.3. docs/AMD_HIP.md. - GLM 5.3 Flash has run on Windows: a user's report with an RTX 5090 D v2 (24 GB) and 128 GB of RAM, a 1M-token context and a 557K-token prompt read whole (#10). The docs say so.
The engine's sources changed, so the zip below is a new ready-made Windows engine; the installer downloads it and checks its SHA-256.
How fast
The tables did not change: 0.1.42-poly.3, the README and docs/BACKENDS.md.
Install
Download the source below, or git clone the repository. Then run START-HERE.bat on Windows or ./setup.sh on Linux. An earlier install updates with UPDATE.bat or ./update.sh.
Limits
- The five added models are experimental, measured on two machines, a pair of RTX 3080s and now one RX 7600.
- The ready-made engine is for Windows and CUDA 13 only; CUDA 12 and AMD cards compile on your PC.
- GLM 5.3 Flash needs about 100 GB of RAM, and about 8 GB more than its file in a container.
- AMD cards on Windows run Qwen3.8-Flash-Next only.
Most of this project is the work of Strata's author and contributors.