Skip to content

Releases

Linux engine 0.1.24 (CUDA 12.8, sm_80/86/89 + PTX)

Choose a tag to compare

Strata engine 0.1.24 for Linux x64, built by this fork's CI. The build:

  • CUDA 12.8, so NVIDIA drivers from 525 up run it;
  • sm_80, sm_86 and sm_89, with PTX for newer cards;
  • the CPU code at the AVX2 baseline;
  • the image encoder (strata-vision).

The source is upstream 0.1.24 plus two open PRs: Niko1221#136 (this Linux prebuilt, and CUDA 12 on Linux in setup.py) and Niko1221#134 (the RAM-based context cap).

The workflow attaches strata-linux-x64.zip and its SHA-256 to this release when it finishes, about 40 minutes after publishing. Use it with this fork's setup.py at the same commit:

STRATA_PREBUILT_URL=https://github.com/architectds/Strata/releases/download/v0.1.24-linux-cuda12.8/ ./setup.sh

Linux engine 0.1.20-linux-sm80-cuda12.8-r2

Choose a tag to compare

Strata engine for Linux x64, built by this repository's CI (run 36512879217, commit 8afd830): sm_80 (A100 and other Ampere), CUDA 12.8 (drivers from 525 up), the CPU code at the AVX2 baseline (no AVX-512 needed), with the image encoder (strata-vision).

Use it through this fork's setup.py at the same commit, which adds STRATA_CUDA=12:

STRATA_CUDA=12 STRATA_PREBUILT_URL=https://github.com/architectds/Strata/releases/download/v0.1.20-linux-sm80-cuda12.8-r2/ ./setup.sh

SHA-256 df7ce1a875c33296c09e31b84ac54b57b49372f60cc0802cad2048172ff1bed3 strata-linux-x64.zip

Linux engine 0.1.20: sm_80, CUDA 12.8, AVX2

Choose a tag to compare

Strata engine 0.1.20 for Linux x64, compiled for sm_80 (A100) with CUDA 12.8, ggml's CPU backend at the AVX2 baseline (STRATA_PORTABLE; Strata's own AVX-512 kernels are still picked at run time on CPUs that have them). No image encoder.

CUDA 12.8 runs on NVIDIA drivers from 525 up, which is what cloud GPUs such as Colab's tend to have (CUDA 13 needs 580). It is used through this fork's setup.py (branch linux-prebuilt), which adds STRATA_CUDA=12: CUDA 12's pip libraries, driver 525 as the minimum, and a check that the ready-made engine was built with the same CUDA major.

STRATA_CUDA=12 STRATA_PREBUILT_URL=https://github.com/architectds/Strata/releases/download/v0.1.20-linux-sm80-cuda12.8/ ./setup.sh

Built from source by the linux-prebuilt workflow (Ubuntu 22.04, no GPU needed to compile): https://github.com/architectds/Strata/actions/runs/36506157966

SHA-256 9389ec88f32681131e186f5d09cf3c7b2906175ed16e1548bf974ff8cdb44583 strata-linux-x64.zip

Run on a Colab A100-SXM4-40GB (6-core Xeon at 2.2 GHz, 83.5 GiB RAM, no AVX-512 VBMI) on 2026-09-29 with IQ3_S at a 262K context: 17,037 of 24,576 experts in VRAM, decode 42-52 t/s (expert hit rate ~0.97), prefill 870 t/s at 32K and 1,558 t/s at 86K.