Skip to content

FastStrata v0.1.0

Choose a tag to compare

@Jarson1408 Jarson1408 released this 21 Oct 13:13
· 14 commits to main since this release

A 35B mixture-of-experts coding model for OpenCode on a gaming PC with a small graphics card: Qwen3.6-35B-A3B and
Ornith 1.5 on one NVIDIA card and system RAM, with its own gateway for OpenCode.

Made for OpenCode

Setup installs the model together with the FastStrata Gateway,
an app written for OpenCode that sits between it and the model. It turns the model's tool calls into the ones OpenCode
reads, stops a turn that loops, starts the model when OpenCode asks for it and swaps between the installed models.
Setup finds OpenCode (or installs it), adds the provider FastStrata to its config and puts a FastStrata shortcut
on the desktop. LODESTAR, a project memory that keeps a small model to a long task, is in the gateway: off at the
start, one switch turns it on.

Speed

On the test laptop (RTX 3060 Laptop 6 GB, Ryzen 7 5800H, 64 GB RAM), Qwen3.6-35B-A3B UD-Q4_K_M with a 144K context,
against the engine FastStrata started from: writing after a 2K prompt 56.4 → 71.8 tok/s, after 37K 41.9 → 66.9, after
139K 24.7 → 48.8; a coding agent's session 62.4 → 82.8.

Install in three steps

  1. Download Source code (zip) below (or git clone) and unzip it anywhere.
  2. Windows: double-click START-HERE.bat. Linux: run ./setup.sh. Press Enter to take what it recommends.
  3. Start the FastStrata shortcut, open OpenCode and pick a model of the provider FastStrata.

The ready-made engine

strata-poly-windows-x64-3ba1bf3a4bf413eb.zip below holds strata-poly.exe and the image encoder for Windows,
built for RTX 20 to RTX 50 with CUDA 13.0. Setup downloads it by itself and checks its SHA-256
(8be7a559e71ac6da29d0152cec5d911184bfd39b68a6c444b4d95cbcbe33c686), so you do not need to download it by hand and
need no compiler. On Linux, with a driver older than 580 or a CPU without AVX2, setup compiles the engine instead
(about five minutes on the test laptop).

What you need

  • An NVIDIA card, RTX 20 or newer: 4 GB of VRAM is the minimum (16K to 48K context), 6 GB is sensible (144K), 8 GB
    is optimal (about 248K, setup's estimate).
  • RAM: the engine holds 24 to 29 GB with the 23 GB models and 19 to 22 GB with the 17 GB ones.
  • 17 to 24 GB on an SSD for each model; Windows 10 / 11 or Linux.

Every number was measured on one laptop; other cards get setup's estimate less 10%, marked "estimated". Results from
your PC are welcome (how). If setup
stops, open an issue and attach logs/setup-*.log: names and keys are already taken out of it.

All changes: CHANGELOG.md