Skip to content

Basalt 0.2.0 CUDA 13.4 Windows pre-built binaries

Latest
Latest

Choose a tag to compare

View all tags
@garlique garlique released this 03 Nov 23:06
release
3cd9289
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Basalt on Windows, prebuilt

RTX 50-series only (sm_120): 5090, 5080, 5070, 5060 Ti 16 GB, RTX PRO Blackwell. Nothing older runs it.

Get this ready

  1. Install CUDA 13 — basalt.exe needs cublas64_13.dll (any 13.x; built against 13.4).
  2. Install the latest Microsoft Visual C++ v14 redistributable x64 (the 2015-2026 one, 14.51.x, from
    visualstudio.microsoft.com/downloads). These were built with MSVC 14.51: with an older redist the exe can fail to
    start with a missing-entry-point error on MSVCP140.dll.
  3. pip install -r requirements.txt (Python 3.10+).
  4. Download one .basalt pack from https://huggingface.co/jesdga/Qwen3.8-Flash-Next-Basalt into models\.
  5. Edit basalt_config.json: model is your pack, gpu is 0 (or 0,1 with a second card), port is the web UI.

Run it

bin\basalt.exe serve --config basalt_config.json

Then open http://127.0.0.1:8080. API: /v1 (OpenAI) and /v1/messages (Anthropic).

System RAM holds the experts that don't fit in VRAM, so leave plenty free. If it starts and then crawls, you ran out.

Other things in here

bin\basalt-probe.exe --model models\your-pack.basalt --engine bin\basalt.exe --fixtures data\bench
bin\basalt-bench.exe --model models\your-pack.basalt --engine bin\basalt.exe --fixtures data\bench

bin\basalt.exe serve --help prints everything; docs/running.md and
docs/configuration/index.md explain the knobs.

To build your own: from a Developer command prompt, cmake -S . -B build -G Ninja -DCMAKE_BUILD_TYPE=Release then
cmake --build build.

Checksums

basalt.exe        66f5dad0000457f83db7245c6e3d3cc5d7b0a0b89165c57bc0e6b2ee7efae52e
basalt-bench.exe  73cfdacaea5e2cfc818c270516067eb74ebd3e78a4adc045d12b620aa4cd2b89
basalt-probe.exe  ff6a5bffcba5cacf0770f7c2779dd7d3c3f37548496ecdc6df104f2202a2625c
basalt-vision.exe 1728fa5aed2820109c579d404f018b8abeaf4a282f0a400674b0657a949a837d

MIT licence (LICENSE, THIRD_PARTY_LICENSES). Model packs are under the Qwen Community License 1.0.
Windows quality has never been measured: no PPL/KLD or benchmark numbers for it yet.

Assets 3
Loading