Skip to content

Releases: urawazakun/Strata

Release list

Strata V100 (sm_70) / CUDA 11.8 — Windows

Strata V100 (sm_70) / CUDA 11.8 — Windows Latest
Latest

Choose a tag to compare

View all tags
@urawazakun urawazakun released this 27 Sep 23:19
v0.1.1-v100
3153cd5

Ready-made Strata engine for Tesla V100 / Volta (sm_70) on Windows, built with CUDA 11.8 + MSVC 14.34 from branch win-cuda118.

  • Runs on NVIDIA drivers 452+ (tested on 472.12). CUDA libraries come from pip (nvidia-cublas-cu11, nvidia-cuda-runtime-cu11); START-HERE.bat installs them.
  • Measured (V100-SXM2 16 GB, GSQ-RCO Q2_0 + MTP, 8K context): decode 51-53 tok/s, prefill ~545 tok/s.
  • BUILD.json: version 0.1.1, archs [70], cuda 11.8.
  • No vision helper (answer "no" to Images). Very long prompts (~60K tokens) are experimental.

Build notes: Docs/windows-cuda118.md

Assets 3
Loading