Skip to content

SparkRing 2026.10.0

Choose a tag to compare

View all tags
@FujitsuPolycom FujitsuPolycom released this 01 Oct 23:26
2026.10.0
e42504d
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

One command sets up two or four directly cabled DGX Sparks and starts a model.

curl -fsSL https://raw.githubusercontent.com/FujitsuPolycom/sparkring/main/install.sh | bash -s -- --profile PROFILE

Pick a --profile from the table. The command asks before it installs the SparkRing package and before it changes any Spark (--yes answers both; --plan changes nothing). Rerunning it upgrades to the newest release on main.

Image

dev-20261001-kraken-cuda1342-nccl2323-status034:
ghcr.io/fujitsupolycom/sparkring@sha256:b01442df4e1496bea2f1339feb629eb61dc8175700c82b0e26abbcebd5b49567
(14.2 GiB download, 29.7 GiB unpacked). All nine installer profiles run it.

vLLM and B12X are Local Inference Lab's Karmic Kraken beta branches with SparkRing's changes, on eugr's spark-vllm-b12x nightly-20261001 (Torch 2.13, FlashInfer 0.7.1, built for GB10), with CUDA 13.4.2 and the patched NCCL 2.32.3.

Profiles

Decode is the aggregate output rate from llm-inference-bench 0.6.2 at temperature 1.0 with no added context; prefill is one cold 64K-token prompt divided by its time to first token. Single runs on one pair or one four-Spark ring.

Model Sparks --profile Decode 1 / 8 / 16 users (tok/s) Prefill 64K (tok/s)
Qwen3.8-Flash-Next NVFP4 QAD 2 qwen38-flash-next-tp2 53.6 / 201 / 296 3,660
Qwen3.8-Flash-Next NVFP4 QAD 4 qwen38-flash-next-qad-tp4 80.9 / 281 / 417 4,564
GLM-5.3-Flash NVFP4 Spark 2 glm53-flash-nvfp4-spark-tp2 37.7 / 107 / 97* 2,497
GLM-5.3-Flash NVFP4 Spark 4 glm53-flash-nvfp4-spark-tp4 65.7 / 211 / 290 3,666
MiMo-V2.6-Flash-MOPD 2 mimo-v26-flash-mopd-tp2 39.8 / 130 / 195 2,604
MiMo-V2.6-Flash-MOPD 4 mimo-v26-flash-mopd-tp4 54.5 / 204 / 332 4,084
DeepSeek-V4.1-Flash 4 deepseek-v41-flash-tp4 68.8 / 201 / 277 4,406
Swift-1.5-Qwen3.8-Flash-Next 2 or 4 swift15-qwen38-flash-next-tp2, -tp4 not measured on this image —

* The two-Spark GLM profile serves 8 requests at a time, so 16 users queue.

Every measured profile passed the functional checks (counting, arithmetic, code, automatic and forced tool calls, image input, thinking) and a 256-request correctness screen with no degenerate response.

Changes

  • Karmic Kraken beta. vLLM and B12X follow Local Inference Lab's integration/karmic-kraken-beta (2026-10-01) instead of dev/karmic-kraken, with SparkRing's changes merged on top (vLLM, B12X). This brings B12X 1.5 and Local Inference Lab's MiMo-V2.6, GLM-5.3 KV-memory, image-request checkpoint and checkpoint-restore work.
  • Rebuildable from the repository. runtime/images/external_context.py prepares the image's software layer; the composition record pins every input.
  • First start compiles again. Kernel caches are kept per image, so each model's first start on this image compiles and tunes its kernels (about 10 minutes on a pair or ring).
  • Open: MiMo's two-Spark 64K prefill measured 2,604 tok/s, below the 2,754–2,806 tok/s of earlier images.
  • Timings are single runs; profiles are implemented, not serving-qualified.

The images of earlier releases stay published, and shared-2026.09.3 remains available for the manual setups in the profile catalog.

Assets 2
Loading