Skip to content

veloGB10 v0.2.0 — Hy3 family support

Choose a tag to compare

View all tags
@sf-stav sf-stav released this 22 Jul 18:17
· 24 commits to main since this release
v0.2.0
eeaf002

veloGB10 v0.2.0 — Hy3 (hy_v3) family support

Headline: Hy3 (295B-A21B MoE) serving incl. TP=2 shard-at-load, MTP speculative decoding (96.9% acceptance), FR-Spec draft head, 4-bit KV cache (GB10_KV_QUANT), head_dim-generic attention (128..512), MoE shared-expert fusion, CLI session flags, curated run presets, tests/ now in the curated set.

Built from the public tree at tag v0.2.0 — the repo builds standalone.
Binary sha256: 9e9300bb9fa01c4111f07cb6bbf1519254b60bd52d99c779340601c8d9550c96

Artifact: velogb10-v0.2.0-gb10-sm121.tar.gz — engine binary + required PTX kernels + TP=2 launch scripts. Verify with sha256sum -c SHA256SUMS.txt; details in PROVENANCE.txt.

Runtime: NVIDIA DGX Spark (GB10, sm_121), current CUDA driver; one machine or two (TP=2 over ConnectX-7). Model weights are NOT included — see https://huggingface.co/doth4580 for the NVFP4 model artifacts.

Assets 5
Loading