veloGB10 v0.5.4 — Built-in OpenTelemetry, FP8 support, DFlash2 tree mode
Built-in OpenTelemetry. --otel-endpoint streams OTLP/HTTP-JSON generation telemetry (the
actual SSE chunk bytes, with model.id / topology / request.id / token.index / event attributes), off
by default, near-zero decode interference. request.id is now the conversation key so a reply's turns
join one continuous session; generation.id stays per-POST. Companion flags: --otel-batch-size,
--otel-batch-interval-ms, --otel-include-tokens, --otel-model-id, --otel-topology.
FP8 support expanded. Direct load of Qwen fine-grained block-128 FP8 (weight_scale_inv); DFlash2
FP8 drafter bake (--df2-bake-fp8) plus weight-only NVFP4 (--df2-bake-nvfp4); --df2-quant-fidelity
gate tool. Fixed FP8 kernel bugs across gpu_batch.cu.
DFlash2 tree verification. New opt-in --spec-source dflash2-tree mode (additive; MTP and
DFlash2 unchanged). Minor bug fixes and optimizations.
Source: dev repo @ e94430c. Built from the public tree (self-contained), binary sha256
269607fc2801210a44fbfe35c16b121cf924d70d9a23e5b97cbd884abfe495aa.
Downloads
- velogb10-v0.5.4-gb10-sm121.tar.gz - engine binary + all 15 PTX kernel artifacts (incl. vision) + TP launch scripts
- SHA256SUMS.txt - checksums
- PROVENANCE.txt - build provenance