Skip to content

DS41RT v13

Choose a tag to compare

@tpurtell tpurtell released this 23 Sep 18:48
· 22 commits to main since this release

DS41RT v13

V13 replaces every adaptive dSpark length selector with one online bandwidth-balance policy. Each round it chooses how many drafted tokens each request verifies by maximizing expected committed tokens per unit of predicted round time, pricing routed-expert weight traffic over an effective bandwidth fitted continuously from the lane's own layer timings. It needs no offline calibration, so quantization, TP width, clock and thermal changes are absorbed at runtime; the drafter's confidence is recalibrated per position online. Official checkpoint deepseek-ai/DeepSeek-V4.1-Flash (dba1be0a40aa45a94ad051997016db3960a90277), four Spark workers.

Image Architecture Registry manifest digest
ghcr.io/tpurtell/ds41rt-coordinator:v13 amd64 sha256:f0a7c245be0224ee6d472bc57c6e42eb578ba6ba8b5b2195afe558937c5282de
ghcr.io/tpurtell/ds41rt-spark-expert:v13 arm64 sha256:42d867515f16d37794127477d16d3d2de9cc40e0e6bac6cade4a784548a9ba86

latest resolves to the same pair. Immutable image build source: 00b25e7025410cdb1dadc7960b8e94ae9b89db48. The annotated tag's checkout adds measurements, documentation and promoted defaults; it is not claimed byte-identical to the image source.

Release decode (C1 dSpark, tokens/s):

Measurement 1 RTX 2 RTX
Weighted decode 91.10 108.91
C1 code decode 134.01 161.20
Counting decode 159.35 192.56

Against v12 in interleaved A/B sessions (four per arm per layout): on two RTX, +2–5% on per-case greedy and sampled C1 decode, topic C1, and code, topic and mixed C2–C16, with weighted batteries tied; on one RTX, +2–3% on per-case greedy and sampled C1 decode and ties elsewhere. Measured losses: topic C1 on one RTX (−4.8%), code C1 on two RTX (−2.1%), and two-RTX counting (about 193 versus 221), because dSpark now drafts its trained five-token block by default on both layouts. --dspark-draft-limit 7 restores the seven-token block with per-round 5/7 choice (opt-in; it measured 2–5% slower on code concurrency). No session had a quality failure.

Removed: the placement cost profiles, DS41RT_ADAPTIVE_COST_*, --dspark-confidence-cutoff, --dspark-reuse-floor and the offline fit scripts. /v1/stats now reports the policy's fitted costs, prediction error, draft-length histogram and per-position confidence reliability under dspark_policy.

v13-evidence.tar.gz (SHA-256 97f320a60a79d8f9acce105823cdb6091ffc5cca0ad21bb81908e504c9a4531d) holds every A/B session and analysis, the release campaign, publication records and build logs. SHA256SUMS verifies its 1,170 payload files; v13-release-assets.sha256 verifies the tarball and payload manifest. See the release notes, the performance report and the policy design.