DS41RT v6

DS41RT v6 adds RAM-backed retained KV caching and safer admission under pressure while preserving the fastest native dual-RTX serving layout as the default. It also ships independently selectable TP2 experiments for further development without enabling paths that did not win end-to-end measurements.

Key features

• Automatic pinned-RAM backing sizes GPU-plus-host logical capacity above 20 retained entries × the configured maximum context. The standard dual recipe provides 14,680,064 GPU tokens plus 6,291,968 RAM tokens.
• Token-aware admission, bounded HTTP queueing, cancellation, explicit overload responses, and safe cache-pressure progress integrate PR #4 and resolve issues #2 and #3.
• Budget-driven bottom-up RTX expert placement can preserve a requested KV budget without requiring exactly 20 RTX layers.
• Opt-in TP2 attention with replicated KV, query projection, output projection, and dSpark routed experts are available independently. They remain off by default because qualification found no consistent end-to-end win.
• The official DeepSeek V4.1 Flash checkpoint remains the native default. EXL3 remains compatible; its historical performance data is linked from the v6 README rather than presented as v6 qualification.
• Standard serving uses port 8000, concurrency 16, adaptive K7 drafting on dual RTX, 20 retained turns, FP4 compressed source KV, and FP8 SWA.

Native performance

Measurements use 400 W per RTX and standard memory speed. Dual RTX reaches 109.44 weighted dSpark tok/s versus 92.00 on one RTX (+19.0%), 1,195.37 C16 code tok/s (+11.8%), 1,508.81 C16 counting tok/s (+19.1%), and 8,355.22 best prefill tok/s (+6.8%). A fresh same-machine v5/v6 control measured mixed decode at 327.02 versus 326.01 tok/s (-0.31%) and 256K retained decode at 98.23 versus 96.36 tok/s (-1.91%).

Validation and artifacts

• Full release campaign: native one/two-RTX decode, retained context through 256K, prefill, target-only controls, combined TP2 smoke, basic EXL3 smoke, and a two-minute tiny-KV pressure torture run.
• Script gate: 209 passed, 1 skipped, 46 subtests passed.
• Coordinator image: ghcr.io/tpurtell/ds41rt-coordinator:v6 (sha256:22d74a117613fa3ed1b75912b3e3732c82b31a55487ffb45efa28b08d53abd00).
• Spark image: ghcr.io/tpurtell/ds41rt-spark-expert:v6 (sha256:9b8a420939ab5e2b5b81047b0b7b1e399c6e0b035b05f824026faea207a130d5).
• Attached binary bundles include exact provenance and internal checksums; the evidence bundle contains the raw reports and telemetry behind the published tables.