Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
d474c8d
perf(deepseek4): fused single-token hyper-connection glue route
asher Aug 7, 2026
3b85e67
perf(deepseek4): fold the pending hc expand into the next front reduce
asher Aug 7, 2026
51028d8
perf(deepseek4): fused attention front kernels, opt-in
asher Aug 7, 2026
77c370b
probe(spec): round build/eval split + graph dot dumps for dspark hunt
asher Aug 6, 2026
101e0aa
perf(deepseek4): reuse one position upload across fused-attn layers
asher Aug 7, 2026
e1749bc
probe(spec): GMLX_VSEG eval-fence per-segment layer timings
asher Aug 7, 2026
89072da
perf(deepseek4): route the fused hc glue through mlx-kquant ops
asher Aug 7, 2026
88c268b
perf(deepseek4): fuse rmsnorm+mixes matmul into the HC sinkhorn kernel
asher Aug 7, 2026
98262c2
serve: per-phase command buffer caps, coarse decode fine prefill
asher Aug 7, 2026
79d9ae9
test(deepseek4): HyperConnection parity vs naive-ops reference
asher Aug 7, 2026
1bde86e
perf(deepseek4): opt-in shared-expert fold into the routed gathers
asher Aug 7, 2026
b58d7cb
perf(deepseek4): route dense skinny matmuls through kq.skinny_matmul
asher Aug 7, 2026
021ce63
test(deepseek4): cover the shared-expert fold install and MoE contract
asher Aug 7, 2026
f147c75
perf(deepseek4): fuse hc_expand into the following HC collapse
asher Aug 7, 2026
0895b6c
revert(deepseek4): drop the shared-expert fold
asher Aug 7, 2026
ae48a17
changelog: verify-width pack entries
asher Aug 7, 2026
f94d957
docs: changelog for the deepseek4 decode glue route and per-phase cb …
asher Aug 8, 2026
0b31f90
Merge branch 'dspark-round-overhead' into deepseek4-hc-unified
asher Aug 8, 2026
7d2a674
strip: remove the dspark branch's scratch probes
asher Aug 8, 2026
7418b0f
strip: remove the GMLX_MODEL_DOT graph-dump probe as well
asher Aug 8, 2026
e32ef2f
fix(spec): deep MTP serve prompts OOM under coarse decode CB caps
asher Aug 8, 2026
01c856e
docs: benchmarks regen for DeepSeek-V4 vs ds4-server b030961: sustain…
asher Aug 9, 2026
8efe89f
build(pkg): require mlx-kquant 0.3.x with floor 0.3.10 for the hc glu…
asher Aug 9, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,30 @@ adhere to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

## [Unreleased]

### Changed

- DeepSeek-V4 single-token decode runs its hyper-connection glue as four
native mlx-kquant ops instead of about 176 python kernel launches per
step. `GMLX_HC_M1_FUSED=0` and `GMLX_HC_KQ=0` restore the previous
routes for A/Bs.
- DeepSeek-V4 hyper-connections at speculative verify widths run as one
fused kernel per call.
- The hc_expand between attention and the ffn hyper-connection fuses into
the following collapse kernel, and dense small-N projections (router
gate, indexer weights, hyper head) route through mlx-kquant's
skinny_matmul at speculative verify widths when available
(GMLX_KQ_SKINNY=0 opts out).
- The server now sizes command buffers per phase, coarse while decoding
and fine during deep prefill, rather than one cap for both.
`GMLX_CB_PHASE=0` restores the single cap.

### Fixed

- GGUFs that quantize the MoE router gate (some community DeepSeek quants;
llama.cpp's own quantize leaves it F32) now load: small quantized tensors
on raw-array modules are dequantized to f32 at load instead of erroring.
- MTP prefill steps now use fine prefill caps to avoid a transient memory
spike that could trigger a Metal OOM.

## [0.2.2] - 2026-08-06

Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading