Skip to content

xpref v0.1.0

Latest

Choose a tag to compare

@SuperMarioYL SuperMarioYL released this 02 Aug 21:06
· 1 commit to main since this release

Predictive MoE expert prefetch — pre-stage Kimi K3 / DeepSeek V4 experts from NVMe→VRAM using router logits (4→~12 t/s)