Skip to content

v0.6.4

@george-connito george-connito tagged this 25 Sep 14:37
moe.miner_topology (default full) replaces the unread partial_moe: the miner
trains with every routed expert present and native top-6 routing, the model
validators score, with frozen experts in fp8. The per-step hash and the
single-group save no longer dequantize the whole model. Validators unchanged. (#283)
Assets 2
Loading