v0.8.16

EricLBuehler released this 20 Jun 06:36

· 124 commits to master since this release

b045ea0

What's Changed

feat(distributed): nccl on only for world size >= 2 by @EricLBuehler in #2257
fix(afq): fix afq launch/index math for large MoE expert stacks by @EricLBuehler in #2258

Full Changelog: v0.8.15...v0.8.16

Contributors

EricLBuehler

Assets 42