Repository navigation
v1.6.1
新特性
- 支持 GLM-5.2 Packing/CP。(需 megatron-core main分支)
- 支持 AbsorbedMLA。(需 megatron-core main分支)
New Features
- Support for GLM-5.2 Packing/CP. (Requires megatron-core main branch)
- Support for AbsorbedMLA. (Requires megatron-core main branch)
What's Changed
- support absorbed_mla & support glm_moe_dsa CP/packing by @Jintao-Huang in #144
- fix embedding seq_cls by @Jintao-Huang in #147
- [bugfix] fix tie_word_embeddings by @Jintao-Huang in #150
- [bugfix] Fix deepseek-v4 fp8 pp by @Jintao-Huang in #151
- [bugfix] skip full-size cat copy when single shard (TP==1) to avoid OOM by @ys2025-AI in #152
- support megatron_fsdp by @Jintao-Huang in #153
New Contributors
- @ys2025-AI made their first contribution in #152
Full Changelog: v1.6.0...v1.6.1