Skip to content

v1.6.2

Choose a tag to compare

@tastelikefeet tastelikefeet released this 15 Aug 02:32
· 59 commits to main since this release

English Version

mcore-bridge v1.6.2

🚀 New Model Support

  • Support Muse Glimmer (#163)
  • Support Nemotron (#164)

✨ Features

  • Support saving unknown/unrecognized parameters, avoiding silent weight drops during conversion (#156)
  • Bump transformers and peft dependencies (#157)

🐛 Bug Fixes

  • Fix context parallel (CP) and sequence packing for DeepSeek-V4 (#161)
  • Fix GDN sequence parallel and CP-aware cu_seqlens resolution (#162)
  • Fix Nemotron MTP (#166)

中文版本

mcore-bridge v1.6.2

🚀 新增模型支持

  • 支持 Muse Glimmer (#163)
  • 支持 Nemotron (#164)

✨ 新特性

  • 支持保存未知/未识别参数,避免转换过程中静默丢弃权重 (#156)
  • 升级 transformers 和 peft 依赖 (#157)

🐛 问题修复

  • 修复 DeepSeek-V4 的上下文并行(CP)与序列 packing 问题 (#161)
  • 修复 GDN 序列并行以及 CP 感知的 cu_seqlens 解析问题 (#162)
  • 修复 Nemotron MTP 问题 (#166)

What's Changed

New Contributors

Full Changelog: v1.6.1...v1.6.2