v2.6.1

sijunhe released this 14 Sep 03:57

· 627 commits to develop since this release

What's Changed

在v2.6.1版本中，我们做了大量的bug修复，提高了LLM模型和相关组件的稳定性。除了bug修复以外，主要新增功能如下：

LLM：新增了 qwen 模型，InTokens数据流兼容了Pipeline Parallel，LLM精调支持从多个训练文件加载以及热启动，增强了LLaMA模型的不同recompute粒度
Trainer: hybrid_parallel_topo_order 选项，并修复了 sharding stage3 的保存模型。
Paddle-pipelines: 添加了对 ERNIE-Bot-turbo和ERNIE-embedding 的支持, 更新了分层搜索示例并且增强了 ChatPaper 的UI
Megatron 数据集：添加了加载 megatron 数据集的支持，支持ernie-1.0和T5数据类型

New Contributors

@xiezheng-XD made their first contribution in #6764
@carryyu made their first contribution in #6676
@xiaoxiaohehe001 made their first contribution in #6798
@MARD1NO made their first contribution in #6865
@zhoutianzi666 made their first contribution in #6905
@lchdl made their first contribution in #6964
@LaiXinyi823 made their first contribution in #6659

Full Changelog: v2.6.0...v2.6.1

Contributors

lchdl, carryyu, and 5 other contributors

Assets 2