New issue

Jump to bottom

megatron多机多卡 #3590

Closed

nioxinjiang3 opened this issue Mar 20, 2025 · 2 comments

nioxinjiang3 commented Mar 20, 2025

缺少megatron多机多卡的使用示例

Xu-Chen commented Mar 21, 2025

和非megatron没区别

Collaborator

Jintao-Huang commented Mar 22, 2025

https://github.com/modelscope/ms-swift/tree/main/examples/train/megatron/multi-node

Jintao-Huang closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment