Skip to content

Issues: modelscope/ms-swift

GRPO (R1) 训练交流群
#3076 opened Feb 12, 2025 by Jintao-Huang
Open 3
Megatron-SWIFT训练交流群
#3604 opened Mar 21, 2025 by Jintao-Huang
Open
ms-swift3 Suggestion Box
#2217 opened Oct 10, 2024 by Jintao-Huang
Open 39
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

464 Open 1,472 Closed
464 Open 1,472 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

RTX3090上运行sft-rlhf-grpo微调，报错：torch.distributed.DistBackendError: [3] is setting up NCCL communicator and retrieving ncclUniqueId from [0] via c10d key-value store by key '0', but store->get('0') got error: wait timeout after 1800000ms,
#3612 opened Mar 22, 2025 by winni0
设置NPROC_PER_NODE后会直接报错 failed (exitcode: -11) local_rank: 1
#3611 opened Mar 22, 2025 by liujiwen0517
1
训练后的RM模型，支持推理引擎sglang/vllm部署
#3610 opened Mar 22, 2025 by Xu-Chen
grpo 固定seed，结果依旧不可复现
#3607 opened Mar 21, 2025 by gouqi666
SWIFT支持embedding模型的推理和部署如何实现
#3606 opened Mar 21, 2025 by xiaolingzang
Evaluate VLM on RefCoco Dataset
#3605 opened Mar 21, 2025 by HieuPhan33
Megatron-SWIFT训练交流群
#3604 opened Mar 21, 2025 by Jintao-Huang
reward margin enhancement New feature or request
#3603 opened Mar 21, 2025 by aleien95
GRPO算法训练，后期训练时，显存暴增
#3600 opened Mar 21, 2025 by RyanOvO
在昇腾上，运行 GRPO 报错：AssertionError: Torch not compiled with CUDA enabled
#3594 opened Mar 20, 2025 by SipingXu
PPO的训练有没有办法定制熵loss？
#3593 opened Mar 20, 2025 by 2043078895
Qwen25VL 72B GRPO training (lora) would hang for no reason.
#3592 opened Mar 20, 2025 by sys-reasoner
1
日志怎么添加训练数据中的字段
#3591 opened Mar 20, 2025 by BrightHai
1
How to obtain the last hidden states of each model?
#3586 opened Mar 20, 2025 by ShawnAn-WHU
多机多卡GRPO assert self.cpu_group is not None
#3583 opened Mar 20, 2025 by munian08
3
Loss goes to 0, Gibberish Outputs
#3582 opened Mar 20, 2025 by radna0
5
能否支持APOLLO（全量微调），尤其是q-apollo-mini？
#3580 opened Mar 20, 2025 by ImmoCat-Git
Train/Reward goes negative?
#3578 opened Mar 20, 2025 by radna0
1
单机多卡跑grpo，多个step后会报错
#3576 opened Mar 20, 2025 by shunxing12345
[Feature request] Support "Soundwave: Less is More for Speech-Text Alignment in LLMs" model
#3571 opened Mar 19, 2025 by 3manifold
All modal dataset format e.g. Janus Pro, how custom dataset format?
#3570 opened Mar 19, 2025 by NTUYWANG103
是否支持知识蒸馏&是否有实例命令
#3566 opened Mar 19, 2025 by iwillflyandfly
多卡多进程使用orpo卡死，触发watchdog caught collective operation timeout.
#3564 opened Mar 19, 2025 by xyshallz
8*H20全量微调qwen32b爆显存
#3560 opened Mar 19, 2025 by joey9503
1
qwen 2.5 vl 72B A100单机rm训练爆内存，不是显存，是不是哪里内存没回收？
#3559 opened Mar 19, 2025 by aleien95
4
ProTip! Type g i on any issue or pull request to go back to the issue listing page.