Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update installation and dpo in README.md #249

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Update installation and dpo in README.md #249

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -211,7 +211,7 @@
- 使用QLoRA训练Baichuan2时，需要安装torch==2.0，并且卸载xformers和apex。
- 使用QLoRA训练Qwen时，需将flash-attn卸载，否则会报错。
```bash
pip install requirements.txt
pip install -r requirements.txt
```

如果需要开启Unsloth，建议安装或者更新以下Python包：
Expand Down Expand Up @@ -303,7 +303,7 @@ torchrun --nproc_per_node={num_gpus} train.py --train_args_file train_args/sft/q

💻 单卡QLoRA进行DPO训练：
```bash
python train.py --train_args_file train_args/sft/qlora/minicpm-2b-dpo-qlora.json
python train.py --train_args_file train_args/dpo/qlora/minicpm-2b-dpo-qlora.json
```

## 模型使用
Expand Down