New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

AttributeError: 'NoneType' object has no attribute 'peft_type' #1224

Closed

1 of 2 tasks

liuqi8827 opened this issue May 20, 2024 · 3 comments

Closed

1 of 2 tasks

AttributeError: 'NoneType' object has no attribute 'peft_type' #1224

liuqi8827 opened this issue May 20, 2024 · 3 comments

Assignees

liuqi8827 commented May 20, 2024 •

edited

System Info / 系統信息

ubuntu

Who can help? / 谁可以帮助到您？

Information / 问题信息

The official example scripts / 官方的示例脚本
My own modified scripts / 我自己修改的脚本和任务

Reproduction / 复现过程

OMP_NUM_THREADS=1 torchrun --standalone --nnodes=1 --nproc_per_node=8 finetune_hf.py data/AdvertiseGen/ /workspace/xxx/models/chatglm3-6b configs/sft.yaml configs/ds_zero_3.json

3.

Expected behavior / 期待表现

正常训练

zRzRzRzRzRzRzR self-assigned this

Collaborator

zRzRzRzRzRzRzR commented May 21, 2024

这不是模型没读入成功吗

Author

liuqi8827 commented May 21, 2024 •

edited

感谢回复

我要做SFT，所以把代码改成如下图所示，代码可以正常运行

但是一直会报OutOfMemoryError: CUDA out of memory.的错误

计算资源如下图，运行时已经设置为--nproc_per_node=8：

使用的是官方代码和官方给的数据集
sft.yaml配置如下：

ds_zero_2.json配置如下：

ds_zero_3.json配置如下：

无论使用ds_zero_2.json还是ds_zero_3.json，dou都会报OutOfMemoryError: CUDA out of memory.的错误

Collaborator

zRzRzRzRzRzRzR commented May 22, 2024

已经解决

zRzRzRzRzRzRzR closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment