Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

微调时报错：use_cache=True is incompatible with gradient checkpointing. Setting `use_cache=False #22

Closed
s861092982 opened this issue Aug 19, 2023 · 4 comments
Closed

微调时报错：use_cache=True is incompatible with gradient checkpointing. Setting `use_cache=False #22

s861092982 opened this issue Aug 19, 2023 · 4 comments

Comments

@s861092982
Copy link

微调时报错：use_cache=True is incompatible with gradient checkpointing. Setting `use_cache=False，这个改怎么修改？
@s861092982
Copy link
Author

已解决：数据集的问题，需要注意数据集格式和数量，数量太少可能会遇到这个问题

@s861092982 s861092982 reopened this Aug 19, 2023
@conderls
Copy link

conderls commented Aug 21, 2023 •
edited

已解决：数据集的问题，需要注意数据集格式和数量，数量太少可能会遇到这个问题

这个是配置不兼容由数据量、格式引起？看着不太像呢，我也有这个 warning，能正常跑，还没跑完。应该没啥影响

https://discuss.huggingface.co/t/why-is-use-cache-incompatible-with-gradient-checkpointing/18811/3

@Jintao-Huang
Copy link
Collaborator

没影响的, 不用管这个warning

@Jintao-Huang
Copy link
Collaborator

这个warning的问题已经修复了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@conderls @s861092982 @Jintao-Huang