Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

colab RuGPT3FinetuneHF.ipynb is not working #43

Closed
sc0eur opened this issue Mar 9, 2021 · 1 comment
Closed

colab RuGPT3FinetuneHF.ipynb is not working #43

sc0eur opened this issue Mar 9, 2021 · 1 comment

Comments

@sc0eur
Copy link

sc0eur commented Mar 9, 2021

Перестал работать ноутбук для файнтюнинга на колабе: https://colab.research.google.com/github/sberbank-ai/ru-gpts/blob/master/examples/Finetune_RuGPTs_with_HF.ipynb
При выполнении ячейки Train ошибка:

2021-03-09 17:40:36.000492: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
Traceback (most recent call last):
  File "ru-gpts/pretrain_transformers.py", line 33, in <module>
    from transformers import (
  File "/usr/local/lib/python3.7/dist-packages/transformers/__init__.py", line 626, in <module>
    from .trainer import Trainer
  File "/usr/local/lib/python3.7/dist-packages/transformers/trainer.py", line 69, in <module>
    from .trainer_pt_utils import (
  File "/usr/local/lib/python3.7/dist-packages/transformers/trainer_pt_utils.py", line 40, in <module>
    from torch.optim.lr_scheduler import SAVE_STATE_WARNING
ImportError: cannot import name 'SAVE_STATE_WARNING' from 'torch.optim.lr_scheduler' (/usr/local/lib/python3.7/dist-packages/torch/optim/lr_scheduler.py)
@king-menin
Copy link
Collaborator

Версия трансформеров не та скорее всего. Попробуйте с 3.5.1

@ai-forever ai-forever deleted a comment Sep 2, 2022
@ai-forever ai-forever deleted a comment Sep 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants