Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unexpected message #10

Open
JochiRaider opened this issue Oct 3, 2021 · 1 comment
Open

unexpected message #10

JochiRaider opened this issue Oct 3, 2021 · 1 comment

Comments

@JochiRaider
Copy link

I am getting this odd message when I make a call from this module in a script:

The tokenizer class you load from this checkpoint is not the same type as the class this function is called from. It may result in unexpected tokenization.
The tokenizer class you load from this checkpoint is 'BartTokenizer'.
The class this function is called from is 'PreTrainedTokenizerFast'.

@jimkang
Copy link

jimkang commented Aug 8, 2022

I got the same thing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants