-
Notifications
You must be signed in to change notification settings - Fork 25.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Tokenizers docs: Specify which class contains __call__
method
#14379
Conversation
@n1t0 This is one instance of |
Cool, I think this is a welcome change! cc @sgugger Could you run the style utilities to fix the code quality issues? You can do so by running this from the root of the repository:
|
Hi @LysandreJik I'm having trouble with that command. Got the following issue:
Not sure what's causing. I do have |
I believe the package to install is |
If you rebase on |
@LysandreJik thanks. I applied the |
Thanks again for your PR! |
Glad it was helpful :) |
…ingface#14379) * Update tokenizer.rst * Apply `make fixup`
Currently, the docs specify the following:
It's not clear what tokenizer class this is referring to. Moreover, the main
tokenizer
page does not have any documentation for__call__
; instead it is found inPreTrainedTokenizerBase
.The proposed change in this PR will make it clear where the user can found documentation about the
__call__
function, which is very widely used now.