Skip to content

Patch v2.5.1: AutoTokenizer slow by default, bug fixes
Compare
Choose a tag to compare
@LysandreJik LysandreJik released this 24 Feb 23:53
v2.5.1
b90745c
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

AutoTokenizer

AutoTokenizer has been put back to False by default so as to not have a breaking change between 2.4.x and 2.5.x

Fast tokenizers

Bug fixes

Slow tokenizers

Bug fixes related to batch_encode_plus

Assets 2
Loading