We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
11dd6c8
BertWordPieceTokenizer
ByteLevelBPETokenizer
dropout
Strip
do_lowercase
lowercase
CharBPETokenizer
__len__
Encoding
BPETokenizer