Releases · ZHEQIUSHUI/tokenizer · GitHub

Repository navigation

Release list

SDK Latest Latest

Latest

github-actions released this 31 Dec 02:29

81941fd

Auto-updated from main: 81941fd

Assets 20

hf-auto-sdk-linux-aarch64.tar.gz

sha256:2701634e9a21c342a1eb5a1cc8f6a3fe3e94f60ced16962c2cf2967715a2b4ac

15.5 MB 2026-01-12T03:08:16Z
hf-auto-sdk-linux-aarch64.tar.gz.sha256

sha256:e35db7507bed43dc94feb393c3c8998f2ee62838bf67b6a19a4a37a8e87327e8

99 Bytes 2026-01-12T03:08:16Z
hf-auto-sdk-linux-x86_64.tar.gz

sha256:25fda93b04a896f9a7e9b2d7f002a067955076b3a266e982a994ae64e1f01980

15.8 MB 2026-01-12T03:08:16Z
hf-auto-sdk-linux-x86_64.tar.gz.sha256

sha256:0e584e77a5825777641322314266a906f4fc28750b45d14fb706c555e51657e6

98 Bytes 2026-01-12T03:08:16Z
hf-auto-sdk-windows-mingw64.zip

sha256:e8b3805bc3ef3844a2eae105bc086bbe7845edd22dcb05051c614ecbbdd29a76

13.8 MB 2026-01-12T03:08:16Z
hf-auto-sdk-windows-mingw64.zip.sha256

sha256:5343d5c2bb9949eccc9653cea8c67d005c713987748363006ffd4383a1b909db

98 Bytes 2026-01-12T03:08:16Z
hf-sdk-linux-aarch64.tar.gz

sha256:5bc4e1a48a758b7b5e486263c9a3914060854d13e818040ceb2d266f313c4b8d

15.5 MB 2026-01-12T03:16:37Z
hf-sdk-linux-aarch64.tar.gz.sha256

sha256:299375eeca95f4d0873711c3d8b783b8a81259e7f1b1446c88f22fc2a65f7322

94 Bytes 2026-01-12T03:16:37Z
hf-sdk-linux-x86_64.tar.gz

sha256:8dec1c22081db6a857443b19096699796352c88563111ef3aef2e9490bac79bf

15.8 MB 2026-01-12T03:16:37Z
hf-sdk-linux-x86_64.tar.gz.sha256

sha256:66eb086040a445f55fd06ea797d90ea97e886526eef0487b8267287fd0da5d47

93 Bytes 2026-01-12T03:16:37Z
Source code (zip)

2026-10-16T11:08:08Z
Source code (tar.gz)

2026-10-16T11:08:08Z

v1.0

ZHEQIUSHUI released this 04 Dec 03:15

0f2726f

qwen3_tokenizer.txt 同时支持 qwen3 qwen3vl
internvl3_tokenizer.txt 同时支持 internvl2.5

Assets 20