There was an error while loading. Please reload this page.
4b98f50
移除eos
236f1db
适配baichuan2
f19ea5b
修复tokenizer异常
a43bc7a
修复非中文的编码错误,重新启用tokenizer.model
4503db9
使用内置tokenizer,将[196,31106]换成[196],与官方一致,去除sentencepiece依赖
649e741
自带tokenizer.model,新增linux_arm64
7e09199
Llama.create_chat_completion新增tokenizer参数,为tokenizer.model路径
36db781
Update setup.py
83bf8e2