-
Notifications
You must be signed in to change notification settings - Fork 194
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Llama 3 GGUF Tokenizer #350
Comments
Passing it the huggingface ID for the regular (non GGUF/quantized) repo works to get the tokenizer. So for Meta-Llama-3-8B-Instruct you'd pass
|
Hello @ChairGraveyard I put the tokenizer as you proposed and also had to accept meta's license and put my huggingface token in ~/.cache/huggingface/token Thank you for your help ! |
Hello, I am coming back to this issue to put some additional info.
|
Hi, I don't have this token folder/file. It is a txt or something similar? How do I add this in? |
Just create it and put inside your token from HF |
Hello, I want to test the new Llama 3 8B model locally but I am unable to make it run using the playground since I cannot find a suitable tokenizer.
I run my server like this:
and have the following in my playground
But I get the error message that there is no tokenizer available:
Any tips on what tokenizer should be used ?
The text was updated successfully, but these errors were encountered: