-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
One click Macos install/Run h2ogpt-osx-m1-gpu ---- errors on loadiong model, chat #1349
Comments
Do you have the full stack trace for the first issue? It may just be verbose output while it tries to figure out how to access, since GGUF are not true HF models, so it takes extra passes to identify. |
What startup should look like:
i.e. it should have autodetected that model as "llama".cpp type, downloaded it after above command, then show below. It would be better for me to use
Then do: |
As title suggested, I used clickonce file to start the app, not the CL. Here is the trace from my Terminal window on start:/Users/xxxx/Downloads/h2ogpt-osx-m1-gpu ; exit; |
Here is the trace for loading model error: |
For For now I recommend you use manual install for mac. @Mathanraj-Sharma Please rebuild the one-click mac installer, I think it's too out of date. Thanks! |
I used Macos one click to install/Run h2oGpt. Web GUI at port 7860 works and I got the interface.
OSError: Can't load tokenizer for 'TheBloke/Mistral-7B-Instruct-v0.1-GGUF'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'TheBloke/Mistral-7B-Instruct-v0.1-GGUF' is the correct path to a directory containing all relevant files for a LlamaTokenizerFast tokenizer."
TypeError: bad operand type for unary -: 'NoneType'", do I have to change configre somewhere to make it work?
The text was updated successfully, but these errors were encountered: