No GGUF source configured for Cookbook models #3526
Unanswered
ProgramCoin
asked this question in
Q&A
Replies: 1 comment
-
|
Hey, I had better luck with downloading a model and running it via lmstudio server, as lmstudio handles downloading from huggingface. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello everyone,
I'll be honest, I'm a bit of a noob and I'm not sure what I've entangled myself into by trying to run Odysseus on my Windows Docker container.
Nonetheless, I keep running into an issue that states "No GGUF source is configured for LiquidAI/LFM2-24B-A2B. Pick a model with a GGUF source, or paste the GGUF repo in Download".
I watched Pewdiepies video on his release of Odysseus and wondered what he meant by "wtf is a GGUF?". And now, I feel that to the core. I was successful in installing pip diffusers, pip llama_cpp and the model itself in cookbook though.
I'd like to know how this 'GGUF source' connects to a Docker container (if at all) or how Odysseus connects to these models. I think that would at least give me some clue as to how to fix it. I've asked my Odysseus AI models that I've integrated, but they seem to want me to create python files in my Odysseus directory and I'm not looking to complicate it that much.
Any help would be appreciated, thank you in advance!
Beta Was this translation helpful? Give feedback.
All reactions