Running
ollama run hf.co/ubergarm/Kimi-K2-Thinking-GGUF:Q2_K
creates the following error:
pulling manifest
Error: pull model manifest: 400: {"error":"The specified repository contains sharded GGUF. Ollama does not support this yet. Follow this issue for more info: https://github.com/ollama/ollama/issues/5245"}
From the error, it seems that it is an issue with Ollama and not unsloth, but I thought you might want to be aware of it.
Running
creates the following error:
pulling manifest Error: pull model manifest: 400: {"error":"The specified repository contains sharded GGUF. Ollama does not support this yet. Follow this issue for more info: https://github.com/ollama/ollama/issues/5245"}From the error, it seems that it is an issue with Ollama and not
unsloth, but I thought you might want to be aware of it.