Skip to content

[Bug] Ollama Sharded GGUF error. #3594

Description

@samancyrus-eaton

Running

ollama run hf.co/ubergarm/Kimi-K2-Thinking-GGUF:Q2_K

creates the following error:

pulling manifest
Error: pull model manifest: 400: {"error":"The specified repository contains sharded GGUF. Ollama does not support this yet. Follow this issue for more info: https://github.com/ollama/ollama/issues/5245"}

From the error, it seems that it is an issue with Ollama and not unsloth, but I thought you might want to be aware of it.

Metadata

Metadata

Assignees

No one assigned

    Labels

    DiscussionQuestions or discussionshelp wantedHelp from the OSS community wanted!

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions