Skip to content
Discussion options

You must be logged in to vote

Hi @tidotua,

You're not missing anything, extra_models_dir skips them on purpose. In src/cpp/server/models/scan_catalog.cpp the scan does

if (!ends_with_ignore_case(filename, ".gguf") ||
    is_draft_gguf_filename(filename)) continue;

and is_draft_gguf_filename matches mtp-*, *-mtp-ud-* and dflash-*. They are treated as draft files, not standalone models, and the extra-dir scan has no step that attaches them to a base model. That pairing (plus the mtp label that makes llama.cpp start with --spec-type draft-mtp) only happens for models that come through the HF cache, in hf_variants.cpp.

Since your actual problem is space on /, the easier fix is to move the HF cache itself instead of using e…

Replies: 2 comments

Comment options

You must be logged in to vote
0 replies
Answer selected by tidotua
Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants