Skip to content

fix(gallery): correct Qwen3.5 typo in qwen3.5-27b-claude-4.6 model override (closes #9362)#9580

Merged
mudler merged 1 commit into
mudler:masterfrom
Anai-Guo:fix/gallery-qwen3-5-typo-9362
Apr 27, 2026
Merged

fix(gallery): correct Qwen3.5 typo in qwen3.5-27b-claude-4.6 model override (closes #9362)#9580
mudler merged 1 commit into
mudler:masterfrom
Anai-Guo:fix/gallery-qwen3-5-typo-9362

Conversation

@Anai-Guo
Copy link
Copy Markdown
Contributor

@Anai-Guo Anai-Guo commented Apr 27, 2026

Summary

Closes #9362.

The gallery entry qwen3.5-27b-claude-4.6-opus-reasoning-distilled-heretic-i1 has a typo in its overrides.parameters.model field — Qwen3.-27B-Claude-... (missing the 5). The downloaded file is named Qwen3.5-27B-Claude-... (matching the files: entry below and the upstream HF repo), so model loads fail with:

Failed to load model: /models/llama-cpp/models/Qwen3.-27B-Claude-4.6-Opus-Reasoning-Distilled-heretic.i1-Q4_K_M.gguf

Diff

   overrides:
     parameters:
-      model: llama-cpp/models/Qwen3.-27B-Claude-4.6-Opus-Reasoning-Distilled-heretic.i1-Q4_K_M.gguf
+      model: llama-cpp/models/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-heretic.i1-Q4_K_M.gguf

Verification

After fix, overrides.parameters.model matches:

  • the files: entry (llama-cpp/models/Qwen3.5-27B-Claude-...)
  • the mmproj field (...mmproj/Qwen3.5-27B-Claude-...)
  • the upstream HuggingFace repo path (mradermacher/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-heretic-i1-GGUF)

I grep'd gallery/index.yaml for similar Qwen3.-/\.\-[0-9]+B patterns; this is the only occurrence — no other entries are affected.

🤖 Generated with Claude Code

…erride (closes mudler#9362)

The overrides.parameters.model field referenced 'Qwen3.-27B-Claude-...' (missing the '5'), so model loads failed because the configured filename did not match the file actually downloaded by the entry's files: list ('Qwen3.5-27B-Claude-...').

Aligns the override filename with the files: entries and with the upstream HF repo (mradermacher/Qwen3.5-27B-...).
@mudler mudler merged commit 86fd622 into mudler:master Apr 27, 2026
16 of 17 checks passed
@localai-bot localai-bot added the bug Something isn't working label May 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

qwen3.5-27b-claude-4.6-opus-reasoning-distilled-heretic-i1 fails to load probably due to regexp escaping bug

3 participants