Skip to content

feat(gallery): add Qwen3.8 GSQ-RCO variants - #11787

Merged
mudler merged 1 commit into
masterfrom
cron/model-gallery-20260830-gsq-rco
Aug 30, 2026
Merged

feat(gallery): add Qwen3.8 GSQ-RCO variants#11787
mudler merged 1 commit into
masterfrom
cron/model-gallery-20260830-gsq-rco

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Description

Add the three Qwen3.8-27B GSQ-RCO GGUF quantizations published by ISTA DASLab. The new variants provide 8.4 GB, 9.3 GB, and 10.1 GB weight options, and each uses the shared BF16 vision projector.

The entries use the existing Qwen3.8-27B llama.cpp configuration and are linked from its variant list. Every artifact SHA-256 matches the Hugging Face x-linked-etag.

Verification

  • go test ./core/gallery -ginkgo.focus="gallery/index.yaml"
  • git diff --check

The full go test ./core/gallery run reached 383 passing specs, but three unrelated network-dependent specs failed because this environment receives HTTP 403 from raw.githubusercontent.com.

Notes for Reviewers

The upstream model card identifies IQ3_XXS as the recommended highest-quality build in this set. Automatic variant resolution still ranks all same-engine builds by measured size and fit.

Signed commits

  • Yes, I signed my commits.
  • Documentation updated (docs/content/) for user-facing changes, or not applicable

The commit is intentionally unsigned because AI assistants cannot provide DCO sign-off.

Add three llama.cpp-compatible mixed quantizations from ISTA DASLab. These builds give Qwen3.8-27B users an 8.4 to 10.1 GB weight tier with the shared vision projector.

Assisted-by: Codex:gpt-5
@mudler
mudler merged commit dd4e759 into master Aug 30, 2026
56 of 57 checks passed
@mudler
mudler deleted the cron/model-gallery-20260830-gsq-rco branch August 30, 2026 18:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants