Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion internal/catalog/seed.go
Original file line number Diff line number Diff line change
Expand Up @@ -224,7 +224,7 @@ func Seeds() []recipe.Recipe {
{
ID: "qwen38-dflash2", Kind: recipe.KindVLLM, Modality: recipe.ModalityText,
Model: "Inferact/Qwen3.8-27B-NVFP4", Image: pinnedVLLMDFlash2,
ServedAs: []string{"dflash2"},
ServedAs: []string{"dflash2", "qwen3.8"},
// Target 24.87 (qwen38's own measured NVFP4 figure) PLUS drafter
// 3.58: the drafter is resident too, and a footprint that ignored
// it would under-plan by 3.58 GiB.
Expand Down
1 change: 1 addition & 0 deletions recipes/qwen38-dflash2.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ model: Inferact/Qwen3.8-27B-NVFP4
image: vllm/vllm-openai@sha256:2a7cde230b59f3ce6cab33dd245ba6bee41aa87b38c9fe84f966ff24016813ce
served_as:
- dflash2
- qwen3.8
declared:
weights_gib: 28.45
kv_gib: 34
Expand Down
Loading