Skip to content

feat(pull): MVP qualification blocked — APR and GGUF formats unavailable for pulled models #211

@noahgift

Description

@noahgift

Summary

MVP qualification runs for Qwen2.5-Coder models complete with 57% of scenarios skipped because apr pull only provides SafeTensors format. The APR and GGUF formats are unavailable, causing all multi-format scenarios to skip with "Format Apr/Gguf not available for model file".

MVP Results

Model Total Passed Skipped Failed Pass Rate Duration
0.5B 21 9 12 0 42.9% 25s
1.5B 21 9 12 0 42.9% 85s
3B 19 0 0 19 0% blocked (aprender#210)
7B 19 0 0 19 0% blocked (aprender#210)

Evidence Pattern (identical for 0.5B and 1.5B)

All 3 pre-flight gates pass:

  • G0-PULL-001: PASS (SafeTensors pulled from pacha cache)
  • G0-VALIDATE-001: PASS (physics validation)
  • G0-INTEGRITY-CONFIG: PASS (config matches tensors)

All 6 SafeTensors scenarios pass (run/chat/serve × cpu/gpu):

  • F-A1 through F-A6: CORROBORATED on safetensors/*

All 12 APR and GGUF scenarios skip:

Skipped  F-A1-001  apr/run/cpu    Format Apr not available for model file
Skipped  F-A1-001  gguf/run/cpu   Format Gguf not available for model file
... (×6 modality/backend combos each)

Root Cause

apr pull delivers only the SafeTensors triplet (<hash>.safetensors, <hash>.config.json, <hash>.tokenizer.json). For full MVP qualification, the executor also needs:

  1. GGUF format — either pulled directly or converted from SafeTensors
  2. APR format — converted from SafeTensors via apr import

Requested

Either:

  • Option A: apr pull also downloads/converts GGUF and APR formats
  • Option B: apr convert command that takes a SafeTensors path and produces GGUF and APR files in the pacha cache
  • Option C: The QA executor handles conversion itself (less preferred — duplicates apr logic)

Cross-References

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions