Skip to content

v3.3: quantcheck audit dataset and tools, fully recomputable

Choose a tag to compare

@aditi-p31 aditi-p31 released this 25 Oct 17:18
· 3 commits to main since this release

quantcheck is a functional audit of quantized LLM files in public model registries: a 15-task screen run over every eligible tag of the official Ollama library plus 22 community files, 164-task confirmations of the flagged ones, recipe-matched rebuilds that trace five failures to uncalibrated quantization, controlled calibration experiments, a 66-tag miss audit, and a proposed acceptance gate. This release adds the per-task results of the 24 configurations the screen was tuned on, so every number in the analysis recomputes from the repository alone; see “Reproduce the paper’s numbers” in the README. The paper it supports is arXiv:2609.05881.