Repository navigation
Vision Bench v0.3.3
Vision Bench 0.3.3 improves the local model-comparison workflow and documents the
project's recurring evaluation use case: comparing new image models and
fine-tuned checkpoints while retaining complete predictions for offline analysis.
- Add the PixAI 1.0 Mexes FP16 profile and optional PyTorch CAFormer resolution experiments.
- Support bounded ONNX CPU sessions and optional tall-image admission limits for library integrations.
- Preserve bounded diagnostic headers in the VLM HTTP transport.
- Rework the README around project motivation, the generated CPU example and a worked autotagging case study. Keep detailed usage in focused guides.
- Point the project page to current GitHub releases instead of a fixed historical wheel.
The worked autotagging case compares five configured pipelines on the same 1,024
images. Read the published autotagging report
on the project Space.
Model weights, the exact image selection
and raw predictions are not included in this release.
CPU package CI passed on Linux (Python 3.11/3.13) and Windows (Python 3.13).
Locally, the built wheel was installed in a fresh environment outside the
checkout on Windows/Python 3.13; 114 tests, dependency checks, the generated CPU
example and exact offline recomputation passed. Ruff lint and format checks
passed. The five historical experiment runs also recomputed exactly from their
verified saved artifacts. This does not establish new GPU/provider performance
or an exact public rerun of the private image selection.
Release assets: wheel, source archive and SHA256SUMS. Project code and
documentation are MIT; third-party models and data retain their own terms.