TokenOptimizer App v1.1.0 (Windows installer)
Adds benchmark reporting/export tooling to the in-app benchmark runner, plus fixes to the underlying benchmark pipeline surfaced by this release's testing.
Install: download TokenOptimizer.msi and run it.
New in the app
- Export for AI Review - zips every benchmark result plus a calibrated review prompt, copies the prompt to your clipboard, and reveals the zip in Explorer so it's ready to hand to an AI for quality scoring.
- Generate Report - writes
BENCHMARK_REPORT.md(per-model scoring matrix + averages across all test prompts) and opens it.
Pipeline fixes (run_benchmarks.py)
- Fixed a bug where Hugging-Face-URL-sourced models downloaded successfully but then always failed to load (
lms loadneeds the resolved catalog key, not the source URL). - Fixed a purge bug that could delete the wrong model's files when two downloads landed at a similar size.
- Per-model generation configs (temperature/context/reasoning budget) sourced from each model's own docs, replacing a one-size-fits-all config that starved reasoning models of the budget they need to produce a real answer.
- The automated quality score no longer gives full credit to responses that never reached a final answer.
Unsigned build - Windows SmartScreen may warn on first run ("More info" -> "Run anyway").