Skip to content

TokenOptimizer App v1.1.0 (Windows installer)

Choose a tag to compare

@ericcayers-ai ericcayers-ai released this 14 Aug 13:49
· 91 commits to main since this release

Adds benchmark reporting/export tooling to the in-app benchmark runner, plus fixes to the underlying benchmark pipeline surfaced by this release's testing.

Install: download TokenOptimizer.msi and run it.

New in the app

  • Export for AI Review - zips every benchmark result plus a calibrated review prompt, copies the prompt to your clipboard, and reveals the zip in Explorer so it's ready to hand to an AI for quality scoring.
  • Generate Report - writes BENCHMARK_REPORT.md (per-model scoring matrix + averages across all test prompts) and opens it.

Pipeline fixes (run_benchmarks.py)

  • Fixed a bug where Hugging-Face-URL-sourced models downloaded successfully but then always failed to load (lms load needs the resolved catalog key, not the source URL).
  • Fixed a purge bug that could delete the wrong model's files when two downloads landed at a similar size.
  • Per-model generation configs (temperature/context/reasoning budget) sourced from each model's own docs, replacing a one-size-fits-all config that starved reasoning models of the budget they need to produce a real answer.
  • The automated quality score no longer gives full credit to responses that never reached a final answer.

Unsigned build - Windows SmartScreen may warn on first run ("More info" -> "Run anyway").