Skip to content

v0.3.0

Choose a tag to compare

@igurss igurss released this 19 Jun 06:11
· 15 commits to main since this release

mlx-Chronos 0.3.0 is a minor release focused on guided CLI workflows, auditable measurements, and stricter public leaderboard integrity.

Features

  • Adds an interactive mlx-chronos wizard with server model discovery and reusable command previews.
  • Adds background PyPI update checks, mlx-chronos upgrade, and optional model preflight validation.
  • Adds required model reference metadata, reconstructible raw decode timing, and a concise post-run result summary.

Reliability and Integrity

  • Requires publishable results to use known engine versions, Apple Silicon metadata, clean warmup, plausible timestamps, and error-free RAM and thermal monitoring.
  • Prevents retries from contaminating timed TTFT and throughput phases and stops cached-TTFT measurement when priming fails.
  • Uses Ollama server metadata as the authority for version, MLX format, and quantization.
  • Rejects duplicate results, secures leaderboard rendering, preserves model URL variants, and ranks comparisons by end-to-end request throughput.
  • Adds bounded transient retries for untimed operations, atomic report writes, and stricter timing and thermal consistency checks.

Maintenance

  • Moves leaderboard generation into a tested Python module and adds Ruff, mypy, coverage, and frontend security gates to CI.
  • Makes pyproject.toml the only manually maintained package-version source, with no stale numeric fallback.