Skip to content

QualityBench 0.1.1

Choose a tag to compare

@launch80 launch80 released this 06 Nov 15:30
· 25 commits to main since this release

A patch release on top of 0.1.0.

  • Preflight: a model that thinks by default, run without --thinking, now stops at once and asks you to pass --thinking off (the usual baseline) or --thinking on. Before, it failed with "the model returned no content": its reasoning used up the preflight's tokens, and the harnesses' token limits would have cut its replies off mid-thought anyway.
  • README: links to the 2-minute intro video and the launch post.
uv tool install git+https://github.com/launch80/QualityBench@v0.1.1

L80 1.3.0 pins this version, so L80 qualitybench runs it with no install step.

Community

Questions, results, or a model you want tested? Join the Launch80 Discord: https://discord.gg/launch80

If this work is useful to you, please support the server: https://launch80.com/supporter