Skip to content

v0.10.1-beta — Every Test, Listed

Choose a tag to compare

@github-actions github-actions released this 27 Oct 21:49
· 88 commits to main since this release
e6938af

What's new in 0.10.1 — Every Test, Listed

  • Results now has a list of every test you've run, along the side. Click one to open it again, whether it was a show (its ranking and answers), a Lab test (its checks) or a speed test (its numbers). "Overview" at the top takes you back to the Top Match screen. In a narrow window the list sits behind a "Tests" button. Opening a test never runs it.
  • On Results, the Runs tab is now "Running now" and shows only what's running. Finished tests are in the new list. Before you've run anything, Results says "No tests yet" with one button to test a model you have, or to get one.
  • On Simple Mode's Pick screen, models you already have now come first among models that fit equally well.
  • Speech and decision models no longer show up as chat picks. Models like phonon (speech), and d3 and kev (decision models, which score text instead of chatting), used to get a Fit grade and could land as your top match, in a show, or in Just Chat. They now carry a "Decision model" or "Audio model" tag, have no Fit grade, and stay out of lineups. In rigmatch-fit, decision models appear only under --all and --installed, and speech models don't appear.
  • RigMatch's list of what each Ollama model can do is refreshed for 263 families, including Bonsai 2 and Nemotron 3.5. Sizes and tags (vision, tools, thinking and so on) are current, so models land under the right filters.
  • A drawing with a big, repetitive style block could freeze RigMatch for anywhere from a few seconds to over a minute while it was checked. The check now gets half a second at most and takes a few milliseconds on a real drawing. A drawing that goes over is scored like one that can't be shown, and the note says it was too complicated to check.
  • The Blind show switch now reacts when you point at it, like the other controls, and so does the "Tell me when a new one lands" switch in What's New.
  • RigMatch now checks whether another program is using your graphics card before a test, and in rigmatch-fit --measure, on any graphics card in Windows and on AMD cards in Linux. It used to read only NVIDIA cards, so on other cards a busy card looked the same as a quiet one. When it can't read the card, it says it couldn't check.
  • RigScore now watches the graphics card while it runs. If another program starts using the card partway through, the run is marked "Not a clean score" with the reason, and it isn't compared with other runs. rigmatch-fit --measure says the same. A run nothing disturbed scores exactly as before, and the watch adds about 3 seconds to the Light test.
  • RigScore on one PC can vary by 15 to 20 percent from one run to the next, not the 10 to 15 the 0.10.0 notes said. Allow for that when you compare two computers.
  • Set RIGMATCH_CHAT_DATA_DIR to a full folder path before starting RigMatch Chat and it keeps its chats, memories and settings there instead of in your profile, so a test can't touch your real chats. If the value isn't a full path Chat can use, it refuses to start and says why, rather than falling back to your own chats.
  • On a model's card, the 0 to 100 speed rating is now called "Speed". "Speed score" is the name of the My PC page, and the two looked like the same number.
  • The "How we score" panel now says what the score does. Speed is an average scaled from 5 to 100 tokens a second. Reliability counts an answer cut off at the token limit as unfinished. The Fit part reads only the model's size from its name, not your graphics memory. The scores themselves haven't changed.

Downloads

  • Windows: RigMatch-*-win-x64.exe (installer), or RigMatch-*-win-x64.zip — unpack it anywhere and run RigMatch.exe, which installs nothing and skips the SmartScreen prompt below
  • macOS Apple Silicon: RigMatch-*-mac-arm64.dmg
  • macOS Intel: RigMatch-*-mac-x64.dmg
  • Linux x64: RigMatch-*-linux-x86_64.AppImage or RigMatch-*-linux-amd64.deb
  • Linux ARM64 / Jetson: RigMatch-*-linux-arm64.AppImage or RigMatch-*-linux-arm64.deb

Already running an older install? It updates itself to this version automatically — nothing to re-download.

Windows first launch

RigMatch for Windows is an unsigned beta, so Microsoft Defender SmartScreen will almost certainly stop it the first time. That warning means the file has no code-signing certificate yet and has not been downloaded enough times to build a reputation — not that anything is wrong with it.

  1. Download RigMatch-*-win-x64.exe.
  2. If SmartScreen says "Windows protected your PC", choose More info, then Run anyway.
  3. If your browser blocks the download instead, choose Keep and, where asked, Keep anyway.

Prefer not to click through a warning at all? Take the .zip from Downloads above instead.

Either way, verify what you downloaded against SHA256SUMS.txt on this release:

Get-FileHash RigMatch-*-win-x64.exe -Algorithm SHA256

A signing certificate is on the roadmap; until it is bought and the reputation builds, this warning is expected on every release.

What you can check in the meantime: every file here is published with GitHub build provenance, a signed record of which workflow built it, from which commit. With the gh CLI:

gh attestation verify RigMatch-*-win-x64.exe --repo DaveEuson/RigMatch

That proves the file came from this repository's release workflow and has not been altered since. It is not code signing, and Windows will still show its warning.

macOS first launch

RigMatch for macOS is currently an unsigned beta distributed outside the App Store. On first launch, macOS may say the developer cannot be verified or that the app was downloaded from the internet.

  1. Download RigMatch-*-mac-arm64.dmg for Apple Silicon/M-series Macs, or RigMatch-*-mac-x64.dmg for Intel Macs.
  2. Open the .dmg and drag RigMatch to Applications.
  3. First launch only: right-click or Control-click RigMatch.app, choose Open, then choose Open again.
  4. If macOS still blocks it, open System Settings > Privacy & Security, scroll to Security, and choose Open Anyway for RigMatch.

After that first approval, RigMatch opens normally by double-clicking. If macOS says the app is damaged after copying it to Applications, run this Terminal command once:

xattr -cr /Applications/RigMatch.app

Apple reference: https://support.apple.com/guide/mac-help/open-a-mac-app-from-an-unknown-developer-mh40616/mac

What's Changed

  • Keep speech and decision models out of chat lists by @DaveEuson in #186
  • List every test on Results and show installed models first on Pick by @DaveEuson in #188
  • Refresh the Ollama capability snapshot by @DaveEuson in #185
  • Add a hover response to the Blind show switch by @DaveEuson in #190
  • Make the drawing cleaner linear and give it a time budget by @DaveEuson in #193
  • Add RIGMATCH_CHAT_DATA_DIR to run Chat on a throwaway folder by @DaveEuson in #192
  • Read the graphics card on any Windows GPU and AMD on Linux by @DaveEuson in #194
  • Mark a speed run as disturbed when a program joins the card mid-run by @DaveEuson in #195
  • Refresh the README and landing page for 0.10.0 by @DaveEuson in #187
  • Prepare 0.10.1: bump, notes and wording fixes by @DaveEuson in #191

Full Changelog: v0.10.0-beta...v0.10.1-beta