Skip to content

v0.5.47

Choose a tag to compare

@SushantGautam SushantGautam released this 06 Nov 20:47
· 25 commits to main since this release

Highlights

Model modal on run pages. Click a target, auditor, judge or agent base model on a run page to open a model view:

  • Model card: opens the Hugging Face or vendor card.
  • Open in Connections: jumps to the model's connection.
  • Benchmark: the EuroEval leaderboard shown right in the modal, with this model highlighted; also opens in a new tab.

It fills the screen on phones. Runs created before model cards existed show the model's current card; runs that recorded one keep their own.

Benchmark leaderboard links.

  • Admin Settings → Overview → Benchmark leaderboard link: a URL template where {model} is replaced with the model's name. Default: the EuroEval Norwegian generative leaderboard with the model highlighted. Leave it empty to hide the links.
  • Leaderboard name per model: the model edit form in Connections has an optional field for when the leaderboard names the model differently (e.g. gpt-4.1-2025-04-14). Otherwise the model card identifier is used.
  • Connections: each model's chip links to its model card and its leaderboard.

SimpleAudit engine 0.6.0. Studio now requires simpleaudit>=0.6.0,<0.7.0. The engine brings judge calibration, parallel repetitions, richer tracing evidence for the judge, broader credential redaction and sturdier verdict parsing. See the engine release notes.

Upgrade note: no migrations. Restart the worker together with the web process so it loads the new engine.