Repository navigation
v0.5.47
Highlights
Model modal on run pages. Click a target, auditor, judge or agent base model on a run page to open a model view:
- Model card: opens the Hugging Face or vendor card.
- Open in Connections: jumps to the model's connection.
- Benchmark: the EuroEval leaderboard shown right in the modal, with this model highlighted; also opens in a new tab.
It fills the screen on phones. Runs created before model cards existed show the model's current card; runs that recorded one keep their own.
Benchmark leaderboard links.
- Admin Settings → Overview → Benchmark leaderboard link: a URL template where
{model}is replaced with the model's name. Default: the EuroEval Norwegian generative leaderboard with the model highlighted. Leave it empty to hide the links. - Leaderboard name per model: the model edit form in Connections has an optional field for when the leaderboard names the model differently (e.g.
gpt-4.1-2025-04-14). Otherwise the model card identifier is used. - Connections: each model's chip links to its model card and its leaderboard.
SimpleAudit engine 0.6.0. Studio now requires simpleaudit>=0.6.0,<0.7.0. The engine brings judge calibration, parallel repetitions, richer tracing evidence for the judge, broader credential redaction and sturdier verdict parsing. See the engine release notes.
Upgrade note: no migrations. Restart the worker together with the web process so it loads the new engine.