Skip to content

v2.1.1 — lspci fallback + badge rebrand

Choose a tag to compare

@Basaltlabs-app Basaltlabs-app released this 21 Apr 06:36
· 1 commit to main since this release

Features

  • Hardware detection — _detect_gpu_info() now parses lspci output as a fallback for NVIDIA GPU names when nvidia-smi isn't on PATH (server installs, stripped-down containers, certain distros). Previously these runs submitted to the community leaderboard with gpu_name="unknown", polluting the data. 5 new parse tests cover bracketed vs codename-only output, multi-GPU selection, AMD-only lines, and empty input.

API / Embeds

  • /api/badge rebrand — dropped the A–F / shields.io colour ramp in favour of Gauntlet's actual certification system:

    Tier Score Tests Colour
    Gold ≥ 90 ≥ 20 #c4a05a
    Silver ≥ 75 ≥ 10 #b0a69c
    Bronze ≥ 60 ≥ 5 #c87850
    Tested any ≥ 1 #b08d6e
    no data — 0 #7a6e62

    A 71-score model that previously rendered as hostile red F (71.1) now renders as warm copper 71 · Bronze. Something a model author actually wants in their HuggingFace / GitHub README.

  • Badge viewBox + role=\"img\" — resizing via <img width=\"...\"> now preserves aspect ratio, and screen readers get a proper label.

Install

```bash
pip install --upgrade gauntlet-cli
```

Full changelog: v2.1.0...v2.1.1