Skip to content

v2.0.3: UX Polish & Layer Sensitivity Expansion

Choose a tag to compare

View all tags
@Basaltlabs-app Basaltlabs-app released this 17 Apr 17:22
· 8 commits to main since this release
v2.0.3
001634f

What's new

Layer Sensitivity expanded (16 to 25 probes)

New probes across all 5 cognitive categories:

  • Syntax: pronoun resolution, word order sensitivity
  • Logic: base-rate fallacy detection, double negation resolution
  • Spatial: mental rotation, direction tracking after turning
  • Pragmatic: understatement recognition, indirect refusal detection
  • Factual: additional date/number recall

Degradation API now includes perplexity

/api/degradation response includes perplexity_mean and perplexity_n per quantization level when V2 data is available. Enables the dashboard to overlay perplexity on degradation curves.

Dashboard UX improvements

  • Empty tabs fixed: Speed, Quality, and Graph tabs now explain they need gauntlet compare instead of showing blank screens
  • Category explanations: Sycophancy Gradient, Perplexity Baseline, and Layer Sensitivity cards show contextual subtitles explaining what the score means
  • Strength Profile: community leaderboard heatmap replaced with expandable glass cards using the warm site palette

22 new tests (529 total, 0 failures)

Upgrade

pip install --upgrade gauntlet-cli
Assets 2
Loading