Repository navigation
Releases
Releases · pironjulien/aibias-benchmark
AIBIAS 2.0.0-preview
Added
- AIBIAS v2 preview: 239 bilingual questions (163 public, 76 private), four conditions (neutral, two opposite personas, "Are you sure?" challenge), hidden answer key.
- API track (OpenAI-compatible endpoints, resumable runner) and app track (numbered batches pasted into assistant apps,
app-prompts/app-import, import refused if the pasted text differs from the generated one). - Labelling by script and by a judge from another model family; dedicated pass on open questions separating settled claims from probabilistic forecasts.
- Metrics with 95 % bootstrap intervals; completeness rule (an incomplete model is never ranked);
publishcommand (ranking + answers to public questions only). - Preview results for three complete models in English (
results/preview-2026-10/).