GeneralGameBench 0.2.0 — 33 scenarios and 17-model exhibition

GeneralGameBench now covers 33 validated scenarios across 26 of the 45 environment cards. This release adds the 16 Procgen games, Crafter, MiniWorld, Pistonball, Breakout, Airstriker, NetHack and MiniHack.

The new snapshot contains 1,089 actual episodes and 14,394 decisions from seven configured OpenAI models, three Anthropic models, seven local vision models and four built-in reference policies. All selected episodes passed exact gameplay replay. The 44 aborted episodes remain in the results with zero scores.

Model evaluations use one seed and eight decisions per game. They demonstrate working integrations, not reliable intelligence rankings. No model met the strict under-100 ms requirement. All results remain local and unattested; official rankings are empty. Nineteen environment cards, including modern commercial AAA titles, still require implementation or validation.

Crafter task version 2 stabilizes creature-selection order across processes. Its entire cohort was regenerated, and both source revisions and the selection rule are recorded in the campaign provenance.

Validation: 83 tests passed locally, including 26 real-engine checks; GitHub checks passed; all 1,089 episodes replayed; browser controls and the production website build passed. The portable Dataset loaded successfully with Hugging Face Datasets.

Assets:

• generalgamebench-evidence-v0.2.0.tar.gz: 16,572 selected event, result and observation files. Install the pinned optional runtimes before replaying.
• generalgamebench-huggingface-v0.2.0.tar.gz: a static Space and separate Dataset, ready for future publication. No Hugging Face upload has occurred. Game media retains its separately credited rights; model weights, game binaries and credentials are excluded.
• SHA256SUMS: checksums for both archives.

Leaderboard · Blog · Provenance · Coverage