Repository navigation
AISB v0.0.1
AISB v0.0.1 packages the current curated AISB benchmark source snapshots from AISB_AUTOSOTA as one zip per benchmark folder for direct download from BenchStore.
What this release contains:
- One zip asset per AISB benchmark package
- The packaged source snapshot, library-authored
AGENTS.md, synchronizedaisb_catalog.yaml, and current benchmark image / metadata files present in each benchmark directory - No claim that every benchmark is fully executable on every machine without external datasets, credentials, or upstream evaluation stacks
Usage notes:
- Download the benchmark zip you need from this release or through BenchStore
- Unzip into a local working directory
- Read
README.md,AGENTS.md, andaisb_catalog.yamlbefore attempting reproduction or modification - Follow each benchmark's dataset, environment, and risk notes carefully; some routes still require external datasets, third-party evaluation repositories, or large hardware budgets
Acknowledgements:
- We thank the original authors of every included paper and codebase for their scientific contributions and open-source releases.
- We also thank the AutoSOTA project for the benchmark collection and organization work: https://github.com/tsinghua-fib-lab/AutoSOTA