Skip to content

AISB v0.0.1

Choose a tag to compare

@zhu-minjun zhu-minjun released this 13 Apr 10:36
· 181 commits to main since this release

AISB v0.0.1 packages the current curated AISB benchmark source snapshots from AISB_AUTOSOTA as one zip per benchmark folder for direct download from BenchStore.

What this release contains:

  • One zip asset per AISB benchmark package
  • The packaged source snapshot, library-authored AGENTS.md, synchronized aisb_catalog.yaml, and current benchmark image / metadata files present in each benchmark directory
  • No claim that every benchmark is fully executable on every machine without external datasets, credentials, or upstream evaluation stacks

Usage notes:

  • Download the benchmark zip you need from this release or through BenchStore
  • Unzip into a local working directory
  • Read README.md, AGENTS.md, and aisb_catalog.yaml before attempting reproduction or modification
  • Follow each benchmark's dataset, environment, and risk notes carefully; some routes still require external datasets, third-party evaluation repositories, or large hardware budgets

Acknowledgements:

  • We thank the original authors of every included paper and codebase for their scientific contributions and open-source releases.
  • We also thank the AutoSOTA project for the benchmark collection and organization work: https://github.com/tsinghua-fib-lab/AutoSOTA