Repository navigation
The public ALFA-updated source and frozen runtime assets.
The benchmark retains the 300 public requests and submitted model commands, with documented transport, reset, environment, reference and correctness repairs. Report scores as ALFA-updated separately from original ALFA. No generative LLM judge was added.
Clone the repository and follow the README. alfa-prepare downloads the seven archives from this release and verifies the hashes in benchmark.lock.json. The source includes the complete change log, correctness reasoning, negative controls and known limitations. Errors remain in the 300-task denominator; live HTTP/DNS resources can still be unavailable.
Archives include the exact five Docker fixtures, CPU embedding runtime and embedding model. SHA256SUMS verifies the files. This is the single initial public version, v0.1.0.