Skip to content

v1.1.1

Choose a tag to compare

@weiwchu weiwchu released this 29 Sep 09:10
· 21 commits to main since this release

FA-Bench v1.1.1 is a maintenance release. No change moves a published number, so the records/202609/ snapshot stands as scored for v1.1.0.

Fixed

  • The Olign adapter reaches the hosted endpoint. Cloudflare in front of it rejects Python's default User-Agent, so the adapter names itself, and it sends the Cloudflare Access service token from .fabench.env when one is set. The default endpoint is https://api.olewave.com/olign/v0.9.
  • Two workers kept an import they no longer use, which failed the lint job.
  • evals/README.md again says the top-level run_all.sh uses the same option parser.

Added

  • The paper as docs/paper.pdf, linked from the top of the README.
  • tools/ci.sh runs the three CI jobs locally, exactly as GitHub and GitLab run them. Ruff is pinned to 0.16.9, so a new ruff release cannot fail an unchanged tree.

The full changelog is at v1.1.0...v1.1.1