Repository navigation
v1.1.1
FA-Bench v1.1.1 is a maintenance release. No change moves a published number, so the records/202609/ snapshot stands as scored for v1.1.0.
Fixed
- The Olign adapter reaches the hosted endpoint. Cloudflare in front of it rejects Python's default User-Agent, so the adapter names itself, and it sends the Cloudflare Access service token from
.fabench.envwhen one is set. The default endpoint ishttps://api.olewave.com/olign/v0.9. - Two workers kept an import they no longer use, which failed the lint job.
evals/README.mdagain says the top-levelrun_all.shuses the same option parser.
Added
- The paper as
docs/paper.pdf, linked from the top of the README. tools/ci.shruns the three CI jobs locally, exactly as GitHub and GitLab run them. Ruff is pinned to 0.16.9, so a new ruff release cannot fail an unchanged tree.
The full changelog is at v1.1.0...v1.1.1