Financial Judgment 2.0.0

Financial Judgment 2.0.0

Complete seven-task Harbor evaluation package with 79 rubric criteria. Delivery requires both the task files in this repository and the three Docker image assets attached to this release.

Download and run

1. Download or clone the repository at this release's tag.
2. Place the three financial-judgment-*.tar.gz release assets in the repository's images/ directory. Do not extract them as task folders.
3. From the repository root, verify and load the supplied images:

shasum -a 256 -c images/SHA256SUMS
docker load --input images/financial-judgment-2021-12.tar.gz
docker load --input images/financial-judgment-2022-06.tar.gz
docker load --input images/financial-judgment-2022-09.tar.gz
uv tool install harbor==0.23.0

Continue only if all three checksums pass. Then follow the README Quickstart or USAGE.md to configure your authorized judge and agent providers and run harbor run --path ./tasks. Provider calls may incur charges and disclose evaluation content to the configured service. There is no bundled API credential or hosted judge.

The Docker images supply runtime and evidence for amd64 and arm64. Minimal task packages supply instructions, rubrics, reference solutions and the separate verifier. Images alone are not a Harbor dataset. Runtime source remains extractable from the images; this release protects task-authoring assets, not evaluator secrecy.

Historical outcomes are preserved, not newly measured model results. Read the README's inherited judge-failure limitation: some critical/pitfall judge failures can still produce a reward under the original evaluator. The release does not silently change those scoring semantics.

See LICENSE.md for permissions and source-specific notices. Names are suppressed, but preserved financial facts can permit re-identification.