ScaffoldScope 1.0.0

Harness and evaluator errors are infrastructure-invalid and excluded from solve
denominators. Model and protocol outcomes remain in intention-to-treat results.
Built-in policies and the scripted provider reject configuration fields they do
not use.
doctor reports preflight_passed and explicitly marks provider connectivity as
not-checked; it does not send a model request.
Python support is bounded to 3.10 through 3.14. CI covers every supported
Python/operating-system combination and runs a real Docker trial on Linux.
Configuration schema 1, evidence schema 2, and plugin API 1 are supported for
the 1.x release line.

Model failures can no longer be recorded as solved, and final integrity checks
run before reports are written.
Malformed SWE-bench inputs, invalid manifests, missing checkouts, and unknown
trial filters now fail with actionable errors.
Evidence bundles are replaced atomically; failed writes do not leave partial
archives.
Trial workspaces and temporary homes are removed after execution. Missing-path
CLI failures no longer leave locks or marker files.
CLI output remains readable under restricted Windows encodings.
Docker preflight accepts standard image metadata when the optional architecture
variant field is absent.

Consumers of doctor JSON must replace ready with preflight_passed.
Plugins compatible with core 1.x should declare an exclusive upper bound of
2.0.0. Plugin API version remains 1.
No configuration or evidence-schema migration is required.

Verify downloads with SHA256SUMS. Report vulnerabilities through private vulnerability reporting.

Navigation Menu