EvalView 0.8.1 — the release that was written in July and never actually shipped. PyPI has been serving 0.8.0 since May; this closes that gap and folds in a new flag plus two bugs found while adding it.
Added
- PEP 561
py.typedmarker: the package now ships its inline type annotations, somypy/pyrighttype-check code that importsevalview(e.g.from evalview import gate) instead of treating it as untyped. evalview check --watch: re-runs the check on every file change, so thesnapshot/checkloop you already know gains a watch mode without reaching for a third command. Delegates to the same watcher asevalview watch. SupportsTEST_PATH,--test,--fail-on,--strict, and--no-judge; combining it with one-shot options (--json,--report,--heal, …) is a loud error rather than a silently dropped flag.
Fixed
evalview watchnever re-ran on file change. The watch loop runs underasyncio.run(), but a triggered check called the synchronousgate(), which callsasyncio.run()again — so every save failed withasyncio.run() cannot be called from a running event loop, rendered as a redCheck failed:line. The startup banner and the initial check both succeeded, which is why this looked healthy. Triggered checks now go throughgate_async(). Affected every release since watch mode shipped in 0.5.5.- Skill test suites broke directory loading.
load_from_directoryrecurses, so a skill suite in a subdirectory (evalview skillterritory, identified by itsskill:key) was parsed as a plain test case and failed the whole load. This brokeevalview check demo-tests— a directory shipped with the package — with three Pydantic errors. Skill suites are now skipped. - Test-case load errors now name the file. A malformed file in a directory of many previously reported a bare
3 validation errors for TestCasewith nothing to grep for; the path is now included. Note:TestCaseLoader.load_from_directorynow raisesValueErrorwrapping the underlying pydanticValidationError. SinceValidationErrorsubclassesValueError,except ValueErrorcallers are unaffected; anything catchingValidationErrorspecifically should widen toValueError. - Bumped the GitHub Action pin in README and
docs/CI_CD.mdfromv0.8.0tov0.8.1. - Synced stale version strings:
evalview.__version__(was 0.7.0) and the MCP registryserver.json(was 0.6.1) now match the released version.
Install: pip install --upgrade evalview
Full changelog: https://github.com/hidai25/eval-view/blob/main/CHANGELOG.md