Skip to content

v0.3.0 — single-file task config + per-dimension scoring

Choose a tag to compare

View all tags
@szjanikowski szjanikowski released this 05 May 08:23
· 70 commits to main since this release
v0.3.0
37bacd6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Changed

  • Breaking: per-task config consolidated into a single task.toml. The previous split between task.json (nasde-only) and task.toml (Harbor) is gone — Harbor sections ([task], [agent], [environment], [verifier], [metadata]) and nasde-specific fields ([nasde.source]) now live side by side in one file. All bundled examples migrated. (#29)
  • Breaking: model is now required in every variant.toml. There is no project-level model default in nasde.toml anymore — different agent families need different models, so each variant declares its own. Missing model fails fast with a clear error. CLI --model still overrides. (#29)

Added

  • Independent per-dimension scoring scales (ADR-008). Each dimension in assessment_dimensions.json declares its own max_score (any positive integer). normalized_score is computed from the actual sum of per-dimension maxima — pick the granularity that matches what you can distinguish, instead of forcing every benchmark into a fixed total. (#34)

Fixed

  • Evaluator now prints a clear, actionable error when the underlying claude or codex CLI is missing, instead of failing with a confusing subprocess trace. (#30)
  • The "missing CLI" hint now prints [evaluation] correctly instead of hiding it as Rich markup.

Security

Docs

  • README: clarified how NASDE is meant to be used end-to-end.
  • README: Harbor links now point at harborframework.com instead of the GitHub repo, matching Harbor's primary site.

Internal

  • CODEOWNERS added so PRs auto-request review from the right people.

Install: uv tool install git+https://github.com/NoesisVision/nasde-toolkit.git@v0.3.0

Full changelog: v0.2.1...v0.3.0

Assets 2
Loading