Skip to content

v0.4.1

Choose a tag to compare

View all tags
@bioinfornatics bioinfornatics released this 23 Aug 14:54
· 24 commits to main since this release
v0.4.1
e1027ed

Agent Plugins v0.4.1

This patch release makes creator evaluations autonomous, executable, and reproducible.

Highlights

  • Replaces ambiguous prompts such as “this Skill” or “this plugin” with explicit structured targets and real fixture paths.
  • Adds immutable evaluation fixture libraries for Skill, agent, hook, and plugin creators.
  • Adds durable eval sets for agent-creator and hook-creator, and rewrites the plugin-creator and skill-creator sets.
  • Introduces explicit scenario metadata: subject, language, target, execution level, preconditions, capabilities, budget, assertions, and coverage tags.
  • Distinguishes explain, dry-run, execute, and resume scenarios so graders cannot require hidden execution.
  • Prohibits hidden grading criteria and requires newly discovered criteria to be added in a later paired iteration.
  • Adds source/baseline provenance and realistic turn/timeout budget guidance.
  • Makes the agent evaluation runner stage declared fixtures in isolated temporary projects and preserve scenario context in metadata.
  • Adds cross-creator distribution tests and verifies evaluation assets in offline and standalone packages.

Fixtures

The release includes known valid and invalid examples for:

  • Agent Skill frontmatter errors and current/baseline Skill comparisons;
  • supported and unsupported Goose custom-agent definitions;
  • safe and unsafe blocking hooks with inert allow/block payloads;
  • schema-minimal, package-ready, partial, and multi-component Open Plugins;
  • partial and complete evaluation workspaces.

Validation

  • agent-creator: 12/12 tests
  • hook-creator: 9/9 tests
  • plugin-creator: 25/25 tests
  • skill-creator: 35/35 tests
  • distribution: 11/11 tests
  • all four evaluation designs: pass, zero warnings
  • all four component behavior gates: 100%, non-regression vs v0.4.0
  • deterministic integration: 100% current vs 0% v0.4.0 baseline
  • offline bundle and archive integrity: pass, 913 canonical files

Asset

agent-plugins-v0.4.1.zip is the self-contained plugin archive.

SHA-256: e61217a91ba81a90b3d23d278168db30efa05ea289ce0ee5951c72bac39d0617

Assets 3
Loading