Skip to content

Behavior Diff Action v0.1.0 (beta)

Pre-release
Pre-release

Choose a tag to compare

@kentwelcome kentwelcome released this 12 Oct 17:29
· 5 commits to main since this release

v0.1.0 beta

Initial beta of Behavior Diff Action for controlled evaluation. Compare agent behavior before and after a PR changes SKILL.md, AGENTS.md, or CLAUDE.md, with an HTML evidence report and optional updatable PR summary. Results are evidence for human review, not an automatic merge verdict.

Included

  • Separate prepare, run and publish jobs with SHA-bound approvals and least-privilege GitHub permissions.
  • Independent single-file comparisons, purpose/scenario preparation, bounded trial execution and partial-evidence reporting.
  • Opt-in report artifacts and deterministic bot-owned PR comment updates.
  • A workflow example for trusted same-repository PRs, exact-SHA comment approvals and manual runs.
  • Marketplace-facing README, configuration/layout guides and security documentation.

Dependencies

  • Behavior Diff core v0.4.5: 415aa72db6d3c764cdca32a642d21d1d034f2cc8.
  • Claude Code: 2.1.296.
  • Target environment: GitHub.com hosted Ubuntu 24.04, with caller-provided CLAUDE_CODE_OAUTH_TOKEN.

Use spacedock-dev/behavior-diff-action@v0.1.0 in each phase, or preferably pin the reviewed release commit:

spacedock-dev/behavior-diff-action@f92caa329102047eddeae38e118428dfc656b5a2

Start with the complete example: https://github.com/spacedock-dev/behavior-diff-action/blob/v0.1.0/examples/behavior-diff.yml

Verification and beta limitations

The deterministic suite has 71 passing tests. The actual v0.4.5 core runner, validator and renderer were exercised locally with synthetic model responses, including missing-extraction reporting and PR Summary projection. Action metadata and workflow syntax validation passed.

Live model authentication, real GitHub artifact access and real PR comment updates remain unverified. This beta is for controlled evaluation while those checks are outstanding. No production-readiness or Marketplace-publication claim is made.

Agent execution is not an untrusted-code sandbox. Approve the code and context, restrict credentials and provider spending, and choose publication policy explicitly. Public-repository reports and summaries may disclose source code, prompts and answers. Read SECURITY.md before enabling credentials.

The GitHub prerelease designation has been removed. The beta limitations above still apply. No stable v1 alias or Marketplace listing is created by this release.