Behavior Diff Action v0.1.2 (beta)

v0.1.2 beta

Changes

• Add optional core-ref to select a reviewed full lowercase 40-character Behavior Diff core commit SHA. Omit it to retain the release's default core v0.4.6 pin.
• Freeze the selected core revision during preparation. Run and publish inherit it, reject conflicting overrides, and reject evidence from another revision. Core code is fetched only from spacedock-dev/behavior-diff.
• Record the selected core SHA in published results. A core override selects executable code with access to model credentials; review that commit before using it.
• Introduce the moving v0.1 tag. Each published v0.1.x release, including beta prereleases, must advance this alias to the same reviewed commit. Exact patch tags remain fixed. The release guide now includes the required update, race-safe push and verification steps.
• Update the README and complete workflow example.

Upgrade

Use the same Action version in prepare, run and publish. Selection schema 2 includes the frozen core revision; old selections are rejected. Prepare a new selection rather than mixing Action versions across jobs.

# Follow beta patch releases:
uses: spacedock-dev/behavior-diff-action@v0.1

# Or select this exact release:
uses: spacedock-dev/behavior-diff-action@v0.1.2

For an immutable pin, use spacedock-dev/behavior-diff-action@32f1bc3bf8c8a2588a0cca5aca44d9cee4de7b93.

Complete workflow · Core override configuration

Beta limitations

Live model authentication, real GitHub artifact upload/download and PR comment updates remain unverified. HTML reports are uploaded without ZIP wrapping; inline browser rendering from artifact links has not been verified. Read SECURITY.md and review code, credentials, disclosure and provider spending limits before enabling the Action.

Full changelog: v0.1.1...v0.1.2

Behavior Diff Action v0.1.1 (beta)

v0.1.1 beta

Changes

• Upload HTML reports separately with upload-artifact v7.0.2 and archive: false. Each report has a unique run/attempt/target filename, so parallel comparisons do not collide.
• Link PR summaries and the report-url output to the single HTML artifact. Keep the evidence ZIP for validated summary generation and as a backup when the separate HTML artifact is unavailable.
• Upgrade Behavior Diff core to v0.4.6, pinned to 5b325ed40062bb819c574e4172da04f53b53b953.
• Update the README, configuration reference and example workflow for v0.1.1.

Usage

Use spacedock-dev/behavior-diff-action@v0.1.1 in all three phases, or pin the reviewed release commit:

uses: spacedock-dev/behavior-diff-action@d0ca905940bf694ad2fe6738fe10464e9a7e9628

Complete workflow · Marketplace

Verification and limitations

Release commit CI passed. Local verification passed 72 deterministic tests, Python compilation, Actionlint and Action metadata validation. A smoke through the actual v0.4.6 core completed both trials and extraction with synthetic model responses; the generated Summary was projected successfully and the separate HTML file matched the bundled report byte-for-byte.

This remains a beta for controlled evaluation. Live model authentication, real artifact upload/download and PR comment updates remain unverified. Direct HTML upload removes ZIP extraction; inline browser rendering from the GitHub artifact link has not been verified. Links require GitHub sign-in and repository access and expire with artifact retention or deletion.

Agent execution is not an untrusted-code sandbox. Review SECURITY.md, approve code and disclosure, and set provider spending limits before enabling credentials.

Full changelog: v0.1.0...v0.1.1

Behavior Diff Action v0.1 (rolling beta)

v0.1 rolling beta

Currently points to v0.1.2 at commit 32f1bc3bf8c8a2588a0cca5aca44d9cee4de7b93.

Use this rolling release to receive future published v0.1.x patches, including beta releases:

uses: spacedock-dev/behavior-diff-action@v0.1

Use the same ref in the prepare, run and publish jobs. The v0.1 tag moves when a new patch is released, and these notes are updated in place. Existing workflow files do not need a version change to receive those updates. This is a mutable release, not an immutable pin.

To stay on the current patch, use @v0.1.2. For an immutable pin, use @32f1bc3bf8c8a2588a0cca5aca44d9cee4de7b93.

Current patch

v0.1.2 adds a reviewed immutable core-ref override and freezes the selected core revision across prepare, run and publish. It retains separate HTML report artifacts and defaults to Behavior Diff core v0.4.6. See the v0.1.2 release notes for changes and upgrade requirements.

Complete workflow · Configuration

Beta limitations

This release is for controlled evaluation. Live model authentication, real GitHub artifact upload/download and PR comment updates remain unverified. Inline browser rendering from HTML artifact links has not been verified. Agent execution is not an untrusted-code sandbox. Review SECURITY.md, approve code and disclosure, and set provider spending limits before enabling credentials.

Behavior Diff Action v0.1.0 (beta)

v0.1.0 beta

Initial beta of Behavior Diff Action for controlled evaluation. Compare agent behavior before and after a PR changes SKILL.md, AGENTS.md, or CLAUDE.md, with an HTML evidence report and optional updatable PR summary. Results are evidence for human review, not an automatic merge verdict.

Included

• Separate prepare, run and publish jobs with SHA-bound approvals and least-privilege GitHub permissions.
• Independent single-file comparisons, purpose/scenario preparation, bounded trial execution and partial-evidence reporting.
• Opt-in report artifacts and deterministic bot-owned PR comment updates.
• A workflow example for trusted same-repository PRs, exact-SHA comment approvals and manual runs.
• Marketplace-facing README, configuration/layout guides and security documentation.

Dependencies

• Behavior Diff core v0.4.5: 415aa72db6d3c764cdca32a642d21d1d034f2cc8.
• Claude Code: 2.1.296.
• Target environment: GitHub.com hosted Ubuntu 24.04, with caller-provided CLAUDE_CODE_OAUTH_TOKEN.

Use spacedock-dev/behavior-diff-action@v0.1.0 in each phase, or preferably pin the reviewed release commit:

spacedock-dev/behavior-diff-action@f92caa329102047eddeae38e118428dfc656b5a2

Start with the complete example: https://github.com/spacedock-dev/behavior-diff-action/blob/v0.1.0/examples/behavior-diff.yml

Verification and beta limitations

The deterministic suite has 71 passing tests. The actual v0.4.5 core runner, validator and renderer were exercised locally with synthetic model responses, including missing-extraction reporting and PR Summary projection. Action metadata and workflow syntax validation passed.

Live model authentication, real GitHub artifact access and real PR comment updates remain unverified. This beta is for controlled evaluation while those checks are outstanding. No production-readiness or Marketplace-publication claim is made.

Agent execution is not an untrusted-code sandbox. Approve the code and context, restrict credentials and provider spending, and choose publication policy explicitly. Public-repository reports and summaries may disclose source code, prompts and answers. Read SECURITY.md before enabling credentials.

The GitHub prerelease designation has been removed. The beta limitations above still apply. No stable v1 alias or Marketplace listing is created by this release.