Skip to content

RunBack v0.1.3-alpha

Pre-release
Pre-release

Choose a tag to compare

@huanglinfei091-cmd huanglinfei091-cmd released this 11 Sep 03:57
· 1 commit to main since this release

RunBack v0.1.3-alpha

RunBack turns a completed public GitHub Actions failure URL into historical evidence, a local
replay plan and a truthful reproduction verdict.

runback https://github.com/OWNER/REPO/actions/runs/RUN_ID

This release adds strict Vitest failure evidence, based on a preregistered public failure.

What changed

  • Parse complete Vitest FAIL blocks for JavaScript and TypeScript test files.
  • Require the same file, line, column, full hierarchical test name, exception, complete
    message and exit code before reporting SAME_FAILURE.
  • Support consecutive parameterized Vitest failure headers that share one error body.
  • Count incomplete, unsupported and duplicate identities as unparsed failures so partial
    evidence cannot become a match.
  • Add mutation tests for changed identity, message, location, exception, count and exit code.

No Matcher threshold, Direct URL acquisition behavior, M1/M2 evidence, Docker daemon setting,
docker0 setting or host network setting changed.

Real validation

Fresh Case H, janosh/svelte-widgets run 34449963179, attempt 1, job unit, was registered
and committed before RunBack acquired it. The first exact URL invocation reproduced four
visible Vitest failures but returned the truthful result:

Result: INSUFFICIENT_EVIDENCE
Evidence level: STEP
Remote failures: 0
Local failures:  0
Matched:         0

One post-parser retry stopped during dependency installation on an npm optional native binding
error and remains REPLAY_BLOCKED / EXECUTE / UNKNOWN. A later invocation of the unchanged URL
and job returned:

Result: SAME_FAILURE
Evidence level: TEST
Remote failures: 4
Local failures:  4
Matched:         4

All retained intermediate outcomes remain in docs/alpha/evidence/case-h/. Case H is a
project-owned compatibility run and is not counted as an external user.

Install or upgrade

Linux amd64 users can install without Go or sudo:

curl -fsSL https://raw.githubusercontent.com/huanglinfei091-cmd/runback/main/scripts/install-release.sh | bash
~/.local/bin/runback doctor

Current boundaries

The alpha targets completed failures in public GitHub.com repositories on ubuntu-latest.
Private repositories, GitHub Enterprise, Windows/macOS/self-hosted runners, services, job
containers, repository-local actions, reusable job workflows, dynamic matrices, secret-heavy
paths and artifact-heavy workflows remain outside the current scope. Node debug environments
are not yet supported by the narrow M2 debug flow.

External-user validation remains USER_VALIDATION_PENDING; project-owned real-case runs are
not counted as external users.