Skip to content

Releases: md-mt/termproof

rs-v0.4.2

Choose a tag to compare

@md-mt md-mt released this 24 Aug 08:01

termproof 0.4.2

Other

  • a hand-pushed rs-v tag publishes its own crates (#203) (be7606d7)
  • before_after: Python moves to Rust's field names, markdown and ordering (#204) (#205) (d9d17458)

Full changelog: rs-v0.4.1...rs-v0.4.2

Binaries for x86_64 Linux, x86_64 macOS and arm64 macOS are attached below with their SHA-256 checksums, and are built with provenance attestation.

rs-v0.4.1

Choose a tag to compare

@md-mt md-mt released this 21 Aug 05:16

TermProof 0.4.1 — Rust.

A patch release that carries breaking changes, on purpose. The project's rule is that a
breaking change under 0.x bumps the minor digit; this release deliberately does not, and
cargo semver-checks is waived for exactly the two breaks below rather than the version being
moved. Read these before upgrading from 0.4.0.

Breaking:

  • evidence::collector::EvidencePublisher gained a fifth public field, so struct-literal
    construction no longer compiles. Use the builder.
  • Recipe now holds its descriptive fields in a RecipeMeta and flattens it. The serialised
    form and the schema are unchanged — this is a source-level break only.

Added:

  • EvidenceCollector::record_session — the whole-session recording sequence 0.4.0 shipped the
    pieces for and never wired together: save the cast, append the captured checkpoint screens,
    convert, upload, and record the outcome including which step failed, with no step allowed to
    fail the run.
  • EvidencePublisher::with_video_converter, the seam that sequence needs.
  • append_checkpoint_frames, so a recording ends by replaying the evidence rather than stopping
    on whatever the last keystroke painted.
  • RecipeMeta, constructible without adopting the declarative runner.
  • A clap layer behind an opt-in feature that fills in a RunConfig and applies the
    pick(flag, configured, builtin) precedence once instead of per flag. One documented
    exception: Requirements.uploaded_media is a bool with no unset state, so its three layers
    are ORed.
  • score_from, so the fraction-of-assertions-held rule — including what an empty assertion set
    scores — is decided once by the library rather than by each caller.

See CHANGELOG.md for the full list.

py-v0.4.1

Choose a tag to compare

@github-actions github-actions released this 21 Aug 05:13

TermProof Release Evidence

Evidence archive: termproof-release-evidence.tgz
Report links point to files inside that archive.

TUI Verification - 7/7 Passed

Build Provenance

  • Mode: installed
  • Command: python3 examples/generic/generic_tui.py
  • Binary: /home/runner/work/termproof/termproof/python/.venv/bin/python3
  • Version: Python 3.12.14
  • Git commit: 49dbaf6fd237e7d87216966a0394e02f3e3a835b
  • Verified: yes
Recipe Renderer Priority Execution Result Score Evidence
generic-tui-workflow default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
colour-stress default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
multi-turn-conversation default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-readonly-review default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-guarded-edit default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-session-resume-export default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-model-context default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
PASS generic-tui-workflow [default]

Assertions

  • PASS dashboard was on screen mid-run - screen after 'wait for dashboard' contains 'DASHBOARD READY'
  • PASS output_contains - contains 'DASHBOARD READY'
  • PASS output_contains - contains 'FILTER READY'
  • PASS output_contains - contains 'EXPORT READY'
  • PASS output_contains - contains 'GENERIC TUI COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'demo>'
  • PASS open dashboard - sent line
  • PASS wait for dashboard - found 'DASHBOARD READY'
  • PASS filter errors - sent line
  • PASS wait for filter - found 'FILTER READY'
  • PASS export report - sent line
  • PASS wait for export - found 'EXPORT READY'
  • PASS close session - sent line
  • PASS wait for close - found 'GENERIC TUI COMPLETE'
PASS colour-stress [default]

Assertions

  • PASS output_contains - contains 'PALETTE READY'
  • PASS output_contains - contains 'ATTRS READY'
  • PASS output_contains - contains 'ANIMATE READY'
  • PASS output_contains - contains 'COLOUR STRESS COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'colour>'
  • PASS show palette - sent line
  • PASS wait for palette - found 'PALETTE READY'
  • PASS show attributes - sent line
  • PASS wait for attributes - found 'ATTRS READY'
  • PASS animate - sent line
  • PASS wait for animation - found 'ANIMATE READY'
  • PASS close session - sent line
  • PASS wait for close - found 'COLOUR STRESS COMPLETE'
PASS multi-turn-conversation [default]

Assertions

  • PASS output_contains - contains 'Repository inspection complete.'
  • PASS output_contains - contains 'Rendering MP4 with agg plus ffmpeg.'
  • PASS output_contains - contains 'Multi-turn verification passed.'
  • PASS output_contains - contains 'SESSION COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'you>'
  • PASS inspect repository - sent line
  • PASS wait for inspection - found 'Repository inspection complete.'
  • PASS pause after inspection - slept
  • PASS run pipeline - sent line
  • PASS wait for pipeline - found 'Pipeline completed.'
  • PASS pause after render - slept
  • PASS summarize evidence - sent line
  • PASS wait for summary - found 'Multi-turn verification passed.'
  • PASS pause before exit - slept
  • PASS close session - sent line
  • PASS wait for completion - found 'SESSION COMPLETE'
PASS pi-workflow-readonly-review [default]

Assertions

  • PASS output_contains - contains '--tools read,grep,find,ls'
  • PASS output_contains - contains 'no write/edit tools were enabled'
  • PASS output_contains - contains 'READONLY REVIEW COMPLETE'
  • PASS output_contains - contains 'WORKFLOW SESSION COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS scope repository - sent line
  • PASS wait for scope - found 'READONLY SCOPE READY'
  • PASS inspect files - sent line
  • PASS wait for inspection - found 'READONLY INSPECTION COMPLETE'
  • PASS run validation - sent line
  • PASS wait for validation - found 'READONLY VALIDATION COMPLETE'
  • PASS report findings - sent line
  • PASS wait for review - found 'READONLY REVIEW COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-guarded-edit [default]

Assertions

  • PASS output_contains - contains 'tool allowlist: read,bash,edit,write'
  • PASS output_contains - contains 'patch applied'
  • PASS output_contains - contains '12 tests passed'
  • PASS output_contains - contains 'diff reviewed'
  • PASS output_contains - contains 'GUARDED EDIT COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS propose change - sent line
  • PASS wait for plan - found 'GUARDED EDIT PLAN READY'
  • PASS apply patch - sent line
  • PASS wait for patch - found 'GUARDED PATCH APPLIED'
  • PASS validate tests - sent line
  • PASS wait for validation - found 'GUARDED VALIDATION COMPLETE'
  • PASS summarize diff - sent line
  • PASS wait for summary - found 'GUARDED EDIT COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-session-resume-export [default]

Assertions

  • PASS output_contains - contains '--name "Verifier workflow audit"'
  • PASS output_contains - contains '--continue'
  • PASS output_contains - contains '--session workflow-001'
  • PASS output_contains - contains '--fork workflow-001'
  • PASS output_contains - contains '--export session.jsonl output.html'
  • PASS output_contains - contains 'SESSION RESUME EXPORT COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS start session - sent line
  • PASS wait for start - found 'SESSION STARTED'
  • PASS continue session - sent line
  • PASS wait for resume - found 'SESSION RESUMED'
  • PASS fork export - sent line
  • PASS wait for export - found 'SESSION RESUME EXPORT COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
...
Read more

rs-v0.4.0

Choose a tag to compare

@md-mt md-mt released this 20 Aug 00:44
f033dcc

TermProof 0.4.0 — Rust.

A breaking release. Third-party types no longer reach the public API, so a consumer's own dependency versions can no longer collide with ours.

Breaking: pyregex::compile returns PyRegex, pyschema::compile/validate use PySchema, and terminal::attributed::from_vt100 is crate-internal. The root re-exports of fancy_regex, jsonschema and vt100 are removed. If you named any of those types through this crate, use the wrappers.

Also: the canonical recipe schema now ships inside the crate and load_canonical_schema works from a registry checkout; the fancy-regex requirement is narrowed to the 0.16 line so a vendoring consumer no longer carries a duplicate engine; per-step screenshots carry attributed rendering; additive seams for imperative consumers.

Full detail in CHANGELOG.md under [0.4.0].

py-v0.4.0

Choose a tag to compare

@github-actions github-actions released this 20 Aug 00:34
f033dcc

TermProof Release Evidence

Evidence archive: termproof-release-evidence.tgz
Report links point to files inside that archive.

TUI Verification - 7/7 Passed

Build Provenance

  • Mode: installed
  • Command: python3 examples/generic/generic_tui.py
  • Binary: /home/runner/work/termproof/termproof/python/.venv/bin/python3
  • Version: Python 3.12.13
  • Git commit: f033dcc51e697a11fefee5c67bd63124c747b2b7
  • Verified: yes
Recipe Renderer Priority Execution Result Score Evidence
generic-tui-workflow default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
colour-stress default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
multi-turn-conversation default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-readonly-review default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-guarded-edit default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-session-resume-export default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-model-context default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
PASS generic-tui-workflow [default]

Assertions

  • PASS dashboard was on screen mid-run - screen after 'wait for dashboard' contains 'DASHBOARD READY'
  • PASS output_contains - contains 'DASHBOARD READY'
  • PASS output_contains - contains 'FILTER READY'
  • PASS output_contains - contains 'EXPORT READY'
  • PASS output_contains - contains 'GENERIC TUI COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'demo>'
  • PASS open dashboard - sent line
  • PASS wait for dashboard - found 'DASHBOARD READY'
  • PASS filter errors - sent line
  • PASS wait for filter - found 'FILTER READY'
  • PASS export report - sent line
  • PASS wait for export - found 'EXPORT READY'
  • PASS close session - sent line
  • PASS wait for close - found 'GENERIC TUI COMPLETE'
PASS colour-stress [default]

Assertions

  • PASS output_contains - contains 'PALETTE READY'
  • PASS output_contains - contains 'ATTRS READY'
  • PASS output_contains - contains 'ANIMATE READY'
  • PASS output_contains - contains 'COLOUR STRESS COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'colour>'
  • PASS show palette - sent line
  • PASS wait for palette - found 'PALETTE READY'
  • PASS show attributes - sent line
  • PASS wait for attributes - found 'ATTRS READY'
  • PASS animate - sent line
  • PASS wait for animation - found 'ANIMATE READY'
  • PASS close session - sent line
  • PASS wait for close - found 'COLOUR STRESS COMPLETE'
PASS multi-turn-conversation [default]

Assertions

  • PASS output_contains - contains 'Repository inspection complete.'
  • PASS output_contains - contains 'Rendering MP4 with agg plus ffmpeg.'
  • PASS output_contains - contains 'Multi-turn verification passed.'
  • PASS output_contains - contains 'SESSION COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'you>'
  • PASS inspect repository - sent line
  • PASS wait for inspection - found 'Repository inspection complete.'
  • PASS pause after inspection - slept
  • PASS run pipeline - sent line
  • PASS wait for pipeline - found 'Pipeline completed.'
  • PASS pause after render - slept
  • PASS summarize evidence - sent line
  • PASS wait for summary - found 'Multi-turn verification passed.'
  • PASS pause before exit - slept
  • PASS close session - sent line
  • PASS wait for completion - found 'SESSION COMPLETE'
PASS pi-workflow-readonly-review [default]

Assertions

  • PASS output_contains - contains '--tools read,grep,find,ls'
  • PASS output_contains - contains 'no write/edit tools were enabled'
  • PASS output_contains - contains 'READONLY REVIEW COMPLETE'
  • PASS output_contains - contains 'WORKFLOW SESSION COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS scope repository - sent line
  • PASS wait for scope - found 'READONLY SCOPE READY'
  • PASS inspect files - sent line
  • PASS wait for inspection - found 'READONLY INSPECTION COMPLETE'
  • PASS run validation - sent line
  • PASS wait for validation - found 'READONLY VALIDATION COMPLETE'
  • PASS report findings - sent line
  • PASS wait for review - found 'READONLY REVIEW COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-guarded-edit [default]

Assertions

  • PASS output_contains - contains 'tool allowlist: read,bash,edit,write'
  • PASS output_contains - contains 'patch applied'
  • PASS output_contains - contains '12 tests passed'
  • PASS output_contains - contains 'diff reviewed'
  • PASS output_contains - contains 'GUARDED EDIT COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS propose change - sent line
  • PASS wait for plan - found 'GUARDED EDIT PLAN READY'
  • PASS apply patch - sent line
  • PASS wait for patch - found 'GUARDED PATCH APPLIED'
  • PASS validate tests - sent line
  • PASS wait for validation - found 'GUARDED VALIDATION COMPLETE'
  • PASS summarize diff - sent line
  • PASS wait for summary - found 'GUARDED EDIT COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-session-resume-export [default]

Assertions

  • PASS output_contains - contains '--name "Verifier workflow audit"'
  • PASS output_contains - contains '--continue'
  • PASS output_contains - contains '--session workflow-001'
  • PASS output_contains - contains '--fork workflow-001'
  • PASS output_contains - contains '--export session.jsonl output.html'
  • PASS output_contains - contains 'SESSION RESUME EXPORT COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS start session - sent line
  • PASS wait for start - found 'SESSION STARTED'
  • PASS continue session - sent line
  • PASS wait for resume - found 'SESSION RESUMED'
  • PASS fork export - sent line
  • PASS wait for export - found 'SESSION RESUME EXPORT COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
...
Read more

rs-v0.3.4

Choose a tag to compare

@md-mt md-mt released this 17 Aug 06:55
ecff687

Rust crate 0.3.4. See CHANGELOG.md for the 0.3.4 entry covering both implementations.

py-v0.3.4

Choose a tag to compare

@github-actions github-actions released this 17 Aug 06:31
ecff687

TermProof Release Evidence

Evidence archive: termproof-release-evidence.tgz
Report links point to files inside that archive.

TUI Verification - 7/7 Passed

Build Provenance

  • Mode: installed
  • Command: python3 examples/generic/generic_tui.py
  • Binary: /home/runner/work/termproof/termproof/python/.venv/bin/python3
  • Version: Python 3.12.13
  • Git commit: ecff687f593024395276056571ed0d1c9de7f33e
  • Verified: yes
Recipe Renderer Priority Execution Result Score Evidence
generic-tui-workflow default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
colour-stress default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
multi-turn-conversation default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-readonly-review default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-guarded-edit default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-session-resume-export default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-model-context default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
PASS generic-tui-workflow [default]

Assertions

  • PASS dashboard was on screen mid-run - screen after 'wait for dashboard' contains 'DASHBOARD READY'
  • PASS output_contains - contains 'DASHBOARD READY'
  • PASS output_contains - contains 'FILTER READY'
  • PASS output_contains - contains 'EXPORT READY'
  • PASS output_contains - contains 'GENERIC TUI COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'demo>'
  • PASS open dashboard - sent line
  • PASS wait for dashboard - found 'DASHBOARD READY'
  • PASS filter errors - sent line
  • PASS wait for filter - found 'FILTER READY'
  • PASS export report - sent line
  • PASS wait for export - found 'EXPORT READY'
  • PASS close session - sent line
  • PASS wait for close - found 'GENERIC TUI COMPLETE'
PASS colour-stress [default]

Assertions

  • PASS output_contains - contains 'PALETTE READY'
  • PASS output_contains - contains 'ATTRS READY'
  • PASS output_contains - contains 'ANIMATE READY'
  • PASS output_contains - contains 'COLOUR STRESS COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'colour>'
  • PASS show palette - sent line
  • PASS wait for palette - found 'PALETTE READY'
  • PASS show attributes - sent line
  • PASS wait for attributes - found 'ATTRS READY'
  • PASS animate - sent line
  • PASS wait for animation - found 'ANIMATE READY'
  • PASS close session - sent line
  • PASS wait for close - found 'COLOUR STRESS COMPLETE'
PASS multi-turn-conversation [default]

Assertions

  • PASS output_contains - contains 'Repository inspection complete.'
  • PASS output_contains - contains 'Rendering MP4 with agg plus ffmpeg.'
  • PASS output_contains - contains 'Multi-turn verification passed.'
  • PASS output_contains - contains 'SESSION COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'you>'
  • PASS inspect repository - sent line
  • PASS wait for inspection - found 'Repository inspection complete.'
  • PASS pause after inspection - slept
  • PASS run pipeline - sent line
  • PASS wait for pipeline - found 'Pipeline completed.'
  • PASS pause after render - slept
  • PASS summarize evidence - sent line
  • PASS wait for summary - found 'Multi-turn verification passed.'
  • PASS pause before exit - slept
  • PASS close session - sent line
  • PASS wait for completion - found 'SESSION COMPLETE'
PASS pi-workflow-readonly-review [default]

Assertions

  • PASS output_contains - contains '--tools read,grep,find,ls'
  • PASS output_contains - contains 'no write/edit tools were enabled'
  • PASS output_contains - contains 'READONLY REVIEW COMPLETE'
  • PASS output_contains - contains 'WORKFLOW SESSION COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS scope repository - sent line
  • PASS wait for scope - found 'READONLY SCOPE READY'
  • PASS inspect files - sent line
  • PASS wait for inspection - found 'READONLY INSPECTION COMPLETE'
  • PASS run validation - sent line
  • PASS wait for validation - found 'READONLY VALIDATION COMPLETE'
  • PASS report findings - sent line
  • PASS wait for review - found 'READONLY REVIEW COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-guarded-edit [default]

Assertions

  • PASS output_contains - contains 'tool allowlist: read,bash,edit,write'
  • PASS output_contains - contains 'patch applied'
  • PASS output_contains - contains '12 tests passed'
  • PASS output_contains - contains 'diff reviewed'
  • PASS output_contains - contains 'GUARDED EDIT COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS propose change - sent line
  • PASS wait for plan - found 'GUARDED EDIT PLAN READY'
  • PASS apply patch - sent line
  • PASS wait for patch - found 'GUARDED PATCH APPLIED'
  • PASS validate tests - sent line
  • PASS wait for validation - found 'GUARDED VALIDATION COMPLETE'
  • PASS summarize diff - sent line
  • PASS wait for summary - found 'GUARDED EDIT COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-session-resume-export [default]

Assertions

  • PASS output_contains - contains '--name "Verifier workflow audit"'
  • PASS output_contains - contains '--continue'
  • PASS output_contains - contains '--session workflow-001'
  • PASS output_contains - contains '--fork workflow-001'
  • PASS output_contains - contains '--export session.jsonl output.html'
  • PASS output_contains - contains 'SESSION RESUME EXPORT COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS start session - sent line
  • PASS wait for start - found 'SESSION STARTED'
  • PASS continue session - sent line
  • PASS wait for resume - found 'SESSION RESUMED'
  • PASS fork export - sent line
  • PASS wait for export - found 'SESSION RESUME EXPORT COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
...
Read more

v0.3.3

Choose a tag to compare

@github-actions github-actions released this 16 Aug 20:24
128881f

TermProof Release Evidence

Evidence archive: termproof-release-evidence.tgz
Report links point to files inside that archive.

TUI Verification - 7/7 Passed

Build Provenance

  • Mode: installed
  • Command: python3 examples/generic/generic_tui.py
  • Binary: /home/runner/work/termproof/termproof/.venv/bin/python3
  • Version: Python 3.12.13
  • Git commit: 128881f69cadf9f682b135d18ba6ec9d3939f4cc
  • Verified: yes
Recipe Renderer Priority Execution Result Score Evidence
generic-tui-workflow default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
colour-stress default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
multi-turn-conversation default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-readonly-review default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-guarded-edit default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-session-resume-export default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-model-context default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
PASS generic-tui-workflow [default]

Assertions

  • PASS dashboard was on screen mid-run - screen after 'wait for dashboard' contains 'DASHBOARD READY'
  • PASS output_contains - contains 'DASHBOARD READY'
  • PASS output_contains - contains 'FILTER READY'
  • PASS output_contains - contains 'EXPORT READY'
  • PASS output_contains - contains 'GENERIC TUI COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'demo>'
  • PASS open dashboard - sent line
  • PASS wait for dashboard - found 'DASHBOARD READY'
  • PASS filter errors - sent line
  • PASS wait for filter - found 'FILTER READY'
  • PASS export report - sent line
  • PASS wait for export - found 'EXPORT READY'
  • PASS close session - sent line
  • PASS wait for close - found 'GENERIC TUI COMPLETE'
PASS colour-stress [default]

Assertions

  • PASS output_contains - contains 'PALETTE READY'
  • PASS output_contains - contains 'ATTRS READY'
  • PASS output_contains - contains 'ANIMATE READY'
  • PASS output_contains - contains 'COLOUR STRESS COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'colour>'
  • PASS show palette - sent line
  • PASS wait for palette - found 'PALETTE READY'
  • PASS show attributes - sent line
  • PASS wait for attributes - found 'ATTRS READY'
  • PASS animate - sent line
  • PASS wait for animation - found 'ANIMATE READY'
  • PASS close session - sent line
  • PASS wait for close - found 'COLOUR STRESS COMPLETE'
PASS multi-turn-conversation [default]

Assertions

  • PASS output_contains - contains 'Repository inspection complete.'
  • PASS output_contains - contains 'Rendering MP4 with agg plus ffmpeg.'
  • PASS output_contains - contains 'Multi-turn verification passed.'
  • PASS output_contains - contains 'SESSION COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'you>'
  • PASS inspect repository - sent line
  • PASS wait for inspection - found 'Repository inspection complete.'
  • PASS pause after inspection - slept
  • PASS run pipeline - sent line
  • PASS wait for pipeline - found 'Pipeline completed.'
  • PASS pause after render - slept
  • PASS summarize evidence - sent line
  • PASS wait for summary - found 'Multi-turn verification passed.'
  • PASS pause before exit - slept
  • PASS close session - sent line
  • PASS wait for completion - found 'SESSION COMPLETE'
PASS pi-workflow-readonly-review [default]

Assertions

  • PASS output_contains - contains '--tools read,grep,find,ls'
  • PASS output_contains - contains 'no write/edit tools were enabled'
  • PASS output_contains - contains 'READONLY REVIEW COMPLETE'
  • PASS output_contains - contains 'WORKFLOW SESSION COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS scope repository - sent line
  • PASS wait for scope - found 'READONLY SCOPE READY'
  • PASS inspect files - sent line
  • PASS wait for inspection - found 'READONLY INSPECTION COMPLETE'
  • PASS run validation - sent line
  • PASS wait for validation - found 'READONLY VALIDATION COMPLETE'
  • PASS report findings - sent line
  • PASS wait for review - found 'READONLY REVIEW COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-guarded-edit [default]

Assertions

  • PASS output_contains - contains 'tool allowlist: read,bash,edit,write'
  • PASS output_contains - contains 'patch applied'
  • PASS output_contains - contains '12 tests passed'
  • PASS output_contains - contains 'diff reviewed'
  • PASS output_contains - contains 'GUARDED EDIT COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS propose change - sent line
  • PASS wait for plan - found 'GUARDED EDIT PLAN READY'
  • PASS apply patch - sent line
  • PASS wait for patch - found 'GUARDED PATCH APPLIED'
  • PASS validate tests - sent line
  • PASS wait for validation - found 'GUARDED VALIDATION COMPLETE'
  • PASS summarize diff - sent line
  • PASS wait for summary - found 'GUARDED EDIT COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-session-resume-export [default]

Assertions

  • PASS output_contains - contains '--name "Verifier workflow audit"'
  • PASS output_contains - contains '--continue'
  • PASS output_contains - contains '--session workflow-001'
  • PASS output_contains - contains '--fork workflow-001'
  • PASS output_contains - contains '--export session.jsonl output.html'
  • PASS output_contains - contains 'SESSION RESUME EXPORT COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS start session - sent line
  • PASS wait for start - found 'SESSION STARTED'
  • PASS continue session - sent line
  • PASS wait for resume - found 'SESSION RESUMED'
  • PASS fork export - sent line
  • PASS wait for export - found 'SESSION RESUME EXPORT COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'

<detai...

Read more

v0.3.0

Choose a tag to compare

@github-actions github-actions released this 16 Aug 06:30
1b621c9

TermProof Release Evidence

Evidence archive: termproof-release-evidence.tgz
Report links point to files inside that archive.

TUI Verification - 7/7 Passed

Build Provenance

  • Mode: installed
  • Command: python3 examples/generic/generic_tui.py
  • Binary: /home/runner/work/termproof/termproof/.venv/bin/python3
  • Version: Python 3.12.13
  • Git commit: 1b621c908d00bbd4015a4b09f3d1c76aeb0673c3
  • Verified: yes
Recipe Renderer Priority Execution Result Score Evidence
generic-tui-workflow default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
colour-stress default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
multi-turn-conversation default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-readonly-review default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-guarded-edit default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-session-resume-export default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-model-context default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
PASS generic-tui-workflow [default]

Assertions

  • PASS output_contains - contains 'DASHBOARD READY'
  • PASS output_contains - contains 'FILTER READY'
  • PASS output_contains - contains 'EXPORT READY'
  • PASS output_contains - contains 'GENERIC TUI COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'demo>'
  • PASS open dashboard - sent line
  • PASS wait for dashboard - found 'DASHBOARD READY'
  • PASS filter errors - sent line
  • PASS wait for filter - found 'FILTER READY'
  • PASS export report - sent line
  • PASS wait for export - found 'EXPORT READY'
  • PASS close session - sent line
  • PASS wait for close - found 'GENERIC TUI COMPLETE'
PASS colour-stress [default]

Assertions

  • PASS output_contains - contains 'PALETTE READY'
  • PASS output_contains - contains 'ATTRS READY'
  • PASS output_contains - contains 'ANIMATE READY'
  • PASS output_contains - contains 'COLOUR STRESS COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'colour>'
  • PASS show palette - sent line
  • PASS wait for palette - found 'PALETTE READY'
  • PASS show attributes - sent line
  • PASS wait for attributes - found 'ATTRS READY'
  • PASS animate - sent line
  • PASS wait for animation - found 'ANIMATE READY'
  • PASS close session - sent line
  • PASS wait for close - found 'COLOUR STRESS COMPLETE'
PASS multi-turn-conversation [default]

Assertions

  • PASS output_contains - contains 'Repository inspection complete.'
  • PASS output_contains - contains 'Rendering MP4 with agg plus ffmpeg.'
  • PASS output_contains - contains 'Multi-turn verification passed.'
  • PASS output_contains - contains 'SESSION COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'you>'
  • PASS inspect repository - sent line
  • PASS wait for inspection - found 'Repository inspection complete.'
  • PASS pause after inspection - slept
  • PASS run pipeline - sent line
  • PASS wait for pipeline - found 'Pipeline completed.'
  • PASS pause after render - slept
  • PASS summarize evidence - sent line
  • PASS wait for summary - found 'Multi-turn verification passed.'
  • PASS pause before exit - slept
  • PASS close session - sent line
  • PASS wait for completion - found 'SESSION COMPLETE'
PASS pi-workflow-readonly-review [default]

Assertions

  • PASS output_contains - contains '--tools read,grep,find,ls'
  • PASS output_contains - contains 'no write/edit tools were enabled'
  • PASS output_contains - contains 'READONLY REVIEW COMPLETE'
  • PASS output_contains - contains 'WORKFLOW SESSION COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS scope repository - sent line
  • PASS wait for scope - found 'READONLY SCOPE READY'
  • PASS inspect files - sent line
  • PASS wait for inspection - found 'READONLY INSPECTION COMPLETE'
  • PASS run validation - sent line
  • PASS wait for validation - found 'READONLY VALIDATION COMPLETE'
  • PASS report findings - sent line
  • PASS wait for review - found 'READONLY REVIEW COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-guarded-edit [default]

Assertions

  • PASS output_contains - contains 'tool allowlist: read,bash,edit,write'
  • PASS output_contains - contains 'patch applied'
  • PASS output_contains - contains '12 tests passed'
  • PASS output_contains - contains 'diff reviewed'
  • PASS output_contains - contains 'GUARDED EDIT COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS propose change - sent line
  • PASS wait for plan - found 'GUARDED EDIT PLAN READY'
  • PASS apply patch - sent line
  • PASS wait for patch - found 'GUARDED PATCH APPLIED'
  • PASS validate tests - sent line
  • PASS wait for validation - found 'GUARDED VALIDATION COMPLETE'
  • PASS summarize diff - sent line
  • PASS wait for summary - found 'GUARDED EDIT COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-session-resume-export [default]

Assertions

  • PASS output_contains - contains '--name "Verifier workflow audit"'
  • PASS output_contains - contains '--continue'
  • PASS output_contains - contains '--session workflow-001'
  • PASS output_contains - contains '--fork workflow-001'
  • PASS output_contains - contains '--export session.jsonl output.html'
  • PASS output_contains - contains 'SESSION RESUME EXPORT COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS start session - sent line
  • PASS wait for start - found 'SESSION STARTED'
  • PASS continue session - sent line
  • PASS wait for resume - found 'SESSION RESUMED'
  • PASS fork export - sent line
  • PASS wait for export - found 'SESSION RESUME EXPORT COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-model-context [default]

Assertions

  • PASS output_contains...
Read more

v0.2.0

Choose a tag to compare

@github-actions github-actions released this 27 Jul 05:48
3838a40

TermProof Release Evidence

Evidence archive: termproof-release-evidence.tgz
Report links point to files inside that archive.

TUI Verification - 6/6 Passed

Build Provenance

  • Mode: installed
  • Command: python3 examples/generic/generic_tui.py
  • Binary: /home/runner/work/termproof/termproof/.venv/bin/python3
  • Version: Python 3.12.13
  • Git commit: 3838a40c0166f67f45a1dd557d7a3e33e04ddc5d
  • Verified: yes
Recipe Renderer Priority Execution Result Score Evidence
generic-tui-workflow default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
multi-turn-conversation default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-readonly-review default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-guarded-edit default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-session-resume-export default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
pi-workflow-model-context default P1 scripted PASS 1.00 screenshot / video / cast / screen_text / step_screenshots
PASS generic-tui-workflow [default]

Assertions

  • PASS output_contains - contains 'DASHBOARD READY'
  • PASS output_contains - contains 'FILTER READY'
  • PASS output_contains - contains 'EXPORT READY'
  • PASS output_contains - contains 'GENERIC TUI COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'demo>'
  • PASS open dashboard - sent line
  • PASS wait for dashboard - found 'DASHBOARD READY'
  • PASS filter errors - sent line
  • PASS wait for filter - found 'FILTER READY'
  • PASS export report - sent line
  • PASS wait for export - found 'EXPORT READY'
  • PASS close session - sent line
  • PASS wait for close - found 'GENERIC TUI COMPLETE'
PASS multi-turn-conversation [default]

Assertions

  • PASS output_contains - contains 'Repository inspection complete.'
  • PASS output_contains - contains 'Rendering MP4 with agg plus ffmpeg.'
  • PASS output_contains - contains 'Multi-turn verification passed.'
  • PASS output_contains - contains 'SESSION COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'you>'
  • PASS inspect repository - sent line
  • PASS wait for inspection - found 'Repository inspection complete.'
  • PASS pause after inspection - slept
  • PASS run pipeline - sent line
  • PASS wait for pipeline - found 'Pipeline completed.'
  • PASS pause after render - slept
  • PASS summarize evidence - sent line
  • PASS wait for summary - found 'Multi-turn verification passed.'
  • PASS pause before exit - slept
  • PASS close session - sent line
  • PASS wait for completion - found 'SESSION COMPLETE'
PASS pi-workflow-readonly-review [default]

Assertions

  • PASS output_contains - contains '--tools read,grep,find,ls'
  • PASS output_contains - contains 'no write/edit tools were enabled'
  • PASS output_contains - contains 'READONLY REVIEW COMPLETE'
  • PASS output_contains - contains 'WORKFLOW SESSION COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS scope repository - sent line
  • PASS wait for scope - found 'READONLY SCOPE READY'
  • PASS inspect files - sent line
  • PASS wait for inspection - found 'READONLY INSPECTION COMPLETE'
  • PASS run validation - sent line
  • PASS wait for validation - found 'READONLY VALIDATION COMPLETE'
  • PASS report findings - sent line
  • PASS wait for review - found 'READONLY REVIEW COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-guarded-edit [default]

Assertions

  • PASS output_contains - contains 'tool allowlist: read,bash,edit,write'
  • PASS output_contains - contains 'patch applied'
  • PASS output_contains - contains '12 tests passed'
  • PASS output_contains - contains 'diff reviewed'
  • PASS output_contains - contains 'GUARDED EDIT COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS propose change - sent line
  • PASS wait for plan - found 'GUARDED EDIT PLAN READY'
  • PASS apply patch - sent line
  • PASS wait for patch - found 'GUARDED PATCH APPLIED'
  • PASS validate tests - sent line
  • PASS wait for validation - found 'GUARDED VALIDATION COMPLETE'
  • PASS summarize diff - sent line
  • PASS wait for summary - found 'GUARDED EDIT COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-session-resume-export [default]

Assertions

  • PASS output_contains - contains '--name "Verifier workflow audit"'
  • PASS output_contains - contains '--continue'
  • PASS output_contains - contains '--session workflow-001'
  • PASS output_contains - contains '--fork workflow-001'
  • PASS output_contains - contains '--export session.jsonl output.html'
  • PASS output_contains - contains 'SESSION RESUME EXPORT COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS start session - sent line
  • PASS wait for start - found 'SESSION STARTED'
  • PASS continue session - sent line
  • PASS wait for resume - found 'SESSION RESUMED'
  • PASS fork export - sent line
  • PASS wait for export - found 'SESSION RESUME EXPORT COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'
PASS pi-workflow-model-context [default]

Assertions

  • PASS output_contains - contains '--provider openai --model gpt-4o-mini'
  • PASS output_contains - contains '--model sonnet:high --thinking high'
  • PASS output_contains - contains '--append-system-prompt project-rules.md'
  • PASS output_contains - contains '--skill ./skills/reviewer'
  • PASS output_contains - contains '--prompt-template ./prompts/fix-bug.md'
  • PASS output_contains - contains '--offline --no-context-files --no-extensions --no-skills'
  • PASS output_contains - contains 'MODEL CONTEXT WORKFLOW COMPLETE'
  • PASS exit_code - expected 0, got 0

Steps

  • PASS wait for prompt - found 'pi>'
  • PASS choose model - sent line
  • PASS wait for model - found 'MODEL ROUTING READY'
  • PASS load context - sent line
  • PASS wait for context - found 'CONTEXT RESOURCES LOADED'
  • PASS configure startup - sent line
  • PASS wait for startup - found 'MODEL CONTEXT WORKFLOW COMPLETE'
  • PASS close session - sent line
  • PASS wait for close - found 'WORKFLOW SESSION COMPLETE'