Skip to content

FE-1317: Close host-landing oracle identity over PTY behavior - #413

Open
lunelson wants to merge 3 commits into
ln/fe-1316-system-authority-auditfrom
ln/fe-1317-host-landing-oracle-identity
Open

FE-1317: Close host-landing oracle identity over PTY behavior#413
lunelson wants to merge 3 commits into
ln/fe-1316-system-authority-auditfrom
ln/fe-1317-host-landing-oracle-identity

Conversation

@lunelson

@lunelson lunelson commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Why

Brunch's automated product-comparison system needs an ironclad guarantee: whenever anything about how it drives and observes a terminal session changes, old comparison results must be treated as stale rather than silently reused. That guarantee had a gap — a few files that affect terminal-driving behavior weren't part of the fingerprint used to detect change.

What

  • Every file that can affect how a terminal session is driven or read is now included in the immutable fingerprint ("oracle pack") that comparison evidence is checked against.
  • Added regression coverage proving that changing any one of those files changes the fingerprint, and that re-running with byte-identical inputs does not — so there are no false staleness alarms either.
  • No behavior change to the terminal driver itself; this only closes a blind spot in how we detect when it has changed.
  • Also fixed two unrelated sources of test flakiness across different developer machines (stray local provider credentials and git signing configuration leaking into test runs).

How to test

  1. npm run verify:full passes.
  2. Confirm it passes consistently regardless of local git/provider environment configuration.

lunelson and others added 3 commits August 5, 2026 14:13
Include every behavior-bearing PTY input in the immutable oracle pack and pin per-input hash sensitivity so retained comparisons cannot reuse a stale identity.

Co-authored-by: Cursor <cursoragent@cursor.com>
Keep deterministic Tier-2 boots isolated from ambient provider credentials and make provenance fixtures independent of global Git signing configuration.

Co-authored-by: Cursor <cursoragent@cursor.com>

lunelson commented Aug 7, 2026

Copy link
Copy Markdown
Contributor Author

@lunelson lunelson changed the title re-enable subagents in proj FE-1317: Close host-landing oracle identity over PTY behavior Aug 7, 2026
@lunelson
lunelson marked this pull request as ready for review August 7, 2026 16:16
Copilot AI review requested due to automatic review settings August 7, 2026 16:16
@cursor

cursor Bot commented Aug 7, 2026

Copy link
Copy Markdown

PR Summary

Low Risk
Changes are confined to comparison fingerprinting and test harness stability; no product PTY or auth logic changes.

Overview
Closes FE-1317 by expanding brunch-host-landing-oracles-v1 so oraclePackSha256 content-addresses every behavior-bearing PTY input: tui-driver/keys.ts and tui-driver/driver.exp join the existing driver/session/screen set in execution-comparison-operator.ts.

New dispatch tests assert stable hashes for identical packs and distinct hashes when any single PTY file changes, without altering PTY runtime behavior.

Test reliability: tier-2 “no available model” coverage now forces an empty model list (and stubs ambient ANTHROPIC_API_KEY in the harness test); comparison fixture git tags use --no-sign to avoid signing config flakes. Planning docs record the frontier as complete.

Reviewed by Cursor Bugbot for commit f109ea4. Bugbot is set up for automated code reviews on this repo. Configure here.

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Want reviews to match your repository better? Bugbot Learning can learn team-specific rules from PR activity. A team admin can enable Learning in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit f109ea4. Configure here.

Comment thread .pi/settings.json
"extensions": [
"-extensions/subagents/index.ts"
"/Users/lunelson/.pi/agent/extensions/subagents/index.ts",
"+/Users/lunelson/.pi/agent/extensions/subagents/index.ts"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Accidental personal path commit

High Severity

extensions in .pi/settings.json was replaced with absolute paths under a personal home directory, including a redundant force-include. That drops the prior project-relative force-exclude of the vendored subagents extension and is unrelated to the oracle-identity or flakiness work in this PR.

Fix in Cursor Fix in Web

Reviewed by Cursor Bugbot for commit f109ea4. Configure here.

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR closes a provenance gap in Brunch’s execution-comparison system by ensuring the host-landing oracle’s immutable “oracle pack” fingerprint includes all PTY behavior-bearing inputs, and adds regression coverage to prove the fingerprint changes on any relevant input change while remaining stable for identical inputs. It also includes small changes intended to reduce test flakiness from ambient developer environment configuration.

Changes:

  • Extend the compiled brunch-host-landing-oracles-v1 implementation file set to include tui-driver/keys.ts and tui-driver/driver.exp so PTY-driving behavior is fully captured in the oracle pack hash.
  • Add a regression test that mutates each PTY input one-at-a-time and asserts the oracle pack hash changes, while identical inputs produce an identical hash.
  • Hardening for local-environment flakiness: force “no model available” in Tier-2 harness services, avoid signed tags in git fixtures, and isolate provider creds from a determinism test.

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
src/dev/tier-2-harness.ts Forces the “no model available” harness path to stay deterministic by overriding model availability to empty.
src/dev/execution-comparison/tests/operator-oracle-dispatch.test.ts Adds regression coverage asserting oracle pack hash sensitivity per PTY input and stability for identical inputs.
src/dev/execution-comparison-operator.ts Adds keys.ts and driver.exp to host-landing compiled oracle implementationFiles for fingerprint completeness.
src/dev/comparison-provenance.test.ts Prevents local git signing config from affecting tag creation in fixtures via git tag --no-sign.
src/dev/tests/tier-2-harness.test.ts Stubs provider env vars to ensure deterministic boots don’t become live turns due to ambient credentials.
memory/PLAN.md Marks FE-1317 as completed and removes the now-closed frontier definition entry.
docs/archive/PLAN_HISTORY.md Archives the FE-1317 closeout summary and traceability notes.
.pi/settings.json Updates Pi settings (currently introduces machine-local absolute paths).

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread .pi/settings.json
Comment on lines 5 to 8
"extensions": [
"-extensions/subagents/index.ts"
"/Users/lunelson/.pi/agent/extensions/subagents/index.ts",
"+/Users/lunelson/.pi/agent/extensions/subagents/index.ts"
]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants