Skip to content

fix(#392): keep the '[seeded] planted answer' marker off the board - #413

Merged
duckyquang merged 0 commit into
mainfrom
fix/seeded-marker-board-leak
Aug 3, 2026
Merged

fix(#392): keep the '[seeded] planted answer' marker off the board#413
duckyquang merged 0 commit into
mainfrom
fix/seeded-marker-board-leak

Conversation

@duckyquang

Copy link
Copy Markdown
Member

Fixes #392.

Summary

A seeded turn with no supplied utterance got a synthetic [seeded] planted answer: 'X' content default. That was harmless until #377 started rendering Turn.content under --show-rationale -- now the holdout reads the harness's own "this is planted" tag, and any referee/judge scanning whole turns (referee._default_shortcut_detector, blind_metric.latch_rate) treats the marker as stated reasoning. Cannot-fail-by-construction, #374 family.

Dropped the marker: the seeded flag and the committed answer already record the plant, so no supplied content means empty content. anchored_seed/prescreen_flag already pass real prose for exactly this reason.

Notes

No committed number is affected -- nothing's been run with --show-rationale yet -- but it's armed for the next #270/#271/#115/#221 run. Pinned two ways: the seeded turn's content stays empty, and render_board(show_rationale=True) doesn't surface the marker. Both went red on the marker before the fix.

The two adjacent renderer issues you flagged in the same pass (multi_round.py indent, the tripwire regex) are split out into #412 rather than bundled here, since they're coupled to each other and separate from the marker leak. @sebasmos mind a look?

@duckyquang
duckyquang requested a review from sebasmos August 1, 2026 14:42

@sebasmos sebasmos left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Verified: the marker is off Turn.content, board render confirmed clean under show_rationale=True, suite at 1159 passed. Sabotage-checked by reintroducing the old [seeded] planted answer string, both new tests go red exactly as expected. Clean fix, approving.

@duckyquang
duckyquang merged this pull request into main Aug 3, 2026
@duckyquang
duckyquang deleted the fix/seeded-marker-board-leak branch August 3, 2026 13:50
sebasmos pushed a commit that referenced this pull request Aug 4, 2026
fix(#392): keep the '[seeded] planted answer' marker off the board
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

--show-rationale renders the harness's own "[seeded] planted answer" marker onto the board (#374 class)

2 participants