test(cliffs): raising n - WEST replicates, "west specifically" does NOT (#84) - #153
Merged
Conversation
…OT (#84) The check six mechanism hunts were spent without. #150's z = 3.01 edge split and #151's four sweep-order arms all reuse the SAME 14 regions, so every one was a re-slice of one sample - the shape this repo has been burned by before. NEW CAPTURE: oracle-vulcanus-cliff-entities-west-oos, eight fresh Vulcanus regions with the same paired ON / ALL-resources-OFF lever, disjoint from all 15 already in use and spread away from spawn and from each other. unexpl border W N E S z(W) z(N) z(E) in sample (14 regions) 25 19 9 5 3 2 2.60 0.41 -1.21 out of sample (8 new) 34 23 10 9 4 7 2.29 1.79 -1.04 WHAT REPLICATES: west is the most enriched edge again (z = 2.29) and east is the depleted edge in both samples. The concentration is real and is not an artifact of re-slicing one sample. WHAT DOES NOT: "west specifically". In sample north sat at its base rate (z = 0.41) and west led it by more than 2 sigma; out of sample north is 1.79 and trails west by half a sigma. The claim that survives both samples is weaker and differently shaped - the LOW-COORDINATE edges, west AND north, are enriched and east is depleted. That widens the target rather than narrowing it, and it matters because "west" and "west + north" point at different mechanisms. #151 already refuted by permutation the one rule whose asymmetry is literally west-then-north: the repair sweep's L, T, R, B clear order. Cost of not doing this earlier: #150's headline was a 4-bin split on 17 cells from one sample, and its Bonferroni note was the right caution about the wrong risk - the multiple-comparison correction survived and it was the SAMPLE that did not. Raise n before slicing again. Adds the capture target, the fixture, its PROVENANCE entry (2.1.12, refs:sync --check reported in sync at capture time), and the spec. Verified: pnpm run verify green - 1588 app (up 4) + 13 worker + 3 container, 0 warnings, exit 0. Measurement only; shipping accuracy unchanged. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01HKjzpWJw1HbnigPP9udqN2
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The check six mechanism hunts were spent without. #150's z = 3.01 edge split and #151's four sweep-order arms all reuse the same 14 regions, so every one of them was a re-slice of a single sample - the shape this repo has been burned by before.
New capture:
oracle-vulcanus-cliff-entities-west-oos, eight fresh Vulcanus regions with the same paired ON / ALL-resources-OFF ore lever, disjoint from all 15 already in use and spread away from spawn and from each other.What replicates
West is the most enriched edge again (z = 2.29), and east is the depleted edge in both samples. The concentration is real - it is not an artifact of re-slicing one sample.
What does not
"West specifically." In sample, north sat at its base rate (z = 0.41) and west led it by more than 2 sigma. Out of sample north is 1.79, trailing west by half a sigma. The claim that survives both samples is weaker and differently shaped:
That widens the target rather than narrowing it, and it matters because "west" and "west + north" point at different mechanisms. Note #151 already refuted, by permutation, the one rule whose asymmetry is literally west-then-north: the repair sweep's
L, T, R, Bclear order.The cost of not doing this earlier
#150's headline was a 4-bin split on 17 cells from one sample. Its Bonferroni note was the right caution about the wrong risk: the multiple-comparison correction survived, and it was the sample that did not. Raise n before slicing again.
Contents
vulcanus-cliff-entities-west-ooscapture targetPROVENANCE.jsonentry (2.1.12;pnpm refs:sync --checkreported in sync at capture time)test/cliffWestOutOfSample.spec.ts, which asserts both halves - what replicated and what did notVerification
pnpm run verifygreen - 1588 app (up 4) + 13 worker + 3 container tests, 0 warnings, exit 0. Measurement only; shipping accuracy unchanged.🤖 Generated with Claude Code
https://claude.ai/code/session_01HKjzpWJw1HbnigPP9udqN2