Add /notes: dated, data-linked board notes - #162
Merged
Merged
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
MaxGhenis
marked this pull request as ready for review
September 5, 2026 11:22
MaxGhenis
force-pushed
the
notes-route
branch
from
September 5, 2026 11:22
57051c6 to
70979ab
Compare
- New note, 2026-09-05: GPT-6 Astra debuts second at 88.0% (#2 of 39). Row by row against GPT-5.6 Sol on the 1,973 scored outputs: both right on 1,816, both wrong on 95, 33 Astra-only misses against 29 Sol-only. Astra's solo misses cluster in two invented rules (an employer-sponsored insurance premium netted from wages, 13 rows; a disability flag read as Medicare eligibility, 10 rows). The row list with both predictions, the reference and the judge's note is committed (scripts/astra_vs_sol_rows.py regenerates it) and the test recomputes every fact from the frozen payload and annotations. - Notes keep the release their facts were checked against. The renderer shows "numbers from release X (board snapshot Y)" under the date; the test recomputes facts for notes on the frozen release and, for notes on a superseded release, checks the release is one the repository published. The frozen payload is read through snapshot_payload (gzip). Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
MaxGhenis
force-pushed
the
notes-route
branch
from
September 5, 2026 16:48
70979ab to
080ba30
Compare
…elease line Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds
/notes: dated records of board changes and findings, each a few paragraphs whose every number is a placeholder filled from afactsblock thattests/test_notes.pyrecomputes from the frozen snapshot underpaper/snapshot/20260501/. Two notes:scripts/snap_pathways.pyrecomputes each household's SNAP tests (meets_snap_gross_income_test,meets_snap_net_income_test,meets_snap_asset_test,is_tanf_non_cash_eligible,is_snap_eligible) with the same situation builderground_truth.pyuses and writesnotes/data/snap_pathways_20260901.csvplus a provenance sidecar (policyengine-us 1.723.0; recomputed SNAP agrees with the frozen 1.755.4 references for all 100). Pathways: ordinary 10, categorical_income 5, categorical_both 1, categorical_assets 4 (NJ, NC, VA, PA), ineligible 80.Also:
SiteHeadertakesactionLinks(Paper and Notes everywhere the Paper link appeared),/notesand both note URLs in the sitemap,.gitignoreadmitsnotes/data/.Based on
add-fable-5-1because the notes cite the 33-model snapshot that #160 lands; retargets to main when #160 merges. Draft until then.Verification on the rebased head: ruff clean; pytest 639 passed, 5 skipped; app lint clean, 101 vitest,
next buildprerenders/notesand both note routes.