Skip to content

Score legacy flat PE H5s#219

Merged
MaxGhenis merged 1 commit into
mainfrom
codex/legacy-us-data-score-20260628
Jun 29, 2026
Merged

Score legacy flat PE H5s#219
MaxGhenis merged 1 commit into
mainfrom
codex/legacy-us-data-score-20260628

Conversation

@MaxGhenis

@MaxGhenis MaxGhenis commented Jun 29, 2026

Copy link
Copy Markdown
Contributor

Adds read-only scoring support for legacy flat PE H5 files that store root variable/ datasets instead of Populace entity tables. This lets us score old eCPS-style artifacts against the current Populace target surface before replacing them.\n\nAlso normalizes legacy zero-weight households out of the scoring frame so target materialization batches cannot create invalid all-zero weight vectors; weighted totals are unchanged.\n\nValidation:\n- uv run --python 3.13 --package populace-build --extra us --group dev pytest packages/populace-build/tests/test_us_fiscal_refresh_builder.py -k "legacy_pe_flat_h5 or legacy_cd_provenance" packages/populace-build/tests/test_us_plan.py::TestUsSources::test_no_incumbent_data_package_references_in_live_tree\n- uv run --python 3.13 --package populace-build --extra us --group dev ruff check tools/score_us_fiscal_targets.py packages/populace-build/tests/test_us_fiscal_refresh_builder.py\n- uv run --python 3.13 --package populace-build --extra us --group dev ruff format --check tools/score_us_fiscal_targets.py packages/populace-build/tests/test_us_fiscal_refresh_builder.py\n\nApplied locally to score the old eCPS-style national H5 on the current 32,637-target surface; final_loss=0.4779988241657727.

@MaxGhenis MaxGhenis force-pushed the codex/legacy-us-data-score-20260628 branch from cd9c635 to f67add9 Compare June 29, 2026 01:06
@MaxGhenis MaxGhenis force-pushed the codex/legacy-us-data-score-20260628 branch from f67add9 to 70002c3 Compare June 29, 2026 01:06
@MaxGhenis MaxGhenis changed the title Score legacy policyengine-us-data flat H5s Score legacy flat PE H5s Jun 29, 2026
@MaxGhenis MaxGhenis merged commit 23ac556 into main Jun 29, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant