Skip to content

📊 Refresh CIA data (129 CSVs + production stats)#2908

Merged
pethers merged 1 commit into
mainfrom
data/cia-csv-refresh
Jun 6, 2026
Merged

📊 Refresh CIA data (129 CSVs + production stats)#2908
pethers merged 1 commit into
mainfrom
data/cia-csv-refresh

Conversation

@github-actions
Copy link
Copy Markdown
Contributor

@github-actions github-actions Bot commented Jun 6, 2026

📊 Automated CIA data refresh

Pulled the latest service.data.impl/sample-data/ CSVs from
Hack23/cia@master
(resolved to commit b50dd2a00429527451fdc1eed26aeca1c75a6273)
and re-ran the production-statistics pipeline against the same commit.

CSV refresh

Metric Count
Total tracked CSVs 146
✅ Updated 129
🟰 Unchanged 11
❔ Missing upstream 0
⏭ Skipped (local-only) 6
❌ Failed downloads 0

Production statistics

  • Total persons: 2499
  • Total votes: 3724917
  • Last extraction: 2026-06-06 20:48:04.446826

How resolution works

The workflow never introduces new files — it only refreshes CSVs
already tracked under data/cia/** and cia-data/**. Upstream paths
are resolved through a recursive basename → upstream-path index
built from the GitHub Tree API, so files living in
sub-folders (distinct_values/, framework-validation/,
risk-rule-tests/) are located correctly even though local paths
are organised differently. An <stem>_sample.csv alias is applied
for the handful of locally-renamed canonical files.

Review checklist

  • CSV diffs look reasonable (no schema regressions)
  • production-stats.json counts move monotonically or within reason
  • Dashboards still render with the refreshed data
  • No unexpected file additions or removals

Generated by .github/workflows/update-cia-csv-data.yml.

…50dd2a

- Upstream ref: master (resolved to b50dd2a00429527451fdc1eed26aeca1c75a6273)
- CSV files: updated 129 / 146 tracked
- Production stats: 2499 persons, 3724917 votes
- Last extraction: 2026-06-06 20:48:04.446826
Copilot AI review requested due to automatic review settings June 6, 2026 22:42
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

@pethers pethers merged commit 6cfe568 into main Jun 6, 2026
2 checks passed
@pethers pethers deleted the data/cia-csv-refresh branch June 6, 2026 22:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants