Skip to content

v0.1.11: Opt-in local SQLite mirror of the frozen Form 477 corpus

Choose a tag to compare

View all tags
@cyanheads cyanheads released this 02 Jul 14:01
v0.1.11
This tag was signed with the committer’s verified signature.
cyanheads Casey Hand
SSH Key Fingerprint: lkZCAfVCK5qsrcvEYCs0BnVRDCX7pKsdCZkw5yYKMuw
Verified
Learn about vigilant mode.
cb0527f
This commit was signed with the committer’s verified signature.
cyanheads Casey Hand
SSH Key Fingerprint: lkZCAfVCK5qsrcvEYCs0BnVRDCX7pKsdCZkw5yYKMuw
Verified
Learn about vigilant mode.

Opt-in local SQLite mirror of the frozen Form 477 corpus

Form 477 queries can now be served from a local mirror instead of the live Socrata API (#8); the mirror is off by default and everything falls back to live behavior when disabled or uncovered.

Added:

  • FCC_MIRROR_ENABLED / FCC_MIRROR_PATH env vars — off by default; path defaults to data/fcc-mirror
  • mirror:init script — state-scoped (--states 11,53) or full-corpus (--full) one-time ingest; idempotent and resumable
  • mirror:verify script — per-store sync state, row counts, integrity checks, coverage roster
  • Coverage-gated serving with silent live-API fallback; provider search/summary and cbsa/tribal/nation geographies require a full ingest
  • FTS5 provider dimension backing fcc_search_providers (word-prefix name matching on the mirror)
  • better-sqlite3 ^12.0.0 optional peer dependency for the Node runtime; Bun uses the built-in bun:sqlite

Changed:

  • Dockerfile ships the mirror lifecycle scripts and a writable data/ directory for in-container bootstrap

156 tests pass; bun run devcheck clean.

Assets 3
Loading