Skip to content

Establish Arch data foundation#1

Merged
MaxGhenis merged 3 commits into
mainfrom
codex/arch-data-foundation
Apr 28, 2026
Merged

Establish Arch data foundation#1
MaxGhenis merged 3 commits into
mainfrom
codex/arch-data-foundation

Conversation

@MaxGhenis
Copy link
Copy Markdown
Contributor

@MaxGhenis MaxGhenis commented Apr 28, 2026

Summary

  • Rename the project surface from microplex-sources to Cosilico Arch (cosilico-arch, arch CLI, arch Python namespace).
  • Add Arch source/fact/normalization/target-input modules with lineage-preserving source facts.
  • Reframe calibration data as Arch target inputs while leaving source selection, reconciliation, aging, and active target sets to Microplex Targets.
  • Update SNAP and ACA ETLs to build target inputs through source facts and representation-only normalization helpers.
  • Remove legacy target variable compatibility helpers and stale wrapper modules.
  • Address review findings by removing the local microplex package collision, moving the old pipeline entry point under arch.pipelines, making Supabase schema boundaries explicit, and adding a wheel-install smoke test to CI.

Validation

  • git diff --check
  • uv run ruff check arch db/supabase_client.py db/etl_snap.py db/etl_aca_enrollment.py db/schema.py calibration/constraints.py calibration/targets.py micro/us/district.py tests/test_arch_facts.py tests/test_arch_namespace.py tests/test_arch_normalization.py tests/test_etl_snap.py tests/test_etl_aca_enrollment.py
  • uv run pytest tests/test_arch_facts.py tests/test_arch_namespace.py tests/test_arch_normalization.py tests/test_etl_snap.py tests/test_etl_aca_enrollment.py tests/test_calibration.py -q
  • uv build
  • Clean wheel install smoke test: import arch, import arch.targets, from micro.us.district import DistrictMicroplex, from microplex import ConditionalMAF, and arch --help

Notes

The repository is temporarily named CosilicoAI/arch-data because GitHub has retired the CosilicoAI/arch namespace. A support request has been sent asking GitHub to release that slug.

@MaxGhenis MaxGhenis marked this pull request as ready for review April 28, 2026 00:42
@MaxGhenis MaxGhenis merged commit fc7ec75 into main Apr 28, 2026
2 checks passed
@MaxGhenis MaxGhenis deleted the codex/arch-data-foundation branch April 28, 2026 00:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant