Skip to content

History / Data Pipeline

Revisions

  • docs: update webui references for proton-pulse-web rename

    @mdeguzis mdeguzis committed Jun 9, 2026
    916cb4e

  • data-pipeline: mark probe-backfill issue resolved + document workflow fix

    @mdeguzis mdeguzis committed May 23, 2026
    fb03d8b

  • data-pipeline: document pulse merge step + source field contract

    @mdeguzis mdeguzis committed May 23, 2026
    daca343

  • docs: Add Data Pipeline wiki page Document the proton-pulse-data CI/CD pipeline architecture (3-stage build -> probe-chunks -> finalize), pipeline cache strategy, env vars, and the probe-backfill performance bug where ~29K apps are re-fetched every run because the filesystem check does not see prior backfills. Includes the fix: pass already_known_app_ids from pipeline state.

    @mdeguzis mdeguzis committed Apr 15, 2026
    25a6476