Skip to content

feat(cost): model streaming summary resources - #331

Merged
zzylol merged 6 commits into
mainfrom
feat/cost-streaming-linear
Sep 4, 2026
Merged

feat(cost): model streaming summary resources#331
zzylol merged 6 commits into
mainfrom
feat/cost-streaming-linear

Conversation

@zzylol

@zzylol zzylol commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Why

At-rest query costing does not account for continuously arriving data, bootstrap work, active window state, retained state, or update multiplicity.

What

Introduce analytical evidence and CPU, peak-memory, and source-I/O formulas for incremental summary maintenance over one comparison horizon. The model uses the existing DataArrival and lifecycle vocabulary and fails closed when required physical evidence is absent.

How

  • Separate initial/bootstrap inputs from arriving rows.
  • Charge insert, merge, subtract, delete, and read operations at their physical multiplicities.
  • Count shared physical state once by identity.
  • Keep source scans, transient workspace, and retained state dimensionally separate.

Before this PR

The analytical estimator could price at-rest query DAGs but had no representation for update-driven summary state.

After this PR

A downstream evidence provider can describe one streaming summary implementation and obtain a resource-dimensional estimate without using structural node counts.

Stack

Base: #330. The next PR adds lifecycle comparison and ranking.

Module boundary

Streaming-specific inputs live under summary_maintenance_cost. The module adds bootstrap, arrival, active/retained-window, and summary-operation evidence on top of the shared analytical estimator over physical-operator evidence; it is not a second physical cost system.

@zzylol
zzylol force-pushed the feat/cost-planner-ranking branch from 6819666 to 9bc1660 Compare September 2, 2026 19:28
@zzylol
zzylol force-pushed the feat/cost-streaming-linear branch from c404f5e to e16c007 Compare September 2, 2026 19:28
@zzylol
zzylol force-pushed the feat/cost-streaming-linear branch from e16c007 to a6228d1 Compare September 3, 2026 02:54
@zzylol
zzylol force-pushed the feat/cost-planner-ranking branch from 9bc1660 to 39417cd Compare September 3, 2026 02:54
@zzylol
zzylol marked this pull request as ready for review September 3, 2026 03:17
@zzylol
zzylol force-pushed the feat/cost-streaming-linear branch from 6717e03 to 640b62a Compare September 3, 2026 13:31
@zzylol
zzylol force-pushed the feat/cost-planner-ranking branch from 4356990 to 2886b84 Compare September 3, 2026 16:13
@zzylol
zzylol force-pushed the feat/cost-streaming-linear branch from 0b8ee9f to 6875361 Compare September 3, 2026 16:25
@zzylol zzylol changed the title feat(cost): rank streaming summary lifecycles feat(cost): model streaming summary resources Sep 3, 2026
@zzylol
zzylol force-pushed the feat/cost-streaming-linear branch from 6875361 to a239227 Compare September 3, 2026 16:29
@zzylol
zzylol force-pushed the feat/cost-planner-ranking branch from 2886b84 to 86025bb Compare September 3, 2026 16:30
@zzylol
zzylol force-pushed the feat/cost-planner-ranking branch from 86025bb to fa499a1 Compare September 3, 2026 23:54
@zzylol
zzylol force-pushed the feat/cost-streaming-linear branch 4 times, most recently from a090454 to ddf6067 Compare September 4, 2026 03:25
@zzylol
zzylol force-pushed the feat/cost-streaming-linear branch from ddf6067 to e9cb271 Compare September 4, 2026 04:01
@zzylol
zzylol changed the base branch from feat/cost-planner-ranking to main September 4, 2026 11:25
@zzylol
zzylol merged commit f2eecb0 into main Sep 4, 2026
3 checks passed
@zzylol
zzylol deleted the feat/cost-streaming-linear branch September 7, 2026 15:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant