Help wanted: Section 13, Where this breaks, and what is unknown: "Attribution for stateful services and batched inference is…"

[anacay]

Attribution for stateful services and batched inference is open

Per-request coefficients break for caches, batches and stateful services, and batched inference is the big new case. If you've attributed cost on one of these, what unit did you use, and what did you do with the remainder?

Author's note 6 on Section 13, Where this breaks, and what is unknown. Reply below; if this settles into a change to the text, an editor will carry it over with credit (see HOW_IT_GROWS.md).