docs(observability): define per-turn cache diagnostics - #256
Closed
627150795 wants to merge 1 commit into
Closed
Conversation
7 tasks
7 tasks
Collaborator
|
Thank you for preserving this research. We are closing this PR as a source record for the Context and model invocation consolidation tracked in #277. This is not a finding that the content is wrong. The current queue contains overlapping contracts from one stale base, so we will extract only settled facts, recommendations, and unknowns into at most one successor record, citing this PR explicitly. Please do not spend time rebasing this branch. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
The model-info footer exposes only a cumulative cache percentage, which cannot identify the turn where prefix reuse changed. A zero cacheRead value is also ambiguous across providers and cache modes.
Value
This documents a conservative, provider-aware diagnostic boundary so operators can distinguish observations, correlations, and verified causes without turning normal best-effort cache behavior into false alarms.
Approach
Add a focused design contract for trace inputs, warm-to-cold classification, explicit versus implicit provider semantics, unknown handling, replay fixtures, and the opt-in delivery gate. The change is intentionally docs-only; it does not add a runtime detector or default UI marker.
Validation
Impact
Addresses #156