Skip to content

v0.7.168

Choose a tag to compare

@SilenNaihin SilenNaihin released this 07 Oct 23:43
ca176cd

Capture-only Chat token probabilities (experiential#1249; experiential 0.7.168, exp-gateway-native 0.3.139). New CaptureConfiguration.capture_logprobs, off by default: with it off nothing changes on the wire, in records, or on the request path (no route scan, no per-frame work). When a host turns it on, an eligible openai_compatible rung (verified supports_logprobs, platform credential, no output guardrail, no caller probability control including an explicit logprobs: false) of a captured request is dialed with logprobs: true under its own Idempotency-Key. The probabilities go to a capture side buffer, never into the caller's event stream, so Chat SSE, the Chat body and Responses SSE stay byte-identical to an uninjected call (tested), with identical usage and settlement. The winning attempt's probabilities land in the capture record as provider_logprobs (logprobs_injected, truncated, nul_replaced, content, refusal), kept only as an aligned prefix beside a complete, successful response. Retention is bounded per attempt, per relay before the winner attaches, by the collector budgets, and by the sink, which sheds the sidecar only when the sidecar alone blocks preparation. A request-shaped refusal of the field before any output or usage, at open or under HTTP 200, re-dials the plain payload inside the same physical attempt (one reserved attempt, fresh per-dial allowances), and a rung whose plain dial then succeeds is not asked again by that worker.