Skip to content

Experiential 0.7.131

Choose a tag to compare

@SilenNaihin SilenNaihin released this 29 Sep 22:20
90704ff

Fast processing tiers

  • Accept service_tier: "fast" as the canonical Priority processing tier on Chat Completions and Responses.
  • Preserve complete tier-specific long-context and cache-write price schedules.
  • Reserve the larger of the frozen Standard and requested-tier schedules, then price the actual served tier from provider evidence.
  • Retain durable holds for missing, unknown, conflicting or unpriceable evidence rather than guessing a charge.
  • Preserve original receipts across direct and swept settlement retries, with idempotent replay of committed holds.
  • Resolve late confirmed receipts after restart or crash without another provider dispatch, preserving delivery-outcome truth.
  • Price cache writes with an unobserved TTL split only when both authored rate legs are known and equal.

Includes exp-gateway-native 0.3.117.

Hosted consumers must persist the new optional GatewayServiceTierAdmission and GatewayServiceTierSettlement contracts before enabling tier cards. Upgrade every catalog reader before authoring non-null long-context schedules inside processing-tier cards. Existing untiered/default/BYOK behavior and the digest of existing cards remain unchanged.