Skip to content

v1.1.10

Choose a tag to compare

@keith-axe keith-axe released this 30 Jul 15:34

Fixed

  • Streaming completions now report accurate token usage and cost across all providers (OpenAI, Azure OpenAI, Anthropic, Bedrock, Vertex AI, Gemini, Cohere) instead of showing zero even on success.
  • The Budget page no longer shows $0 spend for a project or org that has real usage when the analytics pipeline is still catching up.
  • A gateway node whose control-plane certificate was due for renewal (but not yet expired) would fail to start until an operator manually re-enrolled it. It now keeps using the still-valid certificate while renewing in the background, as intended.
  • Self-hosted operators authenticating with an admin token could no longer view or update policies; token-based access to the policies endpoint is restored.
  • A request denied for exceeding your quota now says so specifically, instead of showing the same generic "denied by policy" message as an unrelated policy block.
  • The gateway now finishes in-flight requests before shutting down on a restart or redeploy, instead of dropping active connections immediately.
  • Self-hosted orgs running more than one gateway node no longer see undercounted spend breakdowns, attribution summaries, budget usage, billing, model efficiency, or discovered-domain reports — these now reflect traffic from every node instead of only the node handling the request.