Skip to content

0.11.3

Choose a tag to compare

@github-actions github-actions released this 10 Nov 19:20
· 25 commits to main since this release
7c69e66

One fix for anyone running Prefixwise in front of a router that routes by session: the client's
x-session-id now reaches the router unchanged, and Prefixwise sends no session header of its own.

  • The client's x-session-id is forwarded, and Prefixwise sends none of its own. The proxy replaced it with its own session id on every request, default for traffic with no Prefixwise session, so behind a router that routes on that header (sgl-router, llm-d, AIBrix) every session shared one routing key and landed on one worker. Now the client's value goes through unchanged, groups turns into sessions when no Prefixwise id is given, and is the session SGLang's KV events are labelled with; with no client value, none is sent, as docs/ENGINES.md always said.