Skip to content

Release b289

Choose a tag to compare

@github-actions github-actions released this 03 Mar 16:26

fix: set AccessLogMeta in stream_handler for proper metrics tracking

The streaming response was not setting AccessLogMeta, causing the
middleware to never switch from 'pending' to actual backend counter.
Now both streaming and non-streaming requests properly track
active requests per model/backend.