You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We should configure x-request-id correctly for our out of the box examples, and ensure that gateways can easily then integrate their own request tracing.
For vLLM, it would be very desirable to ensure that x-request-id is sufficiently scoped in logs such that we can identify request start, request end, and any related requests (i.e. POST /v1/completions or similar should show the request id)
The text was updated successfully, but these errors were encountered:
We should configure x-request-id correctly for our out of the box examples, and ensure that gateways can easily then integrate their own request tracing.
For vLLM, it would be very desirable to ensure that x-request-id is sufficiently scoped in logs such that we can identify request start, request end, and any related requests (i.e.
POST /v1/completions
or similar should show the request id)The text was updated successfully, but these errors were encountered: