-
-
Notifications
You must be signed in to change notification settings - Fork 8.9k
Description
🚀 The feature, motivation and pitch
Hi,
when doing vibecoding sometimes AI prepares code to call API /chat/completions, which is not correct.
But this is not even a problem of my code. I am trying to run Google ADK library to use local model served by vLLM.
The problem I am encountering is that either I only get this information:
INFO: 10.147.81.70:62614 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
if e.g. top_p=0 has been set
or nothing appears in logs (like for Google ADK). And I know that the message reaches vLLM, because it did just moment ago, but I added something new like e.g. tool calling and it stops working and there is no information in logs.
Please provide a more detailed dump if the message cannot be parsed. Especially adding logging in the initial stages where an error occurs causes nothing to appear in the logs.
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.