Replies: 2 comments
|
Please refer to our documentation. In short, for Qwen2.5, you should use "hermes" as "--tool-call-parser". vllm does not support the function calling for previous versions of Qwen. |
0 replies
|
Thank you very much! |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Which tool parser is better for deploying Qwen with vLLM?
All reactions