Incorrect tool call syntax on subsequent calls when using native tool call #11039
raphael1-w
started this conversation in
Issues
Replies: 2 comments 1 reply
-
|
Native tools have been implemented in Ollama in the last update (0.5.12). |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
This happens because open-webui removes the older tool calls and puts its own tags. This confuses the model, that read the past messages and may think that the tags are the right way to make tiol calls. Why not use the openai api format for old tool calls in the messages array when using models with native tool call enabled? They have a role for that. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
When using native tool call, the model confuses the UI xml as the tool call syntax.
In the first message, the first tool call is correct (indicated by the event emitter). However, in the third message, the UI shows tool executed but no tools were used (lack of event emitter) as the model generates the UI xml tags directly.
When asked about the syntax subsequently, the model explains that the tool call syntax is to use the xml tags, which is incorrect.
This can cause confusion for the user, as the UI indicates a tool was used but nothing actually happens.
Beta Was this translation helpful? Give feedback.
All reactions