Docs: Chat Completion API contains non-existing "template" parameter #3514
Labels
bug
Something isn't working
Comments
ThomasVitale
added a commit
to ThomasVitale/ollama
that referenced
this issue
Apr 6, 2024
Fixes ollamagh-3514 Signed-off-by: Thomas Vitale <ThomasVitale@users.noreply.github.com>
This was referenced Apr 6, 2024
jmorganca
pushed a commit
that referenced
this issue
Apr 6, 2024
Fixes gh-3514 Signed-off-by: Thomas Vitale <ThomasVitale@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
What is the issue?
The ChatRequest type doesn't contain a
templatefield (https://github.com/ollama/ollama/blob/main/api/types.go#L51), but the documentation lists it as an advanced parameter for thechat completionendpoint (https://github.com/ollama/ollama/blob/main/docs/api.md?plain=1#L397).When included in a request, from what I can see, the Ollama server ignores it and always uses the template from the Modelfile (https://github.com/ollama/ollama/blob/main/server/routes.go#L1292).
What did you expect to see?
No response
Steps to reproduce
No response
Are there any recent changes that introduced the issue?
No response
OS
No response
Architecture
No response
Platform
No response
Ollama version
0.1.30
GPU
No response
GPU info
No response
CPU
No response
Other software
No response
The text was updated successfully, but these errors were encountered: