You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
With the same model (Mistral Instruct v03)
If I use llama.cpp (any version of the last 3 weeks) and the same prompt,
if I say "hello, how are you?" it answers "I am fine, and you?" (or similar)
If I do it using gradio and llama_cpp_python
I get
"I am an assistant.....blah blah.. I don't have feelings... blah blah"
I even took all the parameters from llama.cpp and set the same parameters in llama_cpp_python and the gradio interface.
I really don't understand what might be the difference.
The text was updated successfully, but these errors were encountered:
0wwafa
changed the title
Nosure if it's a bug or a configuration error...
Not sure if it's a bug or a configuration error...
Jun 26, 2024
With the same model (Mistral Instruct v03)
If I use llama.cpp (any version of the last 3 weeks) and the same prompt,
if I say "hello, how are you?" it answers "I am fine, and you?" (or similar)
If I do it using gradio and llama_cpp_python
I get
"I am an assistant.....blah blah.. I don't have feelings... blah blah"
I even took all the parameters from llama.cpp and set the same parameters in llama_cpp_python and the gradio interface.
I really don't understand what might be the difference.
The text was updated successfully, but these errors were encountered: