Trying to stop output generation from SillyTavern doesn't work. Koboldcpp just keeps going while SillyTavern stops updating this specific generation or streaming. If I try to start another generation while the first one is still running in kobolcpp, SillyTavern receives API error 'Server is busy.'
Also, when streaming is enabled and I try to stop generation, koboldcpp outputs [Errno 32] Broken pipe in console. Trying to start a new generation after this error causes koboldcpp to crash.
P.S. Tested on Linux with Mixtral.
Trying to stop output generation from SillyTavern doesn't work. Koboldcpp just keeps going while SillyTavern stops updating this specific generation or streaming. If I try to start another generation while the first one is still running in kobolcpp, SillyTavern receives API error 'Server is busy.'
Also, when streaming is enabled and I try to stop generation, koboldcpp outputs
[Errno 32] Broken pipein console. Trying to start a new generation after this error causes koboldcpp to crash.P.S. Tested on Linux with Mixtral.