You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Using llama-server with this plugin and --parallel 1, the server gets stuck when trying to spawn a PTY. Raising it to at least --parallel 2 seems to be fine.
I think it's worth calling this out in the docs for those doing local inference
Using llama-server with this plugin and
--parallel 1, the server gets stuck when trying to spawn a PTY. Raising it to at least--parallel 2seems to be fine.I think it's worth calling this out in the docs for those doing local inference