Repository navigation
v0.5.4 — the picker stops selling slow models #29
dea6cat
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
/models locallists models that run slower than about 15 tokens per second last and marks them(slow);CLYDE_MIN_TOKSchanges the floor./evalis hidden whichever app runs it (Ollama, Hugging Face GGUF or LM Studio).num_gpu,lms loadgets--gpu.This discussion was created from the release v0.5.4 — the picker stops selling slow models.
All reactions