Repository navigation
v.0.5.4-alpha
Install command, run in a user level powershell.
irm https://raw.githubusercontent.com/omgitsbase/llmash/main/install.ps1 | iexOn Linux:
curl -fsSL https://raw.githubusercontent.com/omgitsbase/llmash/main/install.sh | shAlready installed: llmash update.
Changed
- A drafter
pulldraftfetches for a model in an Ollama store your user can't write to (on Linux the store usually belongs to theollamaaccount) is used again.pulldraftsaved it to the loose-GGUF folder, but the server only looked beside the model's blob, so the model kept drafting by n-gram lookup. The server,pulldraftandrunnow look in both places, for an MTP head, DSpark, DFlash, EAGLE-3 or a draft model alike. Reported and pinned down by @ibilbrey. llmash servereadsLLMASH_MODELS, as the help, the installers andllmash modelsalready said it did.
Checked before release:
- The client program and its tests on Windows and Linux.
The runtime is still build 146, so an update from 0.5.3 does not download it again.