Skip to content

v1.0.9

Compare
Choose a tag to compare
@josStorer josStorer released this 28 May 16:28
· 745 commits to master since this release

Features

use model state cache to achieve 5x - 50x faster preparation time for generation
support for rwkv-4-world
preload preset_system
improve api concurrency performance
experimental macOS/Linux support

Fixes

the configs page now always displays the currently selected non-local model so that other models can be selected properly
sha256 check for model deduplication

chore

add FAQs to About