Skip to content

v0.1.8

Choose a tag to compare

@rifkybujana rifkybujana released this 09 Apr 12:08
· 6 commits to main since this release
1d75966
  • Better memory management in model manager
  • multi-model deployment
  • smart resource approximator for model memory allocation and kv cache allocation
  • added completions endpoint on server
  • fixed url opening through markdown
  • added status bar footer
  • added system prompt editor
  • fix UI layouting
  • added auto-scroll
  • added feature to add your own model easily