Skip to content

v0.1.6

Choose a tag to compare

@rifkybujana rifkybujana released this 08 Mar 18:08
· 10 commits to main since this release
678b4ca
  • Introducing Kolosal AI Server, easily managed server within kolosal AI's application.
  • Added phi 4 and phi 4 mini models.
  • Added continous batching mechanism for decoding
  • Added kv cache management mechanism for batch decoding
  • Added model loading settings within server tabs
  • Added tab management system
  • Added automatic title generation for each chat history