Repository navigation
v0.1.6
- Introducing Kolosal AI Server, easily managed server within kolosal AI's application.
- Added phi 4 and phi 4 mini models.
- Added continous batching mechanism for decoding
- Added kv cache management mechanism for batch decoding
- Added model loading settings within server tabs
- Added tab management system
- Added automatic title generation for each chat history