Skip to content
This repository was archived by the owner on Sep 28, 2025. It is now read-only.

v0.3.1

Choose a tag to compare

View all tags
@mtasic85 mtasic85 released this 02 Jan 11:41
· 39 commits to main since this release
v0.3.1
b7651fd

Added:

  • llama-cpp-cffi server - support for dynamic load/unload of model - hot-swap of models on demand
  • llama-cpp-cffi server - compatible with llama.cpp cli options
  • llama-cpp-cffi server - limited compatibility for OpenAI API /v1/chat/completions for text and vision models
  • Support for CompletionsOptions.messages for VLM prompts with a single message containing just a pair of text and image_url in content.

Changed:

  • llama.cpp revision 0827b2c1da299805288abbd556d869318f2b121e
Assets 20
Loading