Skip to content
This repository was archived by the owner on Sep 28, 2025. It is now read-only.

v0.3.0

Choose a tag to compare

View all tags
@mtasic85 mtasic85 released this 01 Jan 10:49
· 45 commits to main since this release
v0.3.0
92cad07

Added:

  • Qwen 2 VL 2B / 7B vision models support
  • WIP llama-cpp-cffi server - compatible with llama.cpp cli options instead of OpenAI

Changed:

  • llama.cpp revision 5896c65232c7dc87d78426956b16f63fbf58dcf6
  • Refactored Options class into two separate classes: ModelOptions, CompletionsOptions

Fixed:

  • Llava (moondream2, nanoLLaVA-1.5, llava-v1.6-mistral-7b) vision models support
  • MiniCPM-V 2.5 / 2.6 vision models support

Removed:

  • Removed ambiguous Options class
Assets 20
Loading