Skip to content

v0.1.9

Choose a tag to compare

View all tags
@thomasantony thomasantony released this 28 Mar 23:58
· 40 commits to master since this release
v0.1.9
fd778f0
  • Updates the bindings to work with the new llama.cpp API from ggml-org/llama.cpp#370
  • Adds two separate interfaces - LlamaInference which is similar to the bindings in v0.1.8 and the lower level LlamaContext (currently untested)
  • The old bindings are still present in PyLlama.cpp but is currently not compiled and will be removed at a later date
Assets 2
Loading