Skip to content

Llama.csharp-v1.2.0

Choose a tag to compare

View all tags
@stmay4 stmay4 released this 29 Jun 22:47
v1.2.0
d4ed9af
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

This release includes the full source code along with a ready-to-use archive of the library subproject:

📦 llama.csharp-v1.2.0.zip

Supported llama.cpp versions
b9460 and later (up to the latest releases)

You can download the engine files from the official llama.cpp releases: 🔗 llama.cpp releases

Public changes

New features

  • Extended llama.cpp version support: the library is now compatible with versions from b9460 through the latest releases.
  • Added unsupported operation checks in LlamaExecutor for recurrent and hybrid models. Methods that are incompatible with these architectures (DeleteSequenceEnd and StopSeqPrefill) now throw an exception instructing the user to use state checkpoints (not yet implemented).

Docs

  • Fixed a comment for the Sample method in ISamplingPipeline.

Other

Tests

  • Updated llama.cpp paths and model paths in integration tests and example test programs.
Assets 3
Loading