Skip to content

Llama.csharp-v1.3.0

Latest
Latest

Choose a tag to compare

View all tags
@stmay4 stmay4 released this 03 Jul 15:47
v1.3.0
5f55534
This commit was signed with the committer’s verified signature.
stmay4 MayorovSV
SSH Key Fingerprint: 0yPv+S9fqqUkCylYRja8513oWCTV7ZEdDtJtsf/0swc
Verified
Learn about vigilant mode.

This release includes the full source code along with a ready-to-use archive of the library subproject:

📦 llama.csharp-v1.3.0.zip

Supported llama.cpp versions
b9460 and later (up to the latest releases)

You can download the engine files from the official llama.cpp releases: 🔗 llama.cpp releases

Public changes

New features

  • Added ClearSequence method in LlamaExecutor for clearing sequence state and cache for any model type.
  • CopySeqPrefixTo can now be used regardless of the source and target sequence states.

Fixed

  • Fixed partial copy in CopySeqPrefixTo: allowed for hybrid models and fixed setting sequence state after copying (previously the sequence state after partial copy was corrupted).

Other

Tests

  • Added more partial copy tests for different model types and sequence states.
  • Added ClearSequence tests.
Assets 3
Loading