Skip to content

Llama.csharp-v1.1.0

Choose a tag to compare

View all tags
@stmay4 stmay4 released this 28 Jun 23:39
v1.1.0
342bcf5
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

This release includes the full source code along with a ready-to-use archive of the library subproject:

📦 llama.csharp-v1.1.0.zip

Supported llama.cpp versions
b7551 – b7667 (Qwen3 and earlier models)

You can download the engine files from the official llama.cpp releases:

🔗 llama.cpp releases (lib tested on b7552 and b7667)

Public changes

New features

  • StopSeqPrefill method in LlamaExecutor for aborting active prefills (e.g., to cancel a prefill that is no longer needed).

Fixed

  • DeleteSequence now stops active prefill or generation then removing the sequence.
  • Fast empty sequence validation in Generate – throws InvalidOperationException instead of internal decoder exception.
  • The integration_test source code no longer contains the engine files

Docs

  • Added partial documentation for the public methods.

Other

Refactore

  • endInference / endPrefill refactored to accept a Sequence instead of a tuple.

Tests

  • Added integration tests for deletion during prefill/generation.
  • Added integration tests for StopSeqPrefill revert scenarios.
  • Added test for generating on an empty sequence.
Assets 3
Loading