Skip to content

Releases: Dan-wanna-M/kbnf

v0.3.9-python

10 Sep 02:37
210ebe2
Compare
Choose a tag to compare
  • Bug fix: incorrect logits mask will no longer be produced when multiple different language models' vocabulary with the same logits length are used to create engines.

v0.5.3-rust

02 Sep 23:31
3bc0718
Compare
Choose a tag to compare
  • Bug fix: #substrs now correctly constrain the allowed tokens

v0.5.2-rust

02 Sep 23:24
e73916a
Compare
Choose a tag to compare
  • Bug fix: undefined start nonterminal in kbnf grammar string will no longer panick. Instead, an error will be returned.

v0.3.8-python

02 Sep 23:31
3bc0718
Compare
Choose a tag to compare
  • Changes from v0.5.3-rust

v0.3.7-python

02 Sep 23:24
e73916a
Compare
Choose a tag to compare
  • Changes from v0.5.2-rust

v0.5.1-rust

02 Sep 23:19
e888035
Compare
Choose a tag to compare
  • Add #substrs docs.
  • max_state_id is now correctly computed with respect to #substrs
  • Make Python FFI docs safety section more comprehensive

v0.5.0-rust

30 Aug 03:12
437236e
Compare
Choose a tag to compare
  • Make EngineLike a sealed trait so adding more methods to it will not break compatibility.
  • Support new syntax: #substrs"xxxxx" which supports generating one substring out of a long string.

v0.3.6-python

02 Sep 23:22
5f5c8de
Compare
Choose a tag to compare
  • The case of all tokens are allowed is now handled without UB in the fast path of mask_logits for torch tensor
  • Add safety checks to guard against the fast path of mask_logits so mask_logits does not lead to UB on platforms where usize is not 64 bit.
  • Update docs to align with implementations of Engine
  • Changes from v0.5.1-rust

v0.3.5-python

30 Aug 03:14
437236e
Compare
Choose a tag to compare
  • Make torch mask_logits significantly faster by bypassing unreasonably slow Python interpreter & allowed token ids index->allowed token ids CPU tensor cache
  • Changes from v0.5.0-rust

v0.3.4-python

22 Aug 22:09
efbd362
Compare
Choose a tag to compare
  • Make compute_allowed_token_ids no-gil. In other words, it no longer blocks python threads.
  • Changes from v0.4.3-rust