Skip to content

v0.5.0

Latest

Choose a tag to compare

@Dan-wanna-M Dan-wanna-M released this 29 May 20:37
· 1 commit to master since this release
  • For performance reasons, generated json will now allow preceding whitespaces at the beginning.
  • When triton is installed, a new logits masker will be enabled, which is faster and uses significantly less memory.
  • Whitespace patterns are adjusted for better generation quality.