Skip to content

v0.1.3

Choose a tag to compare

@Dan-wanna-M Dan-wanna-M released this 17 Aug 18:43
· 116 commits to master since this release
  • Llama3 huggingface vocabulary is now handled correctly for non-ascii characters.
  • Vllm integrations no longer crash on batch of different generated sequence length
  • logits_processors execution time improved