Skip to content

Version 0.0.6

Choose a tag to compare

View all tags
@fairyshine fairyshine released this 27 Sep 12:54
· 30 commits to master since this release
v0.0.6
bd9e649

New Features:
For transformers, llama.cpp and OpenAI models

  • Generate with logits and probs output.
  • Requests in the OpenAI-like API (/chat/completions/).

Bug fixes:

  • Standardize logits output format for generate method.
Assets 2
Loading