Skip to content

0.1.1

Choose a tag to compare

@feifeibear feifeibear released this 21 Sep 03:53
· 19 commits to main since this release
1da8d0a

Add serving logic. You can launch bloom-based LLM speculative sampling as a server.