Skip to content

b2320

Latest

Choose a tag to compare

@github-actions github-actions released this 02 Mar 20:39
4a6e2d6
llama : add abort_callback to interrupt computation (#5409)

* using abort_callback from ggml to stop llama computation

* format fix

* a brief explaining comment

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>