Skip to content

Releases: hmartinez82/llama.cpp

b4879

Choose a tag to compare

@github-actions github-actions released this 12 Mar 22:30
f08f4b3
Update build.yml for Windows Vulkan builder to use Vulkan 1.4.304 SDK…

b4781

Choose a tag to compare

@github-actions github-actions released this 26 Feb 13:36
3567ee3
gguf-py: enable reading non-native endian files (#12081)

Currently self.byte_order is never used.
Actually use it to byteswap read data to
allow reading big endian files on little endian systems
and vice versa.

Now it's possible to convert little-endian model
into a big-endian model and back
on a little-endian system.

b4710

Choose a tag to compare

@github-actions github-actions released this 13 Feb 22:54
8a8c4ce
llamafile: use member variable instead of constant for iq4nlt (#11780)

b4501

Choose a tag to compare

@github-actions github-actions released this 17 Jan 09:52
667d728
rpc : early register backend devices (#11262)

Early register RPC devices and do not propagate RPC specifics in the
llama model structures.

ref: #10609

b4484

Choose a tag to compare

@github-actions github-actions released this 15 Jan 02:43
b4d92a5
ci : add -no-cnv for tests (#11238)

b4466

Choose a tag to compare

@github-actions github-actions released this 13 Jan 09:31
924518e
Reset color before we exit (#11205)

We don't want colors to leak post termination of llama-run.

Signed-off-by: Eric Curtin <ecurtin@redhat.com>

b4462

Choose a tag to compare

@github-actions github-actions released this 11 Jan 11:20
c05e8c9
gguf-py: fixed local detection of gguf package (#11180)

* updated path to gguf package for non-installed setups

* added reader.py to readme

* Bumped gguf version to 0.15.0

b4410

Choose a tag to compare

@github-actions github-actions released this 03 Jan 22:21
4b0c638
common : disable KV cache shifting automatically for unsupported mode…

b4326

Choose a tag to compare

@github-actions github-actions released this 14 Dec 02:53
56eea07
Removes spurious \r in output that causes logging in journalctl to tr…

b4274

Choose a tag to compare

@github-actions github-actions released this 06 Dec 04:38
7736837
fix(server) : not show alert when DONE is received (#10674)