Releases: hmartinez82/llama.cpp
Releases · hmartinez82/llama.cpp
Release list
b4879
b4781
gguf-py: enable reading non-native endian files (#12081) Currently self.byte_order is never used. Actually use it to byteswap read data to allow reading big endian files on little endian systems and vice versa. Now it's possible to convert little-endian model into a big-endian model and back on a little-endian system.
b4710
llamafile: use member variable instead of constant for iq4nlt (#11780)
b4501
rpc : early register backend devices (#11262) Early register RPC devices and do not propagate RPC specifics in the llama model structures. ref: #10609
b4484
b4466
Reset color before we exit (#11205) We don't want colors to leak post termination of llama-run. Signed-off-by: Eric Curtin <ecurtin@redhat.com>
b4462
gguf-py: fixed local detection of gguf package (#11180) * updated path to gguf package for non-installed setups * added reader.py to readme * Bumped gguf version to 0.15.0
b4410
common : disable KV cache shifting automatically for unsupported mode…
b4326
Removes spurious \r in output that causes logging in journalctl to tr…
b4274
fix(server) : not show alert when DONE is received (#10674)