Repository navigation
Releases: henri-edh/llama.cpp
Releases · henri-edh/llama.cpp
Release list
b4890
b4710
llamafile: use member variable instead of constant for iq4nlt (#11780)
b4699
HIP: Remove GCN from list of devices that avoid MMQ (#11831)
b4549
CANN: Add Ascend CANN build ci (#10217) * CANN: Add Ascend CANN build ci * Update build.yml * Modify cann image version * Update build.yml * Change to run on x86 system * Update build.yml * Update build.yml * Modify format error * Update build.yml * Add 'Ascend NPU' label restrictions * Exclude non PR event Co-authored-by: Yuanhao Ji <jiyuanhao@apache.org> * Update build.yml --------- Co-authored-by: Yuanhao Ji <jiyuanhao@apache.org>
b4490
vulkan: scale caching for k quants + misc fixes (#11081) * q6_k scale caching * 16 bit unpack * q4_k test (slow) * revert it * q3_k * q2_k * little stuff * try precalculating products of a and q2_k scales * Revert "try precalculating products of a and q2_k scales" This reverts commit 65110b81f23f66331a50c6e889a7c1ab9470a86b. * unpack should be u16, add vim swap to gitignore (about time) * better q4_k scales * q5_k * better q6_k with separate paths for all threads and partial threads in use, plus some more optimizations * q2_k better dequant * q3_k optimizations * q3_k use hmask simd from cpu avx version * make the caches happy * q3_k separate out calculation * q2_k separate out * little stuff * use calc_superblock everywhere * q2_k optimize scale calculation * more barriers
b4418
Vulkan: Add device-specific blacklist for coopmat for the AMD proprie…
b4328
nix: allow to override rocm gpu targets (#10794) This allows to reduce compile time when you are building for a single GPU.
b4295
CUDA: fix shared memory access condition for mmv (#10740)
b4290
server : bring back info of final chunk in stream mode (#10722) * server : bring back into to final chunk in stream mode * clarify a bit * traling space
b4125
Skip searching root path for cross-compile builds (#10383)