Skip to content

Releases: henri-edh/llama.cpp

b4890

Choose a tag to compare

@github-actions github-actions released this 15 Mar 06:20
92a3913
[CANN]MUL_MAT optimization (#12382)

b4710

Choose a tag to compare

@github-actions github-actions released this 13 Feb 20:06
8a8c4ce
llamafile: use member variable instead of constant for iq4nlt (#11780)

b4699

Choose a tag to compare

@github-actions github-actions released this 12 Feb 22:53
5c4284d
HIP: Remove GCN from list of devices that avoid MMQ (#11831)

b4549

Choose a tag to compare

@github-actions github-actions released this 25 Jan 03:28
466ea66
CANN: Add Ascend CANN build ci (#10217)

* CANN: Add Ascend CANN build ci

* Update build.yml

* Modify cann image version

* Update build.yml

* Change to run on x86 system

* Update build.yml

* Update build.yml

* Modify format error

* Update build.yml

* Add 'Ascend NPU' label restrictions

* Exclude non PR event

Co-authored-by: Yuanhao Ji <jiyuanhao@apache.org>

* Update build.yml

---------

Co-authored-by: Yuanhao Ji <jiyuanhao@apache.org>

b4490

Choose a tag to compare

@github-actions github-actions released this 16 Jan 01:49
adc5dd9
vulkan: scale caching for k quants + misc fixes (#11081)

* q6_k scale caching

* 16 bit unpack

* q4_k test (slow)

* revert it

* q3_k

* q2_k

* little stuff

* try precalculating products of a and q2_k scales

* Revert "try precalculating products of a and q2_k scales"

This reverts commit 65110b81f23f66331a50c6e889a7c1ab9470a86b.

* unpack should be u16, add vim swap to gitignore (about time)

* better q4_k scales

* q5_k

* better q6_k with separate paths for all threads and partial threads in use, plus some more optimizations

* q2_k better dequant

* q3_k optimizations

* q3_k use hmask simd from cpu avx version

* make the caches happy

* q3_k separate out calculation

* q2_k separate out

* little stuff

* use calc_superblock everywhere

* q2_k optimize scale calculation

* more barriers

b4418

Choose a tag to compare

@github-actions github-actions released this 05 Jan 03:28
b56f079
Vulkan: Add device-specific blacklist for coopmat for the AMD proprie…

b4328

Choose a tag to compare

@github-actions github-actions released this 14 Dec 22:15
e52aba5
nix: allow to override rocm gpu targets (#10794)

This allows to reduce compile time when you are building for a single GPU.

b4295

Choose a tag to compare

@github-actions github-actions released this 10 Dec 08:39
26a8406
CUDA: fix shared memory access condition for mmv (#10740)

b4290

Choose a tag to compare

@github-actions github-actions released this 08 Dec 22:34
e52522b
server : bring back info of final chunk in stream mode (#10722)

* server : bring back into to final chunk in stream mode

* clarify a bit

* traling space

b4125

Choose a tag to compare

@github-actions github-actions released this 18 Nov 18:14
531cb1c
Skip searching root path for cross-compile builds (#10383)