Skip to content

Releases: miltos22/llama-wackMall

Release list

main-b30-6aa17e3

main-b30-6aa17e3 Latest
Latest

Choose a tag to compare

View all tags
@github-actions github-actions released this 05 Aug 16:43
main-b30-6aa17e3
6aa17e3

Website:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Assets 24

temp

temp

Choose a tag to compare

View all tags
@miltos22 miltos22 released this 28 Jul 09:49
temp
7b727b1 
ci: remove release timeout, bump cuda to 3h, suppress NVCC warning 177

Assisted-by: Claude Sonnet
Loading

Build_2

Build_2

Choose a tag to compare

View all tags
@github-actions github-actions released this 28 Jul 11:30
Build_2
7b727b1

Website:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Loading

Build 1

Build 1 Pre-release
Pre-release

Choose a tag to compare

View all tags
@miltos22 miltos22 released this 26 Jul 20:54
Build_1
439ebad

I will look into adding vulkan and Arm support very soon as well as finish working on the tiering from disk. Currently all benefit resides in tiering experts between RAM and VRAM better. I will actively support anyone who has issues as its in early testing and want to get it working on every system.

Note if you are on linux it does work. For less technical users all you have to do is this:

cd to the location you want and

git clone https://github.com/miltos22/llama-wackMall.git
cd llama-wackMall
cmake -B build -DGGML_CUDA=ON
cmake --build build -j $(nproc)

Loading