Skip to content

Build 1

Pre-release
Pre-release

Choose a tag to compare

View all tags
@miltos22 miltos22 released this 26 Jul 20:54
· 23 commits to main since this release
Build_1
439ebad

I will look into adding vulkan and Arm support very soon as well as finish working on the tiering from disk. Currently all benefit resides in tiering experts between RAM and VRAM better. I will actively support anyone who has issues as its in early testing and want to get it working on every system.

Note if you are on linux it does work. For less technical users all you have to do is this:

cd to the location you want and

git clone https://github.com/miltos22/llama-wackMall.git
cd llama-wackMall
cmake -B build -DGGML_CUDA=ON
cmake --build build -j $(nproc)

Assets 4
Loading