How to build llama.cpp on your installed Kan‐Linux

llama.cpp is our featured, customized local AI inference engine in Kan-Linux. Here are the steps to build llama.cpp on your installed Kan-Linux.

Project ggml-hexagon is our fully open-source & customized llama.cpp. It adds some features that upstream llama.cpp does not support.

git clone https://github.com/kan-linux/ggml-hexagon

cd ggml-hexagon

./scripts/build-run-ggmlvulkan-x86-linux.sh (will download Vulkan SDK automatically)

source prebuilts/Vulkan_SDK/1.4.304.1/setup-env.sh

vulkaninfo

vulkanCapsViewer

./scripts/build-run-ggmlvulkan-x86-linux.sh build

./scripts/build-run-ggmlvulkan-x86-linux.sh run_llamacli qwen3-2b