Repository navigation
Docker Image
Image: ghcr.io/supersunho/docker-llama.cpp-arm64:b8252
Build Info
- Architecture: arm64
- llama.cpp Version: b8252
- Base Image: Ubuntu 22.04
- Compiler Cache: ccache enabled
- Optimizations: ccache, GHA cache
Usage
docker run -p 8080:8080 ghcr.io/supersunho/docker-llama.cpp-arm64:b8252Original llama.cpp Release Notes
llama-quant : left-align tensor names in output (#20117)
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: