Skip to content

TurboQuant b10018-1.1.1

Choose a tag to compare

View all tags
@github-actions github-actions released this 23 Jul 22:49
b10018-1.1.1
d4db42d

TurboQuant KV Cache — b10018-1.1.1

Built from master at commit d4db42d39, based on upstream llama.cpp b10018.

What's included

  • llama-server with --cache-type-k turbo3 / turbo4 support
  • llama-cli, llama-bench, llama-perplexity, llama-quantize
  • All supported backends in one release:
Backend Asset
Linux x64 (Vulkan + portable CPU) llama-turboquant-linux-x64-vulkan.tar.gz
Linux x64 CUDA 13.3 (+ portable CPU) llama-turboquant-linux-x64-cuda-13.3.tar.gz
Windows x64 CPU llama-turboquant-windows-x64-cpu.zip
Windows x64 Vulkan llama-turboquant-windows-x64-vulkan.zip
Windows x64 CUDA 12.4 llama-turboquant-windows-x64-cuda-12.4.zip
Windows x64 CUDA 13.3 llama-turboquant-windows-x64-cuda-13.3.zip
macOS ARM64 (Metal, signed + notarized) llama-turboquant-macos-arm64.zip

Versioning

<upstream-base>-<fork-semver>: b10018 is the upstream llama.cpp build this fork is based on, 1.1.1 is the TurboQuant fork version. llama-server --version reports version: b10018-1.1.1.

Assets 12
Loading