Skip to content

Release b11433-ork

Choose a tag to compare

@github-actions github-actions released this 14 Oct 04:33
· 0 commits to master since this release

Automated release of llama.cpp with Rockchip NPU (ggml-ork) and GPU (ggml-vulkan) backends, rebased on upstream version b11433.

Included binaries (ARM64 / Linux):

  • llama-cli
  • llama-completion
  • llama-server
  • libllama.so and libggml*.so shared libraries

Upstream Release Notes


hexagon: add pool op support (#29995)

  • hexagon: add pool_2d support

  • hexagon: add pool_1d support

  • hex-pool: dma changes

  • hex-pool: Optimize HTP pooling boundaries and DMA pipelining

  • hex-pool: code cleanup and correctness fixes

  • hex-pool: re-write the DMA pipeline

  • hex-pool: pool chunking support

  • hex-pool: remove/vectorize all scalar paths

  • hex-pool: simplify chunk solver (no need for a loop)

  • hex-pool: remove redundant checks


Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: