Skip to content

Releases: segestic/llama.cpp

Release list

b6018

Choose a tag to compare

@segestic segestic released this 29 Jul 09:01
bda6219

test-backend-ops : extend test case filtering (ggml-org#14865)

  • Extend test case filtering
  1. Allow passing multiple (comma-separated?) ops to test-backend-ops. This can be convenient when working on a set of ops, when you'd want to test them together (but without having to run every single op). For example:

test-backend-ops.exe test -o "ADD,RMS_NORM,ROPE,SILU,SOFT_MAX"

  1. Support full test-case variation string in addition to basic op names. This would make it easy to select a single variation, either for testing or for benchmarking. It can be particularly useful for profiling a particular variation (ex. a CUDA kernel), for example:

test-backend-ops.exe perf -b CUDA0 -o "MUL_MAT(type_a=f16,type_b=f32,m=4096,n=512,k=14336,bs=[1,1],nr=[1,1],per=[0,1,2,3],v=2)"

These two can be combined. As the current -o, this change doesn't try to detect/report an error if an filter doesn't name existing ops (ex. misspelled)

  • Updating the usage help text

  • Update tests/test-backend-ops.cpp

extra bench

b5904

Choose a tag to compare

@segestic segestic released this 01 Aug 10:50
79e0b68

llama: add LLAMA_API to deprecated llama_kv_self_seq_div (ggml-org#14708)

Add LLAMA_API to fix the run-time error with llama-cpp-python in Windows env:
attributeError: function 'llama_kv_self_seq_div' not found.
Did you mean: 'llama_kv_self_seq_add'?

Although llama_kv_self_seq_div() has been marked deprecated but
it is necessary to export it to make llama-cpp-python happy.

Observed software version:
OS: windows
compiler: MSVC
llama-cpp-python: tag: v0.3.12-cu124
llama.cpp: tag: b5833

Signed-off-by: Min-Hua Chen minhuadotchen@gmail.com
Co-authored-by: Min-Hua Chen minhua.chen@neuchips.ai

Compiled build for the Android platform with the arm64-v8a ABI, targeting Android API level 28, optimized for the armv8.7a architecture, and configured to build as a shared library using the specified C and C++ compiler flags.
#android (armv8.7a) compiled file added - seg