Repository navigation
Releases: segestic/llama.cpp
Release list
b6018
test-backend-ops : extend test case filtering (ggml-org#14865)
- Extend test case filtering
- Allow passing multiple (comma-separated?) ops to test-backend-ops. This can be convenient when working on a set of ops, when you'd want to test them together (but without having to run every single op). For example:
test-backend-ops.exe test -o "ADD,RMS_NORM,ROPE,SILU,SOFT_MAX"
- Support full test-case variation string in addition to basic op names. This would make it easy to select a single variation, either for testing or for benchmarking. It can be particularly useful for profiling a particular variation (ex. a CUDA kernel), for example:
test-backend-ops.exe perf -b CUDA0 -o "MUL_MAT(type_a=f16,type_b=f32,m=4096,n=512,k=14336,bs=[1,1],nr=[1,1],per=[0,1,2,3],v=2)"
These two can be combined. As the current -o, this change doesn't try to detect/report an error if an filter doesn't name existing ops (ex. misspelled)
-
Updating the usage help text
-
Update tests/test-backend-ops.cpp
extra bench
b5904
llama: add LLAMA_API to deprecated llama_kv_self_seq_div (ggml-org#14708)
Add LLAMA_API to fix the run-time error with llama-cpp-python in Windows env:
attributeError: function 'llama_kv_self_seq_div' not found.
Did you mean: 'llama_kv_self_seq_add'?
Although llama_kv_self_seq_div() has been marked deprecated but
it is necessary to export it to make llama-cpp-python happy.
Observed software version:
OS: windows
compiler: MSVC
llama-cpp-python: tag: v0.3.12-cu124
llama.cpp: tag: b5833
Signed-off-by: Min-Hua Chen minhuadotchen@gmail.com
Co-authored-by: Min-Hua Chen minhua.chen@neuchips.ai
Compiled build for the Android platform with the arm64-v8a ABI, targeting Android API level 28, optimized for the armv8.7a architecture, and configured to build as a shared library using the specified C and C++ compiler flags.
#android (armv8.7a) compiled file added - seg