Skip to content

FunASR llama.cpp runtime v0.1.3

Choose a tag to compare

View all tags
@LauraGPT LauraGPT released this 28 Jun 17:26
runtime-llamacpp-v0.1.3
266faea
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Portable rebuild of the FunASR llama.cpp / GGUF runtime binaries.

This release rebuilds the v0.1.2 runtime with conservative CPU flags for the generic x64 assets. In particular, it disables ggml native CPU tuning and high-ISA AVX/AVX2/AVX512/VNNI/FMA/F16C/BMI2 flags so the prebuilt binaries do not depend on the GitHub Actions runner CPU instruction set.

Use this version if v0.1.2 crashes with Illegal instruction, SIGILL, or Windows error 0xC000001D.

Assets 6
Loading