Skip to content

FunASR llama.cpp runtime v0.1.2

Choose a tag to compare

View all tags
@LauraGPT LauraGPT released this 21 Jun 17:55
runtime-llamacpp-v0.1.2
d60617a
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Prebuilt self-contained binaries for running SenseVoice (and Paraformer / Fun-ASR-Nano) locally with the FunASR llama.cpp / GGUF runtime — built-in FSMN-VAD, whisper.cpp-style on-device ASR, strong on Chinese & Cantonese.

New: q8 GGUF models are ~half the size of f16 with the same accuracy.

bash download-funasr-model.sh sensevoice ./gguf
llama-funasr-sensevoice -m ./gguf/sensevoice-small-q8.gguf --vad ./gguf/fsmn-vad.gguf -a audio.wav

No Python, no build. Linux (x64/arm64), macOS (arm64), Windows (x64). Docs: runtime/llama.cpp/README.md.

Assets 6
Loading