Skip to content

FunASR llama.cpp runtime v0.1.7

Choose a tag to compare

View all tags
@github-actions github-actions released this 18 Jul 19:54
runtime-llamacpp-v0.1.7
f1e287e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime: SenseVoice, Paraformer and Fun-ASR-Nano with built-in FSMN-VAD. Download the default quantized model with bash download-funasr-model.sh <sensevoice|paraformer|nano> (the helper requires the Hugging Face CLI: pip install -U huggingface_hub), then run llama-funasr-cli / llama-funasr-sensevoice / llama-funasr-paraformer. Use the default x64 asset for maximum CPU compatibility; use the x64-avx2 asset on CPUs with AVX2/FMA/F16C/BMI2 for higher throughput. The Windows CUDA asset is windows-x64-cuda; it requires an NVIDIA driver compatible with the CUDA Toolkit version configured by the release workflow, targets CUDA architecture 86, and enables SenseVoiceSmall graph execution with llama-funasr-sensevoice ... --backend cuda. Build from source for other GPU architectures. No Python ASR runtime or local build is required. Docs: https://github.com/modelscope/FunASR/blob/runtime-llamacpp-v0.1.7/runtime/llama.cpp/README.md

Assets 9
Loading