llamafile v0.10.4

[aittalam]

What's Changed

The most exciting feature that this release of llamafile brings is the first version of transcribefile! Our transcribefile is nothing more than a cosmocc-build of the CLI tool from transcribe.cpp, @cjpais' ggml-based Speech-to-Text library that supports 16+ model families 💙 For more details, see CJ's post and Mozilla.ai's annoucement.

In addition to this, a new sync with upstream llama.cpp (which will be soon replaced by a more recent one, as I let too much time pass before the release 😬); few improvements to Vulkan and ROCm acceleration; HTTPS support (both for the server and to download models from HF given their IDs); and pledge/SECCOMP sandboxing.

Thanks everyone for improving llamafile with issues and PRs!

• Probe GPU device count out-of-process on Windows (Bug: uncaught SIGSEGV in llamafile-0.10.2 #988 follow-up) by @aittalam in Probe GPU device count out-of-process on Windows (#988 follow-up) #994
• docs: redirect GitHub Pages docs to GitBook by @angpt in docs: redirect GitHub Pages docs to GitBook #993
• ROCm shell script improvements by @aittalam in ROCm shell script improvements #995
• docs(support): add GPU backend status table & acceleration verification (Docs: document supported GPU backends and known limitations #996) by @Anai-Guo in docs(support): add GPU backend status table & acceleration verification (#996) #997
• skill: guardrail llama.cpp update workflow with patch commands by @aittalam in skill: guardrail llama.cpp update workflow with patch commands #998
• Update llama.cpp to b9747 (d6d8995) by @aittalam in Update llama.cpp to b9747 (d6d8995) #1000
• chore: upgrade and digest pin all action digests by @RichardoC in chore: upgrade and digest pin all action digests #1002
• CPU / GPU fixes + harness for upstream ggml's test-backend-ops by @aittalam in CPU / GPU fixes + harness for upstream ggml's test-backend-ops #1004
• vulkan: clearer message when --gpu vulkan is explicitly unavailable by @aittalam in vulkan: clearer message when --gpu vulkan is explicitly unavailable #1006
• Fixes CTRL+C bug in chat mode by @aittalam in Fixes CTRL+C bug in chat mode #1009
• transcribefile: CPU build of transcribe.cpp + sync to df1a4ad by @aittalam in transcribefile: CPU build of transcribe.cpp + sync to df1a4ad #1007
• Updated runner to 16-core by @aittalam in Updated runner to 16-core #1005
• transcribefile: Metal GPU support via llamafile's runtime loader by @aittalam in transcribefile: Metal GPU support via llamafile's runtime loader #1010
• Add HTTPS support via cpp-httplib's mbedtls backend by @aittalam in Add HTTPS support via cpp-httplib's mbedtls backend #1011
• feat(help): list all accepted llama.cpp options in --help by @RichardoC in feat(help): list all accepted llama.cpp options in --help #1003
• Bring back pledge/SECCOMP sandboxing (Bring back pledge/SECCOMP sandboxing #930) by @aittalam in Bring back pledge/SECCOMP sandboxing (#930) #1015

New Contributors

• @Anai-Guo made their first contribution in docs(support): add GPU backend status table & acceleration verification (#996) #997
• @RichardoC made their first contribution in chore: upgrade and digest pin all action digests #1002

Full Changelog: 0.10.3...0.10.4

---

This discussion was created from the release llamafile v0.10.4.