llamafile v0.10.5

[aittalam]

What's Changed

0.10.5 is a release that focused on making the "sync with upstream llama.cpp" task simpler and better. In the span of 2 weeks we performed three syncs and took advantage of these iterations to improve the llamafile skill/plugin for AI agents. The result is a better process that provides more reliable code, requiring fewer iterations to go from an auto-generated draft PR to the final merged code. As a byproduct, llamafile now supports very recent models such as Ternary Bonsai 27B and Laguna-S-2.1.

Thanks to our community's contributions, this release also brings significant documentation updates clarifying the new help system, the difference between different lllamafile executables, and up-to-date llamafile GPU support. Many thanks everyone for the huge help!

• Update llama.cpp to b10052 (b2dd28a) by @aittalam in Update llama.cpp to b10052 (b2dd28a) #1021
• Update llama.cpp to b10083 (846e991) by @aittalam in Update llama.cpp to b10083 (846e991) #1026
• Improve llamacpp update skill by @aittalam in Improve llamacpp update skill #1027
• Update llama.cpp to b10103 (c588c4f) by @aittalam in Update llama.cpp to b10103 (c588c4f) #1030
• docs(quickstart): clarify llamafile vs llamafile-thin and other release binaries (Docs: clarify difference between llamafile and llamafile-thin #1022) by @Anai-Guo in docs(quickstart): clarify llamafile vs llamafile-thin and other release binaries (#1022) #1023
• build(install): install transcribefile so it ships as a release artifact (transcribefile not included as a release artifact #1035) by @Anai-Guo in build(install): install transcribefile so it ships as a release artifact (#1035) #1036
• Fix typo in README.md for 'architectures' by @shawntax in Fix typo in README.md for 'architectures' #1031
• docs: Add docs for cli args and tools by @angpt in docs: Add docs for cli args and tools #1037
• docs(support): document the Vulkan GPU backend (docs: Vulkan backend support #1029) by @Anai-Guo in docs(support): document the Vulkan GPU backend (#1029) #1033

New Contributors

• @shawntax made their first contribution in Fix typo in README.md for 'architectures' #1031

Full Changelog: 0.10.4...0.10.5

---

This discussion was created from the release llamafile v0.10.5.