Skip to content

1.26.0

Choose a tag to compare

@deadprogram deadprogram released this 05 Sep 10:22
· 6 commits to main since this release

This release lets yzma run in a browser, and it checks what it installs.

  • WebAssembly. llama.cpp becomes a WebAssembly module, and a Go program compiled
    by TinyGo drives it through the new pkg/llamawasm package. There are three builds,
    and the JavaScript glue takes the best one the browser can run: WebGPU, more threads,
    or one thread. Text, embeddings, and images all work, with chat templates and tool
    calling. The names and the order of the calls are the same as in pkg/llama and
    pkg/mtmd. See wasm/README.md.
  • Digest checks. Install checks the SHA-256 of each file against the manifest that
    llama-cpp-builder publishes. A version takes the form VERSION@sha256:DIGEST to pin
    the manifest as well, and the new yzma verify command checks an installation later.
  • A pinned llama.cpp release. This release of yzma installs llama.cpp v0.4.0 when
    no version is given. Use --version latest to get the most recent nightly build.
  • mtmd gets TokenizeFromParts and InputPart, and llama gets a wrapper for
    llama_sampler_init_temp.
  • The installer follows the ROCm asset names of llama.cpp from b10356 and b10767.

What's Changed

Full Changelog: v1.25.0...v1.26.0