Skip to content

Arc Llama 0.9.1

Choose a tag to compare

View all tags
@offbyonebit offbyonebit released this 07 Oct 18:54
· 21 commits to main since this release
v0.9.1
90d01c3
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Arc Llama 0.9.1 is a hotfix that restores model launches on current llama.cpp builds.

Fixed

  • Launch failures on current llama.cpp. Upstream replaced --no-mmap, --mlock and --mmap with --load-mode, and current llama-server builds reject the old flags with invalid argument. Arc Llama now probes the binary and launches with --load-mode when it is available: no_mmap becomes --load-mode none, mlock becomes --load-mode mmap+mlock, and both together become --load-mode mlock. Binaries older than llama.cpp b10105 keep the legacy flags. (#86, #87)

Who should upgrade

Anyone running a recent llama.cpp build with a recipe that sets no_mmap or mlock. Both options are off by default, so recipes that leave them unset were not affected.

Validation

  • Linux and Windows CI on Python 3.10, 3.12 and 3.14, bare-wheel installs, and the browser UI regression suite all pass.
  • A real chat request through Arc Llama succeeded on llama.cpp b10380 and b11476 (Intel Arc Pro B60, Linux, SYCL); the launch used --load-mode none on both.
  • Every flag Arc Llama can emit was accepted by b9174, b10380 and b11476.
  • This hotfix was not re-tested on Windows hardware or other Arc models; Windows is covered by CI only.

Known limitation

Flags you add yourself under extra_flags are passed through unchanged, so a hand-written --no-mmap or --mlock there will still be rejected by current llama.cpp builds. Use no_mmap / mlock in the recipe instead.

Install

python -m pip install --upgrade arc-llama
Assets 4
Loading