Skip to content

Arc Llama 0.9.1.2

Latest

Choose a tag to compare

@offbyonebit offbyonebit released this 11 Oct 01:19
· 1 commit to main since this release
9413d2d

Arc Llama 0.9.1.2 makes the path from finding a model to chatting on Intel Arc easier to follow, and adds stronger cleanup and recovery around runtime compatibility checks.

Models and interface

  • Hugging Face discovery sits beside your local library, with publisher avatars, exact quant choices, estimated memory fit, background downloads, and automatic model registration.
  • Review a model and its settings before opening chat. Setup and recovery guidance explain the next action.
  • Check a local GGUF or a selected Hugging Face file against your installed llama.cpp runtime. Explicit architecture rejections are shown separately from memory-fit warnings. Recognition alone does not guarantee every encoding or model will load or run.
  • Chat adds Stop with partial-answer preservation, regenerate/edit, context estimates, per-model prompt and temperature presets, and image attachments for vision models.
  • The README includes a six-screen screenshot walkthrough. An offline gallery provides thumbnails, keyboard navigation, and mobile swipe.

Runtime, integrations, and tuning

  • Canary-checked runtime updates install beside the existing runtime before switching; rollback restores the previous installation.
  • Vision projectors are paired during discovery and download, included in memory estimates, and passed to the runtime. Split GGUFs register as one model and fetch all shards. Text-only models reject image requests before loading.
  • Versioned plugin API 1.0 provides authenticated admin access, GPU leases, lifecycle events, status, and plugin tooling. Incompatible plugins are reported instead of loaded.
  • Reranker models support POST /v1/rerank; /v1/models reports capabilities and context size.
  • API keys and LAN mode support remote clients while native model backends remain bound to loopback.
  • Depth benchmarks, automatic speculative-draft comparisons, driver-aware recipe invalidation, and hourly performance history improve tuning visibility.
  • Multi-GPU tensor split is available as an experimental option.

Reliability

  • Runtime compatibility checks have bounded network reads, deadlines, and limited concurrency. Disconnects, runtime changes, and shutdown cancel pending work, close streams, and reap probe subprocesses.
  • Abandoned or stale browser requests cannot overwrite a newer result. Failed checks remain retryable with clearer access, file, and runtime messages.
  • Light-theme settings fields remain readable. Browser regressions are split into focused modules, with added cancellation coverage.
  • Native inference smoke tests close subprocess pipes after cleanup so successful inference passes strict warning checks. File-replacement regression tests no longer depend on filesystem timestamp resolution.

Validation and coverage

  • Linux and Windows CI on Python 3.10, 3.12, and 3.14, browser regressions, and bare-wheel installs pass.
  • Local Linux suites pass 1,300 tests with warnings treated as errors on each supported Python version. Live inference is validated separately; 33 browser regressions pass. Windows CI passes 1,278 tests with 22 platform-specific skips and the opt-in inference smoke excluded; Linux CI skips only that smoke.
  • A real Intel Arc Pro B60 (24 GiB), Linux, SYCL journey passed: fresh setup, real Hugging Face Qwen2.5-0.5B Q4_K_M download and registration, settings, streamed and non-streamed GPU inference, history, Stop/recovery, architecture rejection, and server restart. The marked native CLI smoke also passes with strict warnings.
  • Wheel/source metadata and package contents were checked; a bare Python 3.10 installation and its packaged UI checks pass.
  • Physical Windows hardware, other Arc GPUs, Vulkan inference, multi-GPU inference, and the separate vision companion's image-rendering workflow were not rerun for this release. Windows is covered by CI, not a new hardware certification. Vision and multi-GPU support depend on the installed runtime and model.

The requested four-component version 0.9.1.2 is a valid Python package version under PEP 440.

Install or upgrade

python -m pip install --upgrade arc-llama==0.9.1.2

See the full changelog for details. Updating Arc Llama does not itself replace your installed llama.cpp runtime; use the runtime update command when you want to update it.