Repository navigation
Arc Llama 0.9.1.2 makes the path from finding a model to chatting on Intel Arc easier to follow, and adds stronger cleanup and recovery around runtime compatibility checks.
Models and interface
- Hugging Face discovery sits beside your local library, with publisher avatars, exact quant choices, estimated memory fit, background downloads, and automatic model registration.
- Review a model and its settings before opening chat. Setup and recovery guidance explain the next action.
- Check a local GGUF or a selected Hugging Face file against your installed llama.cpp runtime. Explicit architecture rejections are shown separately from memory-fit warnings. Recognition alone does not guarantee every encoding or model will load or run.
- Chat adds Stop with partial-answer preservation, regenerate/edit, context estimates, per-model prompt and temperature presets, and image attachments for vision models.
- The README includes a six-screen screenshot walkthrough. An offline gallery provides thumbnails, keyboard navigation, and mobile swipe.
Runtime, integrations, and tuning
- Canary-checked runtime updates install beside the existing runtime before switching; rollback restores the previous installation.
- Vision projectors are paired during discovery and download, included in memory estimates, and passed to the runtime. Split GGUFs register as one model and fetch all shards. Text-only models reject image requests before loading.
- Versioned plugin API 1.0 provides authenticated admin access, GPU leases, lifecycle events, status, and plugin tooling. Incompatible plugins are reported instead of loaded.
- Reranker models support
POST /v1/rerank;/v1/modelsreports capabilities and context size. - API keys and LAN mode support remote clients while native model backends remain bound to loopback.
- Depth benchmarks, automatic speculative-draft comparisons, driver-aware recipe invalidation, and hourly performance history improve tuning visibility.
- Multi-GPU tensor split is available as an experimental option.
Reliability
- Runtime compatibility checks have bounded network reads, deadlines, and limited concurrency. Disconnects, runtime changes, and shutdown cancel pending work, close streams, and reap probe subprocesses.
- Abandoned or stale browser requests cannot overwrite a newer result. Failed checks remain retryable with clearer access, file, and runtime messages.
- Light-theme settings fields remain readable. Browser regressions are split into focused modules, with added cancellation coverage.
- Native inference smoke tests close subprocess pipes after cleanup so successful inference passes strict warning checks. File-replacement regression tests no longer depend on filesystem timestamp resolution.
Validation and coverage
- Linux and Windows CI on Python 3.10, 3.12, and 3.14, browser regressions, and bare-wheel installs pass.
- Local Linux suites pass 1,300 tests with warnings treated as errors on each supported Python version. Live inference is validated separately; 33 browser regressions pass. Windows CI passes 1,278 tests with 22 platform-specific skips and the opt-in inference smoke excluded; Linux CI skips only that smoke.
- A real Intel Arc Pro B60 (24 GiB), Linux, SYCL journey passed: fresh setup, real Hugging Face Qwen2.5-0.5B Q4_K_M download and registration, settings, streamed and non-streamed GPU inference, history, Stop/recovery, architecture rejection, and server restart. The marked native CLI smoke also passes with strict warnings.
- Wheel/source metadata and package contents were checked; a bare Python 3.10 installation and its packaged UI checks pass.
- Physical Windows hardware, other Arc GPUs, Vulkan inference, multi-GPU inference, and the separate vision companion's image-rendering workflow were not rerun for this release. Windows is covered by CI, not a new hardware certification. Vision and multi-GPU support depend on the installed runtime and model.
The requested four-component version 0.9.1.2 is a valid Python package version under PEP 440.
Install or upgrade
python -m pip install --upgrade arc-llama==0.9.1.2See the full changelog for details. Updating Arc Llama does not itself replace your installed llama.cpp runtime; use the runtime update command when you want to update it.