Repository navigation
v0.6.0 — the package runs again
If you installed arc-llama from PyPI any time in the last three weeks, it did not work. This release fixes that. 0.4.0 and 0.5.0 could not run a single command, including arc-llama --version, on a default pip install. 0.3.0 was the last release that ran.
Fixes
The package works again. The CLI imported the optional [tui] extra at module scope, so every command died with arcllama requires textual unless you happened to install extras. (#49)
Vulkan no longer runs on the wrong GPU. arc-llama passed the SYCL device index as a Vulkan device index. SYCL enumerates Intel devices only; Vulkan enumerates every vendor. On a machine with a discrete NVIDIA or AMD card next to an Arc, models silently ran on the other vendor's GPU and looked like they were working. The index is now resolved from llama-server --list-devices, and when it cannot be resolved arc-llama warns rather than guessing. (#52, fixes #51)
The server shuts down. On Python 3.10 and 3.11, asyncio.wait_for discards a CancelledError that arrives after its inner future resolved, which is exactly the window the auto-tune loop's stop path hit every time. Shutdown hung forever and left llama-server running. (#48)
No more orphaned subprocesses or leaked log handles on shutdown. (#45)
The admin token is no longer printed at startup, and list sends its auth header. (#44)
Expert-count detection, read-only config survival, and --config actually being honoured. (#46)
Auto-tune on idle measures the recipe instead of guessing it. (#47)
Guardrails
CI now installs the built wheel with no extras and runs every command, so a packaging break cannot ship green again. (#50)
Verified on hardware before tagging
Bare wheel install on Python 3.10, init GPU detection, install-runtime download, generation on both the SYCL build and the downloaded portable Vulkan build, model swapping, SSE streaming, and clean shutdown on 3.11 and 3.12 with zero orphaned processes.
pip install --upgrade arc-llama