Skip to content

arc-llama 0.8.0

Choose a tag to compare

View all tags
@offbyonebit offbyonebit released this 05 Sep 16:35
· 52 commits to main since this release
v0.8.0
f1a088d

Cross-platform release of arc-llama 0.8.0.

Highlights:

  • Safe speculative decoding with capability validation and target-only fallback.
  • Community tune-recipe registry with explicit sharing.
  • Installable plugin extension point.
  • Open WebUI and LM Studio integration support.
  • Docker Compose support with Linux GPU group handling.
  • Windows runtime installation fallback for assetless GitHub latest releases.
  • Windows console encoding support for legacy code pages.

Validation:

  • Linux Intel Arc B60 end-to-end inference passed.
  • Windows Intel Arc B60 Vulkan end-to-end inference passed.
  • Windows Intel Arc B60 SYCL GPU discovery, model startup, and streaming inference passed.
  • 694 tests passed and 31 skipped in the Windows environment.
  • Ruff passed.
  • Wheel and source archive built successfully.

The same 0.8.0 package supports Linux and Windows. Windows llama.cpp runtime binaries are downloaded by install-runtime.

Assets 4
Loading