Skip to content

ExLlamaSharp 1.3.2.1

Latest

Choose a tag to compare

@Kortexio Kortexio released this 08 Sep 11:34
· 3 commits to main since this release

Summary

  • LAN access toggle in Settings/Setup with firewall rule helper (Tray elevated netsh).
  • Worker hardening: prompt_too_long / kv_cache_full fail-fast, Triton warmup, max_new clamp to remaining context.
  • Clearer OpenAI timeout messaging; default max tokens / batch context tuning for 12 GB GPUs.

Install

Download ExLlamaSharp-Setup-win-x64.exe, run as Administrator, choose Desktop mode.