Skip to content

ExLlamaSharp 1.1.0

Choose a tag to compare

View all tags
@Kortexio Kortexio released this 17 Aug 14:09
· 8 commits to main since this release
v1.1.0
2b172a6

Reliability release for the Windows Admin UI, service startup, and model downloads.

Install

Download ExLlamaSharp-Setup-win-x64.exe, run it (UAC), then open http://127.0.0.1:14563

  • Admin UI: admin / changeme (change this in Setup)
  • API key: sk-exllamasharp-dev
irm https://raw.githubusercontent.com/Kortexio/ExLlamaSharp/main/packaging/install-web.ps1 | iex

Fixes

  • Admin buttons only become clickable after the Blazor circuit is live (no dead first-run UI)
  • Service no longer crashes the host when a GPU model fails to load (ninja/CUDA)
  • Auto-load on boot now respects Load model on startup
  • Setup wizard actually enqueues Hugging Face downloads and no longer skips a failed admin save
  • Hugging Face pulls install huggingface_hub if missing
  • OpenAI API returns 502 when inference fails instead of an empty 200
  • Backup restore now brings back users, API keys, and model records
  • Bind/port from Settings are applied on the next service start
  • Native engine jobs call EngineStep so they cannot hang forever
Assets 4
Loading