ExLlamaSharp 1.1.1

Admin Models now shows whether each EXL3 model fits this GPU's VRAM. The installer still bundles the ExLlamaV3 CUDA extension.

Install

Download ExLlamaSharp-Setup-win-x64.exe, run it (UAC), then open http://127.0.0.1:14563

• Admin UI: admin / changeme (change this in Setup)
• API key: sk-exllamasharp-dev

irm https://raw.githubusercontent.com/Kortexio/ExLlamaSharp/main/packaging/install-web.ps1 | iex

Changes

• Models shows a Fits / Tight / Too large badge against this machine's GPU VRAM (estimate from weight size; it does not auto-select a model)
• Removed the Hugging Face Downloads column from the library list
• Setup pip steps no longer fail when pip uninstall has nothing to remove
• Setup.exe bundles the ExLlamaV3 CUDA .pyd, worker deps, Python installer and VC++; PyTorch CUDA still downloads during install