ExLlamaSharp 1.2.0-beta

Pre-release: concurrent EXL3 sequences now share one GPU forward pass (jsonl-v2 worker + .NET admission). This is not the GitHub Latest download; stable remains 1.1.1.

Install

Download ExLlamaSharp-Setup-win-x64.exe from this pre-release (not the one-liner, which still installs 1.1.1). Run it (UAC), then open http://127.0.0.1:14563

• Admin UI: admin / changeme (change this in Setup)
• API key: sk-exllamasharp-dev

Changes

• Real continuous batching: Python ExLlamaV3 Generator.iterate() multiplexes jobs; .NET admits by priority and streams SSE live
• OpenAI /v1/chat/completions and /v1/completions share one runner and SSE writer
• Worker split into locator, jsonl client, admission queue, and protocol types (SOLID)
• Mock and native engines unchanged

Notes

Treat this as a beta. Keep a 1.1.1 install if you need the last stable build.