Expert Streaming Engine v0.1.0
Expert Streaming Engine v0.1.0
The first supported ESE release combines bounded sparse-MoE inference with the
new Linux ESE Studio desktop control center.
ESE engine
- Transparent
eseplanning and serving for resident, hybrid, bounded-cache,
and deferred-stream policies. - Native global RAM/VRAM/context/KV/expert allocation with explicit reserves.
- Bounded NVMe → RAM → VRAM expert caching across one, two, or three GPUs.
- Turbo KV/TCQ/VBR foundations, transient module sharing, and adaptive
speculation. - Verified Turing and Ampere CUDA coverage. Ada-or-newer runtime coverage is
not claimed because suitable hardware was unavailable.
ESE Studio for Linux
- Recursive GGUF discovery organized into collapsible model families.
- Configurable CLI applications in resizable embedded terminals, including
automatic detection for Codex, Claude Code, OpenCode, and Hermes. - Complete endpoint and model metadata handoff to endpoint-aware applications.
- Hardware-aware Hugging Face GGUF browsing with quant recommendations,
resumable downloads, live speed, ETA, and cancellation. - Real model-backed configuration sweeps that maximize safe context before
tuning stable throughput, with advanced objectives and checkpoint/resume. - Optional Help improve ESE sharing. Sanitized results enter a private
collector; only groups with at least three samples can become public.
Packages
The release includes DEB and RPM packages for x86-64 Linux plus SHA256SUMS.
ESE Studio requires the ese launcher and a locally built ESE runtime for model
serving. Windows, automatic updates, signed packages, and AppImage distribution
are deferred beyond this Linux-first release.
See the main guide,
Studio guide,
and benchmark record
for installation, operation, and measured reference results.