Skip to content

Expert Streaming Engine v0.1.0

Choose a tag to compare

@github-actions github-actions released this 21 Aug 23:51
· 109 commits to main since this release
34ed21c

Expert Streaming Engine v0.1.0

The first supported ESE release combines bounded sparse-MoE inference with the
new Linux ESE Studio desktop control center.

ESE engine

  • Transparent ese planning and serving for resident, hybrid, bounded-cache,
    and deferred-stream policies.
  • Native global RAM/VRAM/context/KV/expert allocation with explicit reserves.
  • Bounded NVMe → RAM → VRAM expert caching across one, two, or three GPUs.
  • Turbo KV/TCQ/VBR foundations, transient module sharing, and adaptive
    speculation.
  • Verified Turing and Ampere CUDA coverage. Ada-or-newer runtime coverage is
    not claimed because suitable hardware was unavailable.

ESE Studio for Linux

  • Recursive GGUF discovery organized into collapsible model families.
  • Configurable CLI applications in resizable embedded terminals, including
    automatic detection for Codex, Claude Code, OpenCode, and Hermes.
  • Complete endpoint and model metadata handoff to endpoint-aware applications.
  • Hardware-aware Hugging Face GGUF browsing with quant recommendations,
    resumable downloads, live speed, ETA, and cancellation.
  • Real model-backed configuration sweeps that maximize safe context before
    tuning stable throughput, with advanced objectives and checkpoint/resume.
  • Optional Help improve ESE sharing. Sanitized results enter a private
    collector; only groups with at least three samples can become public.

Packages

The release includes DEB and RPM packages for x86-64 Linux plus SHA256SUMS.
ESE Studio requires the ese launcher and a locally built ESE runtime for model
serving. Windows, automatic updates, signed packages, and AppImage distribution
are deferred beyond this Linux-first release.

See the main guide,
Studio guide,
and benchmark record
for installation, operation, and measured reference results.