Skip to content

superfluid v0.1.5

Choose a tag to compare

@github-actions github-actions released this 27 Oct 02:44
· 282 commits to main since this release
Immutable release. Only release title and notes can be modified.
ce46155

superfluid 0.1.5

superfluid installs with Homebrew and npm. Each puts the release for this
machine on your PATH and updates it with the package manager:

brew install basecompute/tap/superfluid
npm install --global @basecompute/superfluid

superfluid self update leaves a copy a package manager installed to that
manager, and says which command updates it. The install script and
cargo install superfluid work as before.

New

  • Homebrew and npm packages. basecompute/tap/superfluid installs the
    release tarball whole and links the commands. @basecompute/superfluid
    installs the release for this machine as one optional dependency
    (@basecompute/superfluid-darwin-arm64, -linux-x64 or -linux-arm64) and
    runs the commands from it. Both carry an installed-by file at the release's
    root, which self update, self list and the daily "newer release" line
    read.
  • A fleet in superfluid top. The head serves GET /metrics with a series
    per node (superfluid_fleet_node_{up,lanes,lanes_active,queue_depth,pool_blocks_used,pool_blocks_total,decode_tokens_total}),
    counting tokens as they arrive. superfluid top <head> shows one row per
    node and follows nodes as they join and leave, and superfluid top with no
    address finds the head on the local network.

Changed

  • A baseRT variant that is not installed is pulled as named where basert takes
    one (0.4.2 and later): serve org/model:<variant> runs
    basert pull org/model:<variant>, so a catalog variant such as default-f16,
    or a file-… variant, is fetched as named rather than as the default quant,
    and --pull-file is no longer needed to serve one beside other models. An
    older basert is given the id alone, as before.
  • llama.cpp b11890 is the build superfluid runtime install llamacpp installs,
    tested beside b11889, b11642 and b11284. MLX installs 0.32.4 with mlx-lm
    0.32.2; 0.32.2 with mlx-lm 0.31.3 stays tested.

Fixed

  • A fleet head never announced itself on the local network, so
    superfluid node join with no address found nothing, on macOS or Linux: the
    service name was one byte over what mDNS allows, and the refusal reached no
    one. The host is announced as one label too; macOS's name already ends in
    .local.
  • superfluid serve org/model:<variant> ran basert pull org/model even when
    that variant was installed, which fetched the default quant, or failed where
    the repository has none (no pre-converted .base for quant "q4"); Local saw
    this as an endless restart loop. An installed variant is now served as it
    is, with no pull. A bare id still pulls, as does --pull-force.

See installation
for every way to install superfluid, and
updating
for how each is updated.