Repository navigation
superfluid v0.1.5
·
282 commits
to main
since this release
Immutable
release. Only release title and notes can be modified.
superfluid 0.1.5
superfluid installs with Homebrew and npm. Each puts the release for this
machine on your PATH and updates it with the package manager:
brew install basecompute/tap/superfluid
npm install --global @basecompute/superfluidsuperfluid self update leaves a copy a package manager installed to that
manager, and says which command updates it. The install script and
cargo install superfluid work as before.
New
- Homebrew and npm packages.
basecompute/tap/superfluidinstalls the
release tarball whole and links the commands.@basecompute/superfluid
installs the release for this machine as one optional dependency
(@basecompute/superfluid-darwin-arm64,-linux-x64or-linux-arm64) and
runs the commands from it. Both carry aninstalled-byfile at the release's
root, whichself update,self listand the daily "newer release" line
read. - A fleet in
superfluid top. The head servesGET /metricswith a series
per node (superfluid_fleet_node_{up,lanes,lanes_active,queue_depth,pool_blocks_used,pool_blocks_total,decode_tokens_total}),
counting tokens as they arrive.superfluid top <head>shows one row per
node and follows nodes as they join and leave, andsuperfluid topwith no
address finds the head on the local network.
Changed
- A baseRT variant that is not installed is pulled as named where basert takes
one (0.4.2 and later):serve org/model:<variant>runs
basert pull org/model:<variant>, so a catalog variant such asdefault-f16,
or afile-…variant, is fetched as named rather than as the default quant,
and--pull-fileis no longer needed to serve one beside other models. An
older basert is given the id alone, as before. - llama.cpp b11890 is the build
superfluid runtime install llamacppinstalls,
tested beside b11889, b11642 and b11284. MLX installs 0.32.4 with mlx-lm
0.32.2; 0.32.2 with mlx-lm 0.31.3 stays tested.
Fixed
- A fleet head never announced itself on the local network, so
superfluid node joinwith no address found nothing, on macOS or Linux: the
service name was one byte over what mDNS allows, and the refusal reached no
one. The host is announced as one label too; macOS's name already ends in
.local. superfluid serve org/model:<variant>ranbasert pull org/modeleven when
that variant was installed, which fetched the default quant, or failed where
the repository has none (no pre-converted .base for quant "q4"); Local saw
this as an endless restart loop. An installed variant is now served as it
is, with no pull. A bare id still pulls, as does--pull-force.
See installation
for every way to install superfluid, and
updating
for how each is updated.