Skip to content

v0.3.0: TensorFold 1.1.5

Latest
Latest

Choose a tag to compare

View all tags
@drowzeys drowzeys released this 26 Oct 00:12
v0.3.0
989f848

Boo moves to TensorFold 1.1.5. Bolt on a DGX Spark now runs on the stock TensorFold 1.1.5 release. The keys builds move to 1.1.5 as well: Bolt and Cosmos3-Edge on the Mac (one tensorfold-native with libbolt.dylib), and Cosmos3-Edge on CUDA.

To update, run the install command again, then kgm restart. In Docker, run docker pull ghcr.io/drowzeys/keys-ghost-machine-audio-visual-agent:0.3.0.

  • Same answers, same speed. Measured on an M5 Ultra against the 1.1.4 builds with the same flags:
    • Bolt's greedy replies are identical (7 of 7). Its first token is 77–81 ms on 1.1.5 and 79–80 ms on 1.1.4, at about 96 tokens a second on both.
    • Cosmos3-Edge's camera answers are identical (7 of 7), with a 78 ms first token on both.
  • The Mac's Drama 3 stays on the 1.1.4-keys.1 engine. The Mac archive ships it as bin/tensorfold-drama.
    • Stock 1.1.5 can read the NVFP4 pruned checkpoint on Metal and reuse a voice's reference prefill. Its first audio in a named voice, however, was 107–343 ms, against a steady 67–79 ms for the keys engine.
    • The DGX Spark's Drama 3 is unchanged: plotarmordev's NVFP4 fork with the voice-prefix cache and the silence guard.
  • The v0.2.2 fixes stay. The DGX Spark no longer speaks a Drama 3 keep-warm line, and the TensorFold engines in the Docker image keep cuBLASLt 13.1.

Mac voice to voice (16 synthetic questions): Full 0.45–0.71 s, Lite 0.53–0.57 s.

Assets: keys-boo-tensorfold-1.1.5-macos-arm64.tar.gz and keys-boo-tensorfold-1.1.5-linux-aarch64.tar.gz, each with its .sha256. These are unofficial community builds of TensorFold (Apache-2.0); each archive has its own README, change list, licences and SHA256SUMS.

Assets 6
Loading