Skip to content

v0.2.2 (superseded by v0.3.0): DGX Spark Full voice ~0.5 s voice to voice

Choose a tag to compare

View all tags
@drowzeys drowzeys released this 25 Oct 22:49
· 1 commit to main since this release
v0.2.2
533bf50

Superseded by v0.3.0.

A speed fix for v0.2.1: the DGX Spark's Full voice (Drama 3) answers in about 0.47–0.55 s voice to voice instead of 1.0–1.1 s. Update by running the install command again (it pulls the new code and keeps your models), then kgm restart; in Docker, pull 0.2.2.

Fixes

  • No Drama 3 keep-warm line on the DGX Spark. While you spoke, Boo kept Drama 3 busy with a throwaway "Mm.". The Spark's CUDA Drama 3 runs one synthesis at a time, so when you stopped, the reply's first sentence waited (503, retried) until that line ended, and the extra speech also slowed speech recognition and Bolt. On CUDA Drama 3 starts fast from idle anyway (~115 ms first audio), so the Spark profile now sets "keep_warm": false on the voice. Bolt is still kept warm; the Mac is unchanged. Applies to native installs and Docker.
  • Docker: Drama 3 is back on its fast kernel. The base image's cuBLASLt 13.6 made the Spark Drama 3 build turn its one-row tower kernel off. The TensorFold engines in the image now get the cuBLASLt 13.1 they are qualified with; PyTorch keeps the image's own.

Measured on one DGX Spark in Docker, 7 synthetic questions, two passes each, 0.5 s and 8 s between turns:

v0.2.1 v0.2.2
Voice to voice, median 1.01–1.13 s 0.47–0.55 s
Speech recognition 53–61 ms 28–30 ms
Bolt first token (from end of speech) 182–189 ms 92–96 ms
First audio (from end of speech) 880–1001 ms 308–422 ms

Install

curl -fsSL https://raw.githubusercontent.com/drowzeys/keys-ghost-machine-audio-visual-agent/main/install.sh | bash                    # Drama 3
curl -fsSL https://raw.githubusercontent.com/drowzeys/keys-ghost-machine-audio-visual-agent/main/install.sh | bash -s -- --voice lite  # Kokoro-82M
docker pull ghcr.io/drowzeys/keys-ghost-machine-audio-visual-agent:0.2.2

Image: ghcr.io/drowzeys/keys-ghost-machine-audio-visual-agent:0.2.2 (also latest), digest sha256:db11ca335e08f033a669900316563bde8bd6c80843db52d53c50e51262e0adc0.

Builds

The two engine archives are the v0.2.0 files, unchanged (same SHA-256), re-attached here so the installer finds them:

  • keys-boo-tensorfold-1.1.4-macos-arm64.tar.gz: 409b8572896316c66ff9e91d778aeab9ba8c85191fed629441698160a7874b8d
  • keys-boo-tensorfold-1.1.4-linux-aarch64.tar.gz: 0b95dd1d83ca2c4df3f557e7495ef1e1ac8a039e2b82ed6129b22670b670a545

Their contents, licences and sources are described in the v0.2.0 release and the README.

Assets 6
Loading