Skip to content

v0.3.2

Latest

Choose a tag to compare

@tuanpmt tuanpmt released this 17 Nov 07:02
· 69 commits to main since this release

Same model files; faster start of speech and a faster runtime on both chips.

Changed

  • Firmware: playback starts as soon as the next chunks are sure to be ready, based on each model's measured RTF, and a slower model streams in smaller chunks. ESP32-S3: M starts speaking after 0.40–0.43 s (was 1.2–1.3 s), S after 0.21–0.27 s. ESP32-P4: M after 0.23–0.27 s (was 0.74–0.90 s), S after 0.08–0.09 s.
  • Runtime: register-tiled fp32 conv for the token and duration blocks (about 40% faster), lighter int8 epilogue; bit-exact. ESP32-S3 RTF: S 0.28 → 0.26, M 0.51 → 0.49; ESP32-P4: S 0.17 → 0.15, M 0.27 → 0.24.
  • prof splits the vocoder into input conv, depthwise + LayerNorm, MLP (pw1, GELU + quantization, pw2), head and iSTFT.

Performance

Board Lite model (S): RTF / speech starts Quality model (M): RTF / speech starts
ESP32-P4 (NANO, 86-Panel) 0.15 / 0.08–0.09 s 0.24 / 0.23–0.27 s
ESP32-S3 (EchoEar 2.0, Touch-LCD-2.8) 0.26 / 0.21–0.27 s 0.49 / 0.40–0.43 s

Details: docs/reports/performance.md

Flash a board

gh release download v0.3.2 -R tuanpmt/vtts -p '*.vtts' -D models
cd firmware/esp32
BOARD=nano ./build.sh ../../models/vtts-vi-s-v0.1.q8.vtts ../../models/vtts-vi-m-v0.2.q8.vtts -p PORT flash monitor

BOARD is panel, nano, s3 or echoear. Model files are CC BY-NC 4.0 (non-commercial); code is Apache-2.0.