Repository navigation
Same model files; faster start of speech and a faster runtime on both chips.
Changed
- Firmware: playback starts as soon as the next chunks are sure to be ready, based on each model's measured RTF, and a slower model streams in smaller chunks. ESP32-S3: M starts speaking after 0.40–0.43 s (was 1.2–1.3 s), S after 0.21–0.27 s. ESP32-P4: M after 0.23–0.27 s (was 0.74–0.90 s), S after 0.08–0.09 s.
- Runtime: register-tiled fp32 conv for the token and duration blocks (about 40% faster), lighter int8 epilogue; bit-exact. ESP32-S3 RTF: S 0.28 → 0.26, M 0.51 → 0.49; ESP32-P4: S 0.17 → 0.15, M 0.27 → 0.24.
profsplits the vocoder into input conv, depthwise + LayerNorm, MLP (pw1, GELU + quantization, pw2), head and iSTFT.
Performance
| Board | Lite model (S): RTF / speech starts | Quality model (M): RTF / speech starts |
|---|---|---|
| ESP32-P4 (NANO, 86-Panel) | 0.15 / 0.08–0.09 s | 0.24 / 0.23–0.27 s |
| ESP32-S3 (EchoEar 2.0, Touch-LCD-2.8) | 0.26 / 0.21–0.27 s | 0.49 / 0.40–0.43 s |
Details: docs/reports/performance.md
Flash a board
gh release download v0.3.2 -R tuanpmt/vtts -p '*.vtts' -D models
cd firmware/esp32
BOARD=nano ./build.sh ../../models/vtts-vi-s-v0.1.q8.vtts ../../models/vtts-vi-m-v0.2.q8.vtts -p PORT flash monitorBOARD is panel, nano, s3 or echoear. Model files are CC BY-NC 4.0 (non-commercial); code is Apache-2.0.