Repository navigation
What's Changed
- Feature/prefix attention return full kv by @apt-install-coffee in #1205
- Add segment streaming and text controls to IndexTTS by @david-bowiegxw in #1206
- Sort saved voices and preserve playback while editing by @0xShug0 in #1207
- Refactor LFM3 Audio around shared LFM runtimes and weight helpers by @0xShug0 in #1210
- kitten_tts2: apply repetition penalty to the silence token by @Twistarkle in #1211
- Refactor Nemotron models with shared RoPE encoder and host CTC decoding by @0xShug0 in #1213
- omnivoice: fix CPU voice cloning (non-contiguous residual into ggml_sub in the audio tokenizer) by @ahmednabilfawzy89-cmyk in #1212
- Reuse shared host CTC decoding across ASR models by @0xShug0 in #1214
- Reduce Nemotron Transcribe transfers and unused prefill work by @0xShug0 in #1215
- Reduce streaming delay by @0xShug0 in #1216
- Reduce voice chat UI playback delay by @0xShug0 in #1219
- docs(drama3): document V2 checkpoint and comparison by @JarodMica in #1217
- Refactor HeartMuLa runtime and reduce memory usage by @0xShug0 in #1224
- package_manager: native Hugging Face Xet downloads by @drphero in #1222
- Add MuLaCover cover-song generation by @0xShug0 in #1226
- OmniVoice: native batching and faster generation by @kawshikbuet17 in #1208
- Allow configuring the WebUI models folder at server startup by @0xShug0 in #1227
- docs: add LocalText2Voice to the Projects list by @estebanstifli in #1228
- sanotts: return word timestamps with the NEON decoder by @tarelerulz in #1221
- pocket_tts: honour capitalize_first_letter from config.yaml by @michsethowusu in #1229
- Add MOSS-SoundEffect v2 sound-effect generation by @0xShug0 in #1232
- Refactor Drama3 and Nemotron Transcribe with shared MoE execution by @0xShug0 in #1234
- Refactor Ming3 Audio with shared MoE execution by @0xShug0 in #1238
- sense_asr: return word timestamps from CTC emission frames by @jiabochao in #1236
- feat: expose C API logging callback (audiocpp_log_set) by @kikaitachi in #1235
- Remove logging-only tensor readbacks and complete session timing by @0xShug0 in #1240
- Add SYCL backend support by @newjordan in #1241
- ggml-sycl: kernels and graph replay for audio models by @newjordan in #1242
- docs: add SYCL validation report by @newjordan in #1247
- ggml-sycl: add CONV_2D_DW and BF16/I32 CPY conversions by @newjordan in #1246
- Add opt-in BF16 activation rounding for Qwen3 TTS by @0xShug0 in #1248
- Stop WebUI model status flickering during downloads by @0xShug0 in #1249
- Run YuE2 on the SYCL backend by @newjordan in #1243
- Add session-owned PreparedGraph execution and scheduler support by @0xShug0 in #1250
- Add reusable device denoising and MOSS SoundEffect fusions by @0xShug0 in #1251
- server: accept inline voice_ref in task requests by @magnus-dev-melin in #1252
- 🚨 Add shared DiT runtime and migrate denoiser models by @0xShug0 in #1254
- server: return 400 for an inline voice_ref that is not a WAV by @magnus-dev-melin in #1255
- chatterbox: cache prepared voice-conversion targets by @magnus-dev-melin in #1253
- Refactor model variant selection into explicit routing tables by @0xShug0 in #1256
- fish_drama3: increase default text chunk size to 4000 by @JarodMica in #1257
- Revert "fish_drama3: increase default text chunk size to 4000" by @0xShug0 in #1258
- Add Edda ASR with DFlash2 speculative decoding (edda-v0.2-large-hurtig) by @lkarlslund in #1223
- docs(drama3): explain chunk size tuning for repeated speech by @JarodMica in #1260
- omnivoice: RKNN generator step-graph sidecar (RK3588) by @wOvAN in #1259
- docs: OmniVoice concurrency benchmark report (RTX 4090, C++ vs Python, f16/bf16) by @kawshikbuet17 in #1262
- omnivoice: front-shard RKNN ladder so guidance works on the NPU by @wOvAN in #1261
- docs: record the vendor zero-op matmul single-core ceiling by @wOvAN in #1264
- Fix WebUI ID generation over plain HTTP by @0xShug0 in #1265
- docs(rockchip-npu): price the vendor zero-op matmul path, record the QuaRot int8 negative by @wOvAN in #1266
- Add opt-in RMSNorm lowering and audio runtime memory controls by @0xShug0 in #1267
- Use PreparedGraph build contexts in Nemotron Transcribe and Ming3 Audio by @0xShug0 in #1269
- Add experimental MoE hybrid CPU and GPU expert execution by @0xShug0 in #1270
- Add Kroko XL offline ASR and improve Zipformer inference by @0xShug0 in #1273
- pocket_tts: support flow_lm.z_proj when z_dim differs from transformer d_model by @michsethowusu in #1239
- Promote Qwen3 audio tokenizer into reusable framework codecs by @0xShug0 in #1276
- feat: add reference-audio voice cloning to KugelAudio by @mirek190 in #1275
- Add MossFormer2 speech enhancement and super-resolution by @0xShug0 in #1277
- New Community Model: ZONOS3-Mini (Zyphra) by @Ryu1845 in #1271
- 🚨 Unify MoE expert offloading through shared framework resources by @0xShug0 in #1280
- Add published models to the Web UI by @0xShug0 in #1279
- New Community Model: ZONOS2 (Zyphra) by @Ryu1845 in #1274
- v0.9.5 cleanup: documentation, model manager and test gating by @0xShug0 in #1281
- Refactor Zonos3 execution and preserve chunked voice consistency by @0xShug0 in #1282
- Add Zonos models to the WebUI and default Audio8 TTS to Realistic by @0xShug0 in #1283
New Contributors
- @david-bowiegxw made their first contribution in #1206
- @Twistarkle made their first contribution in #1211
- @ahmednabilfawzy89-cmyk made their first contribution in #1212
- @drphero made their first contribution in #1222
- @michsethowusu made their first contribution in #1229
- @jiabochao made their first contribution in #1236
- @kikaitachi made their first contribution in #1235
- @newjordan made their first contribution in #1241
- @magnus-dev-melin made their first contribution in #1252
- @Ryu1845 made their first contribution in #1271
Full Changelog: v0.9.4...v0.9.5