Skip to content

v0.9.3

Latest
Latest

Choose a tag to compare

View all tags
@github-actions github-actions released this 26 Oct 20:46
· 13 commits to main since this release
v0.9.3
41c1f8f

What's Changed

  • Run the Piper TTS duration path on the host for Vulkan as well by @wOvAN in #913
  • Add an opt-in RKNN decoder sidecar for inflect_v2 by @wOvAN in #915
  • Modify .gitmodules to work with https and ssh checkouts while maintaining compatibility with repo forks by @simcop2387 in #923
  • New Community Model: Fish Audio Drama 3 by @JarodMica in #916
  • Reduce Drama 3 VRAM with opt-in disk-backed expert offload by @0xShug0 in #927
  • Add Drama 3 voice cloning and multi-speaker WebUI by @0xShug0 in #928
  • Fix Drama 3 Vulkan voice conditioning with opt-in F32 encoder accumulation by @0xShug0 in #929
  • Fix Drama 3 offload prefill noise and repeat consistency by @0xShug0 in #930
  • Optimize Drama 3 output head for speech token candidates by @0xShug0 in #931
  • Gate family unit tests on the model set whose symbols they link by @wOvAN in #925
  • Keep CPU f5_tts passes inside the graph pool ceiling, and free the evicted graphs by @wOvAN in #924
  • Strip the ONNX module prefix in the Inflect v2 converter by @wOvAN in #933
  • Fix CPU Fish DAC reference encoding for voice cloning by @0xShug0 in #936
  • Align CUDA reference-encoder precision for Fish Audio and Drama 3 by @0xShug0 in #937
  • Fix C++17 lambda capture breaking HIP server builds by @0xShug0 in #939
  • fix(build): compile model unit tests' own family sources into the test by @wOvAN in #932
  • fix(build): split compiled-in model specs into 16 KB literals by @wOvAN in #934
  • webui: list the server's voices with UI management enabled by @KKTTSPJ in #941
  • docs(piper_tts): the non-finite duration abort is the plain Vulkan path, not the sidecar by @wOvAN in #946
  • Split the RKNN quality numbers by what varies, in docs/build/rockchip-npu.md by @wOvAN in #945
  • webui: preview server voices in config mode and label the list by content by @KKTTSPJ in #943
  • Document the RK3588 IOVA ceiling for engine size by @wOvAN in #949
  • perf(qwen3_tts): opt in to voicing chunked text in one decoder pass by @wOvAN in #910
  • server: add default_session_options for configured and UI-loaded models by @KKTTSPJ in #944
  • Support updated Kitten TTS 2 weights with BF16, Q8 and Q4 GGUFs by @dignome in #947
  • perf(voxcpm2): size the step graphs by the request, not by max_length by @wOvAN in #950
  • fix(f5_tts): free the evicted graphs' staged CUDA constants by @wOvAN in #953
  • feat(cosyvoice3): run the flow DiT estimator on the Rockchip NPU by @wOvAN in #951
  • refactor(f5_tts): drop the unused raw DiT weight store by @wOvAN in #956
  • Reduce shared WavLM memory usage for MioCodec, MioTTS, and MeanVC2 by @0xShug0 in #954
  • server: let voice presets carry request options by @KKTTSPJ in #942
  • refactor(rknn): build every engine through one converter helper by @wOvAN in #961
  • refactor(rknn): split the aperture accounting from the aperture measurements by @wOvAN in #957
  • Fix Drama3 seeded repeatability with sorted expert routing by @0xShug0 in #955
  • feat(tensors): add i-quant (IQ) storage types for GGUF tensor loading by @Th-Underscore in #958
  • Add opt-in NEON library and native model components by @0xShug0 in #962
  • Add Plapre 3 Danish TTS and voice cloning by @0xShug0 in #965
  • Align instruction fields across CLI and server by @0xShug0 in #894
  • Declare shared model object-library dependencies and document Plapre TTS by @0xShug0 in #966
  • Add OpenWakeWord Alexa GGUF package and documentation by @0xShug0 in #968
  • Restore Whistle host decoder and add opt-in NEON acceleration by @0xShug0 in #967
  • Add opt-in NEON network execution for microWakeWord by @0xShug0 in #969
  • feat(fish_drama3): support per-layer expert counts and speech-only head by @Th-Underscore in #959
  • fix(server): count exec_plan engines in the free-memory guard by @wOvAN in #964
  • server: keep config model settings on WebUI loads, and offer demo voices with --ui by @KKTTSPJ in #971
  • fix(rknn): find an exec_plan engine named next to the model by @wOvAN in #963
  • webui: treat configured models the same with and without UI management by @KKTTSPJ in #972
  • perf(rknn): price a ladder engine by what the driver reports by @wOvAN in #970
  • feat(server): support per-model backend device selection by @railep in #973
  • perf(fish_dac): chunked reference encoding to cut VRAM peak by @Th-Underscore in #960
  • feat(webui): add Vietnamese interface translations by @kinhatula in #839
  • Drama3 base/small release cleanup by @0xShug0 in #976
  • text chunking: keep closing quotes with their sentence in tag-aware mode by @5uck1ess in #977
  • fish_drama3: default top_k to 4097 (no cap), matching Fish's Space by @5uck1ess in #978
  • Refactor LoRA adapters and add ComfyUI/LoKr support for YuE2, VibeVoice, and ACE-Step by @0xShug0 in #974
  • Polish Studio layout and unify Studio/Arena voice selection by @0xShug0 in #980
  • Fix server build with Clang in C++17 mode by @0xShug0 in #986
  • refactor(rknn): read the sliced graph through one shared helper by @wOvAN in #983
  • Add Linux Clang C++17 CI build by @0xShug0 in #987
  • perf(voxcpm2): cheaper AudioVAE decode (exact-size graph, one-pass CPU Snake, optional CPU decode overlap) by @ersensari in #981
  • refactor(tools/rknn): one report line and one bootstrap per converter by @wOvAN in #990
  • Preserve Higgs Audio voice across reference-free text chunks by @0xShug0 in #985
  • fix(rknn): name the driver in a sidecar failure by @wOvAN in #989
  • fix(server): price a plan's NPU engines by driver residency by @wOvAN in #975
  • feat(model_spec): ship prebuilt RK3588 engines as rknn packages by @wOvAN in #991
  • Extend framework modules and ggml with opt-in CUDA FP16 paths by @0xShug0 in #988
  • Extend model LoRA support and add GGUF adapter merge tools by @0xShug0 in #993
  • tests: fake-engine coverage for the RKNN sidecar loader paths by @wOvAN in #995
  • feat(qwen3_tts): stream the RKNN decoder with window semantics by @wOvAN in #992
  • piper_tts: RKNN duration-encoder ladder by @wOvAN in #994
  • Add built-in recipes for Any-TTS voice cloning and cross-language dubbing by @0xShug0 in #997
  • fix(audio): discover Homebrew libsoxr on macOS by @0xShug0 in #998
  • Add explicit SheetSage2 encoder attention tiling by @0xShug0 in #999
  • feat(docker): Rockchip NPU image (arm64, pinned librknnrt) by @wOvAN in #1002
  • Allow opt-in incomplete Higgs TTS generation by @0xShug0 in #1009
  • Qwen3-TTS: add optimized streaming mode by @0xShug0 in #1011
  • ACE-Step: reduce tokenizer graph peak VRAM by @0xShug0 in #1012
  • Reduce OmniVoice generation copies and add streaming timings by @0xShug0 in #1013
  • Add Kokoro voice blending by @0xShug0 in #1014
  • feat: xTTS v2 support by @whoreson in #876
  • (WIP) Add Ming 3.0 TTS 0.5B with voice cloning and voice design by @0xShug0 in #1015
  • Restore Qwen3-TTS KV-cache alignment default to 1 by @0xShug0 in #1018
  • Rename Ming 3.0 TTS family to ming3_tts by @0xShug0 in #1019
  • Add LatentSync 1.6 (experimental) by @0xShug0 in #1001
  • text chunking: include parentheses in is_tag_{open,close} by @apt-install-coffee in #1000
  • Ming 3.0 TTS: chunk CJK text at 50 codepoints by default by @hiroki-abe-58 in #1020
  • Ming 3.0 TTS: use the request's language when the language option is unset by @hiroki-abe-58 in #1021
  • Kokoro: chunk Chinese and Japanese text at 100 codepoints by default by @hiroki-abe-58 in #1022
  • Add opt-in NEON execution plans for Kokoro and Tone Color VC by @0xShug0 in #1024
  • Chunk CJK text for MOSS-TTS-Nano at 50 codepoints by default by @hiroki-abe-58 in #1025
  • Chunk Irodori-TTS text at 100 characters by default by @hiroki-abe-58 in #1027
  • Fix ACE-Step planner attention output dimensions by @ZeroDot1 in #1026
  • Add Ming3 Audio Tiny with expert offload and shared Ming speech runtimes by @0xShug0 in #1023
  • Publish nightly Rockchip NPU Docker image by @0xShug0 in #1029
  • Fix Ming3 Audio voice selection and Metal offload defaults by @0xShug0 in #1030
  • Chunk CJK text for FireRedTTS3 at 80 codepoints by default by @hiroki-abe-58 in #1039
  • Split long Ming 3.0 TTS voice design and freeform text like the official runtime by @hiroki-abe-58 in #1034
  • Chunk Chinese and Korean text for MagpieTTS at 60 codepoints by default by @hiroki-abe-58 in #1043
  • Use 100 codepoints for MagpieTTS Chinese and Korean chunks by @hiroki-abe-58 in #1044
  • Add installable VocalRender-Pro VoxCPM2 package by @ZeroDot1 in #1037
  • Fix MOSS-Nano CJK chunking for supplementary ideographs by @ZeroDot1 in #1036
  • Preserve Ming3 audio tails shorter than one trim window by @ZeroDot1 in #1041
  • Chunk CJK text for MioTTS at 120 codepoints by default by @hiroki-abe-58 in #1046
  • Add opt-in VoxCPM2 AudioVAE tiling and packed projections by @0xShug0 in #1047
  • Refresh Kitten TTS 2 checkpoints, Q4/Q8 packages, and CPU graph reuse by @0xShug0 in #1049
  • Add opt-in TQ2_1 ternary CPU kernels and Kitten TTS 2 export by @0xShug0 in #1050
  • Kitten TTS 2: add opt-in NEON HiFT vocoder by @0xShug0 in #1052
  • Zerodot1/higgs887 preserve token order by @ZeroDot1 in #1038
  • Reduce packed-weight loading RAM with opt-in deferred uploads by @0xShug0 in #1048
  • Ignore non-finite logits in Higgs greedy sampling by @ZeroDot1 in #1032
  • Cut unpunctuated CJK runs at the text chunk budget by @hiroki-abe-58 in #1045
  • Support the multilingual Granite TurboCTC checkpoint by @bradmurray-dt in #1035
  • Expose Qwen3 TTS optimization controls and extend cuda_perf preset by @0xShug0 in #1055
  • Expose YuE2 performance controls and cuda_perf preset by @0xShug0 in #1056
  • Zerodot1/ming3 parallel disk reads by @ZeroDot1 in #1042
  • 🚨 Metal: accelerate 1D IM2COL with cooperative tiling by @0xShug0 in #1057
  • Zerodot1/arch linux amd installer by @ZeroDot1 in #1058
  • Add opt-in plain RMS norm for timestep embeddings by @davencyw in #1061
  • Add Gradium Phonon TTS on the PocketTTS runtime by @davencyw in #1062
  • Optimize Drama3 sampling and keep tower decode on-device by @0xShug0 in #1063
  • Enable parallel expert reads on Apple without OpenMP by @0xShug0 in #1064
  • UI v0.9.3: add missing models, LatentSync panel, and models-folder history by @0xShug0 in #1066
  • Batch Drama3 streaming codec frames and overlap decoding with AR generation by @0xShug0 in #1065
  • Precompute Drama3 Gemma scales and remove redundant CUDA decode views by @0xShug0 in #1067
  • Expose Drama3 decode performance controls and default to F16 KV by @0xShug0 in #1068
  • Reduce Ming3 Audio Thinker latency and KV memory by @0xShug0 in #1069
  • 🚨 Expose ACE-Step performance controls and cuda_perf preset by @0xShug0 in #1073
  • Fix HIP VMM access updates for growing pools by @ZeroDot1 in #1059
  • gguf: read numeric array metadata in one bulk fread (Kitten-TTS 2 cold load 20 s -> 7 s) by @JoseConseco in #1072
  • Echo-TTS: Implement optional Joint-CFG by @lojack5 in #773
  • Expose MiniMax Music3 performance controls and compact output head by @0xShug0 in #1077
  • Enable validated HIP VMM defaults in Arch AMD installer by @ZeroDot1 in #1080
  • Fix large-row HIP argsort for device sampling by @0xShug0 in #1076
  • Add Irodori-TTS MeanFlow support by @0xShug0 in #1083
  • fix(assets): preserve direct uploads in weight norm tensor views by @ZeroDot1 in #1081
  • Stage HIP device weight uploads through a bounded host buffer by @Ramon-Balaguer in #1070
  • Treat empty and null speech voice values as omitted by @0xShug0 in #1086
  • Avoid redundant VoxCPM2 KV cache staging and resets by @0xShug0 in #1085
  • Make Drama3 device sampling opt-in outside cuda_perf by @0xShug0 in #1087
  • Expose LoRA controls in Studio and unify adapter groups by @0xShug0 in #1088
  • Align Arena controls with Studio styling by @0xShug0 in #1089
  • Add Earshot VAD (native C++ port) by @Etherll in #1095
  • Let ASR VAD chunking load any built-in VAD family by @Etherll in #1096
  • Report build version and git commit in /health by @HamSanders in #1097
  • BreezeTTS: opt-in fused depth graph for CUDA (perf_mode=cuda_perf) by @Fishballllllll in #1090
  • CUDA: opt-in fusion of bf16-reference rounding into rms_norm, add and SwiGLU by @Fishballllllll in #1091
  • BreezeTTS: opt-in batch-2 CFG backbone decode on CUDA (cfg_batch) by @Fishballllllll in #1092
  • ci: add best-effort HIP/ROCm test prebuilts by @0xShug0 in #1100
  • Add TTS workspace with reusable speakers by @0xShug0 in #1099
  • Ming3 TTS: add streaming, consistent long-form voices, and embedding export by @0xShug0 in #1101
  • 🚨 Extend BreezeTTS performance controls to Vulkan and Metal by @0xShug0 in #1104

New Contributors

Full Changelog: v0.9.2...v0.9.3

Contributors

simcop2387, lojack5, and 21 other contributors
Assets 36
Loading