Repository navigation
v0.8.2-audio8-perf-hotfix
·
231 commits
to main
since this release
What's Changed
- Speed up BS-RoFormer CUDA separation by batching projections by @mirek190 in #666
- higgs_audio_tts: optimize CUDA KV-cache transitions by @mirek190 in #669
- pocket_tts: use flow_lm.flow.depth for the flow net (fixes *_24l loading) by @bvisible in #670
- pocket_tts: chunk text like the reference, UTF-8 aware text prep by @bvisible in #671
- moss_tts_v15: call the backbone's own timing report by @christopherthompson81 in #676
- Improve Nemotron 3 diarization NeMo parity by @LysanderdeJong in #677
- Add Pascal support to Windows CUDA 12.4 releases by @0xShug0 in #682
- moss_ttsd: MOSS-TTSD, and share the moss_tts_delay prompt assembly by @christopherthompson81 in #652
- Reduce MOSS-TTS v1.5 GPU memory usage by @0xShug0 in #674
- voxtral_realtime: never end a streaming delta inside a UTF-8 character by @christopherthompson81 in #684
- moss_ttsd: take #674's f16 decoder and KV cache, keep the encoder at f32 by @christopherthompson81 in #687
- moss_ttsd: hold the encoder at its stored type and widen to f32 in the graph by @christopherthompson81 in #690
- metrics: process peak memory in --metrics, reserved-vs-used per ggml context in --log by @engival in #688
New Contributors
Full Changelog: v0.8.2...v0.8.2-audio8-perf-hotfix