Skip to content

v0.2.5 - Corrected instruct language guidance (verified)

Latest

Choose a tag to compare

@Saganaki22 Saganaki22 released this 18 Aug 16:55

Patch Release

Corrects the v0.2.4 language guidance for FireRedTTS3-Instruct cloning after direct verification. v0.2.4 claimed instruct cloning inherits the reference audio's language - further testing proved that wrong for non-ZH/EN:

  • Greek reference + Greek text -> degenerate output (""Thank you.""). Same-language reference does not rescue instruct cloning; the model simply lacks the base variant's multilingual conditioning (<|lang|> tags + CAM++ speaker embedding)
  • Cantonese: usable with a same-language reference, degrades with a cross-language reference (Chinese-family behavior, not a hard failure like Greek)

Verified language map (all cells tested, whisper-verified):

ZH EN Cantonese Other (e.g. Greek)
Clone (base) OK OK OK OK - use this
Clone (instruct) OK OK same-language ref only broken even with native ref
Voice Design OK OK untested broken
Semantic / Acoustic Edit inherits input audio OK inherits input audio OK (Greek verified)

Changed

  • README (EN/ZH) language table corrected: instruct cloning reliable for Chinese/English; Cantonese usable with same-language reference; all other languages -> use base
  • Voice Clone node warning upgraded: fires on the resolved language (covers auto detection too) whenever instruct is loaded and the language isn't Chinese/English/Cantonese, telling you to switch the loader variant to fireredtts3_base
  • Suite 17/17 passing

Multilingual voice cloning should use FireRedTTS3-Base. Thanks to everyone reporting and testing.