Skip to content

v0.2.0

Choose a tag to compare

View all tags
@Saganaki22 Saganaki22 released this 14 Aug 20:16
· 8 commits to main since this release
v0.2.0
d52b2a3

Initial Release

ComfyUI custom nodes for FireRedTTS3 - zero-shot voice cloning, voice design, and speech editing, running natively in-process with ComfyUI/AIMDO DynamicVRAM support.

Nodes (6)

  • FireRedTTS3 Load Model - base/instruct variants from three weight sources: FireRedTTS3-bf16 (recommended), FireRedTTS3-int8 (INT8 ConvRot), FireRedTTS3-fp32 (official); dtype / device / attention selection; download_if_missing toggle; extra_model_paths.yaml + symlink aware
  • FireRedTTS3 Voice Clone - zero-shot cloning in 24 languages + 21 Chinese dialects, automatic FastText language detection, wetext text normalization (zh/en), sentence splitting with cross-fade
  • FireRedTTS3 Voice Design (instruct) - create a voice from a natural-language description; returns the model's voice plan as text
  • FireRedTTS3 Semantic Edit (instruct) - insert/delete/replace words by instruction; returns the rewritten text
  • FireRedTTS3 Acoustic Edit (instruct) - speed (0.5-2.0x), pitch (plus/minus 6 steps), volume (0.3-2.0x) via the trained instruction templates
  • FireRedTTS3 Whisper Transcribe - reference transcripts with audio passthrough

Highlights

  • Native inference - Qwen3 backbone, PatchEncoder, DiT flow head, RedAE codec, and CAM++ speaker encoder run inside ComfyUI with per-module memory registration (static + AIMDO DynamicVRAM paging)
  • INT8 ConvRot - official comfy-kitchen quantizer, format int8_tensorwise with per-row fp32 scales and group size 256; 321/332 transformer linears quantized; checkpoint 7.90 -> 3.07 GiB, peak VRAM 13.1 -> 8.3 GiB, validated end-to-end (worst layer cosine 0.999953, runtime proven via counted kernel calls)
  • bf16 mirror - official-equivalent mixed precision (backbone + RedAE encoder bf16, flow head/decoder fp32); same-seed output identical to fp32 (SNR > 80 dB)
  • flash_attention on auto - auto picks flash_attention_2 when flash_attn is installed and compatible (CUDA + bf16), matching upstream; RedAE decoder always sdpa; explicit sdpa/sageattention options
  • Model mirrors on HuggingFace: drbaph/FireRedTTS3-bf16, drbaph/FireRedTTS3-int8
  • pip/uv compatible installer that never touches torch/torchaudio/transformers

Model weights

Pick a repo in the loader; weights land under ComfyUI/models/fireredtts3/ (only the selected variant downloads):

Repo Base Instruct RedAE
FireRedTTS3-bf16 4.70 GiB 4.69 GiB 2.46 GiB
FireRedTTS3-int8 3.30 GB 3.30 GB unchanged
FireRedTTS3-fp32 8.48 GB 8.48 GB 3.78 GB

Voice cloning is intended for research use. Do not clone voices without consent. FireRedTTS3 model weights remain Apache-2.0 under their own license.

Assets 2
Loading