RAI 1.8.0 Release

Release Note: Version 1.8.0

• LLM

  • 8 new LLM and VLM support: Hunyuan-0.5B-Instruct, Hunyuan-1.8B-Instruct, Hunyuan-4B-Instruct, Hunyuan-7B-Instruct, HY-MT1.5-1.8B, HY-MT1.5-7B, VideoChat-Flash-Qwen2_5-7B_InternVideo2-1B, Qwen3-VL-4B-Instruct
  • New TTS model support: neutts-air, neutts-nano
  • New embedding model support: embeddinggemma-300m
  • New translation model support: translategemma-4b-it

• Stable Diffusion

  • New models, new applications, more dynamic resolutions
    • SD1.5 i2i-canny
    • SDXL-turbo t2i with 5x Dynamic Resolutions
    • SDXL-base t2i with 20x Dynamic Resolutions
    • SSD-1B t2i with 20x Dynamic Resolutions
    • Playground v2.5 t2i with 20x Dynamic Resolutions
    • DreamShaper-XL-Lightning t2i with 20x Dynamic Resolutions
    • FLUX.1-Schnell t2i with 20x Dynamic Resolutions
    • SD3.0-medium t2i with 20x Dynamic Resolutions
    • SD3.5-medium t2i with 20x Dynamic Resolutions
    • SD3.0-inpainting
    • Flux.2-Klein-4B t2i

• Performance optimizations with -O1 for SD3.x models

• Support running large models on low-memory machine

• Whisper.cpp: Improved short-audio transcription speed, with 3-second audio RTF reduced to 13.9% (Whisper small) and 33.7% (Whisper large-v3-turbo)

• Known Issues

  • LLM

    • The following models are not supported in the current release:
      • Full Fusion: Qwen2.5-14B, Qwen2.5-14B-Instruct, Qwen3-0.6B, Qwen3-14B
      • TPS Fusion: Phi-3-mini-128k-instruct is only supported on Windows
    • Model generation is not supported on Linux in this release. Models generated on Windows are compatible with Linux

  • BF16 Models

    • The openai-whisper-medium-encoder model requires the following additional compiler option FE_EXPERIMENT+=enable-binary-blob-inputs=0 in the BF16 config file