Skip to content

audio.cpp Windows prebuilt binaries v0.4.1

Choose a tag to compare

View all tags
@0xShug0 0xShug0 released this 24 Jul 02:48
· 261 commits to main since this release
release-0.4
cc06321

These Windows prebuilt packages are for audio.cpp 0.4, built from commit ea4d039 on main.

What's New

  • Included PR #97 and Chinese text normalization improvement for IndexTTS2.

This release brings audio.cpp to 35 model families listed across the supported and community tables and adds Higgs Audio v3 TTS 4B, Fish Audio S2 Pro, and Voxtral Realtime ASR, with GGUF-first CUDA validation for the new paths. On warmed TTS requests, Higgs Audio Q8_0 runs about 8.8x-10.1x faster than real time, while Fish Audio Q8_0 runs about 3.1x-3.4x faster than real time. Voxtral adds offline and streaming ASR, with Q8_0 GGUF around 15.7x faster than real time and about 171 ms streaming TTFT.

Also new: community models OuteTTS and VieNeu-TTS, broader standalone GGUF/package-spec support, and reusable framework work for vocoders, sampling, attention, Whisper frontend, and model metadata.

WebUI (thanks to @kigner and @patrickjchen ) is a community-maintained, standalone Python/Gradio application. It is NOT included in the prebuilts.

Packages

CPU packages are self-contained:

  • audiocpp-windows-cpu-fast.zip
  • audiocpp-windows-cpu-balance.zip
  • audiocpp-windows-cpu-portable.zip

CUDA packages are split into one shared runtime package plus one profile package:

  • audiocpp-windows-cuda-runtime.zip
  • audiocpp-windows-cuda-fast.zip
  • audiocpp-windows-cuda-balance.zip
  • audiocpp-windows-cuda-portable.zip

The CUDA runtime package contains the large CUDA DLLs shared by all CUDA profiles. Download it once, then pair it with whichever CUDA profile package you want to use. You don't need to download it if you already have it from previous releases.

Which Package Should I Download?

Use a CUDA package if you have a supported NVIDIA GPU. CUDA profile packages include both CUDA and CPU backend support, so they can run with either --backend cuda or --backend cpu once the CUDA runtime DLLs are available.

Use a CPU package if you do not have a supported NVIDIA GPU or only want CPU inference.

For most users:

  • NVIDIA GPU: download audiocpp-windows-cuda-runtime.zip and audiocpp-windows-cuda-balance.zip
  • CPU only: download audiocpp-windows-cpu-balance.zip

CPU Architecture Profiles

The package names use three CPU compatibility profiles:

Profile CPU build setting Best for Tradeoff
fast Native CPU optimization Newer high-end x86-64 CPUs that support the same instruction families used by the package Fastest CPU path, but least portable. If your CPU is older or missing newer SIMD instructions, use balance or portable.
balance AVX2 CPU kernels, native CPU optimization off Most modern x86-64 Windows PCs with AVX2 support Recommended default. More portable than fast, faster than portable, and avoids AVX512/AVX-VNNI requirements.
portable Baseline CPU kernels, native CPU optimization off, llamafile SGEMM off Older or unknown x86-64 Windows CPUs Broadest compatibility, but slowest. Avoids AVX, AVX2, AVX512, AVX-VNNI, and llamafile SGEMM.

The CUDA packages still include a CPU backend, so the same CPU profile applies when a CUDA package is run with --backend cpu.

CUDA Package Requirements

  • 64-bit Windows
  • NVIDIA GPU with compute capability 7.5 or newer
  • NVIDIA driver 580 or newer
  • Model files downloaded separately

The CUDA Toolkit and Visual Studio Build Tools are not required to run the CUDA packages. The required CUDA runtime DLLs are provided in audiocpp-windows-cuda-runtime.zip.

The CUDA packages are intended for RTX 20/30/40/50 series GPUs and similar NVIDIA datacenter GPUs. Older GPUs such as GTX 10-series Pascal cards or V100-class Volta cards are not covered by the CUDA 13 package; use a CPU package or build a separate package with an older CUDA Toolkit if those GPUs must be supported.

Quick Start

CPU users: unzip one CPU package, then run:

.\audiocpp_cli.exe --help

CUDA users: unzip audiocpp-windows-cuda-runtime.zip and one CUDA profile package into the same directory, then run:

.\audiocpp_cli.exe --help

CUDA example:

.\audiocpp_cli.exe --backend cuda --task tts --family <family> --model C:\path\to\model [options]

CPU example:

.\audiocpp_cli.exe --backend cpu --task tts --family <family> --model C:\path\to\model [options]

Server:

.\audiocpp_server.exe --config C:\path\to\server.json

Notes

  • Models are not bundled.
  • For CPU packages, keep the bundled DLL files next to the .exe files.
  • For CUDA packages, keep the CUDA runtime DLLs from audiocpp-windows-cuda-runtime.zip next to the .exe files, or put that runtime directory on PATH.
  • If CUDA startup fails, update the NVIDIA driver first.
Assets 15
Loading