Fish Audio Drama 3 requested !

[AndyLeAI]

Hi! Would you consider integrating Fish Audio Drama 3 (.GGUF) into the prebuilt release of audio.cpp?

Model: https://huggingface.co/fishaudio/drama-3

Drama 3 is an expressive TTS model designed for natural voice acting, emotion control, multiple speakers, and long-form dialogue. It would be a great addition for users interested in audiobooks, storytelling, dialogue generation, and voice-over production.

It would be especially helpful if users could download a ready-to-run prebuilt package without having to manually set up the entire inference environment and its dependencies.

If native integration isn't feasible, perhaps an optional backend or a simple integration with the official inference engine could be considered.

Thanks for your work on audio.cpp!

[0xShug0]

@AndyLeAI Thanks! This is definitely an important model. It would be the first MoE model in audio.cpp, and I'm sure it will introduce useful new framework patterns and primitives. Supporting it will require careful framework extensions.

I'm currently tied up with wrapping up the next release, so implementation and optimization will be deferred until after the release.

I also found an existing GGUF conversion here: https://huggingface.co/Jmica/Drama-3-GGUF. The inference implementation appears to be based on a fork of audio.cpp.

@JarodMica, thanks for your work on this! If you're interested, I'd love to collaborate and bring your work upstream into audio.cpp. It would be great to combine our efforts and build on what you've already accomplished. Of course, I completely understand if you'd prefer to continue developing it independently. Either way, I really appreciate your contribution to the ecosystem!

[0xShug0]

@JarodMica Oh, I just saw your GitHub profile! When I first started exploring TTS models, I actually followed your YouTube channel after seeing it recommended in a Reddit post :)

[JarodMica]

@JarodMica Oh, I just saw your GitHub profile! When I first started exploring TTS models, I actually followed your YouTube channel after seeing it recommended in a Reddit post :)

Hi! I'm glad people have found me through various means, I've been vibing around for awhile xd. I'd have to say, awesome work on audio.cpp, I love having a one stop shop for audio models and I have high praise for the ease of use here.

I'd love to contribute the work I've done so far, but to be frank, it's all coded by codex. But if that's acceptable, I'll take a look at contributing standards and get a PR going.

I'm still testing things out and from what I've tried so far, it works very well.

[0xShug0]

@JarodMica Great! If you plan to contribute, just make sure the changes are well-scoped and any framework or GGML changes are additive and opt-in. I'd be happy to pick this up after the next release.

[AndyLeAI]

Thanks a lot, @0xShug0 and @JarodMica! No rush on the timeline, I really appreciate you both working on this. Happy to test whenever it's ready.

[0xShug0]

@AndyLeAI @GalenMarek14 Drama3 is now in main! Kudos to @JarodMica for the contribution! Please help test it and spread the word. Once the model is stable enough, I'll create a minor release to include it.

[0xShug0]

Demo here. 8GB VRAM and 2x faster than real time on an RTX 5090 https://www.reddit.com/r/LocalLLaMA/s/SNCa6GS3Mx