Real time voice conversion

[KoolenDasheppi]

Just a question, but will there ever be a way to clone a voice, except instead of typing it out, you can just have a real time (or almost real time) voice conversion? As in I could say something after "training" it to a different voice into the mic, and it would output audio in near real time. I don't know how else to explain it, I hope you know what I mean. XP

[CorentinJ]

This is called voice conversion and it's essentially a form of style transfer, usually applied at the spectrogram level.

There are proofs of concept here and there:
https://github.com/leimao/Voice_Converter_CycleGAN
https://github.com/hujinsen/StarGAN-Voice-Conversion

It is however beyond the scope of this repo.

[KoolenDasheppi]

Thanks for the quick response! And that's a bit disappointing (but understandable), because this tool is very easy to set up and use, unlike the other "voice conversion" tools I've seen. If you know of a repo like this one (as in easy to setup and has pretrained models and stuff), please let me know. I've always wanted to try out something like that.

[arzutahtasiz2]

Chat now

[arzutahtasiz2]

434