breaking the training barrier

[dida-80b]

we have essentially established the first fully functional, publicly accessible training workflow for kokoro. this isnt just about german. these fixes provide a blueprint for anyone looking to train kokoro for any language.

[semidark]

Yeah, I know—really awesome, right? I stumbled upon this a few days ago because I thought it would be easy and interesting enough to do my first model fine-tuning on something I really wanted. What a blast!

[semidark]

@dida-80b Btw. My Stage 2 Epoch 1 finally finished and it sounds great. Not finished but still great. Have re verified that the adversarial training in the later epochs of Stage 2 are actually working? I have not made it there yet.

[dida-80b]

Yes, I can confirm... I made it to Stage 2 Epoch 4, with the adversarial training kicking in from Epoch 3 (joint_epoch=3). The losses all looked healthy throughout: Disc Loss ~3.97, Gen Loss ~3.7, WavLM Loss ~1.5. No instability, no collapse.

And subjectively the audio quality did improve noticeably in the later epochs — Eva-K's voice character comes through more clearly and the speech feels more natural compared to the earlier epochs. Still room to grow, but the adversarial training is definitely doing its job.

[dida-80b]

@semidark i suggest you make a reddit post.

[semidark]

Good idea, Where do you think is the right thread/forum (or what ever they are called nowadays) ? I am not very big into the Socials-Interwebs 🤓.

[semidark]

But maybe we should wait a bit until we Trained Models that have more impressive results. You know. Pitching a breaktrough with a robotic german Voice probably only "kicks" the nerds like us. The rest will say: "Meh... Sounds like crap... I'll keep paying for something worthwhile" Also a Demo Webpage where people can try it would probably help. I`ll create an issue for that

[dida-80b]

haha you are right. - for Reddit:

• r/LocalLLaMA — should be the best place.

[pok14575-ops]

I am super new to this too and just iterated on your works. I hope I didn't do anything wrong and linked you as originals. It works on windows now and people can safely use it atleast for german. https://github.com/pok14575-ops/kokoro-german-voice-cloning-tools . I only stumbled upon this because my wife is pretty bad at english and there was no working solution for my specific case. Thank you guys for your work. If you want me to take it down, let me know, I do not want to take anybodys work or credits or fame. I will now return to being a silent one, I really don't want to expose myself much. Have a nice day !