-
Notifications
You must be signed in to change notification settings - Fork 57
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support for piper models #135
Comments
Hi @danemadsen ! The piper model looks indeed really nice. Would you like to try to implement it? I'm happy to guide you in the process. |
Haha, I'd love to help implement it but I'm afraid I'm not educated on the topic to be able to pull it off. I've looked into vits.cpp (an incomplete GGML implementation of vits / piper models) , it compiles but crashes instantly. My understanding is the main challenge of a vits implementation will be finding a way to handle phonemization without using espeak-ng. I'm wanting an implementation without espeak-ng as I'm wanting to use a vits model in my llama.cpp android frontend maid and espeak-ng struggles to compile for android. Thanks for any advice. |
How about implementing a version of https://github.com/lingjzhu/CharsiuG2P ? This is a G2P model for 100 languages. License is MIT. Certainly a bigger canoon than espeak-ng, though :) |
It would be helpful to add support for piper models into bark.cpp
there is already a c++ library for piper but it is difficult to compile and does not work well cross platform. Piper is currently running on the onnx runtime.
https://github.com/rhasspy/piper
The text was updated successfully, but these errors were encountered: