Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature request] Language Support ("Hindi") missing in XTTS on local machine. #3655

Closed
ghost opened this issue Mar 30, 2024 · 7 comments · Fixed by idiap/coqui-ai-TTS#4
Closed
Labels
feature request feature requests for making TTS better. wontfix This will not be worked on but feel free to help.

Comments

@ghost
Copy link

ghost commented Mar 30, 2024

*Title

On XTTS site (i.e https://huggingface.co/coqui/XTTS-v2), Hindi language is already supported and it's working perfect on demo site. But, the problem is when I install XTTS on my local machine, error appears that 'hi' is not supported.

Language hi is not supported. Supported languages are ['en', 'es', 'fr', 'de', 'it', 'pt', 'pl', 'tr', 'ru', 'nl', 'cs', 'ar', 'zh-cn', 'hu', 'ko', 'ja']

Possible solution might be adding 'hi' index in languages. Since afaik, XTTS on local machine import the dataset as on the online demo website. Also, for fine tuning XTTS (used colab notebook from this video - https://www.youtube.com/watch?v=8tpDiiouGxc), Hindi language option isn't available as a option. It would be helpful to add support plus able to fine tune XTTS for that language.

Thanks!

@eginhard
Copy link
Contributor

Thanks for spotting this. I've enabled Hindi in the fine-tuning demo and tokenizer in our fork: https://github.com/idiap/coqui-ai-TTS

@ghost
Copy link
Author

ghost commented Apr 19, 2024

Hi, thanks for the fork repo link, I noticed keyerror='hi' type of errors when I tried to fine tune model, however I've added some 'hi' tags/attributes in some function located in tokenizer.py and now it's works perfectly.

Copy link

stale bot commented Jun 5, 2024

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. You might also look our discussion channels.

@stale stale bot added the wontfix This will not be worked on but feel free to help. label Jun 5, 2024
@stale stale bot closed this as completed Jun 26, 2024
@jiten634
Copy link

jiten634 commented Jun 30, 2024

Hi, thanks for the fork repo link, I noticed keyerror='hi' type of errors when I tried to fine tune model, however I've added some 'hi' tags/attributes in some function located in tokenizer.py and now it's works perfectly.

Can you share the files, where you have added hindi tags/att ? because I am still stuck at there. Please help... I am facing the same issue in xtts v1.1

@ghost
Copy link
Author

ghost commented Jun 30, 2024

Install the Coqui TTS, then,
Download the selected tokenizer.py and put it in TTS/tts/layers/xtts folder
https://drive.google.com/file/d/1cAW8b-JTttyVLST3_PIYGJbvs4gQQMzc/view?usp=drivesdk

@jiten634
Copy link

jiten634 commented Jul 1, 2024

Install the Coqui TTS, then, Download the selected tokenizer.py and put it in TTS/tts/layers/xtts folder https://drive.google.com/file/d/1cAW8b-JTttyVLST3_PIYGJbvs4gQQMzc/view?usp=drivesdk

Thanks for the link. I am also facing one more problem in XTTS V2, when I am making hindi voice, in the end of the audio file, sometimes it cut the word, or sometimes it speak a different hallucination type voice. is there any solution for this?

@ghost
Copy link
Author

ghost commented Jul 7, 2024

It's the known issue of XTTS V2, there's no fix for this issue because as far as I know XTTS is proprietary TTS engine(not open source).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request feature requests for making TTS better. wontfix This will not be worked on but feel free to help.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants