add Facebook MMS TTS with expanded language support - #82
Conversation
added the support for facebook mms tts, now just the language id can be used to download the relevant facebook model.
|
Is this up for review or is it a draft? |
|
Yeah, Hindi is supported with this PR, I was just curious, should we add all the other languages with the same PR as well? Or maybe just few more common ones. |
|
I would add all the languages in TTS/facebookmms_handler.py such that we know which ones are supported by facebookmms at least |
|
List of all the supported languages by facebook-mms is here under a toggle button, there are 1000+ languages, and adding all will also require the lm and stt selection accordingly, maybe for a start we can add all the languages supported by whisper that is likely less than 100 languages. |
|
We're seeing here issues entailed with having such a modular pipeline and parts that support different languages. I also think that since Whisper will be mostly used, starting by adding its supported languages makes sense here. |
|
Alright, I added the languages supported by both whisper and mms-tts as of now. The list of supported languages and their respective iso codes were picked up from OpenAI Docs and MMS - Language Coverage. It's up for review now. |
|
I'm merging this into an intermediate branch to fix some stuff before going to main. It's been a while since you opened the PR but there are a few things to fix |

This PR introduces support for multiple languages in the speech-to-speech pipeline by integrating Facebook's MMS TTS model.
Key Changes:
--tts_languageflag.facebookmmsTTS model.Example usage with Hindi: