-
Notifications
You must be signed in to change notification settings - Fork 372
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Unable to run training script of Natural Speech 2 #43
Comments
It has some differences for the data processing for NS2 between other TTS. We will update the data processing section as soon as possible. |
Hi @HeCheng0625 , I hope this message finds you well. I understand that these things take time and effort, and I appreciate the work you're putting into it. If possible, could you please provide an estimated timeline for when we might expect the update? |
Hi, we will update a new checkpoint and data processing pipeline on a large dataset (> 1 w hours) in about two weeks. Now, we only use libritts to train the model. |
Thanks @HeCheng0625. |
Hi @HeCheng0625 , |
Any updates on the data preprocessing pipeline? |
Hello,@dongngm |
@HeCheng0625 @RMSnow Do you have any updates on the preprocessing pipeline for neuralspeech2? |
Hi,
I ran into multiple issues trying to run the training script:
In
ns2_dataset.py
:self.utt2phone[utt] = utt_info["phones"]
: wherephones
comes from? I suspect we need to run the phonemizer first? but I don't seeextract_phone=True
in the config fileIn
exp_config_base.json
:use_code=true, use_pitch=true, use_phone
, shouldextract_acoustic_token=true, extract_pitch=true, extract_phone=true
also?tts/preprocessing.py
and the config file. For example:code_dir
should beacoustic_token_dir
?The text was updated successfully, but these errors were encountered: