Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SCP-GAN train loss NAN #1

Open
taqta opened this issue Nov 13, 2023 · 3 comments
Open

SCP-GAN train loss NAN #1

taqta opened this issue Nov 13, 2023 · 3 comments

Comments

@taqta
Copy link

taqta commented Nov 13, 2023

Hello! I have encountered an issue and would appreciate your help.

when I try to train SCP-GAN with Voicebank-Demand dataset, the Loss become NAN after several batch as the fig below:
image

the command is below:
python main_gan -a scp --config= ./config/scp.yaml -j 8 --world-size=1 --multiprocessing-distributed

Thank you very much for your help! I look forward to your response.

@Wang-Jingrun
Copy link

Hello! I have encountered an issue and would appreciate your help.

when I try to train SCP-GAN with Voicebank-Demand dataset, the Loss become NAN after several batch as the fig below: image

the command is below: python main_gan -a scp --config= ./config/scp.yaml -j 8 --world-size=1 --multiprocessing-distributed

Thank you very much for your help! I look forward to your response.

I also have a similar issue. It seems to occur after computing 'est_prime_spec', but I haven't identified the root cause of the error yet. I'm not sure if you've resolved it?

@taqta
Copy link
Author

taqta commented Jan 11, 2024

I didn't resolve this problem, but I reproduce CMGAN using this code https://github.com/SherifAbdulatif/CMGAN. By the way, CMGAN will perform better if you delete C-NORM when you use https://github.com/SherifAbdulatif/CMGAN.

@Wang-Jingrun
Copy link

Thank you for your response. I'll give it a try.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants