Skip to content
This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

master64 same model as reported in the paper? #14

Closed
pranaymanocha opened this issue Sep 22, 2020 · 6 comments
Closed

master64 same model as reported in the paper? #14

pranaymanocha opened this issue Sep 22, 2020 · 6 comments

Comments

@pranaymanocha
Copy link

pranaymanocha commented Sep 22, 2020

Hi,
Thanks for the great repo. I ran the master64 pretrained model (that was trained on VCTK and DNS together) and evaluated it on the VCTK valset. I am getting a PESQ score of 3.019 and STOI of 95.00 (averaged across all 824 files in the valset). This model corresponds to H=64, U=4,S=4, so I looked at the paper and the objective score mentioned there (for the same parameter model) is PESQ=2.94 and STOI =95. Does that look to be correct, or I am doing something wrong here?

One another question I had was regarding access to the non-causal model reported in the paper. Are you guys working to release that soon? Thanks in advance for your response!!

@adiyoss
Copy link
Contributor

adiyoss commented Sep 23, 2020

The numbers you get are fine. The master model was trained on both DNS and Valentini datasets. Its results are not reported in the manuscript. We provide this model so people can use a better performing model for downstream tasks / clean noisy files / etc.
Regarding non-causal training, you can pass demucs.causal=False to train a non-causal model.

@pranaymanocha
Copy link
Author

pranaymanocha commented Sep 23, 2020

Thanks for your response! Appreciate it! On my second point, I was more interested in getting access to a pretrained non-causal model. I was curious as to how much better could that model be. The current master64 model is great, but still has a few artifacts that I can observe. I was wondering it the non-causal model gets rid of that?

@adiyoss
Copy link
Contributor

adiyoss commented Sep 24, 2020

Ohhh sorry about that...:)
I'll upload the non-causal version soon. The non-causal version was trained on VCTK only, it might be a good idea to train it on a bigger and more challenging set.

@zhangxingtao
Copy link

where can I find the pretrained models?

@adiyoss
Copy link
Contributor

adiyoss commented Oct 22, 2020

Hi @zhangxingtao ,
You can add --master64 to your evaluation script and it will automatically download the pre-trained model.
You can do the same with --dns48 and --dns64.

@adefossez
Copy link
Contributor

If you want to fine tune from a pre-train model, please see this issue: #7

@adiyoss adiyoss closed this as completed Apr 5, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants