Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reproducibility issue #12

Closed
whikwon opened this issue Feb 18, 2020 · 5 comments
Closed

Reproducibility issue #12

whikwon opened this issue Feb 18, 2020 · 5 comments

Comments

@whikwon
Copy link

whikwon commented Feb 18, 2020

Hello, thank you for sharing nice work.
I'm sorry but I can't get the dice score you got.
Is it able to reproduce the evaluation result without changing any code?

@mateuszbuda
Copy link
Owner

Hi, thanks for trying my code.
If you run training from docker, then validation split is the same and you should get roughly the same (or very similar) dice score.

@whikwon
Copy link
Author

whikwon commented Feb 20, 2020

I've tried using docker but model doesn't predict CS6667(2nd in validation set) well(dice score = 0.0).
I checked the data but it's OK.

@mateuszbuda
Copy link
Owner

Did you train your model from scratch or are you running inference only?

@whikwon
Copy link
Author

whikwon commented Feb 20, 2020

I'm training model from scratch now.

@whikwon
Copy link
Author

whikwon commented Feb 20, 2020

I've checked the inference only result and it was OK.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants