Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I CAN NOT get same result #41

Closed
zihao-lu opened this issue Mar 19, 2019 · 7 comments
Closed

I CAN NOT get same result #41

zihao-lu opened this issue Mar 19, 2019 · 7 comments

Comments

@zihao-lu
Copy link

i trained the model using the pretrained model(resnet-101) with cityscapes dataset, but i only got 70.07 mIOU, How can i the same result as the paper? please~~~~ thanks !
I set the batch_size 15 (5 GPUs), epochs 120 .

@junfu1115
Copy link
Owner

@Mr-zihao, I suggest you use our command to train the network, including batch_size 8, epochs 240 etc. In addition, the result of val set is not real during training phase, you need use test.py to obtain the final results of val set

@zihao-lu
Copy link
Author

@junfu1115 Hello, i still can not get the same result as the paper using the same setting and testing after training. The final result is mIOU 75.05( backbone : resnet101 with multi-grid and DA without multi-scale).
maybe there are still some tricks. What can i do??? thanks~~~~

@junfu1115
Copy link
Owner

@Mr-zihao, There's no other tricks during training except for multi-loss on the end of the network when both PAM and CAM are used. you can ref #14 (comment) although there's still some gaps compared to our results. Or try resnet50 when training the network. We hope you get same results.

@yazhe2017
Copy link

@junfu1115 Hi, Thanks for the great repo. Why the val mIoU results during training phase is not real? I found the val phase during training is very fast but the 'real' validation from test.py is very slow (it is about take 20min with default setting 4gpus in single scale) ? Thanks.

@MendelXu
Copy link

MendelXu commented Apr 25, 2019

Have you guys reproduced the result? I have trained the model with the same command authors denote and test it on single scale. However, I can only get 78.93 mIOU which is 1 point lower while pixelAcc is 95.99.

@junfu1115
Copy link
Owner

junfu1115 commented May 4, 2019

@yazhe2017 In training phase, we evalute the model with only a part of an image, it is fast but not real result. while in test phase whole image is used.

@Serge-weihao
Copy link

@Mr-zihao could you tell me your crop size and total gpu memory use at "batch_size 15 (5 GPUs), epochs 120 " as you mentioned above?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants