Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About training accuracy #26

Closed
HeQibin opened this issue Apr 12, 2022 · 7 comments
Closed

About training accuracy #26

HeQibin opened this issue Apr 12, 2022 · 7 comments

Comments

@HeQibin
Copy link

HeQibin commented Apr 12, 2022

I repeated experiments on U2PL according to your settings for many times, and the accuracy in the paper can not be achieved under the condition of eight V100. Can you provide the training log to help check details?

@Haochen-Wang409
Copy link
Owner

On which dataset?

@Haochen-Wang409
Copy link
Owner

Haochen-Wang409 commented Apr 12, 2022

Our checkpoints here for VOC and here for Cityscapes.

@HeQibin
Copy link
Author

HeQibin commented Apr 12, 2022

Thanks for providing checkpoint, but I'm more concerned about whether the semi-supervised training can achieve the same accuracy through U2PL.

On which dataset?

Cityscapes.

@Haochen-Wang409
Copy link
Owner

On Cityscapes dataset, we apply slide-window evaluation following AEL, which means we should run sh eval.sh after training.
Therefore, the mIoU reported during training is not the final performance, which is quite different from VOC.

Did you run sh eval.sh after training?

@Haochen-Wang409
Copy link
Owner

For instance, under 1/2 partition protocol on Cityscapes, the final result is 79.12 with AEL, but the mIoU is around 75 during training.

@Haochen-Wang409
Copy link
Owner

By the way, can you reproduce the results on VOC?

@HeQibin
Copy link
Author

HeQibin commented Apr 12, 2022

For instance, under 1/2 partition protocol on Cityscapes, the final result is 79.12 with AEL, but the mIoU is around 75 during training.

Thanks. I'll try eval.sh.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants