Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why OCRNet is worse than DeepLabv3 in table 5. #3

Closed
EricKani opened this issue Sep 14, 2021 · 4 comments
Closed

Why OCRNet is worse than DeepLabv3 in table 5. #3

EricKani opened this issue Sep 14, 2021 · 4 comments

Comments

@EricKani
Copy link

Or why you choose DeepLabv3 as your structure not other latest structure in your experiments? Maybe it can hit a higher score.
Just confused.

Thank you~

@CharlesPikachu
Copy link
Owner

(1) Why OCRNet is worse than DeepLabv3
In our re-implementation (refer to https://github.com/SegmentationBLWX/sssegmentation), Deeplabv3 baseline (45.16%) is much better than OCRNet baseline (43.99%), under the same training settings (e.g., backbone, iterations, to name a few).
(2) why you choose DeepLabv3 as your structure not other latest structure in your experiments
You are right, other latest structure (e.g., upernet, deeplabv3plus) can help our method hit a higher score. But deeplabv3 is good enough in our view.

@EricKani
Copy link
Author

I get you.
You mean your reimplementation of DeepLabv3 is better than OCRNet in Table 5.
But I find there are some situations that OCRNet performs better than DeepLabv3, e.g. in Table 7.
Is that means OCRNet is not a robust structure as a newer method? In fact, OCRNet and DeepLabv3 perform comparably?

And BTW, are the scores in the tables are copied from original papers, or reimplemented by yourself?

Best

@CharlesPikachu
Copy link
Owner

Table 1-5 is used for ablation study, so all the reported scores are the reimplemented results for a fair comparison.

In Table 6-9, the reported scores of other methods are copied from original papers.

This is a common practice.

@EricKani
Copy link
Author

Thanks for your patient response. It's a great work!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants