Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test sets results #12

Closed
arash-ashra opened this issue Apr 25, 2020 · 7 comments
Closed

Test sets results #12

arash-ashra opened this issue Apr 25, 2020 · 7 comments

Comments

@arash-ashra
Copy link

For comparison in our paper, we are looking for the detailed test set results (class IoUs) of these prediction files that you shared: https://drive.google.com/drive/folders/156vMABydr7btdPDBU6b9J-e0jJHuPI73
Do you happen to have a snapshot of the submission results obtained with these predictions?
Thank you for your consideration.

@arash-ashra
Copy link
Author

arash-ashra commented Apr 25, 2020

Screenshot from 2020-04-25 05-45-09
Is the best prediction files the same as the ones submitted to the first submissions in this snapshot? how about without SegFix results?

@PkuRainBow
Copy link
Contributor

PkuRainBow commented Apr 25, 2020

@arashash Yes, it is the same.

hrnet_w48_ocr_b_hrnet48_8_20000_xx_pretrain_freeze_bn_1_test_ms_6x_mIoU_842.zip is the result w/o SegFix, which achieves 84.2 on Cityscapes test set.

segfix_hrnet_w48_ocr_b_hrnet48_8_20000_xx_pretrain_freeze_bn_1_test_ms_6x_mIoU_845.zip is the result w/ SegFix, which achieves 84.5 on Cityscapes test set.

@arash-ashra
Copy link
Author

Awesome. but there is no submission with 84.2 on Cityscapes test set right now. is it because it's replaced? if so do you have the screenshot of its detailed results?

@arash-ashra
Copy link
Author

by the way, how should we cite these results? should we use this:
@Article{yuan2020segfix,
title={SegFix: Model-Agnostic Boundary Refinement for Segmentation},
author={Yuan Yuhui and Xie Jingyi and Chen Xilin and Wang Jingdong},
journal={arXiv preprint},
year={2020}
}
or your earlier works?

@PkuRainBow
Copy link
Contributor

PkuRainBow commented Apr 26, 2020

Thanks.

You might consider citing both OCR and SegFix as below (you can update the arxiv id of SegFix after the paper is released),

@Article{yuan2019ocr,
title={Object-Contextual Representations for Semantic Segmentation},
author={Yuan Yuhui and Chen Xilin and Wang Jingdong},
journal={arXiv preprint arXiv:1909.11065},
year={2019}
}

@Article{yuan2020segfix,
title={SegFix: Model-Agnostic Boundary Refinement for Segmentation},
author={Yuan Yuhui and Xie Jingyi and Chen Xilin and Wang Jingdong},
journal={arXiv preprint},
year={2020}
}

@PkuRainBow
Copy link
Contributor

PkuRainBow commented Apr 26, 2020

Here is the screenshot of our previous submission of HRNet + OCR (w/o SegFix). I hope it helps!

screencapture-cityscapes-dataset-method-details-2020-04-26-10_00_36

@arash-ashra
Copy link
Author

Fantastic. Thank you so much

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants