Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question]Reproduce the results of RibFrac Task #6

Closed
carlinl opened this issue Jun 22, 2021 · 5 comments
Closed

[Question]Reproduce the results of RibFrac Task #6

carlinl opened this issue Jun 22, 2021 · 5 comments
Labels
question Default label

Comments

@carlinl
Copy link

carlinl commented Jun 22, 2021

Hello

I was wondering what kinds of preprocessing methods did you use to get this mAP, like crop size and spacing? Thanks for your marvelous job by the way!

image

@mibaumgartner
Copy link
Collaborator

mibaumgartner commented Jun 22, 2021

Hi @carlinl ,

you can check our paper(will be linked to the readme soon) for more info on how we came up with the hyperparameters and the whole preprocessing/training/inference pipeline.

RibFrac:
Target Spacing is [1.25, 0.73, 0.73] and the patch size is [112 160 160] with batch size 4. These settings will work on GPUs with 11GB of VRAM (e.g. RTX 2080TI).

Please note that our numbers are not directly comparable to the live leaderboard due to several reasons:

  • the reported numbers are Box mAP at an IoU of 0.1 while the official challenge is an Instance Segmentation Task with FROC and an IoU of 0.25. (in case you rerun our experiment and check the FROC score reported by nnDet, note that the False Positive thresholds between nnDet and the challenge are different)
  • we used a 5 fold cross-validation scheme for the numbers.

Best,
Michael

@mibaumgartner mibaumgartner added the question Default label label Jun 22, 2021
@carlinl
Copy link
Author

carlinl commented Jun 22, 2021

Thanks for your reply, it helps a lot!

@BelieferQAQ
Copy link

Thanks for your reply, it helps a lot!

Hello, how long does it take you to train a round? Why do I need about 4 hours? 3090ti. Can you add a QQ for discussion.318831418

@BelieferQAQ
Copy link

Hi @carlinl ,

you can check our paper(will be linked to the readme soon) for more info on how we came up with the hyperparameters and the whole preprocessing/training/inference pipeline.

RibFrac: Target Spacing is [1.25, 0.73, 0.73] and the patch size is [112 160 160] with batch size 4. These settings will work on GPUs with 11GB of VRAM (e.g. RTX 2080TI).

Please note that our numbers are not directly comparable to the live leaderboard due to several reasons:

  • the reported numbers are Box mAP at an IoU of 0.1 while the official challenge is an Instance Segmentation Task with FROC and an IoU of 0.25. (in case you rerun our experiment and check the FROC score reported by nnDet, note that the False Positive thresholds between nnDet and the challenge are different)
  • we used a 5 fold cross-validation scheme for the numbers.

Best, Michael

Hello, my target spacing, patch size and batch size are the same as yours. The GPU is 24GB (3090ti). It takes more than 3 hours to train an epoch. Is it normal? How long will you train?

@mibaumgartner
Copy link
Collaborator

Continued in #102

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Default label
Projects
None yet
Development

No branches or pull requests

3 participants