Failed to Achieve Expected Experimental Results

[mzsqw]

Hello, I replicated the experiment following the experimental setup in your paper's appendix and your code, but did not achieve the results mentioned in your code comments. Is there any additional configuration, such as Test Time Augmentation (TTA)? Or what could be the reason for this discrepancy?
Looking forward to your reply, thank you very much!

[youngskkim]

Hi, can you reproduce the reported number using the provided checkpoint?
If you can reproduce results by checkpoint, the performance gap can be caused by the training randomness.

The performances reported in config files are obtained without TTA.

[jaser-rayeh]

@SunLuyue26 Hello,
I encoutered some errors while trying to compile the CRN Checkpoint. I see that you came to measure its performance could you help me please solve this issue.

[loserhou]

Hello, I replicated the experiment following the experimental setup in your paper's appendix and your code, but did not achieve the results mentioned in your code comments. Is there any additional configuration, such as Test Time Augmentation (TTA)? Or what could be the reason for this discrepancy? Looking forward to your reply, thank you very much!

have you solved the problem?i also can't reproduce the results