Number of sampling when i evaluate on regression model

[markkim1115]

HI. Thank you for good research and code sharing!

I have a question about regression performance.

How much the number of generated samples affects to performance?

In your code, default setting is 4096 for evaluation, but my 24GB GPU memory cannot hold it during evaluation(OOM problem)

So, i tried to evaluate with 2048 samples. Would it affect on performance?
On 3DPW, i got ..
mode_re: 59.83 mm
min_re: 41.92 mm
(* Paper performance)
mode_re : 59.8 / min_re : 40.8
On MPII3DHP,
mode_re: 64.68 mm
min_re: 50.29 mm
(* Paper performance)
mode_re : 65.0 / min_re : Not reported?

Actually, mode reconstruction and min reconstruction performance are pretty close.
But i'm curious.

Thanks!

[nkolot]

The number of samples only affects the minimum error, not the mode error.
Actually 4096 samples should easily fit on a 24GB GPU if you decrease the batch size.

[markkim1115]

Thanks for your quick response!