GPU vs CPU Performance

[Mom0aut]

Hello,

first of all i wanna say thank you for this great Framework and those tuned Hyper parameters.

Now to my question:
I tested the performance with my own gym/baselines examples and there were only 5-10 seconds difference.
I also tested your implementation and the difference vs CPU and GPU is really small (about 5 sec.).
Is this an normal behavior or must be the difference much higher (maybe i installed the nvidia-docker wrong with the wrong nvidia-runtime settings) ?

I hope maybe you can help me out

Thanks!!!

Regards Mom0

[araffin]

Duplicate of hill-a/stable-baselines#308

Also related: hill-a/stable-baselines#367

So for short, for small networks, there won't be any difference between of communication delay and also passing data from cpu to gpu back and forth. For bigger architecture and especially CNN, you should see a boost when using GPU.

[Mom0aut]

Ok thank you for your fast response.

I didn´t know that, i will try so test bigger networks.