Why is the detection speed slow on GPU？

[Mrgao9]

Dear author, I use yolov5s.pt to detect images. It takes 289 ms per frame on CPU and 127 ms per frame on rtx3070 graphics card. Why is it slow on GPU? Pytorch version yolov5 takes 11 ms per frame on rtx3070 graphics card。

I look forward to your help！

[TongShuo-Demon]

同样想问一下，为什么我在libtorch上面比pytorch还慢？

[blackCmd]

• My env : Windows 10 + Quadro 8000.

So slow on GPU...... It about 10FPS
In Python version, the FPS is 45FPS.