tensorrt test time is not stable

[jiaqizhang123-stack]

Hello, when I use c++ to infer the engine file, when the nvidia driver version is a new version, the inference time is not stable(16-200ms)

But inference time is stable（16ms） when nvidia driver version is old. For example, nvGameS.dll is 27

I also tested different cuda version and trt version, I want to ask what is the reason for this, thanks for your answer.

[nvpohanh]

could you set your GPU to Performance mode?

[jiaqizhang123-stack]

Where should this be modified?

[jiaqizhang123-stack]

By modifying the parameters of the nvidia control panel, the test time is still unstable. What is the reason for this?

[nvpohanh]

Could be a driver bug...

[ttyio]

Closing since this seems not TRT bug, also for Windows I believe the OS and other app also try to use the GPU resource. Might need enable Windows TCC mode to make the perf stable.