multiple cpu cores

[nqvqb]

Hi,

Thank you very much for your guide and I finally got customised trained yolov3 tiny version working on my laptop. Also the yolov3 version is working at 4~5FPS. My pc shows 1 cpu is utilised at 100%, it is possible to allocate the computation to multiple cpus? I can tell the batch size is forced to 1, would it work in async with higher batch size and potentially increase over all inference speed when running a larger model like yolov3?

[PINTO0309]

The performance of OpenVINO depends on the total number of CPU cores. Please see the benchmark article below. I can not try because I do not have the following high-performance CPU.
https://www.intel.ai/cpu-inference-performance-boost-openvino/#gs.c1wkmh

[PINTO0309]

If you quantize a model, it may work even faster.
https://www.intel.ai/introducing-int8-quantization-for-fast-cpu-inference-using-openvino/#gs.c21087