One GPU is working during Evaluation

[khawar-islam]

Hi @zhongyy

I have noted that while training all GPUs are working but when performance evaluation is started only 1 GPU is used. Would it be possible to use four GPUs during performance evaluation? It will make the process faster.

Regards,
Khawar

[zhongyy]

Hi Khawar, Sorry for the late reply. Thanks for your interests, and good advices. While it is not easy for me to implement your good ideas. Transformers realy consumes a lot and I am busy with another project these days. So I am afraid that I cannot update it.