Problem with GPU allocation after updating to CTranslate2 4.0.0

[carolinaxxxxx]

E.g. when the device_index = 1 parameter (GPU 1), the GPU 0 is charged with low value data (in my case about 250 MB) and GPU itself shows signs of work, although it should not. This is clearly the result of the CTranslate2 4.0.0. update. The GPU allocation option shows instability or ctranslate2 has made some changes as to the processing itself.. After returning to ctranslate2 3.2.4 the problem disappears.

[carolinaxxxxx]

[jordimas]

@carolinaxxxxx I have not look at this problem, but thanks for reporting it to the CTranslate2 project OpenNMT/CTranslate2#1628