About the dataset centroid initialization

[ShiMinghao0208]

About two hours passed，the ‘Initialize source-domain class centroids in the hybrid memory’ is still there.
Is this normal?

the nvidia-smi screen shot（it seem like normal）：

target-domin question：

[yxgeee]

It's abnormal. Did your GPUs work normally? Try to check it by nvidia-smi.

[ShiMinghao0208]

It's abnormal. Did your GPUs work normally? Try to check it by nvidia-smi.

today the ‘source-domain class centroids in the hybrid memory initialzation’ is very fast，but the ‘Initialize target-domain class centroids in the hybrid memory’ . please look my new screen shot..

[yxgeee]

It seems your GPUs did not run since the usage is 0% and the third GPU only occupied 983M. It's abnormal, but I did not meet such an issue in my machines. Try to use one GPU first and check if the problem occurs when communicating between multiple GPUs.

[ShiMinghao0208]

It seems your GPUs did not run since the usage is 0% and the third GPU only occupied 983M. It's abnormal, but I did not meet such an issue in my machines. Try to use one GPU first and check if the problem occurs when communicating between multiple GPUs.

thank u，one GPU did working，i will check the comunicating between multiple GPUs.
i'm sorry to disturb u

[ShiMinghao0208]

It seems your GPUs did not run since the usage is 0% and the third GPU only occupied 983M. It's abnormal, but I did not meet such an issue in my machines. Try to use one GPU first and check if the problem occurs when communicating between multiple GPUs.

emmmm，i trained 1 epoch，then a memory error has occurred， it is normal？ why after one epoch instead of the starting of trainning .. the screenshot i have updated..

[yxgeee]

use search_option=3 for compute_jaccard_distance

[ShiMinghao0208]

use search_option=3 for compute_jaccard_distance
ok i will try it ，thank u

[Emersonzc]

use search_option=3 for compute_jaccard_distance
ok i will try it ，thank u

hi， i met the same problem ,have you fix it ?