How to deal with out of cuda memory?

[qiuzhen8484]

Hello, looking for your reply. The code "self.CoVariance = torch.zeros(class_num, feature_num, feature_num).cuda()" needs too much cuda memory when the feature_num is large such as 2048. How to deal with it? I cannot put it onto a GPU.

[kxgong]

Hi, there are two ways to remedy this problem.

1. Decrease the batch size.
2. Approximate the covariance matrices by their diagonals, i.e., the variance of each dimension of the features. In this way, you only need to create a tensor with size (class_num, feature_num).