CUDA/PyTorch Version Issues

[rlee3359]

Hi, thanks for the great work and sharing the code!

I'm trying to run the demos but having some trouble installing.
I followed the install instructions to install with conda. However, I'm having a CUFFT_INTERNAL_ERROR when trying to get the features:

x_freq = fft.fftn(x, dim=(-2, -1))

RuntimeError: cuFFT error: CUFFT_INTERNAL_ERROR

This seems to be caused by a CUDA bug in 1.6, as described here:
pytorch/pytorch#88038

Upgrading to pytorch 2.0 doesn't seem like an option since it's not compatible with detectron2, but pytorch 1.13.1 isn't compatible with CUDA 1.8 either.

Any ideas on how to resolve this?

Also, it might be worth adding a few lines to the installation instructions that cover Mask2Former installing in the third_party directory.

Thanks again, and I appreciate any help you can provide!

[Junyi42]

Hi,

Sorry for the late reply and thanks for your suggestions. I tested the installation process on my device with RTX3090s and it went fine. Could you please elaborate a bit more on the problem you met?

According to the information you shared, I would suggest you check where the line x_freq = fft.fftn(x, dim=(-2, -1)) came up and see if there is a way to bypass it.

Besides, another alternative way is to use the DIFT implementation for SD feature extractor to replace the ODISE's version. While this approach might give slightly worse result, it can bypass the installation of ODISE (and also the Mask2Former and detectron).

Best,
Junyi

[thanhnguyentung95]

Install torch==2.0.0 then rebuild detectron2, mask2former worked for me.