cuda error

[mmoghadam11]

loading annotations into memory...
Done (t=0.01s)
creating index...
index created!
[ ] 0/4750, elapsed: 0s, ETA:THCudaCheck FAIL file=src/roi_align_kernel.cu line=145 error=209 : unrecognized error code
Traceback (most recent call last):
File "/content/CG-Net/tools/test.py", line 212, in
main()
File "/content/CG-Net/tools/test.py", line 182, in main
outputs = single_gpu_test(model, data_loader, args.show, args.log_dir)
File "/content/CG-Net/tools/test.py", line 38, in single_gpu_test
result = model(return_loss=False, rescale=not show, **data)
File "/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(*input, **kwargs)
File "/usr/local/lib/python3.7/dist-packages/torch/nn/parallel/data_parallel.py", line 150, in forward
return self.module(*inputs[0], **kwargs[0])
File "/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(*input, **kwargs)
File "/content/CG-Net/mmdet/models/detectors/base_new.py", line 97, in forward
return self.forward_test(img, img_meta, **kwargs)
File "/content/CG-Net/mmdet/models/detectors/base_new.py", line 86, in forward_test
return self.simple_test(imgs[0], img_metas[0], **kwargs)
File "/content/CG-Net/mmdet/models/detectors/RoITransformer.py", line 265, in simple_test
x[:len(self.bbox_roi_extractor.featmap_strides)], rois)
File "/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(*input, **kwargs)
File "/content/CG-Net/mmdet/models/roi_extractors/single_level.py", line 86, in forward
roi_feats_t = self.roi_layers[i](feats[i], rois_)
File "/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(*input, **kwargs)
File "/content/CG-Net/mmdet/ops/roi_align/modules/roi_align.py", line 16, in forward
self.spatial_scale, self.sample_num)
File "/content/CG-Net/mmdet/ops/roi_align/functions/roi_align.py", line 32, in forward
sample_num, output)
RuntimeError: cuda runtime error (209) : unrecognized error code at src/roi_align_kernel.cu:145

[WeiZongqi]

Hi，may be mmcv verision problem, you can try pip install mmcv==0.2.15.

[mmoghadam11]

pip install mmcv==0.2.15

i use google colab for runing...when it gives tesla tesla t4 or tesla p4 gpu everything works good

but when it gives tesla k80...it gives cuda error
i changed the mmcv to 0.2.15 but stil get error:
.
.
.
RuntimeError: cuda runtime error (209) : unrecognized error code at src/roi_align_kernel.cu:145