Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What is your experiment environment? #18

Closed
susanbao opened this issue Apr 12, 2022 · 3 comments
Closed

What is your experiment environment? #18

susanbao opened this issue Apr 12, 2022 · 3 comments

Comments

@susanbao
Copy link

susanbao commented Apr 12, 2022

When I tried to train for SECOND. I meet this problem:
Traceback (most recent call last):
File "opencood/tools/train.py", line 138, in
main()
File "opencood/tools/train.py", line 100, in main
ouput_dict = model(batch_data['ego'])
File "/home/sas20048/anaconda3/envs/opencood/lib/python3.7/site-packages/torch/nn/modules/module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "/home/sas20048/code/OpenCOOD/opencood/models/second_intermediate.py", line 45, in forward
batch_dict = self.backbone_3d(batch_dict)
File "/home/sas20048/anaconda3/envs/opencood/lib/python3.7/site-packages/torch/nn/modules/module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "/home/sas20048/code/OpenCOOD/opencood/models/sub_modules/sparse_backbone_3d.py", line 106, in forward
x = self.conv_input(input_sp_tensor)
File "/home/sas20048/anaconda3/envs/opencood/lib/python3.7/site-packages/torch/nn/modules/module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "/home/sas20048/anaconda3/envs/opencood/lib/python3.7/site-packages/spconv/modules.py", line 134, in forward
input = module(input)
File "/home/sas20048/anaconda3/envs/opencood/lib/python3.7/site-packages/torch/nn/modules/module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "/home/sas20048/anaconda3/envs/opencood/lib/python3.7/site-packages/spconv/conv.py", line 181, in forward
use_hash=self.use_hash)
File "/home/sas20048/anaconda3/envs/opencood/lib/python3.7/site-packages/spconv/ops.py", line 95, in get_indice_pairs
int(use_hash))
ValueError: /home/sas20048/code/spconv/src/spconv/spconv_ops.cc 87
unknown device type

I found this issue traveller59/spconv#58 and tried their method. But failed.

So I think maybe my cuda version or pytorch version mismatches spconv1.2.1. So could you tell me your experiment environment information, especially for cuda and pytorch? Thanks.

I used cuda 10.1, pytorch 1.10.0.

@DerrickXuNu
Copy link
Owner

For sure! I know spconv can have some issues and give you a hard time....
OS: Ubuntu 1804
Pytorch: 1.10.2
CUDA version: Cuda compilation tools, release 11.1, V11.1.105

Can you run pointpillar or voxelnet? Is it just SECOND?

@susanbao
Copy link
Author

susanbao commented Apr 12, 2022

I just met this problem on SECOND. the other three models work fine.

@DerrickXuNu
Copy link
Owner

Ok,as this is mainly an issue related to spconv, I will close it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants