New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
The error about training the S3DIS dataset #40
Comments
Hi @week0425 , |
Command: python tools/train.py configs/fcaf3d/fcaf3d_s3dis-3d-5class.py
|
Can you please try with our dockerfile or package versions from there, i.e. However anyway the error looks strange. I can have a look if nothing from above helps you... |
OK, I will try. I have tried to train S3DIS on the pointnet2. It worked well. So I think it may be not the environment's problem. I will give you a feedback when I find new messages. Thank you! |
Hi, @filaPro . I think I have found the reason, it's because the GPU doesn't have enough memory. So I will close this issue. Thanks again for your help. |
Hello, an error ocurred when I tried to train the S3DIS dataset:
Traceback (most recent call last):
File "tools/train.py", line 223, in
main()
File "tools/train.py", line 212, in main
train_model(
File "/mmdetection3d/mmdet3d/apis/train.py", line 27, in train_model
train_detector(
File "/opt/conda/lib/python3.8/site-packages/mmdet/apis/train.py", line 170, in train_detector
runner.run(data_loaders, cfg.workflow)
File "/opt/conda/lib/python3.8/site-packages/mmcv/runner/epoch_based_runner.py", line 127, in run
epoch_runner(data_loaders[i], **kwargs)
File "/opt/conda/lib/python3.8/site-packages/mmcv/runner/epoch_based_runner.py", line 50, in train
self.run_iter(data_batch, train_mode=True, **kwargs)
File "/opt/conda/lib/python3.8/site-packages/mmcv/runner/epoch_based_runner.py", line 29, in run_iter
outputs = self.model.train_step(data_batch, self.optimizer,
File "/opt/conda/lib/python3.8/site-packages/mmcv/parallel/data_parallel.py", line 67, in train_step
return self.module.train_step(*inputs[0], **kwargs[0])
File "/opt/conda/lib/python3.8/site-packages/mmdet/models/detectors/base.py", line 237, in train_step
losses = self(**data)
File "/opt/conda/lib/python3.8/site-packages/torch/nn/modules/module.py", line 889, in _call_impl
result = self.forward(*input, **kwargs)
File "/opt/conda/lib/python3.8/site-packages/mmcv/runner/fp16_utils.py", line 98, in new_func
return old_func(*args, **kwargs)
File "/mmdetection3d/mmdet3d/models/detectors/base.py", line 58, in forward
return self.forward_train(**kwargs)
File "/mmdetection3d/mmdet3d/models/detectors/single_stage_sparse.py", line 48, in forward_train
x = self.extract_feat(points, img_metas)
File "/mmdetection3d/mmdet3d/models/detectors/single_stage_sparse.py", line 40, in extract_feat
x = self.neck_with_head(x)
File "/opt/conda/lib/python3.8/site-packages/torch/nn/modules/module.py", line 889, in _call_impl
result = self.forward(*input, **kwargs)
File "/mmdetection3d/mmdet3d/models/dense_heads/fcaf3d_neck_with_head.py", line 102, in forward
x = self._prune(x, scores)
File "/mmdetection3d/mmdet3d/models/dense_heads/fcaf3d_neck_with_head.py", line 124, in _prune
prune_mask[permutation[mask]] = True
RuntimeError: invalid shape dimension -255
I don't know how to solve it. Looking forward to your reply!
The text was updated successfully, but these errors were encountered: