You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am trying to train various models on custom data. However, with OA-CNN I encounter the problem below.
Traceback (most recent call last):
File "/workspace/Pointcept/tests/test_models.py", line 216, in test_oacnn
self._model_dict_for_val_loader(self.model_definition_dict["oacnn"])
File "/workspace/Pointcept/tests/test_models.py", line 209, in _model_dict_for_val_loader
output_dict = model(input_dict)
File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "/workspace/Pointcept/pointcept/models/default.py", line 20, in forward
seg_logits = self.backbone(input_dict)
File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "/workspace/Pointcept/pointcept/models/oacnns/oacnns_v1m1_base.py", line 324, in forward
x = self.enc[i](x)
File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "/workspace/Pointcept/pointcept/models/oacnns/oacnns_v1m1_base.py", line 158, in forward
x = self.down(x)
File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "/opt/conda/lib/python3.10/site-packages/spconv/pytorch/modules.py", line 138, in forward
input = module(input)
File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "/opt/conda/lib/python3.10/site-packages/spconv/pytorch/conv.py", line 755, in forward
return self._conv_forward(self.training,
File "/opt/conda/lib/python3.10/site-packages/spconv/pytorch/conv.py", line 408, in _conv_forward
raise e
File "/opt/conda/lib/python3.10/site-packages/spconv/pytorch/conv.py", line 385, in _conv_forward
res = ops.get_indice_pairs_implicit_gemm(
File "/opt/conda/lib/python3.10/site-packages/spconv/pytorch/ops.py", line 460, in get_indice_pairs_implicit_gemm
raise ValueError(
ValueError: your out spatial shape [12, 12, 0] reach zero!!! input shape: [25, 25, 1]
I can influence the number of input files where this error occurs by the grid size of the sampling I choose. I.e. with a grid-size of 0.1 it fails on 17/174 files; with a grid size of 0.01 it fails on only 4/174 files.
I took a look at the grid_coord and noticed that all data on which it fails have a range (max grid_coord - min grid_coord) in the z-component of less than 15. Equaling 15 and above it just works fine. Looking at the failure cases also showed that all failures correspond to flat surfaces on e.g. streets. See example below (blue background comes from visualizing with CloudCompare)
Do you have any workaround so that OA-CNN can be trained and (especially) evaluated on all data?
The text was updated successfully, but these errors were encountered:
Thanks! I changed the torch.add(..., 1) to torch.add(..., 96) as in the other issue and it worked. Wouldn't it be better to introduce a parameter for the configuration for that?
Hi, first of all thanks for the nice repository.
I am trying to train various models on custom data. However, with OA-CNN I encounter the problem below.
I can influence the number of input files where this error occurs by the grid size of the sampling I choose. I.e. with a grid-size of
0.1
it fails on 17/174 files; with a grid size of0.01
it fails on only 4/174 files.I took a look at the
![image](https://private-user-images.githubusercontent.com/1538444/331082949-6bfe1f4a-8e85-4b26-9978-a176e9bb2045.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg5OTI0ODksIm5iZiI6MTcxODk5MjE4OSwicGF0aCI6Ii8xNTM4NDQ0LzMzMTA4Mjk0OS02YmZlMWY0YS04ZTg1LTRiMjYtOTk3OC1hMTc2ZTliYjIwNDUucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDYyMSUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA2MjFUMTc0OTQ5WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MDM1YTU3ZDc5NzljZDc3NWExNTNlYjdlNTRmNDRlNWE4NDkxZTczNzI5ZTJkYWIxMTMyZDIzNDVjZmVhNTdkMiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.NBYto6sewINIGsXwjpi75-URAZInA17DsFXjRR7wE60)
grid_coord
and noticed that all data on which it fails have a range (max grid_coord - min grid_coord) in the z-component of less than 15. Equaling 15 and above it just works fine. Looking at the failure cases also showed that all failures correspond to flat surfaces on e.g. streets. See example below (blue background comes from visualizing with CloudCompare)Do you have any workaround so that OA-CNN can be trained and (especially) evaluated on all data?
The text was updated successfully, but these errors were encountered: