Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What is the result of PointCNN in semantic3d dataset? #13

Closed
LZDSJTU opened this issue Mar 5, 2018 · 7 comments
Closed

What is the result of PointCNN in semantic3d dataset? #13

LZDSJTU opened this issue Mar 5, 2018 · 7 comments

Comments

@LZDSJTU
Copy link

LZDSJTU commented Mar 5, 2018

希望了解PointCNN在semantic3D数据集上的结果?以及训练这个数据集需要的时间?谢谢!

@yangyanli
Copy link
Owner

We are working on this dataset. The code for processing semantic3d at the moment probably is not a good solution. It just serves as an exemplar to demonstrate that semantic3d could be processed in a very similar way as that for ScanNet and S3DIS, though it won't lead to the best performance.

Compared with ScanNet and S3DIS, semantic3d is extremely dense (and yes, it takes longer to train/eval), and we are working on a way to better leverage all the training data, which is likely doable through a proper preprocessing, without touch the PointCNN core code.

So, please stay tuned ;-)

@LZDSJTU
Copy link
Author

LZDSJTU commented Mar 24, 2018

How long does it need to train the cls/seg network? What is your device?

@LZDSJTU
Copy link
Author

LZDSJTU commented Mar 26, 2018

I find that it may be overfitting using 1024 epoch in S3DIS. Do you have such problem?

@burui11087
Copy link
Collaborator

Hi, @LZDSJTU
We also have this problem. We can get almost 100 percision on training set, but only 80-90 acc on val. We still try to reslove this problem~~

@bw4sz
Copy link

bw4sz commented Jun 19, 2018

any update on semantic segmentation? I'm happy to chase preprocessing ideas. Are people seeing improvement over pointnet? I have that up and running and am decently happy with results. I'm debating trying pointnet++ or pointcnn.

@yangyanli
Copy link
Owner

Semantic3D is large in terms of point number, but rather small in terms of diverse scene. Due to this reason, we observed strong overfitting on Semantic3d. Nevertheless, we managed to achieve results that would reach 2nd place on the leader board. We believe the results can be further improved if we try some more data augmentation tricks, so we decided not to release our results on the leader board. Then we joined Alibaba and do not have enough time to play on this dataset (we have larger datasets to play with ;-).

In short, we believe PointCNN should perform well on Semantic3D, if you have time/patience in fighting against the overfitting.

@bw4sz
Copy link

bw4sz commented Sep 27, 2018 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants