Results on S3DIS benefit from pretraining on ScanNet, so is it a fair comparision with other methods?

[xiaodongww]

Hi, thanks for your great job on SoftGroup. I have a question about the training of S3DIS. It seems that the model is initialized from a model pre-trained on ScanNet. This means that external data is used in the evaluation process of S3DIS. Are the results comparable to those of other work (like PointGroup, SSTNet, and HAIS)?

[thangvubk]

I contacted the authors of HAIS and asked for training on S3DIS. Training S3DIS from ScanNet checkpoint is suggested by them. I am pretty sure that HAIS also uses ScanNet pretraining for S3DIS. Furthermore, PointGroup and SSTNet do not have released code for S3DIS. I am not sure how they trained on S3DIS.

[xiaodongww]

Thanks for your quick reply very much. Do you have the results of S3DIS training from scratch? Is the improvement huge with the help of pertaining on ScanNet?

[thangvubk]

I will benchmark it when available.