How to test with PoinTr on my own dataset?

[JANEKKO]

Thanks a lot for your commit, could you please give some ideas on how to test with PoinTr on my own dataset?

[yuxumin]

@JANEKKO Hi,
First, create a dataset class for your own data in the form of ShapeNet-55 dataset class here, if you align the output for __getitem__ function with other dataset in this repo, you can save the time to modify the code in runner.py.
The config file for dataset class should be define in the cfgs/dataset_configs. For example, ShapeNet55_meta_config. It will be loaded and used when initialize the dataset class if you specify the _base_ in model config, like PoinTr_on_ShapeNet55.

Second, you can create a model config folder. For example. a config folder for ShapeNet55 here. And put the meta config for PoinTr into this folder. (Do not forget to modify the dataset config in this yaml file)

Last, you can test the pretrain PoinTr by change the config file to the newly create one.

[JANEKKO]

Thanks for your prompt replay, I need time to understand and figure it out. I will try! Thank you!

…

------------------ 原始邮件 ------------------ 发件人: "yuxumin/PoinTr" ***@***.***>; 发送时间: 2021年10月25日(星期一) 下午2:39 ***@***.***>; ***@***.******@***.***>; 主题: Re: [yuxumin/PoinTr] How to test with PoinTr on my own dataset? (Issue #11) @JANEKKO Hi, First, create a dataset class for your own data in the form of ShapeNet-55 dataset class here, if you align the output for __getitem__ function with other dataset in this repo, you can save the time to modify the code in runner.py. The config file for dataset class should be define in the cfgs/dataset_configs. For example, ShapeNet55_meta_config. It will be loaded and used when initialize the dataset class if you specify the _base_ in model config, like PoinTr_on_ShapeNet55. Second, you can create a model config folder. For example. a config folder for ShapeNet55 here. And put the meta config for PoinTr into this folder. (Do forget modify the dataset config in this yaml file) Last, you can test the pretrain PoinTr by change the config file to newly create one. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.

[yuxumin]

@JANEKKO feel free to reopen the issue if you find something difficult to cope with.

[blukaz]

Hi yuxumin,

Thanks for the insights, but I get the following error:
Traceback (most recent call last): File "main.py", line 68, in <module> main() File "main.py", line 64, in main run_net(args, config, train_writer, val_writer) File "/content/drive/MyDrive/ColabNotebooks/PoinTr_setup/PoinTr/tools/runner.py", line 17, in run_net (train_sampler, train_dataloader), (_, test_dataloader) = builder.dataset_builder(args, config.dataset.train), \ File "/content/drive/MyDrive/ColabNotebooks/PoinTr_setup/PoinTr/tools/builder.py", line 14, in dataset_builder dataset = build_dataset_from_cfg(config._base_, config.others) File "/content/drive/MyDrive/ColabNotebooks/PoinTr_setup/PoinTr/datasets/build.py", line 16, in build_dataset_from_cfg return DATASETS.build(cfg, default_args = default_args) File "/content/drive/MyDrive/ColabNotebooks/PoinTr_setup/PoinTr/utils/registry.py", line 148, in build return self.build_func(*args, **kwargs, registry=self) File "/content/drive/MyDrive/ColabNotebooks/PoinTr_setup/PoinTr/utils/registry.py", line 282, in build_from_cfg f'{obj_type} is not in the {registry.name} registry') KeyError: 'SIW is not in the dataset registry'

It seems that my custom dataset doesn't get loaded into the registry:
Registry(name=dataset, items={'KITTI': <class 'datasets.KITTIDataset.KITTI'>, 'PCN': <class 'datasets.PCNDataset.PCN'>, 'ShapeNet': <class 'datasets.ShapeNet55Dataset.ShapeNet'>})

I tried to debug it in the registry.py script, but I couldn't figure out what the problem is. In line 270 it merges the new config successfully and then gets kicked out at 278.

Note: I've added the dataset config file, model config file and the python script in the datasets folder.

Thanks in advance!

[yuxumin]

@blukaz Have you initialized your dataset class in the `datatsets/__init__.py'？ For example, here

[blukaz]

@yuxumin Thanks! That did the job

[blukaz]

Here is are some additional steps for others who are trying to train the PoinTr model on their own (custom) dataset:

• add this line in the ".datasets/init.py" script: import datasets.CUSTOMDATASETNAME
• add the support for your dataset in the ".tools/runner.py" script: take a look at line 82 (def run_net) and line 178 (def validate) in the code
• optional: if you need support for ".ply" files then you have to add this in ".datasets/io.py" script
• important: don't forget to center and normalize your point cloud data

[zura-false]

Here is are some additional steps for others who are trying to train the PoinTr model on their own (custom) dataset:

• add this line in the ".datasets/init.py" script: import datasets.CUSTOMDATASETNAME
• add the support for your dataset in the ".tools/runner.py" script: take a look at line 82 (def run_net) and line 178 (def validate) in the code
• optional: if you need support for ".ply" files then you have to add this in ".datasets/io.py" script
• important: don't forget to center and normalize your point cloud data

Excuse me, have you tried training this model on a dataset of large outdoor buildings

[JANEKKO]

【自动回复】已收到邮件。