Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NUM_ENVIRONMENTS setting #7

Closed
zhangpingrui opened this issue Jun 22, 2024 · 2 comments
Closed

NUM_ENVIRONMENTS setting #7

zhangpingrui opened this issue Jun 22, 2024 · 2 comments

Comments

@zhangpingrui
Copy link

This is really a nice work! But there are some questions I want to ask.
I found that when I set NUM_ENVIRONMENTS>1, this code will run fail. Is that because in this method NUM_ENVIRONMENTSonly can be 1? And by the way, how much time does the training procedure take?

@MrZihan
Copy link
Owner

MrZihan commented Jun 22, 2024

Hello! Currently our code only allows setting NUM_ENVIRONMENTS to 1. We are working on improving it to support NUM_ENVIRONMENTS > 1. Additionally, we used 4 RTX 3090 GPUs to pre-train the HNR model for over one week. If you find the current code settings to be slow for training, you can try the following methods:

  1. In NeRF/models/Policy_ViewSelection_ETP.py, reduce the number of point clouds saved for RGB rendering; this will not affect the quality of the predicted semantic representation.
    92a11e3ea418e6c9d458f82494f4c4c

  2. In Lookahead\NeRF\models\etp\nerf.py, reduce the number of sampled rays used for RGB rendering training within each batch.
    b3f6bb80b508dc4bf3bf647004e48bd

  3. In Lookahead\NeRF\ss_trainer_ETP.py, reduce the number of subregions used for local semantic alignment.
    c935beb972fdf547e956ab80e441aea

If only novel view representation is needed and RGB rendering is not required, you can remove the code used for RGB rendering. This will result in much faster training.

If you have any other questions, please feel free to ask.

@zhangpingrui
Copy link
Author

Hello! Currently our code only allows setting NUM_ENVIRONMENTS to 1. We are working on improving it to support NUM_ENVIRONMENTS > 1. Additionally, we used 4 RTX 3090 GPUs to pre-train the HNR model for over one week. If you find the current code settings to be slow for training, you can try the following methods:

  1. In NeRF/models/Policy_ViewSelection_ETP.py, reduce the number of point clouds saved for RGB rendering; this will not affect the quality of the predicted semantic representation.
    92a11e3ea418e6c9d458f82494f4c4c
  2. In Lookahead\NeRF\models\etp\nerf.py, reduce the number of sampled rays used for RGB rendering training within each batch.
    b3f6bb80b508dc4bf3bf647004e48bd
  3. In Lookahead\NeRF\ss_trainer_ETP.py, reduce the number of subregions used for local semantic alignment.
    c935beb972fdf547e956ab80e441aea

If only novel view representation is needed and RGB rendering is not required, you can remove the code used for RGB rendering. This will result in much faster training.

If you have any other questions, please feel free to ask.

Thanks for your reply! It's really helpful!

@MrZihan MrZihan closed this as completed Jun 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants