InsertNeRF: Instilling Generalizability into NeRF with HyperNet Modules

Installation

Setup

Clone this repository:

git clone https://github.com/bbbbby-99/InsertNeRF.git
cd InsertNeRF
pip install -r requirements.txt

Train generalization model

Train the model with NeuRay initialized from estimated depth of COLMAP:

python run_training.py --cfg configs/train/gen/insert_gen_depth_train.yaml

Models will be saved at data/model.

Render with trained models

python render.py --cfg configs/gen/insert_gen_depth_train.yaml

Evaluation

Evaluation on all scenes in datasets, psnr/ssim/lpips will be printed on screen.

python eval.py

Results

InsertNeRF

Results for all scenes are obtained through our InsertNeRF rendering following Setting I, without any retraining in testing scenes.

Insert-NeRF++

Insert-mip-NeRF

It will be released soon.

Acknowledgements

In this repository, we build our codes based on the NeuRay. We thank all the authors for sharing great codes.