Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to reproduce llff dataset #2040

Open
zkaiWu opened this issue Jun 6, 2023 · 5 comments
Open

How to reproduce llff dataset #2040

zkaiWu opened this issue Jun 6, 2023 · 5 comments

Comments

@zkaiWu
Copy link

zkaiWu commented Jun 6, 2023

I use the command

"ns-process-data images --data /data5/wuzhongkai/data/dreamfusion_data/llff/nerf_llff_data/flower --output-dir /data5/wuzhongkai/data/dreamfusion_data/llff/nerf_llff_data/flower --skip_colmap --colmap_model_path sparse/0 --skip_image_processing"

to generate transform.json and use the command

CUDA_VISIBLE_DEVICES=$1 ns-train nerfacto --data /data/nerf_llff_data/flower/transforms.json
--experiment-name llff/flower --vis wandb
nerfstudio-data

to train the model, but get bad result.
Are there any key points to train the nerfacto on llff

@lixinyu123-lxy
Copy link

almost the same.I use vanilla-nerf to train the fox dataset of instant-ngp but get awful result with blurry color blocks but no convergence. I use the same command "ns-process-data ..." and get a transforms.json and then use command "ns-train vanilla-nerf ...... nerfstudio-data" to train it. Also ,I notice that it works the same in mipnerf , and it's weird that its training time remain the same when I use different numbers of pictures to train.
image

@tancik
Copy link
Contributor

tancik commented Jun 9, 2023

The vanilla-nerf and mipnerf models are setup to work with the blender synthetic data, not real-world data. For real-world data, use nerfacto or instant-ngp

@lixinyu123-lxy
Copy link

和模型设置为使用搅拌机合成数据,而不是真实世界的数据vanilla-nerfmipnerf对于真实世界的数据,使用nerfactoinstant-ngp

How can I prepare this Blender data to train and reconstruct on Mip-NeRF or Vanilla-NeRF by using colmap? I also noticed that if the command ns-train is used without the nerfstudio-data suffix, the system assumes the data format is Blender data, but it throws an error saying that transforms_train.json cannot be found.

@MvWouden
Copy link
Contributor

The vanilla-nerf and mipnerf models are setup to work with the blender synthetic data, not real-world data. For real-world data, use nerfacto or instant-ngp

Are there any mipnerf parameters we could try to change to make it more "suitable" for real-world bounded data like this?

@Arcxml
Copy link

Arcxml commented Mar 2, 2024

Hello, I would like to ask if you have solved this problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants