Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sdf mode PSNR problem #58

Open
trebladev opened this issue Jun 6, 2023 · 5 comments
Open

sdf mode PSNR problem #58

trebladev opened this issue Jun 6, 2023 · 5 comments

Comments

@trebladev
Copy link

Hi,
I just use the scripts/runall_syn_sdf.sh to run sdf mode.
But I found that the PSNR of sdf mode is just 18 in chair scene, I get 34 without sdf mode.
Is that normal?
Thanks.

@trebladev
Copy link
Author

And when I train the ship, it will error below when epoch 40-45
loss=nan (nan) lr=0.007100: : 86% 86/100 [00:00<00:00, 98.30it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007100: : 87% 87/100 [00:00<00:00, 98.30it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007099: : 88% 88/100 [00:00<00:00, 98.30it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007099: : 89% 89/100 [00:00<00:00, 98.30it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007098: : 90% 90/100 [00:00<00:00, 98.30it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007098: : 91% 91/100 [00:00<00:00, 98.30it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007097: : 93% 93/100 [00:00<00:00, 98.93it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007097: : 93% 93/100 [00:00<00:00, 98.93it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007096: : 94% 94/100 [00:00<00:00, 98.93it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007096: : 95% 95/100 [00:00<00:00, 98.93it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007095: : 96% 96/100 [00:00<00:00, 98.93it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007094: : 97% 97/100 [00:01<00:00, 98.93it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007094: : 98% 98/100 [00:01<00:00, 98.93it/s]NaN or Inf found in input tensor.

@Seiano
Copy link

Seiano commented Jul 20, 2023

貌似sdf模式不仅降低了psnr的值,而且训练速度也很慢。

@fatbao55
Copy link

I also encountered the same problem NaN or Inf found in input tensor for certain examples. @trebladev Have you found the fix?

@juuso-oskari
Copy link

Same error here, at least with the synthetic scenes

@zzj403
Copy link

zzj403 commented Mar 16, 2024

I also encountered the same problem NaN or Inf found in input tensor for certain examples. @trebladev Have you found the fix?

same problem. Wondering reason. also be seen in #96

here is some result in lego
ngp_stage0_ep0060_0076_rgb_proc

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants