Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about KPlanes result of DyNeRF dataset? #18

Closed
xuyaojian123 opened this issue Jan 24, 2024 · 4 comments
Closed

Question about KPlanes result of DyNeRF dataset? #18

xuyaojian123 opened this issue Jan 24, 2024 · 4 comments

Comments

@xuyaojian123
Copy link

xuyaojian123 commented Jan 24, 2024

image

May I ask whether your k-planes results are from orginal paper results or from your own actual runs to get? I trained the K-planes hybrid version using the DyNeRF dataset, following K-planes config file without making any other changes to the configuration. There are difference between the results in the paper and my results. sarafridov/K-Planes#30 (comment)

@dendenxu
Copy link
Member

dendenxu commented Jan 24, 2024

Hi @xuyaojian123 , we used their original code without change.

On the note of different metrics of yours than their paper, I must say it could get very hard to have an exact match of the numbers since different machines (gpus) use different heuristics in their underlying algorithms. In my experience, 3090 usually reports more stable results than 4090, and 4090 than A100 (so all of our quantitative experiments are done on 3090s). And if you trained the model on one machine (for example, a 3090), running the evaluation on a 4090 will produce a different metric number (usually worse). So maybe you could (1) rerun their experiments on a 3090 or (2) ask them for qualitative comparison images.

@xuyaojian123
Copy link
Author

谢谢,感谢你的回答,我也是在3090跑的,主要是我的结果和论文结果差距很大,特别是ssim指标。我需要在他的基础上做模型大小压缩。请问你在k-planes代码中修改了哪里让他训练全部300帧,而不是50帧,从而结果和他论文差不多的结果,感谢!!!

@dendenxu
Copy link
Member

谢谢,感谢你的回答,我也是在3090跑的,主要是我的结果和论文结果差距很大,特别是ssim指标。我需要在他的基础上做模型大小压缩。请问你在k-planes代码中修改了哪里让他训练全部300帧,而不是50帧,从而结果和他论文差不多的结果,感谢!!!

Sorry,我发现我看错你说的baseline了🤦‍,我们改的是hyperreel的配置,不是kplanes的。

@dendenxu
Copy link
Member

我们是直接跑的原版代码,看起来是你的evaluation方式没有和他们的code完全align?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants