Cannot replicate experiments/neuralvolumes results: Completely vague output and vanishing kldiv

[RogerDAI1217]

Hi, could someone kindly help me? I cannot replicate the output results in experiments/neuralvolumes. I have successfully built the extension and download the experiment.zip in the latest release. However, the output images are completely vague. I found that my kldiv term is quickly vanishing to 0, while in the example log.txt file given in experiment.zip, the kldiv terms remain larger than 0.3.

Below are my outputs after 79579, 92139, and 106682 iterations.

Here I append my log.txt file which contains my configuration information and training statistics:
log.txt

I'm not sure where is the problem. Incorrect camera pose? Or the code in this repository has some bugs. Really hope some kind guy could help me. Thanks!
:)

[RogerDAI1217]

Also, my irgbmse remains larger, while the irgbmse in the sample file in experiments.zip decreases quickly.
:(

[stephenlombardi]

Hi,

Please post your version of python, pytorch, gcc, and cuda. Also please post the output of building the CUDA extensions. I'm guessing this is a problem with your environment because I just built the extensions and tested the training code on an instance of Google colab and it appears to be training fine:

(the Colab instance is running with Python 3.7.14, GCC 7.5.0, PyTorch 1.12.1+cu113)