UserWarning: Grad strides do not match bucket view strides

[LeoXinhaoLee]

Hi, thank you very much for releasing code for this inspiring work! When I try to run the code of the RGBD part, though the code is totally runnable, I encounter this warning at the beginning of training:

UserWarning: Grad strides do not match bucket view strides. This may indicate grad was not created according to the gradient layout contract, or that the param's strides changed since DDP was constructed.  This is not an error, but may impair performance.
grad.sizes() = [1, 64], strides() = [1, 1]
bucket_view.sizes() = [1, 64], strides() = [64, 1] (Triggered internally at ../torch/csrc/distributed/c10d/reducer.cpp:323.)
  Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass

I'm wondering what could be the cause of it and if it will really have any influence on performance. Thank you very much for your time and help!