Extraction of depth map and normal map

[gwang-kim]

Hi,
Thank you for the great work!
I'm assuming that we can render depth and normal map from the learned point clouds.
Could you give any tips for extracting depth and normal map from the learned models?

Thanks,
Bradley

[dendenxu]

Hi, the depth map extraction is already supported and enabled by default.
For offline rendered depth, you can find the rendered depth image if you've run some training at data/result/xxx/DEPTH.
For online rendering, you can find the depth visualization in the Rendering tab and Visualization node.

For normal maps, I think it should be possible to have one by applying normal estimation methods on the point clouds directly (the quality might suffer). But generally, the point cloud representation of 4K4D doesn't incorporate normal extraction directly.
Reference implementation:

4K4D/easyvolcap/utils/gl_utils.py

Line 294 in a79cba4

def est_pcd_norms():

Another interesting directly is to compute the normal map as the gradient of the depth map. I think it should lead to better quality than the method I mentioned above.