DepthImageToPointCloud does not handle frame offsets #12125
Labels
component: geometry perception
How geometry appears in color, depth, and label images (via the RenderEngine API)
priority: medium
type: feature request
type: MIT 6.4210
Related to http://manipulation.csail.mit.edu
@pangtao22 noticed that the RGB ad point clouds are off for the physical robot, and realized that our DepthImageToPointCloud class does not handle the case when the RGB camera frame is offset from the depth camera frame.
I'm not actually sure what the "right" algorithm is here (the projection seems nontrivial?). to leave myself a breadcrumb, the open3d version is here: http://www.open3d.org/docs/release/python_api/open3d.geometry.RGBDImage.html#open3d.geometry.RGBDImage.create_from_color_and_depth but opens with "RGBDImage is for a pair of registered color and depth images, viewed from the same view, of the same resolution. If you have other format, convert it first."
The text was updated successfully, but these errors were encountered: