-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
colored point cloud streaming #15
Comments
From Intel tuning-depth-cameras-for-best-performance The optimal depth resolution is:
From librealsense#7820
|
From Intel tuning-depth-cameras-for-best-performance\
So we should expect worse result with RGB sensor aligned to depth (or depth aligned to RGB sensor) compared to texturing depth with IR. |
From #14 FOV, for D435 Aligning depth to color will:
Aligning color to depth will:
librealsensee align example may be used to see what happens during alignment (cropping). |
From librealsense#3042 YUYV is the native format of RGB sensor data. Ideally we would want to use YUYV format for RGB sensor to avoid unnecessary conversions. From libreasense alignment code we see that it is not possible to align to depth with YUYV color format. From HVE#18 VAAPI supports both YUYV (yuyv422) and RGBA8/BGRA8 (but not RGB8/BGR8) as rgb0/bgr0 The best we can do is:
|
In theory alignment should be performed for undistorted images. From librealsense#1430 D400 doesn't use distortion models (all coefficients as 0).
As far as I know nothing has changed in this area (undistortion code present but coefficents always zeroed). |
- alignment direction CLI argument - YUYV/RGBA for color/depth alignment direction - librealsense not supporting YUYV alignment to depth - but YUYV is native Realsense format (optimal) - so we use it when possible (aligning to color) - determine result resolutions on alignment direction Related to #15
Functionally it is finished. Readme needs some update before merging. |
- add aligned depth + color info Related to #15
Ready for merge |
Stream aligned depth and RGB color encoded in HEVC Main10 and HEVC Main. - implemented in separate example (realsense-nhve-depth-color) - additional user control over - resolutions - alignment direction - calculates and outputs FOV along intrinsics - YUYV/RGBA for color/depth alignment direction - librealsense not supporting YUYV alignment to depth - but YUYV is native Realsense format (optimal) - so we use it when possible (aligning to color) - update readme Finishes (implementation) #15 RNHVE part of bmegli/hardware-video-streaming#8 Related to #13
Merged. The last thing to do is to update how-it-works section on wiki. |
finished |
Continuing #13
RNHVE part of HVS#8
Proof-of-concept already implemented in depth-color branch.
The text was updated successfully, but these errors were encountered: