Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hole-filling filter for depth images #170

Open
vinesmsuic opened this issue Jan 2, 2021 · 1 comment
Open

Hole-filling filter for depth images #170

vinesmsuic opened this issue Jan 2, 2021 · 1 comment
Assignees
Labels
enhancement New feature or request help wanted Extra attention is needed triage approved The Issue has been reviewed and approved for development by the Azure Kinect ROS Driver Team

Comments

@vinesmsuic
Copy link

vinesmsuic commented Jan 2, 2021

Is your feature request related to a problem? Please describe.

Hi, I am new to Kinect and ROS. I am trying to write an object tracking program with accurate distance info. I tried to retrieve the depth frames from the Kinect on ROS1 and I found some depth pixels are having 0 distance (shown black in the image). I guess the distance is out of range or the material is special that the IR cant reach. Are there any filters provided by Azure_Kinect_ROS_Driver that can help me to fix the hole problem of Kinect? Or we are supposed to implement our own Holes Filling filter?
The below image showing the depth_to_rgb/image_raw topic with the hole/noise problem.

Are there also any ways to configure the max depth when launching driver.launch? I saw the operating range are at most 5.5m in the documentation page but somehow I found it can detect up to 7m.

Describe the solution you'd like

I did some research and I found the hole-filling filter can be implemented using the Region Growing technique and Gaussian/Bilateral filter. I am not sure how it can be implemented efficiently but I noticed the ROS Wrapper for Intel® RealSense has a launch parameter allowing the user to apply some filters to the depth image.

@vinesmsuic vinesmsuic added enhancement New feature or request triage needed The Issue still needs to be reviewed by the Azure Kinect ROS Driver Team labels Jan 2, 2021
@vinesmsuic vinesmsuic changed the title Holes Filling filter for Depth Images Hole-Filling filter for Depth Images Jan 2, 2021
@vinesmsuic vinesmsuic changed the title Hole-Filling filter for Depth Images Hole-filling filter for depth images Jan 2, 2021
@ooeygui ooeygui added help wanted Extra attention is needed triage approved The Issue has been reviewed and approved for development by the Azure Kinect ROS Driver Team and removed triage needed The Issue still needs to be reviewed by the Azure Kinect ROS Driver Team labels Jan 4, 2021
@ooeygui
Copy link
Member

ooeygui commented Jan 4, 2021

Thank you for the feature request. This seems like a good feature to have, especially under a dynamic configuration option with hardware acceleration.

I've added a Help Wanted tag to this incase anyone wants to take a crack at it.

Otherwise, we will investigate adding it once we have completed some hardware acceleration workstreams.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed triage approved The Issue has been reviewed and approved for development by the Azure Kinect ROS Driver Team
Projects
None yet
Development

No branches or pull requests

3 participants