Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DetectNet freezes and stops publishing #16

Closed
GEngels opened this issue Nov 22, 2022 · 7 comments
Closed

DetectNet freezes and stops publishing #16

GEngels opened this issue Nov 22, 2022 · 7 comments
Assignees
Labels
bug Something isn't working

Comments

@GEngels
Copy link

GEngels commented Nov 22, 2022

We have been very happy with your Isaac repo, but yesterday I ran into a small problem. After running the object detector for a couple of minutes the publishing freezes and nothing is published to the topic. If you then a ros command like (ros2 topic list, topic echo, etc) it continues again for a couple of minutes and freezes at some point. By calling a ros command you seem to trigger something and make it restart.

Nothing is publishes to the encoder so there is also nothing at the topic /detectnet/detections, but it seems to already stagnate at /tensor_pub. We are testing with a realsense camera and the image topic of the realsense keeps working, so that doesn't seem to be the problem.

Any idea what could be going wrong?

@Ilia-Kovalev
Copy link

I'm a colleague of @GEngels and after some extra investigation I can add the following:

  • the problem disappears after changing component container type to component_container instead of component_container_mt
  • the problem still appears when I launched only two nodes: realsense2_camera and isaac_ros_dnn_encoders

@swapnesh-wani-nvidia
Copy link

Thank you for the feedback. Could you please provide more details on how to reproduce the issue? Which platform are you running this on? Which RealSense camera?

@swapnesh-wani-nvidia swapnesh-wani-nvidia self-assigned this Nov 28, 2022
@swapnesh-wani-nvidia swapnesh-wani-nvidia added the needs info Needs more information label Nov 28, 2022
@GEngels
Copy link
Author

GEngels commented Nov 29, 2022

We are using a Jetson AGX Orin with the D455 realsense camera. We are running everything inside a docker container with DP 1.1 Release.

@Ilia-Kovalev
Copy link

With DP 2 release the problem occurs too.

@jaiveersinghNV jaiveersinghNV added bug Something isn't working and removed needs info Needs more information labels Dec 5, 2022
@jaiveersinghNV
Copy link
Contributor

Thanks for the additional information, we are looking into this.

@GEngels
Copy link
Author

GEngels commented May 31, 2023

Any update on this?

@hemalshahNV
Copy link
Contributor

We have not been able to reproduce this. Can you see this on other AGX Orin units?

Notes from SQA below.

  • Xavier AGX + isaac_ros_detectnet (public DP2) + realsense camera (D435) [>4Hrs]
  • Xavier AGX + isaac_ros_detectnet (public DP2) + realsense Rosbags (provided rosbag in quickstart, freshly recorded rosbag) [>4Hrs]
  • Orin AGX + isaac_ros_detectnet (public DP2, internal DP_1.1) + realsense Rosbags (provided rosbag in quickstart, freshly recorded rosbag) [>4Hrs]
    Also checked with running just realsense2_camera node and isaac_ros_dnn_encoders ... to see if it freezes (mentioned in #2).. Still no repro.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

5 participants