-
Notifications
You must be signed in to change notification settings - Fork 254
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Xavier NX and Yolov4-Tiny #1
Comments
@MuhammadAsadJaved |
OK. Thank you very much. |
Hi, please install TensorRT 7. You can try my script |
OK. Let me give it a try. Thank you. @GeekAlexis |
@GeekAlexis |
@xhzzc1994 What is your Jetpack version on AGX Xavier? Did you run |
@xhzzc1994 @MuhammadAsadJaved For Ubuntu 16.04, it appears it might be related to dusty-nv/jetson-inference#281 (comment). |
@GeekAlexis Actually can not reinstall cuda cudnn etc packages because existing cuda and cudnn etc packages are configured with a lot of running projects. |
@MuhammadAsadJaved In that case, it would be better to use an Nvidia docker container. But I don't have time to investigate it for now. If upgrading TensorRT is fine, you can try to install TensorRT 7 only using NVIDIA's cuda-repo and machine-learning-repo. |
That's no problem. My ultimate goal is to use in Xavier NX. So I will try
in it.
…On Tue, Oct 13, 2020 at 6:52 PM Yukai Yang (Alexis) < ***@***.***> wrote:
@MuhammadAsadJaved <https://github.com/MuhammadAsadJaved> In that case,
it would be better to use an Nvidia docker container. But I don't have time
to support it for now.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#1 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AG4GR5FO4MZQKK7L5PM46CLSKQWOVANCNFSM4SMK4PUQ>
.
|
@MuhammadAsadJaved |
@darbyyyy Thank you so much for your update. I will also try in Xavier NX now. Is there any suggestion about the installation process? |
@darbyyyy For me in Xavier NX the average speed is 6 FPS when there are 15 ~ 20 detected objects at the same time. May I ask for you 25 ~ 32 FPS there was how many objects?
|
@MuhammadAsadJaved Keep in mind that running for the first time will be slow due to Numba compilation. Also, I got my results without using |
@MuhammadAsadJaved |
@darbyyyy @GeekAlexis I got these results Performance
https://drive.google.com/drive/folders/1CtNqQm3RzWafPg_qzBk-XuQX82wuAm5A?usp=sharing |
@MuhammadAsadJaved This is weird. Are all packages correctly installed? Without display, I got 23 FPS on nyc1.mp4, 30 FPS on cycle1.mp4, and 34 FPS on cycle2.mp4. FYI, cycle1 and cycle2 are really distorted and blurry which makes camera motion hard to estimate. The tracker will perform better on these if you decrease |
@GeekAlexis I just installed using
Update: I might build OpenCV without Gstreamer support. It must influence the speed. let me verify it. |
@MuhammadAsadJaved OpenCV 4.1.1 from Jetpack 4.4 should already support GStreamer. Did you reinstall OpenCV by any chance? Gstreamer is used to accelerate video resizing so it does have some impact. |
Yes, I rebuild OpenCV for some other projects. So I will rebuild it, then verify the results again and update you. Thank you for your time. |
@MuhammadAsadJaved Here's my result. I tried on ssh connection so I disabled gui option |
@darbyyyy Thank you for your efforts. |
@GeekAlexis
Also checked other libraries and versions and they are same as mentioned in the project. What is possible reason for slow speed? |
@MuhammadAsadJaved
|
@GeekAlexis CMake Error at modules/core/CMakeLists.txt:40 (message): -- Configuring incomplete, errors occurred! Here are my environment details. |
@xhzzc1994 The opencv contrib path seems to be incorrect in the script, I just pushed a fix. You can try again by pulling or changing it yourself:
Please open another issue if you encounter further problems. |
@MuhammadAsadJaved OpenCV is mostly used in |
Now results without display are: So most probably it's OpenCV difference. @darbyyyy Yes I am using Thank you for your time and cooperation. I think now we should close this issue so that people should not mix up other issues here. @GeekAlexis It would be nice if you try to add other Yolo models like V3, Tiny-v3 in this repo. It will help a lot of people. I know a lot of people are looking for this kind of project. Thank you. |
@MuhammadAsadJaved Thanks. I believe reversing the order of |
Can you use yolo models trained for two classes? person and car? if yes then i can share .weights or .onnx with you. So it can save our time. I have trained models. for V3, Tiny-V3 and Tiny-V4. |
@MuhammadAsadJaved That'd be great if you are open to sharing your .onnx models. Two classes are fine. I can disable the car class until a ReID model gets trained. BTW, what dimensions are these models? |
@GeekAlexis I have sent you a personal email. We can discuss in detail. |
HI @MuhammadAsadJaved @GeekAlexis @darbyyyy . I am just tagging new comments to to this issue because I am getting only Bench-marking on 11 second video
Jetson Board
Video Properties Power Mode 15W 6CORE OpenCV Version - Built from source
................................................### LOG........................................................................................................... WITH_GSTREAMER = True - Video Saving after inference**
|
@Myron1996 I have said this so many times. Since you reinstalled OpenCV you have to guarantee it has all the optimization turned on, which I cannot help you. GStreamer is critical on Jetson, so it must be turned on. This repo only guarantees maximum performance with the default OpenCV from Jetpack. You might want to reflash your Jetson as a last resort. FYI, 2 core power mode is slightly faster but that's not the real cause for you. |
Hello @GeekAlexis, if I understand correctly, if I train a ReID model using fast-reid, then when I use FastMOT, the feature extractor in Deep SORT will be swapped to the ReID model I trained, right? Also, do you happen to know if I can train a custom ReID model in fast-reid (I have a dataset containing images of fruits). Thank you! |
@rafaelbate Correct, but I'm not sure how ReID works on fruits in practice? FYI, You need to have instance ID's on fruits to train ReID. |
Thanks for your fast reply and clarification @GeekAlexis! By "instance ID's on fruits", you mean each individual fruit must have a specific ID that identifies it along its appearance in multiple photos? |
@rafaelbate Yes |
Hi,
Thanks for the great work. I have a few questions about the project.
1 - Are you using Yolov4 + DeepSort tracker? What is the speed in Jetson Nano?
2- Can we run it on Jetson Xavier NX as well with TenosrRT support?
3- Can we use any other yolov4 model trained for different classes and can track more than one class at the same time? i.e person and car?
4- Are you planning to update project to run with Yolov4-Tiny + DeepSort?
The text was updated successfully, but these errors were encountered: