I've been having trouble training and testing my models on my desktop PC. Currently, the dev branch (821bea9) and nvmm-disabled (9a94ef5) compiles. Other branches like master (9bf5549) produce this error when I try to build:
[ 6%] Linking CXX shared library ../x86_64/lib/libjetson-utils.so
/usr/bin/ld: cannot find -lnvbuf_utils
When I compile dev or nvmm-disabled and run the detectnet executable through a script, I get this output:
[TRT] cache file not found, profiling network model on device GPU
[TRT] The logger passed into createInferBuilder differs from one already assigned, 0x7ffe5f25b868, logger not updated.
./test.sh: line 36: 47735 Segmentation fault (core dumped) detectnet --model=$MODEL --labels=$LABELS --input-blob=input_0 --output-cvg=scores --output-bbox=boxes --threshold=$THRESHOLD $INPUT $OUTPUT
I've run this same model on real Jetson hardware with no issues. I was able to run this command a year or so ago when my machine was on Ubuntu 18, cuda 10.X.
Is this issue happening because I'm not on the master branch? What is causing nvbuf_utils to not be found? I'm happy to provide more info if needed.
uname -a output:
Linux XXX 5.4.0-89-generic #100-Ubuntu SMP Fri Sep 24 14:50:10 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
lsb_release -a output:
Distributor ID: Ubuntu
Description: Ubuntu 20.04.3 LTS
Release: 20.04
Codename: focal
nvidia-smi output:
Thu Nov 4 19:34:15 2021
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 465.19.01 Driver Version: 465.19.01 CUDA Version: 11.3 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 NVIDIA GeForce ... On | 00000000:01:00.0 Off | N/A |
| 0% 37C P8 9W / 215W | 337MiB / 8116MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
| 0 N/A N/A 1524 G /usr/lib/xorg/Xorg 327MiB |
| 0 N/A N/A 1681 G /usr/bin/gnome-shell 6MiB |
+-----------------------------------------------------------------------------+
nvcc --version output:
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA Corporation
Built on Mon_May__3_19:15:13_PDT_2021
Cuda compilation tools, release 11.3, V11.3.109
Build cuda_11.3.r11.3/compiler.29920130_0
dpkg -l | grep nvinfer output:
ii libnvinfer-bin 8.0.0-1+cuda11.3 amd64 TensorRT binaries
ii libnvinfer-dev 8.0.0-1+cuda11.3 amd64 TensorRT development libraries and headers
ii libnvinfer-doc 8.0.0-1+cuda11.3 all TensorRT documentation
ii libnvinfer-plugin-dev 8.0.0-1+cuda11.3 amd64 TensorRT plugin libraries
ii libnvinfer-plugin8 8.0.0-1+cuda11.3 amd64 TensorRT plugin libraries
ii libnvinfer-samples 8.0.0-1+cuda11.3 all TensorRT samples
ii libnvinfer8 8.0.0-1+cuda11.3 amd64 TensorRT runtime libraries
ii python3-libnvinfer 8.0.0-1+cuda11.3 amd64 Python 3 bindings for TensorRT
ii python3-libnvinfer-dev 8.0.0-1+cuda11.3 amd64 Python 3 development package for TensorRT
I've been having trouble training and testing my models on my desktop PC. Currently, the dev branch (821bea9) and nvmm-disabled (9a94ef5) compiles. Other branches like master (9bf5549) produce this error when I try to build:
When I compile dev or nvmm-disabled and run the detectnet executable through a script, I get this output:
I've run this same model on real Jetson hardware with no issues. I was able to run this command a year or so ago when my machine was on Ubuntu 18, cuda 10.X.
Is this issue happening because I'm not on the master branch? What is causing nvbuf_utils to not be found? I'm happy to provide more info if needed.
uname -aoutput:Linux XXX 5.4.0-89-generic #100-Ubuntu SMP Fri Sep 24 14:50:10 UTC 2021 x86_64 x86_64 x86_64 GNU/Linuxlsb_release -aoutput:nvidia-smioutput:nvcc --versionoutput:dpkg -l | grep nvinferoutput: