-
Notifications
You must be signed in to change notification settings - Fork 2.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
YOLOv7: use the correct version of ONNX Runtime for GPU #6940
Conversation
ccea0a9
to
0acf660
Compare
From this link https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements we probably need specific CUDA version compatible with onnx runtime version. My cuda is 12.1 and I got this error. It installed And it requires CUDNN. So, after research:
|
Currently, we install plain `onnxruntime`, which means that when the function is deployed with `deploy_gpu.sh`, it ends up using the CPU anyway. `onnxruntime-gpu` depends on a specific version of CUDA, so update the base image and bound the version of the package to avoid mismatches in the future.
09ea6da
to
4f0cd7a
Compare
@bsekachev Thanks for the investigation. I updated the PR, could you try it again? |
Yes, it works in current configuration |
Codecov Report
Additional details and impacted files@@ Coverage Diff @@
## develop #6940 +/- ##
===========================================
- Coverage 81.50% 81.49% -0.01%
===========================================
Files 365 365
Lines 39923 39923
Branches 3703 3703
===========================================
- Hits 32538 32536 -2
- Misses 7385 7387 +2
|
Motivation and context
Currently, we install plain
onnxruntime
, which means that when the function is deployed withdeploy_gpu.sh
, it ends up using the CPU anyway.Fixes #6793.
How has this been tested?
Checklist
develop
branch[ ] I have updated the documentation accordingly[ ] I have added tests to cover my changes[ ] I have increased versions of npm packages if it is necessary(cvat-canvas,
cvat-core,
cvat-data and
cvat-ui)
License
Feel free to contact the maintainers if that's a concern.