-
Notifications
You must be signed in to change notification settings - Fork 171
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add support for TensorRT 10. #4489
Add support for TensorRT 10. #4489
Conversation
b93b31d
to
a2eac2a
Compare
a2eac2a
to
67c5c1d
Compare
meson_options.txt
Outdated
@@ -17,7 +17,9 @@ option('orcc-support', type: 'feature', value: 'auto') | |||
option('snpe-support', type: 'feature', value: 'auto') | |||
option('protobuf-support', type: 'feature', value: 'auto') | |||
option('flatbuf-support', type: 'feature', value: 'auto') | |||
option('cuda-support', type: 'feature', value: 'auto') |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You don't need cuda-support configured by users.
if not get_option('cuda-support').disabled()
can be rewritten as
if not get_option('tensorrt-support').disabled() or not get_option('tensorrt10-support').disabled()
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done. (nitpick: this will require any subsequent filter that requires cuda to be added to this condition.)
To pass the "Doxygen tag check" of "Static checkers and verifiers", add a Doxygen (
|
3f5563e
to
194c700
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.
Please add a newline at the end of a text file (cuda-version.sh).
194c700
to
8c14bb0
Compare
Adds a tensor_filter (tensorrt10) for TensorRT 10+ using the onnx and engine parsers. Leaves as-is the tensor_filter (tensorrt) for TensorRT 10- using the uffparsers. Signed-off-by: Bram Veldhoen <noreply@github.com>
8c14bb0
to
28c42ec
Compare
Added a separate subplugin for tensorrt 10.
Changes proposed in this PR:
See also:
nnstreamer/nnstreamer-example#338
Self evaluation:
How to evaluate: