Skip to content

Issues: NVIDIA/TensorRT

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

387 Open 3,523 Closed
387 Open 3,523 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

When converting the yolov8-det model to ONNX using the NMS operator, the following error occurs when using trtexec to convert it into an engine model.
#4383 opened Mar 14, 2025 by alanxinn
Unstable inference time
#4382 opened Mar 11, 2025 by JasonSloan
Why is the inference speed of DLA on agx orin much slower than that without DLA?
#4380 opened Mar 10, 2025 by fpeanut
onnx_graphsurgeon.GraphPattern()：The order in which the nodes are added affects the success of the match.
#4377 opened Mar 6, 2025 by peanutPod
Are some layers implemented in DFINE and DEIM which aren't supported? Module:Engine Build Issues with engine build triaged Issue has been triaged by maintainers waiting for feedback Requires more information from user to make progress on the issue.
#4375 opened Mar 5, 2025 by horngjason
@kevinch-nv
2
Error Code 2: Internal Error (Assertion c != kNoColor failed. Topological sort failed, which means there's a circle in the graph.) internal-bug-tracked Tracked internally, will be fixed in a future release. Module:Engine Build Issues with engine build triaged Issue has been triaged by maintainers
#4374 opened Mar 4, 2025 by zhluo94
1
failure of SigLIP2 FP32 to FP16 Module:Accuracy Output mismatch between TensorRT and other frameworks triaged Issue has been triaged by maintainers
#4373 opened Mar 4, 2025 by yijun02
2
deserializeCudaEngine failure of TensorRT 8.6.1.6 Module:Runtime triaged Issue has been triaged by maintainers
#4372 opened Feb 28, 2025 by veritas-Qiu
@kevinch-nv
1
How are qparams (scale and zero_point) determined after fusing Conv and BN layers? Module:Quantization Issues related to Quantization triaged Issue has been triaged by maintainers
#4369 opened Feb 27, 2025 by gef1998
Explicit quantization is slower than implicit quantization and produces invalid results Module:Quantization Issues related to Quantization triaged Issue has been triaged by maintainers
#4366 opened Feb 24, 2025 by itmo153277
the consistency between trt and modelopt is quite different? triaged Issue has been triaged by maintainers waiting for feedback Requires more information from user to make progress on the issue.
#4364 opened Feb 24, 2025 by 666DZY666
2
Trt ouput mismatch with onnx output.
#4361 opened Feb 20, 2025 by zhaocc1106
[stable diffusion] [unet] [compiling] faild to find implemtation ForeignNode[/up_blocks.0/resnets.0/time_mixer/Constant_1_output_0.../conv_act/Mul Module:DemoDiffusion Issues regarding demoDiffusion question Further information is requested triaged Issue has been triaged by maintainers
#4360 opened Feb 19, 2025 by focusunsink
@asfiyab-nvidia
7
How to run the multiple trt engines in a single GPU?
#4358 opened Feb 15, 2025 by another-tee
Floating point exception of TensorRT 10.5 when converting an ONNX model with trtexec on GPU GeForce RTX 2080 Ti Module:Engine Build Issues with engine build triaged Issue has been triaged by maintainers
#4356 opened Feb 11, 2025 by tom-brosch
@kevinch-nv
3
Video memory leak Module:Performance General performance issues Module:Polygraphy Issues with Polygraphy triaged Issue has been triaged by maintainers waiting for feedback Requires more information from user to make progress on the issue.
#4354 opened Feb 10, 2025 by XL634663985
@LeoZDong
1
demo_img2vid: Error Code 1: Cuda Runtime (out of memory) Module:DemoDiffusion Issues regarding demoDiffusion triaged Issue has been triaged by maintainers waiting for feedback Requires more information from user to make progress on the issue.
#4353 opened Feb 10, 2025 by praveenperfecto
@kevinch-nv
4
Update tensorrt-cu12-libs Package to Use Metadata 2.2 or Later for Improved Dependency Resolution Feature Request Request for new functionality internal-bug-tracked Tracked internally, will be fixed in a future release. Module:OSS Build Issues building open source code triaged Issue has been triaged by maintainers
#4352 opened Feb 9, 2025 by validatedev
@kevinch-nv
13
Lack of Performance Gain with Mixed Precison using TensorRT 10.3 when running DinoV2S on jetson-orin/RTX 4090 Module:Performance General performance issues triaged Issue has been triaged by maintainers
#4348 opened Feb 5, 2025 by SConsul
@nvpohanh
5
Failure of TensorRT 10.7 to eliminate concatenation with upstream custom layer Feature Request Request for new functionality Module:Documentation Lack of clarity in documentation triaged Issue has been triaged by maintainers
#4345 opened Feb 4, 2025 by jchia
@kevinch-nv
6
after converting onnx fp32 to int8 engine with custom calibration, the engine layers still show fp32 Module:Polygraphy Issues with Polygraphy triaged Issue has been triaged by maintainers waiting for feedback Requires more information from user to make progress on the issue.
#4341 opened Jan 28, 2025 by jinhonglu
@kevinch-nv
2
Problems using pytorch stream Module:Runtime triaged Issue has been triaged by maintainers
#4340 opened Jan 26, 2025 by ninono12345
@kevinch-nv
Onnx GroupNorm Op21 failed in TensorRT 10.7 internal-bug-tracked Tracked internally, will be fixed in a future release. Module:ONNX Issues relating to ONNX usage and import triaged Issue has been triaged by maintainers
#4336 opened Jan 24, 2025 by toothache
@kevinch-nv
3
Comparison of infer speed between different TRT8.5.3.1 VS TRT 10.5.0.18 on GPU 3060-12G/4060Ti-16G Module:Performance General performance issues question Further information is requested
#4332 opened Jan 21, 2025 by gaoyu-cao
5
TensorRT‌ 10.3 wrong results! Module:Documentation Lack of clarity in documentation triaged Issue has been triaged by maintainers waiting for feedback Requires more information from user to make progress on the issue.
#4330 opened Jan 19, 2025 by OctaAIVision
@kevinch-nv
9
ProTip! Mix and match filters to narrow down what you’re looking for.