Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix bug for trt inference #12209

Open
wants to merge 59 commits into
base: master
Choose a base branch
from
Open
Changes from 2 commits
Commits
Show all changes
59 commits
Select commit Hold shift + click to select a range
19c8663
fix bug for trt inference
AllenZYJ Oct 8, 2023
1ff4f08
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Oct 8, 2023
2f8beb3
Merge branch 'master' into trt-infer-bug
glenn-jocher Jan 17, 2024
749079b
Auto-format by Ultralytics actions
UltralyticsAssistant Jan 17, 2024
39abc5a
Merge branch 'master' into trt-infer-bug
glenn-jocher Jan 17, 2024
d5c35d6
Merge branch 'master' into trt-infer-bug
glenn-jocher Apr 9, 2024
8dcc16f
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Apr 14, 2024
5e398fd
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Apr 18, 2024
6f5cf6f
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Apr 27, 2024
57ab8a8
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Apr 28, 2024
1759c9b
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant May 5, 2024
c573eb5
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant May 12, 2024
43eac63
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant May 12, 2024
eb954d4
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant May 12, 2024
af9f953
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant May 12, 2024
61e83cc
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant May 13, 2024
43a975d
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant May 18, 2024
625d300
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant May 24, 2024
bca1c92
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant May 28, 2024
97b49f3
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant May 29, 2024
b763c59
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant May 29, 2024
5f1669e
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant May 30, 2024
79b2961
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 8, 2024
a7e9e26
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 8, 2024
788bce9
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 9, 2024
b258633
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 16, 2024
113f644
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 16, 2024
452429d
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 17, 2024
b30fa3d
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 19, 2024
55e5bfb
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 19, 2024
8af4991
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 20, 2024
a271f26
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 20, 2024
6d17b94
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 20, 2024
8a44216
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 20, 2024
0a3068a
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 22, 2024
d1fd5f7
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 30, 2024
28a0ca7
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 30, 2024
b9716cf
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jun 30, 2024
ac4fe15
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 5, 2024
e3a6ebe
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 8, 2024
58277cc
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 8, 2024
7d85f8f
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 8, 2024
07dc073
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 10, 2024
37d6591
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 13, 2024
1fd8994
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 15, 2024
174e905
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 15, 2024
57a226d
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 17, 2024
16ef98f
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 17, 2024
4b4cfb0
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 22, 2024
d09e835
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 23, 2024
a8fc597
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 25, 2024
6b201aa
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 29, 2024
a8a906a
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Jul 29, 2024
5e1873c
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Aug 11, 2024
98239e3
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Aug 14, 2024
2585252
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Aug 14, 2024
e41adb8
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Aug 19, 2024
902813c
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Aug 20, 2024
c0e35f0
Merge branch 'master' into trt-infer-bug
UltralyticsAssistant Aug 20, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion models/common.py
Original file line number Diff line number Diff line change
Expand Up @@ -549,7 +549,7 @@ def forward(self, im, augment=False, visualize=False):
assert im.shape == s, f"input size {im.shape} {'>' if self.dynamic else 'not equal to'} max model size {s}"
self.binding_addrs['images'] = int(im.data_ptr())
self.context.execute_v2(list(self.binding_addrs.values()))
y = [self.bindings[x].data for x in sorted(self.output_names)]
y = [self.bindings[x].data for x in ['output', '462']]
elif self.coreml: # CoreML
im = im.cpu().numpy()
im = Image.fromarray((im[0] * 255).astype('uint8'))
Expand Down