Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

onnxruntime 在C++上如何实现fp16的推理 yolov5模型 #20395

Open
hkdddld opened this issue Apr 20, 2024 · 6 comments
Open

onnxruntime 在C++上如何实现fp16的推理 yolov5模型 #20395

hkdddld opened this issue Apr 20, 2024 · 6 comments
Assignees
@yihonglyu
Labels
quantization issues related to quantization stale issues that have not been addressed in a while; categorized by a bot

Comments

@hkdddld
Copy link

hkdddld commented Apr 20, 2024

Describe the issue

我在推理fp16的yolov5模型时通过
微信图片_20240420200338
这样转换出来推理不出结果是为什么

To reproduce

微信图片_20240420200338

Urgency

No response

Platform

Linux

OS Version

22.0

ONNX Runtime Installation

Built from Source

ONNX Runtime Version or Commit ID

1.10.1

ONNX Runtime API

C++

Architecture

X86

Execution Provider

Default CPU

Execution Provider Library Version

No response

Model File

yolov5s官网的模型

Is this a quantized model?

Yes
@github-actions github-actions bot added the quantization issues related to quantization label Apr 20, 2024
@yihonglyu
Copy link
Contributor

@hkdddld Could you please share the entire reproducer in text format so that I can execute it?

@hkdddld
Copy link
Author

hkdddld commented Apr 29, 2024

您能否以文本格式共享整个复制器，以便我可以执行它？
Uploading YOLOV5.txt…

@hkdddld
Copy link
Author

hkdddld commented Apr 29, 2024

YOLOV5.txt

@github-actions GitHub Actions
Copy link
Contributor

This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.

@github-actions github-actions bot added the stale issues that have not been addressed in a while; categorized by a bot label May 29, 2024
@luozhaohui800
Copy link

楼主解决了吗，c++ fp16超分模型也推理错误了，python是可以正常推理的

@yihonglyu
Copy link
Contributor

onnxruntime is 1.18.1 now. Do you encounter the same issue with latest commit?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yihonglyu yihonglyu

Labels
quantization issues related to quantization stale issues that have not been addressed in a while; categorized by a bot
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@yihonglyu @luozhaohui800 @hkdddld