New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问如何支持batch的推理？ #22

Open

VincentJYZhang opened this issue Jun 25, 2023 · 1 comment

VincentJYZhang commented Jun 25, 2023 •

edited

目前的onnx输入，第一维度是1，如何支持batch的推理，把第一维度改成N？

Owner

tpoisonooo commented Jun 30, 2023

直接编辑 onnx，1 改 N 就行了。这个没啥影响。

代码的话 import onnx，inputs 的参数都是可写的。

tpoisonooo mentioned this issue

GPU Inference #25

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment