Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Discussion] gpu预测速度 #74

Closed
rivaldinho123 opened this issue Jun 8, 2020 · 3 comments
Closed

[Discussion] gpu预测速度 #74

rivaldinho123 opened this issue Jun 8, 2020 · 3 comments

Comments

@rivaldinho123
Copy link

模型在v100 GPU上直接利用demo.py进行预测，发现在min_len设置为150时，每生成一个sample需要80-90s，即使把min_len缩短为10，每生成一个sample也需要30s左右，请问这是正常的吗？如果是的话有什么可以加速预测的设置或者方法吗？

谢谢。
@rivaldinho123
Copy link
Author

另外在生成sample的时间里，虽然在GPU指定的卡上能看到预测进程，但只占用了几百M显存，而且观察GPU的利用率一直是0%。。。不知道是不是哪里使用有些问题

@rivaldinho123
Copy link
Author

确实是没有使用gpu的问题，已解决

@kunpeng199494
Copy link

请问你是怎么解决的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@kunpeng199494 @rivaldinho123