New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to use Forward to infer the pytorch version of bert, are there any relevant demo? #7
Comments
Bert-Pytorch demo is updated here. https://github.com/Tencent/Forward/tree/master/demo/bert |
@yuanzexi Bug when running
EnvironmentTensorRT Version: 7.2.1.6 |
Torch BERT models are only supported for |
@Fan9 The problem has been resolved in the newest master branch. You could try it again. |
I have successfully run BERT-Torch on |
hi, @yuanzexi ,Have you tested the efficiency improvement of tensort? In my experiment, the speed of
Is there any problem here? EnvironmentTensorRT Version: 7.2.1.6 |
@Fan9 Thanks for your feedback. We had tested the performance of models in tensorrt, but we didn't try these configuration and environments. We'll try to profile this BERT model to figure out this problem. |
No description provided.
The text was updated successfully, but these errors were encountered: