Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CPU usage for prediction tasks #753

Open
mfeblowitz opened this issue Jul 9, 2019 · 0 comments
Open

CPU usage for prediction tasks #753

mfeblowitz opened this issue Jul 9, 2019 · 0 comments

Comments

@mfeblowitz
Copy link

mfeblowitz commented Jul 9, 2019 •
edited

Following on from #677.

For prediction, BERT with Tensorflow makes use of a single cpu for all processing up to and after the example processing (including, e.g., nbest processing). Any shift to multi-threading, if possible, would help for large prediction tasks.
@mfeblowitz mfeblowitz changed the title CPU usage for predict CPU usage for predict tasks Jul 10, 2019
@mfeblowitz mfeblowitz changed the title CPU usage for predict tasks CPU usage for prediction tasks Jul 10, 2019
@tnmcneil tnmcneil mentioned this issue Aug 16, 2019
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mfeblowitz