Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatically determine an appropriate number of PyTorch workers #91

Open
kamilzyla opened this issue Jul 16, 2020 · 0 comments
Open

Automatically determine an appropriate number of PyTorch workers #91

kamilzyla opened this issue Jul 16, 2020 · 0 comments
Labels
5 SP Story points tech debt Tasks that will make working on the project easier
Projects

Comments

@kamilzyla
Copy link
Collaborator

The option --pytorch_num_workers must be set to 0 on Windows; otherwise the classifier script fails in a cryptic way (see #90). A better solution would be to automatically determine a proper number of workers based on the system (keep the option so the user can overwrite this setting).

In addition it would be good to research what setting is actually appropriate and document the choice. Does having more workers make the inference faster? Does it come with increased memory usage (it might lead to crashes, see #74) or other drawbacks?

@kamilzyla kamilzyla added the tech debt Tasks that will make working on the project easier label Jan 18, 2022
@kamilzyla kamilzyla added this to Backlog in Kanban Jan 18, 2022
@kamilzyla kamilzyla added the 5 SP Story points label Jan 18, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
5 SP Story points tech debt Tasks that will make working on the project easier
Projects
Kanban
Backlog
Development

No branches or pull requests

1 participant