-
Notifications
You must be signed in to change notification settings - Fork 382
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Explain how to use Dask to parallelize grid search across GPUs #241
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Some minor change requests regarding the text.
docs/user/parallelism.rst
Outdated
Skorch supports model parallelism via `Dask | ||
<https://dask.pydata.org>`_. In this section we'll describe how to | ||
use Dask to efficiently distribute a grid search or a randomized | ||
search on hyper paramerers across multiple GPUs and potentially |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
paramerers parameters
docs/user/parallelism.rst
Outdated
CUDA_VISIBLE_DEVICES=1 dask-worker 127.0.0.1:8786 --nthreads 1 | ||
|
||
Now, instead of importing ``GridSearchCV`` or ``RandomizedSearchCV`` | ||
from scikit-learn, import from ``dask_searchcv`` instead. And set up |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"instead ... instead." Remove the 2nd "instead"
addresses #95 |
d71022f
to
d3bdbaa
Compare
Updated to use joblib's |
Thanks, great work. |
Based on #237
Work in progress, but please give me feedback.
Also explains how to use Palladium to run grid search in parallel. This feature currently requires ottogroup/palladium#87