Skip to content

Commit

Permalink
update ambiguous info (Lightning-AI#3613)
Browse files Browse the repository at this point in the history
  • Loading branch information
awaelchli committed Sep 22, 2020
1 parent b4c553b commit d2a3d6a
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/source/multi_gpu.rst
Expand Up @@ -292,11 +292,11 @@ We use DDP this way because `ddp_spawn` has a few limitations (due to Python and
2. Dataloader(num_workers=N), where N is large, bottlenecks training with DDP... ie: it will be VERY slow or won't work at all. This is a PyTorch limitation.
3. Forces everything to be picklable.

There are cases in which it is not possible to use DDP. Examples are:
There are cases in which it is NOT possible to use DDP. Examples are:

- Jupyter Notebook, Google COLAB, Kaggle, etc.
- You have a nested script without a root package
- Your script needs to invoke `.fit` or `.test` multiple times
- Your script needs to invoke both `.fit` and `.test`, or one of them multiple times

In these situations you should use `dp` or `ddp_spawn` instead.

Expand Down

0 comments on commit d2a3d6a

Please sign in to comment.