Learn how to use multiple GPUs with PyTorch.
Pytorch only uses one GPU by default. In this tutorial by Soumith Chintala, one of the creators of PyTorch, you'll learn how to use multiple GPUs in PyTorch with the DataParallel class. This will allow you to split each mini-batch of samples into multiple smaller mini-batches, and run the computation for each of these in parallel.
PyTorch, Educational
By clicking the Run on Gradient button above, you will be launching the contents of this repository into a Jupyter notebook on Paperspace Gradient.
Docs are available at docs.paperspace.com.
Be sure to read about how to create a notebook or watch the video instead!