Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

multi-gpu cifar10 #71

Merged
merged 13 commits into from
Sep 14, 2015
Merged

multi-gpu cifar10 #71

merged 13 commits into from
Sep 14, 2015

Conversation

mli
Copy link
Member

@mli mli commented Sep 14, 2015

4 gtx 980, no cudnn

minibatch = 128, 3.5x speedup

[==================================================] 100.0% ...Epoch 0, Speed: 2605.49 pic/sec
Train Acc: 0.517283, Valid Acc: 0.647646, Time: 39.2246 sec
[==================================================] 100.0% ...Epoch 1, Speed: 2694.62 pic/sec
Train Acc: 0.685042, Valid Acc: 0.726162, Time: 39.0921 sec
[==================================================] 99.7% ...Epoch 2, Speed: 2685.01 pic/sec
Train Acc: 0.747115, Valid Acc: 0.770733, Time: 39.2046 sec
[==================================================] 100.0% ...Epoch 3, Speed: 2540.94 pic/sec
Train Acc: 0.782569, Valid Acc: 0.792468, Time: 39.2251 sec
[==================================================] 100.0% ...Epoch 4, Speed: 2747.77 pic/sec
Train Acc: 0.802649, Valid Acc: 0.810597, Time: 39.4084 sec
[==================================================] 99.7% ...Epoch 5, Speed: 2600.94 pic/sec
Train Acc: 0.824079, Valid Acc: 0.820413, Time: 39.8275 sec

minibatch = 192

[==================================================] 100.3% ...Epoch 0, Speed: 3169.72 pic/sec
Train Acc: 0.491311, Valid Acc: 0.627943, Time: 36.6551 sec
[==================================================] 99.9% ...Epoch 1, Speed: 3091.24 pic/sec
Train Acc: 0.661625, Valid Acc: 0.706783, Time: 36.5123 sec
[==================================================] 99.9% ...Epoch 2, Speed: 2903.36 pic/sec
Train Acc: 0.727851, Valid Acc: 0.753501, Time: 36.5515 sec
[==================================================] 99.9% ...Epoch 3, Speed: 3010.61 pic/sec
Train Acc: 0.765826, Valid Acc: 0.781413, Time: 36.6714 sec
[==================================================] 99.9% ...Epoch 4, Speed: 3194.31 pic/sec
Train Acc: 0.789576, Valid Acc: 0.801421, Time: 37.2469 sec
[==================================================] 99.9% ...Epoch 5, Speed: 2962.52 pic/sec
Train Acc: 0.811745, Valid Acc: 0.811024, Time: 38.162 sec
[==================================================] 99.9% ...Epoch 6, Speed: 2736.86 pic/sec
Train Acc: 0.828191, Valid Acc: 0.818327, Time: 38.5073 sec

LOG(INFO) << "-----Execution memory plan-----\n"
<< DebugStr() << '\n'
<< "------------------------------\n";
// LOG(INFO) << "-----Execution memory plan-----\n"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change is not needed.

mli added a commit that referenced this pull request Sep 14, 2015
@mli mli merged commit 4c1016f into apache:master Sep 14, 2015
reminisce pushed a commit to reminisce/mxnet that referenced this pull request Jun 9, 2017
iblislin pushed a commit to iblislin/incubator-mxnet that referenced this pull request Mar 18, 2018
MXNet exposes a transpose function
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants