Permalink
Switch branches/tags
Nothing to show
Find file Copy path
Fetching contributors…
Cannot retrieve contributors at this time
609 lines (608 sloc) 19.4 KB
/home/ubuntu/master/python/mxnet/gluon/block.py:520: UserWarning: All children of this Sequential layer 'bigrnn0_sequential0_' are HybridBlocks. Consider using HybridSequential for the best performance.
cld.hybridize(active, **kwargs)
Namespace(batch_size=32, bptt=20, clip=1.0, dropout=0.1, emsize=512, epochs=42, eps=1, eval_only=True, from_epoch=None, gpus=None, k=8192, log_interval=1000, lr=0.2, nhid=2048, nlayers=1, nproj=512, save='/dev/shm/eos_128.params', seed=1, test_mode=False)
BigRNN(
(decoder): Dense(None -> 793471, linear)
(encoder): HybridSequentialRNNCell(
(0): LSTMPCell(None -> 8192 -> 512)
(1): DropoutCell(rate=0.1, axes=())
)
(embedding): Sequential(
(0): Embedding(793471 -> 512, float32)
(1): Dropout(p = 0.1, axes=())
)
)
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.00
[Epoch 0] test loss 4.09, test ppl 59.74
Epoch 0 took 631.63 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.01
[Epoch 1] test loss 3.97, test ppl 53.12
Epoch 1 took 655.39 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.02
[Epoch 2] test loss 3.92, test ppl 50.30
Epoch 2 took 634.78 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.03
[Epoch 3] test loss 3.89, test ppl 48.73
Epoch 3 took 679.27 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.04
[Epoch 4] test loss 3.86, test ppl 47.70
Epoch 4 took 632.88 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.05
[Epoch 5] test loss 3.85, test ppl 46.99
Epoch 5 took 619.90 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.06
[Epoch 6] test loss 3.84, test ppl 46.38
Epoch 6 took 620.61 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.07
[Epoch 7] test loss 3.83, test ppl 45.99
Epoch 7 took 620.47 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.08
[Epoch 8] test loss 3.82, test ppl 45.63
Epoch 8 took 618.49 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.09
[Epoch 9] test loss 3.81, test ppl 45.31
Epoch 9 took 621.51 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.10
[Epoch 10] test loss 3.81, test ppl 45.15
Epoch 10 took 623.64 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.11
[Epoch 11] test loss 3.81, test ppl 44.94
Epoch 11 took 617.01 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.12
[Epoch 12] test loss 3.80, test ppl 44.79
Epoch 12 took 620.00 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.13
[Epoch 13] test loss 3.80, test ppl 44.64
Epoch 13 took 620.41 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.14
[Epoch 14] test loss 3.80, test ppl 44.53
Epoch 14 took 876.26 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.15
[Epoch 15] test loss 3.79, test ppl 44.44
Epoch 15 took 620.17 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.16
[Epoch 16] test loss 3.79, test ppl 44.43
Epoch 16 took 859.76 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.17
[Epoch 17] test loss 3.79, test ppl 44.28
Epoch 17 took 620.88 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.18
[Epoch 18] test loss 3.79, test ppl 44.24
Epoch 18 took 804.16 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.19
[Epoch 19] test loss 3.79, test ppl 44.23
Epoch 19 took 620.83 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.20
[Epoch 20] test loss 3.79, test ppl 44.11
Epoch 20 took 822.18 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.21
[Epoch 21] test loss 3.79, test ppl 44.08
Epoch 21 took 619.63 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.22
[Epoch 22] test loss 3.78, test ppl 44.01
Epoch 22 took 617.45 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.23
[Epoch 23] test loss 3.78, test ppl 43.94
Epoch 23 took 620.00 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.24
[Epoch 24] test loss 3.78, test ppl 44.02
Epoch 24 took 620.28 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.25
[Epoch 25] test loss 3.78, test ppl 43.96
Epoch 25 took 622.51 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.26
[Epoch 26] test loss 3.78, test ppl 43.91
Epoch 26 took 620.53 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.27
[Epoch 27] test loss 3.78, test ppl 43.93
Epoch 27 took 713.64 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.28
[Epoch 28] test loss 3.78, test ppl 43.95
Epoch 28 took 618.61 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.29
[Epoch 29] test loss 3.78, test ppl 43.82
Epoch 29 took 680.48 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.30
[Epoch 30] test loss 3.78, test ppl 43.83
Epoch 30 took 619.11 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.31
[Epoch 31] test loss 3.78, test ppl 43.83
Epoch 31 took 967.99 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.32
[Epoch 32] test loss 3.78, test ppl 43.80
Epoch 32 took 622.02 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.33
[Epoch 33] test loss 3.78, test ppl 43.74
Epoch 33 took 621.83 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.34
[Epoch 34] test loss 3.78, test ppl 43.70
Epoch 34 took 621.34 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.35
[Epoch 35] test loss 3.78, test ppl 43.84
Epoch 35 took 620.96 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.36
[Epoch 36] test loss 3.78, test ppl 43.81
Epoch 36 took 619.74 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.37
[Epoch 37] test loss 3.78, test ppl 43.79
Epoch 37 took 619.93 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.38
[Epoch 38] test loss 3.78, test ppl 43.78
Epoch 38 took 623.13 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.39
[Epoch 39] test loss 3.78, test ppl 43.80
Epoch 39 took 872.91 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.40
[Epoch 40] test loss 3.78, test ppl 43.76
Epoch 40 took 613.04 seconds.
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Wait for a new checkpoint...
Loaded parameters from checkpoint /dev/shm/eos_128.params.41
[Epoch 41] test loss 3.78, test ppl 43.65
Epoch 41 took 617.77 seconds.