Skip to content
Permalink
master
Switch branches/tags
Go to file
 
 
Cannot retrieve contributors at this time
176 lines (176 sloc) 9.66 KB
/home/ubuntu/anaconda3/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
from ._conv import register_converters as _register_converters
INFO:root:Ngrams range for the training run : 1
INFO:root:Loading Training data
INFO:root:Opening file /dev/shm/fastText/data/dbpedia.train for reading input
INFO:root:Loading Test data
INFO:root:Opening file /dev/shm/fastText/data/dbpedia.test for reading input
INFO:root:Vocabulary size: 803505
INFO:root:Training data converting to sequences...
INFO:root:Done! Sequence conversion Time=161.65s, #Sentences=560000
INFO:root:Done! Sequence conversion Time=145.70s, #Sentences=70000
INFO:root:Encoding labels
INFO:root:Label mapping:{'__label__1': 0, '__label__10': 1, '__label__11': 2, '__label__12': 3, '__label__13': 4, '__label__14': 5, '__label__2': 6, '__label__3': 7, '__label__4': 8, '__label__5': 9, '__label__6': 10, '__label__7': 11, '__label__8': 12, '__label__9': 13}
INFO:root:Done! Preprocessing Time=12.20s, #Sentences=560000
INFO:root:Done! Preprocessing Time=5.16s, #Sentences=70000
/home/ubuntu/anaconda3/lib/python3.6/site-packages/gluonnlp/data/sampler.py:366: UserWarning: Some buckets are empty and will be removed. Unused bucket keys=[833, 907, 981, 1129, 1203, 1425]
str(unused_bucket_keys))
INFO:root:Number of labels: 14
INFO:root:Initializing network
INFO:root:Running Training on ctx:gpu(1)
INFO:root:Number of output units in the last layer :14
INFO:root:Network initialized
INFO:root:Loss function for training:SoftmaxCrossEntropyLoss(batch_axis=0, w=None)
INFO:root:Starting Training!
INFO:root:Training on 560000 samples and testing on 70000 samples
INFO:root:Number of batches for each epoch : 35000.0, Display cadence: 3500
INFO:root:Epoch : 0, Batches complete :0
INFO:root:Epoch : 0, Batches complete :3500
INFO:root:Epoch : 0, Batches complete :7000
INFO:root:Epoch : 0, Batches complete :10500
INFO:root:Epoch complete :0, Computing Accuracy
INFO:root:Epochs completed : 0 Test Accuracy: 0.9699, Test Loss: 0.6863976057549881
INFO:root:Epoch : 1, Batches complete :0
INFO:root:Epoch : 1, Batches complete :3500
INFO:root:Epoch : 1, Batches complete :7000
INFO:root:Epoch : 1, Batches complete :10500
INFO:root:Epoch complete :1, Computing Accuracy
INFO:root:Epochs completed : 1 Test Accuracy: 0.9768714285714286, Test Loss: 0.4500242570382416
INFO:root:Epoch : 2, Batches complete :0
INFO:root:Epoch : 2, Batches complete :3500
INFO:root:Epoch : 2, Batches complete :7000
INFO:root:Epoch : 2, Batches complete :10500
INFO:root:Epoch complete :2, Computing Accuracy
INFO:root:Epochs completed : 2 Test Accuracy: 0.9772857142857143, Test Loss: 0.35363802586575893
INFO:root:Epoch : 3, Batches complete :0
INFO:root:Epoch : 3, Batches complete :3500
INFO:root:Epoch : 3, Batches complete :7000
INFO:root:Epoch : 3, Batches complete :10500
INFO:root:Epoch complete :3, Computing Accuracy
INFO:root:Epochs completed : 3 Test Accuracy: 0.9792, Test Loss: 0.2845098681688672
INFO:root:Epoch : 4, Batches complete :0
INFO:root:Epoch : 4, Batches complete :3500
INFO:root:Epoch : 4, Batches complete :7000
INFO:root:Epoch : 4, Batches complete :10500
INFO:root:Epoch complete :4, Computing Accuracy
INFO:root:Epochs completed : 4 Test Accuracy: 0.9794, Test Loss: 0.2565364573793349
INFO:root:Epoch : 5, Batches complete :0
INFO:root:Epoch : 5, Batches complete :3500
INFO:root:Epoch : 5, Batches complete :7000
INFO:root:Epoch : 5, Batches complete :10500
INFO:root:Epoch complete :5, Computing Accuracy
INFO:root:Epochs completed : 5 Test Accuracy: 0.9788857142857142, Test Loss: 0.24630683094896577
INFO:root:Epoch : 6, Batches complete :0
INFO:root:Epoch : 6, Batches complete :3500
INFO:root:Epoch : 6, Batches complete :7000
INFO:root:Epoch : 6, Batches complete :10500
INFO:root:Epoch complete :6, Computing Accuracy
INFO:root:Epochs completed : 6 Test Accuracy: 0.9786857142857143, Test Loss: 0.23837156017298708
INFO:root:Epoch : 7, Batches complete :0
INFO:root:Epoch : 7, Batches complete :3500
INFO:root:Epoch : 7, Batches complete :7000
INFO:root:Epoch : 7, Batches complete :10500
INFO:root:Epoch complete :7, Computing Accuracy
INFO:root:Epochs completed : 7 Test Accuracy: 0.9786714285714285, Test Loss: 0.23524657592540643
INFO:root:Epoch : 8, Batches complete :0
INFO:root:Epoch : 8, Batches complete :3500
INFO:root:Epoch : 8, Batches complete :7000
INFO:root:Epoch : 8, Batches complete :10500
INFO:root:Epoch complete :8, Computing Accuracy
INFO:root:Epochs completed : 8 Test Accuracy: 0.9787285714285714, Test Loss: 0.23481739638505386
INFO:root:Epoch : 9, Batches complete :0
INFO:root:Epoch : 9, Batches complete :3500
INFO:root:Epoch : 9, Batches complete :7000
INFO:root:Epoch : 9, Batches complete :10500
INFO:root:Epoch complete :9, Computing Accuracy
INFO:root:Epochs completed : 9 Test Accuracy: 0.9787428571428571, Test Loss: 0.2338253844417883
INFO:root:Epoch : 10, Batches complete :0
INFO:root:Epoch : 10, Batches complete :3500
INFO:root:Epoch : 10, Batches complete :7000
INFO:root:Epoch : 10, Batches complete :10500
INFO:root:Epoch complete :10, Computing Accuracy
INFO:root:Epochs completed : 10 Test Accuracy: 0.9786571428571429, Test Loss: 0.23401775828205204
INFO:root:Epoch : 11, Batches complete :0
INFO:root:Epoch : 11, Batches complete :3500
INFO:root:Epoch : 11, Batches complete :7000
INFO:root:Epoch : 11, Batches complete :10500
INFO:root:Epoch complete :11, Computing Accuracy
INFO:root:Epochs completed : 11 Test Accuracy: 0.9786857142857143, Test Loss: 0.2339698174562463
INFO:root:Epoch : 12, Batches complete :0
INFO:root:Epoch : 12, Batches complete :3500
INFO:root:Epoch : 12, Batches complete :7000
INFO:root:Epoch : 12, Batches complete :10500
INFO:root:Epoch complete :12, Computing Accuracy
INFO:root:Epochs completed : 12 Test Accuracy: 0.9786571428571429, Test Loss: 0.23381617988806827
INFO:root:Epoch : 13, Batches complete :0
INFO:root:Epoch : 13, Batches complete :3500
INFO:root:Epoch : 13, Batches complete :7000
INFO:root:Epoch : 13, Batches complete :10500
INFO:root:Epoch complete :13, Computing Accuracy
INFO:root:Epochs completed : 13 Test Accuracy: 0.9786857142857143, Test Loss: 0.23380975439287707
INFO:root:Epoch : 14, Batches complete :0
INFO:root:Epoch : 14, Batches complete :3500
INFO:root:Epoch : 14, Batches complete :7000
INFO:root:Epoch : 14, Batches complete :10500
INFO:root:Epoch complete :14, Computing Accuracy
INFO:root:Epochs completed : 14 Test Accuracy: 0.9786714285714285, Test Loss: 0.2338121177066216
INFO:root:Epoch : 15, Batches complete :0
INFO:root:Epoch : 15, Batches complete :3500
INFO:root:Epoch : 15, Batches complete :7000
INFO:root:Epoch : 15, Batches complete :10500
INFO:root:Epoch complete :15, Computing Accuracy
INFO:root:Epochs completed : 15 Test Accuracy: 0.9786571428571429, Test Loss: 0.23381176800340597
INFO:root:Epoch : 16, Batches complete :0
INFO:root:Epoch : 16, Batches complete :3500
INFO:root:Epoch : 16, Batches complete :7000
INFO:root:Epoch : 16, Batches complete :10500
INFO:root:Epoch complete :16, Computing Accuracy
INFO:root:Epochs completed : 16 Test Accuracy: 0.9786571428571429, Test Loss: 0.23380597550799498
INFO:root:Epoch : 17, Batches complete :0
INFO:root:Epoch : 17, Batches complete :3500
INFO:root:Epoch : 17, Batches complete :7000
INFO:root:Epoch : 17, Batches complete :10500
INFO:root:Epoch complete :17, Computing Accuracy
INFO:root:Epochs completed : 17 Test Accuracy: 0.9786571428571429, Test Loss: 0.23380099870770082
INFO:root:Epoch : 18, Batches complete :0
INFO:root:Epoch : 18, Batches complete :3500
INFO:root:Epoch : 18, Batches complete :7000
INFO:root:Epoch : 18, Batches complete :10500
INFO:root:Epoch complete :18, Computing Accuracy
INFO:root:Epochs completed : 18 Test Accuracy: 0.9786571428571429, Test Loss: 0.2337988977641527
INFO:root:Epoch : 19, Batches complete :0
INFO:root:Epoch : 19, Batches complete :3500
INFO:root:Epoch : 19, Batches complete :7000
INFO:root:Epoch : 19, Batches complete :10500
INFO:root:Epoch complete :19, Computing Accuracy
INFO:root:Epochs completed : 19 Test Accuracy: 0.9786571428571429, Test Loss: 0.23379760068644875
INFO:root:Epoch : 20, Batches complete :0
INFO:root:Epoch : 20, Batches complete :3500
INFO:root:Epoch : 20, Batches complete :7000
INFO:root:Epoch : 20, Batches complete :10500
INFO:root:Epoch complete :20, Computing Accuracy
INFO:root:Epochs completed : 20 Test Accuracy: 0.9786571428571429, Test Loss: 0.233796498817279
INFO:root:Epoch : 21, Batches complete :0
INFO:root:Epoch : 21, Batches complete :3500
INFO:root:Epoch : 21, Batches complete :7000
INFO:root:Epoch : 21, Batches complete :10500
INFO:root:Epoch complete :21, Computing Accuracy
INFO:root:Epochs completed : 21 Test Accuracy: 0.9786571428571429, Test Loss: 0.23379624106003863
INFO:root:Epoch : 22, Batches complete :0
INFO:root:Epoch : 22, Batches complete :3500
INFO:root:Epoch : 22, Batches complete :7000
INFO:root:Epoch : 22, Batches complete :10500
INFO:root:Epoch complete :22, Computing Accuracy
INFO:root:Epochs completed : 22 Test Accuracy: 0.9786571428571429, Test Loss: 0.2337961024970286
INFO:root:Epoch : 23, Batches complete :0
INFO:root:Epoch : 23, Batches complete :3500
INFO:root:Epoch : 23, Batches complete :7000
INFO:root:Epoch : 23, Batches complete :10500
INFO:root:Epoch complete :23, Computing Accuracy
INFO:root:Epochs completed : 23 Test Accuracy: 0.9786571428571429, Test Loss: 0.23379605659751337
INFO:root:Epoch : 24, Batches complete :0
INFO:root:Epoch : 24, Batches complete :3500
INFO:root:Epoch : 24, Batches complete :7000
INFO:root:Epoch : 24, Batches complete :10500
INFO:root:Epoch complete :24, Computing Accuracy
INFO:root:Epochs completed : 24 Test Accuracy: 0.9786571428571429, Test Loss: 0.23379605076231144