Repository navigation
Expand file tree
/
Copy pathfasttext-dbpedia.log
More file actions
176 lines (176 loc) · 9.66 KB
/
Copy pathfasttext-dbpedia.log
File metadata and controls
176 lines (176 loc) · 9.66 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
/home/ubuntu/anaconda3/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
from ._conv import register_converters as _register_converters
INFO:root:Ngrams range for the training run : 1
INFO:root:Loading Training data
INFO:root:Opening file /dev/shm/fastText/data/dbpedia.train for reading input
INFO:root:Loading Test data
INFO:root:Opening file /dev/shm/fastText/data/dbpedia.test for reading input
INFO:root:Vocabulary size: 803505
INFO:root:Training data converting to sequences...
INFO:root:Done! Sequence conversion Time=161.65s, #Sentences=560000
INFO:root:Done! Sequence conversion Time=145.70s, #Sentences=70000
INFO:root:Encoding labels
INFO:root:Label mapping:{'__label__1': 0, '__label__10': 1, '__label__11': 2, '__label__12': 3, '__label__13': 4, '__label__14': 5, '__label__2': 6, '__label__3': 7, '__label__4': 8, '__label__5': 9, '__label__6': 10, '__label__7': 11, '__label__8': 12, '__label__9': 13}
INFO:root:Done! Preprocessing Time=12.20s, #Sentences=560000
INFO:root:Done! Preprocessing Time=5.16s, #Sentences=70000
/home/ubuntu/anaconda3/lib/python3.6/site-packages/gluonnlp/data/sampler.py:366: UserWarning: Some buckets are empty and will be removed. Unused bucket keys=[833, 907, 981, 1129, 1203, 1425]
str(unused_bucket_keys))
INFO:root:Number of labels: 14
INFO:root:Initializing network
INFO:root:Running Training on ctx:gpu(1)
INFO:root:Number of output units in the last layer :14
INFO:root:Network initialized
INFO:root:Loss function for training:SoftmaxCrossEntropyLoss(batch_axis=0, w=None)
INFO:root:Starting Training!
INFO:root:Training on 560000 samples and testing on 70000 samples
INFO:root:Number of batches for each epoch : 35000.0, Display cadence: 3500
INFO:root:Epoch : 0, Batches complete :0
INFO:root:Epoch : 0, Batches complete :3500
INFO:root:Epoch : 0, Batches complete :7000
INFO:root:Epoch : 0, Batches complete :10500
INFO:root:Epoch complete :0, Computing Accuracy
INFO:root:Epochs completed : 0 Test Accuracy: 0.9699, Test Loss: 0.6863976057549881
INFO:root:Epoch : 1, Batches complete :0
INFO:root:Epoch : 1, Batches complete :3500
INFO:root:Epoch : 1, Batches complete :7000
INFO:root:Epoch : 1, Batches complete :10500
INFO:root:Epoch complete :1, Computing Accuracy
INFO:root:Epochs completed : 1 Test Accuracy: 0.9768714285714286, Test Loss: 0.4500242570382416
INFO:root:Epoch : 2, Batches complete :0
INFO:root:Epoch : 2, Batches complete :3500
INFO:root:Epoch : 2, Batches complete :7000
INFO:root:Epoch : 2, Batches complete :10500
INFO:root:Epoch complete :2, Computing Accuracy
INFO:root:Epochs completed : 2 Test Accuracy: 0.9772857142857143, Test Loss: 0.35363802586575893
INFO:root:Epoch : 3, Batches complete :0
INFO:root:Epoch : 3, Batches complete :3500
INFO:root:Epoch : 3, Batches complete :7000
INFO:root:Epoch : 3, Batches complete :10500
INFO:root:Epoch complete :3, Computing Accuracy
INFO:root:Epochs completed : 3 Test Accuracy: 0.9792, Test Loss: 0.2845098681688672
INFO:root:Epoch : 4, Batches complete :0
INFO:root:Epoch : 4, Batches complete :3500
INFO:root:Epoch : 4, Batches complete :7000
INFO:root:Epoch : 4, Batches complete :10500
INFO:root:Epoch complete :4, Computing Accuracy
INFO:root:Epochs completed : 4 Test Accuracy: 0.9794, Test Loss: 0.2565364573793349
INFO:root:Epoch : 5, Batches complete :0
INFO:root:Epoch : 5, Batches complete :3500
INFO:root:Epoch : 5, Batches complete :7000
INFO:root:Epoch : 5, Batches complete :10500
INFO:root:Epoch complete :5, Computing Accuracy
INFO:root:Epochs completed : 5 Test Accuracy: 0.9788857142857142, Test Loss: 0.24630683094896577
INFO:root:Epoch : 6, Batches complete :0
INFO:root:Epoch : 6, Batches complete :3500
INFO:root:Epoch : 6, Batches complete :7000
INFO:root:Epoch : 6, Batches complete :10500
INFO:root:Epoch complete :6, Computing Accuracy
INFO:root:Epochs completed : 6 Test Accuracy: 0.9786857142857143, Test Loss: 0.23837156017298708
INFO:root:Epoch : 7, Batches complete :0
INFO:root:Epoch : 7, Batches complete :3500
INFO:root:Epoch : 7, Batches complete :7000
INFO:root:Epoch : 7, Batches complete :10500
INFO:root:Epoch complete :7, Computing Accuracy
INFO:root:Epochs completed : 7 Test Accuracy: 0.9786714285714285, Test Loss: 0.23524657592540643
INFO:root:Epoch : 8, Batches complete :0
INFO:root:Epoch : 8, Batches complete :3500
INFO:root:Epoch : 8, Batches complete :7000
INFO:root:Epoch : 8, Batches complete :10500
INFO:root:Epoch complete :8, Computing Accuracy
INFO:root:Epochs completed : 8 Test Accuracy: 0.9787285714285714, Test Loss: 0.23481739638505386
INFO:root:Epoch : 9, Batches complete :0
INFO:root:Epoch : 9, Batches complete :3500
INFO:root:Epoch : 9, Batches complete :7000
INFO:root:Epoch : 9, Batches complete :10500
INFO:root:Epoch complete :9, Computing Accuracy
INFO:root:Epochs completed : 9 Test Accuracy: 0.9787428571428571, Test Loss: 0.2338253844417883
INFO:root:Epoch : 10, Batches complete :0
INFO:root:Epoch : 10, Batches complete :3500
INFO:root:Epoch : 10, Batches complete :7000
INFO:root:Epoch : 10, Batches complete :10500
INFO:root:Epoch complete :10, Computing Accuracy
INFO:root:Epochs completed : 10 Test Accuracy: 0.9786571428571429, Test Loss: 0.23401775828205204
INFO:root:Epoch : 11, Batches complete :0
INFO:root:Epoch : 11, Batches complete :3500
INFO:root:Epoch : 11, Batches complete :7000
INFO:root:Epoch : 11, Batches complete :10500
INFO:root:Epoch complete :11, Computing Accuracy
INFO:root:Epochs completed : 11 Test Accuracy: 0.9786857142857143, Test Loss: 0.2339698174562463
INFO:root:Epoch : 12, Batches complete :0
INFO:root:Epoch : 12, Batches complete :3500
INFO:root:Epoch : 12, Batches complete :7000
INFO:root:Epoch : 12, Batches complete :10500
INFO:root:Epoch complete :12, Computing Accuracy
INFO:root:Epochs completed : 12 Test Accuracy: 0.9786571428571429, Test Loss: 0.23381617988806827
INFO:root:Epoch : 13, Batches complete :0
INFO:root:Epoch : 13, Batches complete :3500
INFO:root:Epoch : 13, Batches complete :7000
INFO:root:Epoch : 13, Batches complete :10500
INFO:root:Epoch complete :13, Computing Accuracy
INFO:root:Epochs completed : 13 Test Accuracy: 0.9786857142857143, Test Loss: 0.23380975439287707
INFO:root:Epoch : 14, Batches complete :0
INFO:root:Epoch : 14, Batches complete :3500
INFO:root:Epoch : 14, Batches complete :7000
INFO:root:Epoch : 14, Batches complete :10500
INFO:root:Epoch complete :14, Computing Accuracy
INFO:root:Epochs completed : 14 Test Accuracy: 0.9786714285714285, Test Loss: 0.2338121177066216
INFO:root:Epoch : 15, Batches complete :0
INFO:root:Epoch : 15, Batches complete :3500
INFO:root:Epoch : 15, Batches complete :7000
INFO:root:Epoch : 15, Batches complete :10500
INFO:root:Epoch complete :15, Computing Accuracy
INFO:root:Epochs completed : 15 Test Accuracy: 0.9786571428571429, Test Loss: 0.23381176800340597
INFO:root:Epoch : 16, Batches complete :0
INFO:root:Epoch : 16, Batches complete :3500
INFO:root:Epoch : 16, Batches complete :7000
INFO:root:Epoch : 16, Batches complete :10500
INFO:root:Epoch complete :16, Computing Accuracy
INFO:root:Epochs completed : 16 Test Accuracy: 0.9786571428571429, Test Loss: 0.23380597550799498
INFO:root:Epoch : 17, Batches complete :0
INFO:root:Epoch : 17, Batches complete :3500
INFO:root:Epoch : 17, Batches complete :7000
INFO:root:Epoch : 17, Batches complete :10500
INFO:root:Epoch complete :17, Computing Accuracy
INFO:root:Epochs completed : 17 Test Accuracy: 0.9786571428571429, Test Loss: 0.23380099870770082
INFO:root:Epoch : 18, Batches complete :0
INFO:root:Epoch : 18, Batches complete :3500
INFO:root:Epoch : 18, Batches complete :7000
INFO:root:Epoch : 18, Batches complete :10500
INFO:root:Epoch complete :18, Computing Accuracy
INFO:root:Epochs completed : 18 Test Accuracy: 0.9786571428571429, Test Loss: 0.2337988977641527
INFO:root:Epoch : 19, Batches complete :0
INFO:root:Epoch : 19, Batches complete :3500
INFO:root:Epoch : 19, Batches complete :7000
INFO:root:Epoch : 19, Batches complete :10500
INFO:root:Epoch complete :19, Computing Accuracy
INFO:root:Epochs completed : 19 Test Accuracy: 0.9786571428571429, Test Loss: 0.23379760068644875
INFO:root:Epoch : 20, Batches complete :0
INFO:root:Epoch : 20, Batches complete :3500
INFO:root:Epoch : 20, Batches complete :7000
INFO:root:Epoch : 20, Batches complete :10500
INFO:root:Epoch complete :20, Computing Accuracy
INFO:root:Epochs completed : 20 Test Accuracy: 0.9786571428571429, Test Loss: 0.233796498817279
INFO:root:Epoch : 21, Batches complete :0
INFO:root:Epoch : 21, Batches complete :3500
INFO:root:Epoch : 21, Batches complete :7000
INFO:root:Epoch : 21, Batches complete :10500
INFO:root:Epoch complete :21, Computing Accuracy
INFO:root:Epochs completed : 21 Test Accuracy: 0.9786571428571429, Test Loss: 0.23379624106003863
INFO:root:Epoch : 22, Batches complete :0
INFO:root:Epoch : 22, Batches complete :3500
INFO:root:Epoch : 22, Batches complete :7000
INFO:root:Epoch : 22, Batches complete :10500
INFO:root:Epoch complete :22, Computing Accuracy
INFO:root:Epochs completed : 22 Test Accuracy: 0.9786571428571429, Test Loss: 0.2337961024970286
INFO:root:Epoch : 23, Batches complete :0
INFO:root:Epoch : 23, Batches complete :3500
INFO:root:Epoch : 23, Batches complete :7000
INFO:root:Epoch : 23, Batches complete :10500
INFO:root:Epoch complete :23, Computing Accuracy
INFO:root:Epochs completed : 23 Test Accuracy: 0.9786571428571429, Test Loss: 0.23379605659751337
INFO:root:Epoch : 24, Batches complete :0
INFO:root:Epoch : 24, Batches complete :3500
INFO:root:Epoch : 24, Batches complete :7000
INFO:root:Epoch : 24, Batches complete :10500
INFO:root:Epoch complete :24, Computing Accuracy
INFO:root:Epochs completed : 24 Test Accuracy: 0.9786571428571429, Test Loss: 0.23379605076231144