forked from SKTBrain/KoBERT
-
Notifications
You must be signed in to change notification settings - Fork 0
/
bert_naver_small_512_news_simple_20190624.txt
598 lines (598 loc) · 42.3 KB
/
bert_naver_small_512_news_simple_20190624.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
CUDA_VISIBLE_DEVICES=4
INFO:root:Namespace(accumulate=2, batch_size=64, dev_batch_size=8, epochs=5, gpu=True, init_param='/root/gfs/gogamza/korean_bert_pre_trained/mxnet_model/korbert_model_054_00003271.params', log_interval=10, lr=5e-05, max_len=512, optimizer='bertadam', seed=2, tokenizer='/root/gfs/gogamza/korean_bert_pre_trained/tokenizer/tokenizer.model', vocab_file='/root/gfs/gogamza/korean_bert_pre_trained/vocabs/news_wiki_2019_small_bertvocab.json', warmup_ratio=0.1)
INFO:root:Using gradient accumulation. Effective batch size = 128
INFO:root:[Epoch 0 Batch 20/2349] loss=0.6985, lr=0.0000009, acc=0.521
INFO:root:[Epoch 0 Batch 40/2349] loss=0.6912, lr=0.0000017, acc=0.525
INFO:root:[Epoch 0 Batch 60/2349] loss=0.6763, lr=0.0000026, acc=0.543
INFO:root:[Epoch 0 Batch 80/2349] loss=0.6519, lr=0.0000034, acc=0.572
INFO:root:[Epoch 0 Batch 100/2349] loss=0.6092, lr=0.0000043, acc=0.598
INFO:root:[Epoch 0 Batch 120/2349] loss=0.5466, lr=0.0000051, acc=0.623
INFO:root:[Epoch 0 Batch 140/2349] loss=0.5037, lr=0.0000060, acc=0.643
INFO:root:[Epoch 0 Batch 160/2349] loss=0.4727, lr=0.0000068, acc=0.662
INFO:root:[Epoch 0 Batch 180/2349] loss=0.4602, lr=0.0000077, acc=0.677
INFO:root:[Epoch 0 Batch 200/2349] loss=0.4767, lr=0.0000085, acc=0.688
INFO:root:[Epoch 0 Batch 220/2349] loss=0.4414, lr=0.0000094, acc=0.699
INFO:root:[Epoch 0 Batch 240/2349] loss=0.4079, lr=0.0000103, acc=0.709
INFO:root:[Epoch 0 Batch 260/2349] loss=0.4265, lr=0.0000111, acc=0.716
INFO:root:[Epoch 0 Batch 280/2349] loss=0.4092, lr=0.0000120, acc=0.724
INFO:root:[Epoch 0 Batch 300/2349] loss=0.4460, lr=0.0000128, acc=0.729
INFO:root:[Epoch 0 Batch 320/2349] loss=0.3898, lr=0.0000137, acc=0.736
INFO:root:[Epoch 0 Batch 340/2349] loss=0.3804, lr=0.0000145, acc=0.742
INFO:root:[Epoch 0 Batch 360/2349] loss=0.3750, lr=0.0000154, acc=0.747
INFO:root:[Epoch 0 Batch 380/2349] loss=0.3776, lr=0.0000162, acc=0.752
INFO:root:[Epoch 0 Batch 400/2349] loss=0.3826, lr=0.0000171, acc=0.755
INFO:root:[Epoch 0 Batch 420/2349] loss=0.3574, lr=0.0000179, acc=0.760
INFO:root:[Epoch 0 Batch 440/2349] loss=0.3806, lr=0.0000188, acc=0.762
INFO:root:[Epoch 0 Batch 460/2349] loss=0.3789, lr=0.0000197, acc=0.765
INFO:root:[Epoch 0 Batch 480/2349] loss=0.3418, lr=0.0000205, acc=0.769
INFO:root:[Epoch 0 Batch 500/2349] loss=0.3144, lr=0.0000214, acc=0.773
INFO:root:[Epoch 0 Batch 520/2349] loss=0.3721, lr=0.0000222, acc=0.776
INFO:root:[Epoch 0 Batch 540/2349] loss=0.3593, lr=0.0000231, acc=0.778
INFO:root:[Epoch 0 Batch 560/2349] loss=0.3343, lr=0.0000239, acc=0.781
INFO:root:[Epoch 0 Batch 580/2349] loss=0.2992, lr=0.0000248, acc=0.784
INFO:root:[Epoch 0 Batch 600/2349] loss=0.3499, lr=0.0000256, acc=0.786
INFO:root:[Epoch 0 Batch 620/2349] loss=0.3485, lr=0.0000265, acc=0.788
INFO:root:[Epoch 0 Batch 640/2349] loss=0.3567, lr=0.0000274, acc=0.790
INFO:root:[Epoch 0 Batch 660/2349] loss=0.3207, lr=0.0000282, acc=0.792
INFO:root:[Epoch 0 Batch 680/2349] loss=0.3397, lr=0.0000291, acc=0.794
INFO:root:[Epoch 0 Batch 700/2349] loss=0.3379, lr=0.0000299, acc=0.796
INFO:root:[Epoch 0 Batch 720/2349] loss=0.3357, lr=0.0000308, acc=0.797
INFO:root:[Epoch 0 Batch 740/2349] loss=0.3422, lr=0.0000316, acc=0.799
INFO:root:[Epoch 0 Batch 760/2349] loss=0.3019, lr=0.0000325, acc=0.801
INFO:root:[Epoch 0 Batch 780/2349] loss=0.3251, lr=0.0000333, acc=0.802
INFO:root:[Epoch 0 Batch 800/2349] loss=0.3399, lr=0.0000342, acc=0.803
INFO:root:[Epoch 0 Batch 820/2349] loss=0.3116, lr=0.0000350, acc=0.805
INFO:root:[Epoch 0 Batch 840/2349] loss=0.3557, lr=0.0000359, acc=0.806
INFO:root:[Epoch 0 Batch 860/2349] loss=0.3411, lr=0.0000368, acc=0.808
INFO:root:[Epoch 0 Batch 880/2349] loss=0.3002, lr=0.0000376, acc=0.809
INFO:root:[Epoch 0 Batch 900/2349] loss=0.3168, lr=0.0000385, acc=0.810
INFO:root:[Epoch 0 Batch 920/2349] loss=0.3541, lr=0.0000393, acc=0.811
INFO:root:[Epoch 0 Batch 940/2349] loss=0.3555, lr=0.0000402, acc=0.811
INFO:root:[Epoch 0 Batch 960/2349] loss=0.2993, lr=0.0000410, acc=0.813
INFO:root:[Epoch 0 Batch 980/2349] loss=0.3127, lr=0.0000419, acc=0.814
INFO:root:[Epoch 0 Batch 1000/2349] loss=0.3205, lr=0.0000427, acc=0.815
INFO:root:[Epoch 0 Batch 1020/2349] loss=0.3432, lr=0.0000436, acc=0.816
INFO:root:[Epoch 0 Batch 1040/2349] loss=0.3004, lr=0.0000444, acc=0.817
INFO:root:[Epoch 0 Batch 1060/2349] loss=0.3220, lr=0.0000453, acc=0.818
INFO:root:[Epoch 0 Batch 1080/2349] loss=0.3243, lr=0.0000462, acc=0.818
INFO:root:[Epoch 0 Batch 1100/2349] loss=0.3269, lr=0.0000470, acc=0.819
INFO:root:[Epoch 0 Batch 1120/2349] loss=0.3718, lr=0.0000479, acc=0.819
INFO:root:[Epoch 0 Batch 1140/2349] loss=0.3387, lr=0.0000487, acc=0.820
INFO:root:[Epoch 0 Batch 1160/2349] loss=0.3155, lr=0.0000496, acc=0.820
INFO:root:[Epoch 0 Batch 1180/2349] loss=0.3200, lr=0.0000500, acc=0.821
INFO:root:[Epoch 0 Batch 1200/2349] loss=0.3082, lr=0.0000499, acc=0.822
INFO:root:[Epoch 0 Batch 1220/2349] loss=0.3230, lr=0.0000498, acc=0.823
INFO:root:[Epoch 0 Batch 1240/2349] loss=0.3285, lr=0.0000497, acc=0.823
INFO:root:[Epoch 0 Batch 1260/2349] loss=0.3115, lr=0.0000496, acc=0.824
INFO:root:[Epoch 0 Batch 1280/2349] loss=0.3151, lr=0.0000495, acc=0.824
INFO:root:[Epoch 0 Batch 1300/2349] loss=0.2915, lr=0.0000494, acc=0.825
INFO:root:[Epoch 0 Batch 1320/2349] loss=0.3143, lr=0.0000493, acc=0.826
INFO:root:[Epoch 0 Batch 1340/2349] loss=0.3417, lr=0.0000492, acc=0.826
INFO:root:[Epoch 0 Batch 1360/2349] loss=0.2848, lr=0.0000491, acc=0.827
INFO:root:[Epoch 0 Batch 1380/2349] loss=0.2971, lr=0.0000490, acc=0.828
INFO:root:[Epoch 0 Batch 1400/2349] loss=0.2928, lr=0.0000489, acc=0.829
INFO:root:[Epoch 0 Batch 1420/2349] loss=0.3258, lr=0.0000488, acc=0.829
INFO:root:[Epoch 0 Batch 1440/2349] loss=0.2955, lr=0.0000487, acc=0.830
INFO:root:[Epoch 0 Batch 1460/2349] loss=0.2928, lr=0.0000486, acc=0.831
INFO:root:[Epoch 0 Batch 1480/2349] loss=0.3149, lr=0.0000485, acc=0.831
INFO:root:[Epoch 0 Batch 1500/2349] loss=0.2939, lr=0.0000484, acc=0.831
INFO:root:[Epoch 0 Batch 1520/2349] loss=0.2996, lr=0.0000483, acc=0.832
INFO:root:[Epoch 0 Batch 1540/2349] loss=0.2749, lr=0.0000482, acc=0.833
INFO:root:[Epoch 0 Batch 1560/2349] loss=0.3180, lr=0.0000482, acc=0.833
INFO:root:[Epoch 0 Batch 1580/2349] loss=0.3121, lr=0.0000481, acc=0.834
INFO:root:[Epoch 0 Batch 1600/2349] loss=0.3010, lr=0.0000480, acc=0.834
INFO:root:[Epoch 0 Batch 1620/2349] loss=0.3024, lr=0.0000479, acc=0.834
INFO:root:[Epoch 0 Batch 1640/2349] loss=0.2806, lr=0.0000478, acc=0.835
INFO:root:[Epoch 0 Batch 1660/2349] loss=0.2992, lr=0.0000477, acc=0.836
INFO:root:[Epoch 0 Batch 1680/2349] loss=0.2903, lr=0.0000476, acc=0.836
INFO:root:[Epoch 0 Batch 1700/2349] loss=0.3172, lr=0.0000475, acc=0.836
INFO:root:[Epoch 0 Batch 1720/2349] loss=0.3008, lr=0.0000474, acc=0.837
INFO:root:[Epoch 0 Batch 1740/2349] loss=0.2878, lr=0.0000473, acc=0.837
INFO:root:[Epoch 0 Batch 1760/2349] loss=0.2797, lr=0.0000472, acc=0.838
INFO:root:[Epoch 0 Batch 1780/2349] loss=0.2787, lr=0.0000471, acc=0.839
INFO:root:[Epoch 0 Batch 1800/2349] loss=0.2899, lr=0.0000470, acc=0.839
INFO:root:[Epoch 0 Batch 1820/2349] loss=0.2943, lr=0.0000469, acc=0.839
INFO:root:[Epoch 0 Batch 1840/2349] loss=0.3081, lr=0.0000468, acc=0.840
INFO:root:[Epoch 0 Batch 1860/2349] loss=0.2504, lr=0.0000467, acc=0.840
INFO:root:[Epoch 0 Batch 1880/2349] loss=0.2934, lr=0.0000466, acc=0.841
INFO:root:[Epoch 0 Batch 1900/2349] loss=0.3081, lr=0.0000465, acc=0.841
INFO:root:[Epoch 0 Batch 1920/2349] loss=0.2955, lr=0.0000464, acc=0.841
INFO:root:[Epoch 0 Batch 1940/2349] loss=0.2660, lr=0.0000464, acc=0.842
INFO:root:[Epoch 0 Batch 1960/2349] loss=0.2827, lr=0.0000463, acc=0.842
INFO:root:[Epoch 0 Batch 1980/2349] loss=0.2583, lr=0.0000462, acc=0.843
INFO:root:[Epoch 0 Batch 2000/2349] loss=0.2739, lr=0.0000461, acc=0.843
INFO:root:[Epoch 0 Batch 2020/2349] loss=0.2727, lr=0.0000460, acc=0.844
INFO:root:[Epoch 0 Batch 2040/2349] loss=0.2707, lr=0.0000459, acc=0.844
INFO:root:[Epoch 0 Batch 2060/2349] loss=0.3077, lr=0.0000458, acc=0.844
INFO:root:[Epoch 0 Batch 2080/2349] loss=0.2741, lr=0.0000457, acc=0.845
INFO:root:[Epoch 0 Batch 2100/2349] loss=0.2567, lr=0.0000456, acc=0.845
INFO:root:[Epoch 0 Batch 2120/2349] loss=0.2881, lr=0.0000455, acc=0.846
INFO:root:[Epoch 0 Batch 2140/2349] loss=0.2805, lr=0.0000454, acc=0.846
INFO:root:[Epoch 0 Batch 2160/2349] loss=0.2873, lr=0.0000453, acc=0.846
INFO:root:[Epoch 0 Batch 2180/2349] loss=0.2876, lr=0.0000452, acc=0.846
INFO:root:[Epoch 0 Batch 2200/2349] loss=0.2848, lr=0.0000451, acc=0.847
INFO:root:[Epoch 0 Batch 2220/2349] loss=0.2573, lr=0.0000450, acc=0.847
INFO:root:[Epoch 0 Batch 2240/2349] loss=0.2612, lr=0.0000449, acc=0.848
INFO:root:[Epoch 0 Batch 2260/2349] loss=0.2889, lr=0.0000448, acc=0.848
INFO:root:[Epoch 0 Batch 2280/2349] loss=0.2706, lr=0.0000447, acc=0.848
INFO:root:[Epoch 0 Batch 2300/2349] loss=0.2847, lr=0.0000446, acc=0.848
INFO:root:[Epoch 0 Batch 2320/2349] loss=0.2673, lr=0.0000445, acc=0.849
INFO:root:[Epoch 0 Batch 2340/2349] loss=0.2624, lr=0.0000445, acc=0.849
INFO:root:Validation accuracy: 0.889
INFO:root:Time cost=1112.9s
INFO:root:[Epoch 1 Batch 20/2349] loss=0.2233, lr=0.0000443, acc=0.909
INFO:root:[Epoch 1 Batch 40/2349] loss=0.2262, lr=0.0000442, acc=0.911
INFO:root:[Epoch 1 Batch 60/2349] loss=0.2202, lr=0.0000441, acc=0.913
INFO:root:[Epoch 1 Batch 80/2349] loss=0.1996, lr=0.0000440, acc=0.913
INFO:root:[Epoch 1 Batch 100/2349] loss=0.2070, lr=0.0000439, acc=0.915
INFO:root:[Epoch 1 Batch 120/2349] loss=0.2591, lr=0.0000438, acc=0.911
INFO:root:[Epoch 1 Batch 140/2349] loss=0.2206, lr=0.0000437, acc=0.912
INFO:root:[Epoch 1 Batch 160/2349] loss=0.2414, lr=0.0000436, acc=0.912
INFO:root:[Epoch 1 Batch 180/2349] loss=0.2285, lr=0.0000436, acc=0.911
INFO:root:[Epoch 1 Batch 200/2349] loss=0.2258, lr=0.0000435, acc=0.911
INFO:root:[Epoch 1 Batch 220/2349] loss=0.2438, lr=0.0000434, acc=0.910
INFO:root:[Epoch 1 Batch 240/2349] loss=0.2635, lr=0.0000433, acc=0.909
INFO:root:[Epoch 1 Batch 260/2349] loss=0.2210, lr=0.0000432, acc=0.909
INFO:root:[Epoch 1 Batch 280/2349] loss=0.2180, lr=0.0000431, acc=0.910
INFO:root:[Epoch 1 Batch 300/2349] loss=0.2051, lr=0.0000430, acc=0.910
INFO:root:[Epoch 1 Batch 320/2349] loss=0.2268, lr=0.0000429, acc=0.910
INFO:root:[Epoch 1 Batch 340/2349] loss=0.2329, lr=0.0000428, acc=0.910
INFO:root:[Epoch 1 Batch 360/2349] loss=0.2296, lr=0.0000427, acc=0.910
INFO:root:[Epoch 1 Batch 380/2349] loss=0.1956, lr=0.0000426, acc=0.911
INFO:root:[Epoch 1 Batch 400/2349] loss=0.2434, lr=0.0000425, acc=0.910
INFO:root:[Epoch 1 Batch 420/2349] loss=0.2016, lr=0.0000424, acc=0.911
INFO:root:[Epoch 1 Batch 440/2349] loss=0.2303, lr=0.0000423, acc=0.910
INFO:root:[Epoch 1 Batch 460/2349] loss=0.2212, lr=0.0000422, acc=0.910
INFO:root:[Epoch 1 Batch 480/2349] loss=0.2246, lr=0.0000421, acc=0.910
INFO:root:[Epoch 1 Batch 500/2349] loss=0.2499, lr=0.0000420, acc=0.909
INFO:root:[Epoch 1 Batch 520/2349] loss=0.2516, lr=0.0000419, acc=0.909
INFO:root:[Epoch 1 Batch 540/2349] loss=0.2362, lr=0.0000418, acc=0.909
INFO:root:[Epoch 1 Batch 560/2349] loss=0.2645, lr=0.0000418, acc=0.908
INFO:root:[Epoch 1 Batch 580/2349] loss=0.2116, lr=0.0000417, acc=0.908
INFO:root:[Epoch 1 Batch 600/2349] loss=0.2422, lr=0.0000416, acc=0.908
INFO:root:[Epoch 1 Batch 620/2349] loss=0.2013, lr=0.0000415, acc=0.908
INFO:root:[Epoch 1 Batch 640/2349] loss=0.2036, lr=0.0000414, acc=0.908
INFO:root:[Epoch 1 Batch 660/2349] loss=0.2012, lr=0.0000413, acc=0.909
INFO:root:[Epoch 1 Batch 680/2349] loss=0.2188, lr=0.0000412, acc=0.909
INFO:root:[Epoch 1 Batch 700/2349] loss=0.2139, lr=0.0000411, acc=0.909
INFO:root:[Epoch 1 Batch 720/2349] loss=0.2246, lr=0.0000410, acc=0.909
INFO:root:[Epoch 1 Batch 740/2349] loss=0.2387, lr=0.0000409, acc=0.909
INFO:root:[Epoch 1 Batch 760/2349] loss=0.2298, lr=0.0000408, acc=0.909
INFO:root:[Epoch 1 Batch 780/2349] loss=0.2360, lr=0.0000407, acc=0.909
INFO:root:[Epoch 1 Batch 800/2349] loss=0.2352, lr=0.0000406, acc=0.908
INFO:root:[Epoch 1 Batch 820/2349] loss=0.2290, lr=0.0000405, acc=0.909
INFO:root:[Epoch 1 Batch 840/2349] loss=0.2175, lr=0.0000404, acc=0.909
INFO:root:[Epoch 1 Batch 860/2349] loss=0.2253, lr=0.0000403, acc=0.909
INFO:root:[Epoch 1 Batch 880/2349] loss=0.2683, lr=0.0000402, acc=0.908
INFO:root:[Epoch 1 Batch 900/2349] loss=0.2149, lr=0.0000401, acc=0.908
INFO:root:[Epoch 1 Batch 920/2349] loss=0.2285, lr=0.0000400, acc=0.908
INFO:root:[Epoch 1 Batch 940/2349] loss=0.2042, lr=0.0000400, acc=0.908
INFO:root:[Epoch 1 Batch 960/2349] loss=0.2121, lr=0.0000399, acc=0.909
INFO:root:[Epoch 1 Batch 980/2349] loss=0.2260, lr=0.0000398, acc=0.909
INFO:root:[Epoch 1 Batch 1000/2349] loss=0.2110, lr=0.0000397, acc=0.909
INFO:root:[Epoch 1 Batch 1020/2349] loss=0.2101, lr=0.0000396, acc=0.909
INFO:root:[Epoch 1 Batch 1040/2349] loss=0.1777, lr=0.0000395, acc=0.910
INFO:root:[Epoch 1 Batch 1060/2349] loss=0.1972, lr=0.0000394, acc=0.910
INFO:root:[Epoch 1 Batch 1080/2349] loss=0.2308, lr=0.0000393, acc=0.910
INFO:root:[Epoch 1 Batch 1100/2349] loss=0.2192, lr=0.0000392, acc=0.910
INFO:root:[Epoch 1 Batch 1120/2349] loss=0.2243, lr=0.0000391, acc=0.910
INFO:root:[Epoch 1 Batch 1140/2349] loss=0.1994, lr=0.0000390, acc=0.910
INFO:root:[Epoch 1 Batch 1160/2349] loss=0.2122, lr=0.0000389, acc=0.910
INFO:root:[Epoch 1 Batch 1180/2349] loss=0.2322, lr=0.0000388, acc=0.909
INFO:root:[Epoch 1 Batch 1200/2349] loss=0.2328, lr=0.0000387, acc=0.909
INFO:root:[Epoch 1 Batch 1220/2349] loss=0.2218, lr=0.0000386, acc=0.909
INFO:root:[Epoch 1 Batch 1240/2349] loss=0.2323, lr=0.0000385, acc=0.909
INFO:root:[Epoch 1 Batch 1260/2349] loss=0.2130, lr=0.0000384, acc=0.910
INFO:root:[Epoch 1 Batch 1280/2349] loss=0.2207, lr=0.0000383, acc=0.910
INFO:root:[Epoch 1 Batch 1300/2349] loss=0.1797, lr=0.0000382, acc=0.910
INFO:root:[Epoch 1 Batch 1320/2349] loss=0.2173, lr=0.0000381, acc=0.910
INFO:root:[Epoch 1 Batch 1340/2349] loss=0.2212, lr=0.0000381, acc=0.910
INFO:root:[Epoch 1 Batch 1360/2349] loss=0.2119, lr=0.0000380, acc=0.910
INFO:root:[Epoch 1 Batch 1380/2349] loss=0.2112, lr=0.0000379, acc=0.910
INFO:root:[Epoch 1 Batch 1400/2349] loss=0.2070, lr=0.0000378, acc=0.910
INFO:root:[Epoch 1 Batch 1420/2349] loss=0.2457, lr=0.0000377, acc=0.910
INFO:root:[Epoch 1 Batch 1440/2349] loss=0.2218, lr=0.0000376, acc=0.910
INFO:root:[Epoch 1 Batch 1460/2349] loss=0.1926, lr=0.0000375, acc=0.910
INFO:root:[Epoch 1 Batch 1480/2349] loss=0.2147, lr=0.0000374, acc=0.910
INFO:root:[Epoch 1 Batch 1500/2349] loss=0.2371, lr=0.0000373, acc=0.910
INFO:root:[Epoch 1 Batch 1520/2349] loss=0.2106, lr=0.0000372, acc=0.910
INFO:root:[Epoch 1 Batch 1540/2349] loss=0.2332, lr=0.0000371, acc=0.910
INFO:root:[Epoch 1 Batch 1560/2349] loss=0.1809, lr=0.0000370, acc=0.911
INFO:root:[Epoch 1 Batch 1580/2349] loss=0.2317, lr=0.0000369, acc=0.911
INFO:root:[Epoch 1 Batch 1600/2349] loss=0.2128, lr=0.0000368, acc=0.911
INFO:root:[Epoch 1 Batch 1620/2349] loss=0.2263, lr=0.0000367, acc=0.911
INFO:root:[Epoch 1 Batch 1640/2349] loss=0.2215, lr=0.0000366, acc=0.911
INFO:root:[Epoch 1 Batch 1660/2349] loss=0.2291, lr=0.0000365, acc=0.910
INFO:root:[Epoch 1 Batch 1680/2349] loss=0.2073, lr=0.0000364, acc=0.911
INFO:root:[Epoch 1 Batch 1700/2349] loss=0.2083, lr=0.0000363, acc=0.911
INFO:root:[Epoch 1 Batch 1720/2349] loss=0.2227, lr=0.0000363, acc=0.911
INFO:root:[Epoch 1 Batch 1740/2349] loss=0.2015, lr=0.0000362, acc=0.911
INFO:root:[Epoch 1 Batch 1760/2349] loss=0.2062, lr=0.0000361, acc=0.911
INFO:root:[Epoch 1 Batch 1780/2349] loss=0.2114, lr=0.0000360, acc=0.911
INFO:root:[Epoch 1 Batch 1800/2349] loss=0.1953, lr=0.0000359, acc=0.911
INFO:root:[Epoch 1 Batch 1820/2349] loss=0.2316, lr=0.0000358, acc=0.911
INFO:root:[Epoch 1 Batch 1840/2349] loss=0.2266, lr=0.0000357, acc=0.911
INFO:root:[Epoch 1 Batch 1860/2349] loss=0.2026, lr=0.0000356, acc=0.911
INFO:root:[Epoch 1 Batch 1880/2349] loss=0.1875, lr=0.0000355, acc=0.911
INFO:root:[Epoch 1 Batch 1900/2349] loss=0.2406, lr=0.0000354, acc=0.911
INFO:root:[Epoch 1 Batch 1920/2349] loss=0.1935, lr=0.0000353, acc=0.911
INFO:root:[Epoch 1 Batch 1940/2349] loss=0.2212, lr=0.0000352, acc=0.911
INFO:root:[Epoch 1 Batch 1960/2349] loss=0.2096, lr=0.0000351, acc=0.911
INFO:root:[Epoch 1 Batch 1980/2349] loss=0.2192, lr=0.0000350, acc=0.912
INFO:root:[Epoch 1 Batch 2000/2349] loss=0.2126, lr=0.0000349, acc=0.912
INFO:root:[Epoch 1 Batch 2020/2349] loss=0.2200, lr=0.0000348, acc=0.912
INFO:root:[Epoch 1 Batch 2040/2349] loss=0.2011, lr=0.0000347, acc=0.912
INFO:root:[Epoch 1 Batch 2060/2349] loss=0.2247, lr=0.0000346, acc=0.912
INFO:root:[Epoch 1 Batch 2080/2349] loss=0.2204, lr=0.0000345, acc=0.912
INFO:root:[Epoch 1 Batch 2100/2349] loss=0.2040, lr=0.0000345, acc=0.912
INFO:root:[Epoch 1 Batch 2120/2349] loss=0.2322, lr=0.0000344, acc=0.912
INFO:root:[Epoch 1 Batch 2140/2349] loss=0.1871, lr=0.0000343, acc=0.912
INFO:root:[Epoch 1 Batch 2160/2349] loss=0.2286, lr=0.0000342, acc=0.912
INFO:root:[Epoch 1 Batch 2180/2349] loss=0.1914, lr=0.0000341, acc=0.912
INFO:root:[Epoch 1 Batch 2200/2349] loss=0.2238, lr=0.0000340, acc=0.912
INFO:root:[Epoch 1 Batch 2220/2349] loss=0.2056, lr=0.0000339, acc=0.912
INFO:root:[Epoch 1 Batch 2240/2349] loss=0.2146, lr=0.0000338, acc=0.912
INFO:root:[Epoch 1 Batch 2260/2349] loss=0.1991, lr=0.0000337, acc=0.912
INFO:root:[Epoch 1 Batch 2280/2349] loss=0.2153, lr=0.0000336, acc=0.912
INFO:root:[Epoch 1 Batch 2300/2349] loss=0.2157, lr=0.0000335, acc=0.912
INFO:root:[Epoch 1 Batch 2320/2349] loss=0.2053, lr=0.0000334, acc=0.912
INFO:root:[Epoch 1 Batch 2340/2349] loss=0.2125, lr=0.0000333, acc=0.912
INFO:root:Validation accuracy: 0.900
INFO:root:Time cost=1119.2s
INFO:root:[Epoch 2 Batch 20/2349] loss=0.1304, lr=0.0000332, acc=0.955
INFO:root:[Epoch 2 Batch 40/2349] loss=0.1755, lr=0.0000331, acc=0.947
INFO:root:[Epoch 2 Batch 60/2349] loss=0.1244, lr=0.0000330, acc=0.951
INFO:root:[Epoch 2 Batch 80/2349] loss=0.1791, lr=0.0000329, acc=0.946
INFO:root:[Epoch 2 Batch 100/2349] loss=0.1618, lr=0.0000328, acc=0.946
INFO:root:[Epoch 2 Batch 120/2349] loss=0.1467, lr=0.0000327, acc=0.946
INFO:root:[Epoch 2 Batch 140/2349] loss=0.1281, lr=0.0000326, acc=0.948
INFO:root:[Epoch 2 Batch 160/2349] loss=0.1397, lr=0.0000325, acc=0.949
INFO:root:[Epoch 2 Batch 180/2349] loss=0.1528, lr=0.0000324, acc=0.947
INFO:root:[Epoch 2 Batch 200/2349] loss=0.1688, lr=0.0000323, acc=0.946
INFO:root:[Epoch 2 Batch 220/2349] loss=0.1431, lr=0.0000322, acc=0.946
INFO:root:[Epoch 2 Batch 240/2349] loss=0.1519, lr=0.0000321, acc=0.946
INFO:root:[Epoch 2 Batch 260/2349] loss=0.1376, lr=0.0000320, acc=0.946
INFO:root:[Epoch 2 Batch 280/2349] loss=0.1606, lr=0.0000319, acc=0.946
INFO:root:[Epoch 2 Batch 300/2349] loss=0.1352, lr=0.0000318, acc=0.946
INFO:root:[Epoch 2 Batch 320/2349] loss=0.1712, lr=0.0000318, acc=0.946
INFO:root:[Epoch 2 Batch 340/2349] loss=0.1347, lr=0.0000317, acc=0.946
INFO:root:[Epoch 2 Batch 360/2349] loss=0.1213, lr=0.0000316, acc=0.946
INFO:root:[Epoch 2 Batch 380/2349] loss=0.1337, lr=0.0000315, acc=0.946
INFO:root:[Epoch 2 Batch 400/2349] loss=0.1686, lr=0.0000314, acc=0.946
INFO:root:[Epoch 2 Batch 420/2349] loss=0.1508, lr=0.0000313, acc=0.946
INFO:root:[Epoch 2 Batch 440/2349] loss=0.1619, lr=0.0000312, acc=0.945
INFO:root:[Epoch 2 Batch 460/2349] loss=0.1140, lr=0.0000311, acc=0.946
INFO:root:[Epoch 2 Batch 480/2349] loss=0.1127, lr=0.0000310, acc=0.946
INFO:root:[Epoch 2 Batch 500/2349] loss=0.1468, lr=0.0000309, acc=0.947
INFO:root:[Epoch 2 Batch 520/2349] loss=0.1844, lr=0.0000308, acc=0.946
INFO:root:[Epoch 2 Batch 540/2349] loss=0.1160, lr=0.0000307, acc=0.947
INFO:root:[Epoch 2 Batch 560/2349] loss=0.1582, lr=0.0000306, acc=0.947
INFO:root:[Epoch 2 Batch 580/2349] loss=0.1315, lr=0.0000305, acc=0.947
INFO:root:[Epoch 2 Batch 600/2349] loss=0.1660, lr=0.0000304, acc=0.947
INFO:root:[Epoch 2 Batch 620/2349] loss=0.1738, lr=0.0000303, acc=0.946
INFO:root:[Epoch 2 Batch 640/2349] loss=0.1525, lr=0.0000302, acc=0.946
INFO:root:[Epoch 2 Batch 660/2349] loss=0.1257, lr=0.0000301, acc=0.946
INFO:root:[Epoch 2 Batch 680/2349] loss=0.1421, lr=0.0000300, acc=0.946
INFO:root:[Epoch 2 Batch 700/2349] loss=0.1389, lr=0.0000299, acc=0.947
INFO:root:[Epoch 2 Batch 720/2349] loss=0.1440, lr=0.0000299, acc=0.946
INFO:root:[Epoch 2 Batch 740/2349] loss=0.1741, lr=0.0000298, acc=0.946
INFO:root:[Epoch 2 Batch 760/2349] loss=0.1400, lr=0.0000297, acc=0.946
INFO:root:[Epoch 2 Batch 780/2349] loss=0.1668, lr=0.0000296, acc=0.946
INFO:root:[Epoch 2 Batch 800/2349] loss=0.1171, lr=0.0000295, acc=0.946
INFO:root:[Epoch 2 Batch 820/2349] loss=0.1660, lr=0.0000294, acc=0.946
INFO:root:[Epoch 2 Batch 840/2349] loss=0.1562, lr=0.0000293, acc=0.946
INFO:root:[Epoch 2 Batch 860/2349] loss=0.1316, lr=0.0000292, acc=0.946
INFO:root:[Epoch 2 Batch 880/2349] loss=0.1534, lr=0.0000291, acc=0.946
INFO:root:[Epoch 2 Batch 900/2349] loss=0.1541, lr=0.0000290, acc=0.946
INFO:root:[Epoch 2 Batch 920/2349] loss=0.1554, lr=0.0000289, acc=0.946
INFO:root:[Epoch 2 Batch 940/2349] loss=0.1265, lr=0.0000288, acc=0.946
INFO:root:[Epoch 2 Batch 960/2349] loss=0.1317, lr=0.0000287, acc=0.946
INFO:root:[Epoch 2 Batch 980/2349] loss=0.1633, lr=0.0000286, acc=0.946
INFO:root:[Epoch 2 Batch 1000/2349] loss=0.1158, lr=0.0000285, acc=0.946
INFO:root:[Epoch 2 Batch 1020/2349] loss=0.1435, lr=0.0000284, acc=0.946
INFO:root:[Epoch 2 Batch 1040/2349] loss=0.1600, lr=0.0000283, acc=0.946
INFO:root:[Epoch 2 Batch 1060/2349] loss=0.1303, lr=0.0000282, acc=0.946
INFO:root:[Epoch 2 Batch 1080/2349] loss=0.1450, lr=0.0000281, acc=0.946
INFO:root:[Epoch 2 Batch 1100/2349] loss=0.1393, lr=0.0000281, acc=0.946
INFO:root:[Epoch 2 Batch 1120/2349] loss=0.1438, lr=0.0000280, acc=0.946
INFO:root:[Epoch 2 Batch 1140/2349] loss=0.1516, lr=0.0000279, acc=0.946
INFO:root:[Epoch 2 Batch 1160/2349] loss=0.1219, lr=0.0000278, acc=0.946
INFO:root:[Epoch 2 Batch 1180/2349] loss=0.1538, lr=0.0000277, acc=0.946
INFO:root:[Epoch 2 Batch 1200/2349] loss=0.1509, lr=0.0000276, acc=0.946
INFO:root:[Epoch 2 Batch 1220/2349] loss=0.1508, lr=0.0000275, acc=0.946
INFO:root:[Epoch 2 Batch 1240/2349] loss=0.1380, lr=0.0000274, acc=0.946
INFO:root:[Epoch 2 Batch 1260/2349] loss=0.1513, lr=0.0000273, acc=0.946
INFO:root:[Epoch 2 Batch 1280/2349] loss=0.1543, lr=0.0000272, acc=0.946
INFO:root:[Epoch 2 Batch 1300/2349] loss=0.1648, lr=0.0000271, acc=0.946
INFO:root:[Epoch 2 Batch 1320/2349] loss=0.1586, lr=0.0000270, acc=0.946
INFO:root:[Epoch 2 Batch 1340/2349] loss=0.1468, lr=0.0000269, acc=0.945
INFO:root:[Epoch 2 Batch 1360/2349] loss=0.1388, lr=0.0000268, acc=0.945
INFO:root:[Epoch 2 Batch 1380/2349] loss=0.1050, lr=0.0000267, acc=0.946
INFO:root:[Epoch 2 Batch 1400/2349] loss=0.1374, lr=0.0000266, acc=0.946
INFO:root:[Epoch 2 Batch 1420/2349] loss=0.1636, lr=0.0000265, acc=0.946
INFO:root:[Epoch 2 Batch 1440/2349] loss=0.1430, lr=0.0000264, acc=0.946
INFO:root:[Epoch 2 Batch 1460/2349] loss=0.1411, lr=0.0000263, acc=0.946
INFO:root:[Epoch 2 Batch 1480/2349] loss=0.1259, lr=0.0000263, acc=0.946
INFO:root:[Epoch 2 Batch 1500/2349] loss=0.1280, lr=0.0000262, acc=0.946
INFO:root:[Epoch 2 Batch 1520/2349] loss=0.1701, lr=0.0000261, acc=0.946
INFO:root:[Epoch 2 Batch 1540/2349] loss=0.1508, lr=0.0000260, acc=0.946
INFO:root:[Epoch 2 Batch 1560/2349] loss=0.1237, lr=0.0000259, acc=0.946
INFO:root:[Epoch 2 Batch 1580/2349] loss=0.1398, lr=0.0000258, acc=0.946
INFO:root:[Epoch 2 Batch 1600/2349] loss=0.1406, lr=0.0000257, acc=0.946
INFO:root:[Epoch 2 Batch 1620/2349] loss=0.1495, lr=0.0000256, acc=0.946
INFO:root:[Epoch 2 Batch 1640/2349] loss=0.1369, lr=0.0000255, acc=0.946
INFO:root:[Epoch 2 Batch 1660/2349] loss=0.1874, lr=0.0000254, acc=0.946
INFO:root:[Epoch 2 Batch 1680/2349] loss=0.1558, lr=0.0000253, acc=0.946
INFO:root:[Epoch 2 Batch 1700/2349] loss=0.1182, lr=0.0000252, acc=0.946
INFO:root:[Epoch 2 Batch 1720/2349] loss=0.1452, lr=0.0000251, acc=0.946
INFO:root:[Epoch 2 Batch 1740/2349] loss=0.1211, lr=0.0000250, acc=0.946
INFO:root:[Epoch 2 Batch 1760/2349] loss=0.1866, lr=0.0000249, acc=0.946
INFO:root:[Epoch 2 Batch 1780/2349] loss=0.1620, lr=0.0000248, acc=0.946
INFO:root:[Epoch 2 Batch 1800/2349] loss=0.1377, lr=0.0000247, acc=0.946
INFO:root:[Epoch 2 Batch 1820/2349] loss=0.1552, lr=0.0000246, acc=0.946
INFO:root:[Epoch 2 Batch 1840/2349] loss=0.1447, lr=0.0000245, acc=0.946
INFO:root:[Epoch 2 Batch 1860/2349] loss=0.1402, lr=0.0000245, acc=0.946
INFO:root:[Epoch 2 Batch 1880/2349] loss=0.1288, lr=0.0000244, acc=0.946
INFO:root:[Epoch 2 Batch 1900/2349] loss=0.1362, lr=0.0000243, acc=0.946
INFO:root:[Epoch 2 Batch 1920/2349] loss=0.1413, lr=0.0000242, acc=0.946
INFO:root:[Epoch 2 Batch 1940/2349] loss=0.1575, lr=0.0000241, acc=0.946
INFO:root:[Epoch 2 Batch 1960/2349] loss=0.1297, lr=0.0000240, acc=0.946
INFO:root:[Epoch 2 Batch 1980/2349] loss=0.1368, lr=0.0000239, acc=0.946
INFO:root:[Epoch 2 Batch 2000/2349] loss=0.1324, lr=0.0000238, acc=0.946
INFO:root:[Epoch 2 Batch 2020/2349] loss=0.1312, lr=0.0000237, acc=0.946
INFO:root:[Epoch 2 Batch 2040/2349] loss=0.1133, lr=0.0000236, acc=0.946
INFO:root:[Epoch 2 Batch 2060/2349] loss=0.1617, lr=0.0000235, acc=0.946
INFO:root:[Epoch 2 Batch 2080/2349] loss=0.1629, lr=0.0000234, acc=0.946
INFO:root:[Epoch 2 Batch 2100/2349] loss=0.1266, lr=0.0000233, acc=0.946
INFO:root:[Epoch 2 Batch 2120/2349] loss=0.1597, lr=0.0000232, acc=0.946
INFO:root:[Epoch 2 Batch 2140/2349] loss=0.1222, lr=0.0000231, acc=0.946
INFO:root:[Epoch 2 Batch 2160/2349] loss=0.1443, lr=0.0000230, acc=0.946
INFO:root:[Epoch 2 Batch 2180/2349] loss=0.1100, lr=0.0000229, acc=0.946
INFO:root:[Epoch 2 Batch 2200/2349] loss=0.1378, lr=0.0000228, acc=0.946
INFO:root:[Epoch 2 Batch 2220/2349] loss=0.1469, lr=0.0000227, acc=0.946
INFO:root:[Epoch 2 Batch 2240/2349] loss=0.1492, lr=0.0000226, acc=0.946
INFO:root:[Epoch 2 Batch 2260/2349] loss=0.1693, lr=0.0000226, acc=0.946
INFO:root:[Epoch 2 Batch 2280/2349] loss=0.1691, lr=0.0000225, acc=0.946
INFO:root:[Epoch 2 Batch 2300/2349] loss=0.1463, lr=0.0000224, acc=0.946
INFO:root:[Epoch 2 Batch 2320/2349] loss=0.1373, lr=0.0000223, acc=0.946
INFO:root:[Epoch 2 Batch 2340/2349] loss=0.1490, lr=0.0000222, acc=0.946
INFO:root:Validation accuracy: 0.899
INFO:root:Time cost=1114.4s
INFO:root:[Epoch 3 Batch 20/2349] loss=0.0887, lr=0.0000220, acc=0.969
INFO:root:[Epoch 3 Batch 40/2349] loss=0.0966, lr=0.0000219, acc=0.968
INFO:root:[Epoch 3 Batch 60/2349] loss=0.1050, lr=0.0000218, acc=0.967
INFO:root:[Epoch 3 Batch 80/2349] loss=0.0728, lr=0.0000217, acc=0.969
INFO:root:[Epoch 3 Batch 100/2349] loss=0.0899, lr=0.0000217, acc=0.969
INFO:root:[Epoch 3 Batch 120/2349] loss=0.0921, lr=0.0000216, acc=0.969
INFO:root:[Epoch 3 Batch 140/2349] loss=0.0765, lr=0.0000215, acc=0.970
INFO:root:[Epoch 3 Batch 160/2349] loss=0.0799, lr=0.0000214, acc=0.971
INFO:root:[Epoch 3 Batch 180/2349] loss=0.1005, lr=0.0000213, acc=0.970
INFO:root:[Epoch 3 Batch 200/2349] loss=0.0803, lr=0.0000212, acc=0.970
INFO:root:[Epoch 3 Batch 220/2349] loss=0.0934, lr=0.0000211, acc=0.969
INFO:root:[Epoch 3 Batch 240/2349] loss=0.0922, lr=0.0000210, acc=0.969
INFO:root:[Epoch 3 Batch 260/2349] loss=0.1014, lr=0.0000209, acc=0.969
INFO:root:[Epoch 3 Batch 280/2349] loss=0.0616, lr=0.0000208, acc=0.969
INFO:root:[Epoch 3 Batch 300/2349] loss=0.0956, lr=0.0000207, acc=0.969
INFO:root:[Epoch 3 Batch 320/2349] loss=0.0963, lr=0.0000206, acc=0.969
INFO:root:[Epoch 3 Batch 340/2349] loss=0.1058, lr=0.0000205, acc=0.968
INFO:root:[Epoch 3 Batch 360/2349] loss=0.1081, lr=0.0000204, acc=0.968
INFO:root:[Epoch 3 Batch 380/2349] loss=0.0721, lr=0.0000203, acc=0.969
INFO:root:[Epoch 3 Batch 400/2349] loss=0.0829, lr=0.0000202, acc=0.969
INFO:root:[Epoch 3 Batch 420/2349] loss=0.1092, lr=0.0000201, acc=0.969
INFO:root:[Epoch 3 Batch 440/2349] loss=0.1071, lr=0.0000200, acc=0.969
INFO:root:[Epoch 3 Batch 460/2349] loss=0.0945, lr=0.0000199, acc=0.969
INFO:root:[Epoch 3 Batch 480/2349] loss=0.1088, lr=0.0000199, acc=0.968
INFO:root:[Epoch 3 Batch 500/2349] loss=0.0943, lr=0.0000198, acc=0.968
INFO:root:[Epoch 3 Batch 520/2349] loss=0.0869, lr=0.0000197, acc=0.968
INFO:root:[Epoch 3 Batch 540/2349] loss=0.1120, lr=0.0000196, acc=0.968
INFO:root:[Epoch 3 Batch 560/2349] loss=0.0640, lr=0.0000195, acc=0.968
INFO:root:[Epoch 3 Batch 580/2349] loss=0.0963, lr=0.0000194, acc=0.968
INFO:root:[Epoch 3 Batch 600/2349] loss=0.0680, lr=0.0000193, acc=0.969
INFO:root:[Epoch 3 Batch 620/2349] loss=0.0771, lr=0.0000192, acc=0.969
INFO:root:[Epoch 3 Batch 640/2349] loss=0.0962, lr=0.0000191, acc=0.969
INFO:root:[Epoch 3 Batch 660/2349] loss=0.0929, lr=0.0000190, acc=0.969
INFO:root:[Epoch 3 Batch 680/2349] loss=0.1006, lr=0.0000189, acc=0.969
INFO:root:[Epoch 3 Batch 700/2349] loss=0.0941, lr=0.0000188, acc=0.968
INFO:root:[Epoch 3 Batch 720/2349] loss=0.0807, lr=0.0000187, acc=0.968
INFO:root:[Epoch 3 Batch 740/2349] loss=0.0820, lr=0.0000186, acc=0.969
INFO:root:[Epoch 3 Batch 760/2349] loss=0.0982, lr=0.0000185, acc=0.969
INFO:root:[Epoch 3 Batch 780/2349] loss=0.1066, lr=0.0000184, acc=0.969
INFO:root:[Epoch 3 Batch 800/2349] loss=0.0931, lr=0.0000183, acc=0.969
INFO:root:[Epoch 3 Batch 820/2349] loss=0.0988, lr=0.0000182, acc=0.969
INFO:root:[Epoch 3 Batch 840/2349] loss=0.1155, lr=0.0000181, acc=0.968
INFO:root:[Epoch 3 Batch 860/2349] loss=0.0908, lr=0.0000181, acc=0.968
INFO:root:[Epoch 3 Batch 880/2349] loss=0.1082, lr=0.0000180, acc=0.968
INFO:root:[Epoch 3 Batch 900/2349] loss=0.1005, lr=0.0000179, acc=0.968
INFO:root:[Epoch 3 Batch 920/2349] loss=0.0837, lr=0.0000178, acc=0.968
INFO:root:[Epoch 3 Batch 940/2349] loss=0.0863, lr=0.0000177, acc=0.968
INFO:root:[Epoch 3 Batch 960/2349] loss=0.1011, lr=0.0000176, acc=0.968
INFO:root:[Epoch 3 Batch 980/2349] loss=0.0897, lr=0.0000175, acc=0.968
INFO:root:[Epoch 3 Batch 1000/2349] loss=0.0892, lr=0.0000174, acc=0.968
INFO:root:[Epoch 3 Batch 1020/2349] loss=0.0952, lr=0.0000173, acc=0.968
INFO:root:[Epoch 3 Batch 1040/2349] loss=0.0852, lr=0.0000172, acc=0.968
INFO:root:[Epoch 3 Batch 1060/2349] loss=0.0666, lr=0.0000171, acc=0.968
INFO:root:[Epoch 3 Batch 1080/2349] loss=0.0968, lr=0.0000170, acc=0.968
INFO:root:[Epoch 3 Batch 1100/2349] loss=0.0801, lr=0.0000169, acc=0.968
INFO:root:[Epoch 3 Batch 1120/2349] loss=0.0832, lr=0.0000168, acc=0.968
INFO:root:[Epoch 3 Batch 1140/2349] loss=0.0931, lr=0.0000167, acc=0.968
INFO:root:[Epoch 3 Batch 1160/2349] loss=0.0765, lr=0.0000166, acc=0.968
INFO:root:[Epoch 3 Batch 1180/2349] loss=0.1259, lr=0.0000165, acc=0.968
INFO:root:[Epoch 3 Batch 1200/2349] loss=0.1182, lr=0.0000164, acc=0.968
INFO:root:[Epoch 3 Batch 1220/2349] loss=0.0642, lr=0.0000163, acc=0.968
INFO:root:[Epoch 3 Batch 1240/2349] loss=0.0974, lr=0.0000162, acc=0.968
INFO:root:[Epoch 3 Batch 1260/2349] loss=0.0918, lr=0.0000162, acc=0.968
INFO:root:[Epoch 3 Batch 1280/2349] loss=0.0742, lr=0.0000161, acc=0.968
INFO:root:[Epoch 3 Batch 1300/2349] loss=0.0882, lr=0.0000160, acc=0.968
INFO:root:[Epoch 3 Batch 1320/2349] loss=0.0876, lr=0.0000159, acc=0.968
INFO:root:[Epoch 3 Batch 1340/2349] loss=0.0797, lr=0.0000158, acc=0.968
INFO:root:[Epoch 3 Batch 1360/2349] loss=0.1009, lr=0.0000157, acc=0.968
INFO:root:[Epoch 3 Batch 1380/2349] loss=0.0946, lr=0.0000156, acc=0.968
INFO:root:[Epoch 3 Batch 1400/2349] loss=0.1064, lr=0.0000155, acc=0.968
INFO:root:[Epoch 3 Batch 1420/2349] loss=0.0820, lr=0.0000154, acc=0.968
INFO:root:[Epoch 3 Batch 1440/2349] loss=0.0910, lr=0.0000153, acc=0.968
INFO:root:[Epoch 3 Batch 1460/2349] loss=0.0943, lr=0.0000152, acc=0.968
INFO:root:[Epoch 3 Batch 1480/2349] loss=0.0707, lr=0.0000151, acc=0.968
INFO:root:[Epoch 3 Batch 1500/2349] loss=0.0542, lr=0.0000150, acc=0.969
INFO:root:[Epoch 3 Batch 1520/2349] loss=0.0643, lr=0.0000149, acc=0.969
INFO:root:[Epoch 3 Batch 1540/2349] loss=0.0903, lr=0.0000148, acc=0.969
INFO:root:[Epoch 3 Batch 1560/2349] loss=0.1009, lr=0.0000147, acc=0.969
INFO:root:[Epoch 3 Batch 1580/2349] loss=0.0789, lr=0.0000146, acc=0.969
INFO:root:[Epoch 3 Batch 1600/2349] loss=0.0903, lr=0.0000145, acc=0.969
INFO:root:[Epoch 3 Batch 1620/2349] loss=0.0920, lr=0.0000144, acc=0.969
INFO:root:[Epoch 3 Batch 1640/2349] loss=0.1110, lr=0.0000144, acc=0.969
INFO:root:[Epoch 3 Batch 1660/2349] loss=0.0823, lr=0.0000143, acc=0.969
INFO:root:[Epoch 3 Batch 1680/2349] loss=0.0873, lr=0.0000142, acc=0.969
INFO:root:[Epoch 3 Batch 1700/2349] loss=0.0887, lr=0.0000141, acc=0.969
INFO:root:[Epoch 3 Batch 1720/2349] loss=0.0929, lr=0.0000140, acc=0.969
INFO:root:[Epoch 3 Batch 1740/2349] loss=0.1094, lr=0.0000139, acc=0.969
INFO:root:[Epoch 3 Batch 1760/2349] loss=0.0854, lr=0.0000138, acc=0.969
INFO:root:[Epoch 3 Batch 1780/2349] loss=0.1062, lr=0.0000137, acc=0.969
INFO:root:[Epoch 3 Batch 1800/2349] loss=0.0951, lr=0.0000136, acc=0.969
INFO:root:[Epoch 3 Batch 1820/2349] loss=0.0960, lr=0.0000135, acc=0.969
INFO:root:[Epoch 3 Batch 1840/2349] loss=0.0848, lr=0.0000134, acc=0.969
INFO:root:[Epoch 3 Batch 1860/2349] loss=0.0857, lr=0.0000133, acc=0.969
INFO:root:[Epoch 3 Batch 1880/2349] loss=0.0994, lr=0.0000132, acc=0.969
INFO:root:[Epoch 3 Batch 1900/2349] loss=0.0955, lr=0.0000131, acc=0.969
INFO:root:[Epoch 3 Batch 1920/2349] loss=0.1111, lr=0.0000130, acc=0.968
INFO:root:[Epoch 3 Batch 1940/2349] loss=0.1101, lr=0.0000129, acc=0.968
INFO:root:[Epoch 3 Batch 1960/2349] loss=0.0787, lr=0.0000128, acc=0.968
INFO:root:[Epoch 3 Batch 1980/2349] loss=0.0890, lr=0.0000127, acc=0.968
INFO:root:[Epoch 3 Batch 2000/2349] loss=0.1081, lr=0.0000126, acc=0.968
INFO:root:[Epoch 3 Batch 2020/2349] loss=0.0923, lr=0.0000126, acc=0.968
INFO:root:[Epoch 3 Batch 2040/2349] loss=0.0855, lr=0.0000125, acc=0.968
INFO:root:[Epoch 3 Batch 2060/2349] loss=0.0953, lr=0.0000124, acc=0.968
INFO:root:[Epoch 3 Batch 2080/2349] loss=0.0991, lr=0.0000123, acc=0.968
INFO:root:[Epoch 3 Batch 2100/2349] loss=0.0786, lr=0.0000122, acc=0.968
INFO:root:[Epoch 3 Batch 2120/2349] loss=0.0863, lr=0.0000121, acc=0.968
INFO:root:[Epoch 3 Batch 2140/2349] loss=0.0841, lr=0.0000120, acc=0.968
INFO:root:[Epoch 3 Batch 2160/2349] loss=0.0886, lr=0.0000119, acc=0.969
INFO:root:[Epoch 3 Batch 2180/2349] loss=0.0730, lr=0.0000118, acc=0.969
INFO:root:[Epoch 3 Batch 2200/2349] loss=0.0848, lr=0.0000117, acc=0.969
INFO:root:[Epoch 3 Batch 2220/2349] loss=0.0962, lr=0.0000116, acc=0.969
INFO:root:[Epoch 3 Batch 2240/2349] loss=0.0900, lr=0.0000115, acc=0.969
INFO:root:[Epoch 3 Batch 2260/2349] loss=0.1082, lr=0.0000114, acc=0.969
INFO:root:[Epoch 3 Batch 2280/2349] loss=0.0690, lr=0.0000113, acc=0.969
INFO:root:[Epoch 3 Batch 2300/2349] loss=0.1000, lr=0.0000112, acc=0.969
INFO:root:[Epoch 3 Batch 2320/2349] loss=0.0890, lr=0.0000111, acc=0.969
INFO:root:[Epoch 3 Batch 2340/2349] loss=0.0927, lr=0.0000110, acc=0.969
INFO:root:Validation accuracy: 0.899
INFO:root:Time cost=1118.6s
INFO:root:[Epoch 4 Batch 20/2349] loss=0.0582, lr=0.0000109, acc=0.981
INFO:root:[Epoch 4 Batch 40/2349] loss=0.0704, lr=0.0000108, acc=0.980
INFO:root:[Epoch 4 Batch 60/2349] loss=0.0796, lr=0.0000107, acc=0.978
INFO:root:[Epoch 4 Batch 80/2349] loss=0.0481, lr=0.0000106, acc=0.979
INFO:root:[Epoch 4 Batch 100/2349] loss=0.0580, lr=0.0000105, acc=0.979
INFO:root:[Epoch 4 Batch 120/2349] loss=0.0469, lr=0.0000104, acc=0.980
INFO:root:[Epoch 4 Batch 140/2349] loss=0.0580, lr=0.0000103, acc=0.980
INFO:root:[Epoch 4 Batch 160/2349] loss=0.0460, lr=0.0000102, acc=0.980
INFO:root:[Epoch 4 Batch 180/2349] loss=0.0444, lr=0.0000101, acc=0.981
INFO:root:[Epoch 4 Batch 200/2349] loss=0.0424, lr=0.0000100, acc=0.981
INFO:root:[Epoch 4 Batch 220/2349] loss=0.0722, lr=0.0000099, acc=0.981
INFO:root:[Epoch 4 Batch 240/2349] loss=0.0645, lr=0.0000099, acc=0.981
INFO:root:[Epoch 4 Batch 260/2349] loss=0.0715, lr=0.0000098, acc=0.981
INFO:root:[Epoch 4 Batch 280/2349] loss=0.1030, lr=0.0000097, acc=0.980
INFO:root:[Epoch 4 Batch 300/2349] loss=0.0666, lr=0.0000096, acc=0.979
INFO:root:[Epoch 4 Batch 320/2349] loss=0.0529, lr=0.0000095, acc=0.980
INFO:root:[Epoch 4 Batch 340/2349] loss=0.0743, lr=0.0000094, acc=0.980
INFO:root:[Epoch 4 Batch 360/2349] loss=0.0573, lr=0.0000093, acc=0.980
INFO:root:[Epoch 4 Batch 380/2349] loss=0.0356, lr=0.0000092, acc=0.980
INFO:root:[Epoch 4 Batch 400/2349] loss=0.0631, lr=0.0000091, acc=0.980
INFO:root:[Epoch 4 Batch 420/2349] loss=0.0518, lr=0.0000090, acc=0.980
INFO:root:[Epoch 4 Batch 440/2349] loss=0.0762, lr=0.0000089, acc=0.980
INFO:root:[Epoch 4 Batch 460/2349] loss=0.0546, lr=0.0000088, acc=0.980
INFO:root:[Epoch 4 Batch 480/2349] loss=0.0619, lr=0.0000087, acc=0.980
INFO:root:[Epoch 4 Batch 500/2349] loss=0.0361, lr=0.0000086, acc=0.980
INFO:root:[Epoch 4 Batch 520/2349] loss=0.0476, lr=0.0000085, acc=0.980
INFO:root:[Epoch 4 Batch 540/2349] loss=0.0624, lr=0.0000084, acc=0.980
INFO:root:[Epoch 4 Batch 560/2349] loss=0.0579, lr=0.0000083, acc=0.980
INFO:root:[Epoch 4 Batch 580/2349] loss=0.0560, lr=0.0000082, acc=0.980
INFO:root:[Epoch 4 Batch 600/2349] loss=0.0526, lr=0.0000081, acc=0.981
INFO:root:[Epoch 4 Batch 620/2349] loss=0.0471, lr=0.0000080, acc=0.981
INFO:root:[Epoch 4 Batch 640/2349] loss=0.0764, lr=0.0000080, acc=0.980
INFO:root:[Epoch 4 Batch 660/2349] loss=0.0682, lr=0.0000079, acc=0.980
INFO:root:[Epoch 4 Batch 680/2349] loss=0.0576, lr=0.0000078, acc=0.980
INFO:root:[Epoch 4 Batch 700/2349] loss=0.0553, lr=0.0000077, acc=0.980
INFO:root:[Epoch 4 Batch 720/2349] loss=0.0768, lr=0.0000076, acc=0.980
INFO:root:[Epoch 4 Batch 740/2349] loss=0.0625, lr=0.0000075, acc=0.980
INFO:root:[Epoch 4 Batch 760/2349] loss=0.0521, lr=0.0000074, acc=0.980
INFO:root:[Epoch 4 Batch 780/2349] loss=0.0657, lr=0.0000073, acc=0.980
INFO:root:[Epoch 4 Batch 800/2349] loss=0.0749, lr=0.0000072, acc=0.980
INFO:root:[Epoch 4 Batch 820/2349] loss=0.0573, lr=0.0000071, acc=0.980
INFO:root:[Epoch 4 Batch 840/2349] loss=0.0713, lr=0.0000070, acc=0.980
INFO:root:[Epoch 4 Batch 860/2349] loss=0.0604, lr=0.0000069, acc=0.980
INFO:root:[Epoch 4 Batch 880/2349] loss=0.0449, lr=0.0000068, acc=0.980
INFO:root:[Epoch 4 Batch 900/2349] loss=0.0719, lr=0.0000067, acc=0.980
INFO:root:[Epoch 4 Batch 920/2349] loss=0.0693, lr=0.0000066, acc=0.980
INFO:root:[Epoch 4 Batch 940/2349] loss=0.0678, lr=0.0000065, acc=0.980
INFO:root:[Epoch 4 Batch 960/2349] loss=0.0485, lr=0.0000064, acc=0.980
INFO:root:[Epoch 4 Batch 980/2349] loss=0.0578, lr=0.0000063, acc=0.980
INFO:root:[Epoch 4 Batch 1000/2349] loss=0.0494, lr=0.0000062, acc=0.980
INFO:root:[Epoch 4 Batch 1020/2349] loss=0.0510, lr=0.0000062, acc=0.980
INFO:root:[Epoch 4 Batch 1040/2349] loss=0.0660, lr=0.0000061, acc=0.980
INFO:root:[Epoch 4 Batch 1060/2349] loss=0.0576, lr=0.0000060, acc=0.980
INFO:root:[Epoch 4 Batch 1080/2349] loss=0.0457, lr=0.0000059, acc=0.980
INFO:root:[Epoch 4 Batch 1100/2349] loss=0.0493, lr=0.0000058, acc=0.980
INFO:root:[Epoch 4 Batch 1120/2349] loss=0.0540, lr=0.0000057, acc=0.980
INFO:root:[Epoch 4 Batch 1140/2349] loss=0.0622, lr=0.0000056, acc=0.980
INFO:root:[Epoch 4 Batch 1160/2349] loss=0.0684, lr=0.0000055, acc=0.980
INFO:root:[Epoch 4 Batch 1180/2349] loss=0.0520, lr=0.0000054, acc=0.980
INFO:root:[Epoch 4 Batch 1200/2349] loss=0.0725, lr=0.0000053, acc=0.980
INFO:root:[Epoch 4 Batch 1220/2349] loss=0.0824, lr=0.0000052, acc=0.980
INFO:root:[Epoch 4 Batch 1240/2349] loss=0.0708, lr=0.0000051, acc=0.980
INFO:root:[Epoch 4 Batch 1260/2349] loss=0.0545, lr=0.0000050, acc=0.980
INFO:root:[Epoch 4 Batch 1280/2349] loss=0.0685, lr=0.0000049, acc=0.980
INFO:root:[Epoch 4 Batch 1300/2349] loss=0.0500, lr=0.0000048, acc=0.980
INFO:root:[Epoch 4 Batch 1320/2349] loss=0.0633, lr=0.0000047, acc=0.980
INFO:root:[Epoch 4 Batch 1340/2349] loss=0.0526, lr=0.0000046, acc=0.980
INFO:root:[Epoch 4 Batch 1360/2349] loss=0.0570, lr=0.0000045, acc=0.980
INFO:root:[Epoch 4 Batch 1380/2349] loss=0.0614, lr=0.0000044, acc=0.980
INFO:root:[Epoch 4 Batch 1400/2349] loss=0.0564, lr=0.0000044, acc=0.980
INFO:root:[Epoch 4 Batch 1420/2349] loss=0.0735, lr=0.0000043, acc=0.980
INFO:root:[Epoch 4 Batch 1440/2349] loss=0.0646, lr=0.0000042, acc=0.980
INFO:root:[Epoch 4 Batch 1460/2349] loss=0.0708, lr=0.0000041, acc=0.980
INFO:root:[Epoch 4 Batch 1480/2349] loss=0.0508, lr=0.0000040, acc=0.980
INFO:root:[Epoch 4 Batch 1500/2349] loss=0.0656, lr=0.0000039, acc=0.980
INFO:root:[Epoch 4 Batch 1520/2349] loss=0.0493, lr=0.0000038, acc=0.980
INFO:root:[Epoch 4 Batch 1540/2349] loss=0.0468, lr=0.0000037, acc=0.980
INFO:root:[Epoch 4 Batch 1560/2349] loss=0.0316, lr=0.0000036, acc=0.980
INFO:root:[Epoch 4 Batch 1580/2349] loss=0.0508, lr=0.0000035, acc=0.980
INFO:root:[Epoch 4 Batch 1600/2349] loss=0.0540, lr=0.0000034, acc=0.980
INFO:root:[Epoch 4 Batch 1620/2349] loss=0.0823, lr=0.0000033, acc=0.980
INFO:root:[Epoch 4 Batch 1640/2349] loss=0.0550, lr=0.0000032, acc=0.980
INFO:root:[Epoch 4 Batch 1660/2349] loss=0.0571, lr=0.0000031, acc=0.980
INFO:root:[Epoch 4 Batch 1680/2349] loss=0.0819, lr=0.0000030, acc=0.980
INFO:root:[Epoch 4 Batch 1700/2349] loss=0.0654, lr=0.0000029, acc=0.980
INFO:root:[Epoch 4 Batch 1720/2349] loss=0.0933, lr=0.0000028, acc=0.980
INFO:root:[Epoch 4 Batch 1740/2349] loss=0.0707, lr=0.0000027, acc=0.980
INFO:root:[Epoch 4 Batch 1760/2349] loss=0.0749, lr=0.0000026, acc=0.980
INFO:root:[Epoch 4 Batch 1780/2349] loss=0.0636, lr=0.0000026, acc=0.980
INFO:root:[Epoch 4 Batch 1800/2349] loss=0.0728, lr=0.0000025, acc=0.980
INFO:root:[Epoch 4 Batch 1820/2349] loss=0.0666, lr=0.0000024, acc=0.980
INFO:root:[Epoch 4 Batch 1840/2349] loss=0.0753, lr=0.0000023, acc=0.980
INFO:root:[Epoch 4 Batch 1860/2349] loss=0.0628, lr=0.0000022, acc=0.980
INFO:root:[Epoch 4 Batch 1880/2349] loss=0.0595, lr=0.0000021, acc=0.980
INFO:root:[Epoch 4 Batch 1900/2349] loss=0.0509, lr=0.0000020, acc=0.980
INFO:root:[Epoch 4 Batch 1920/2349] loss=0.0504, lr=0.0000019, acc=0.980
INFO:root:[Epoch 4 Batch 1940/2349] loss=0.0583, lr=0.0000018, acc=0.980
INFO:root:[Epoch 4 Batch 1960/2349] loss=0.0448, lr=0.0000017, acc=0.980
INFO:root:[Epoch 4 Batch 1980/2349] loss=0.0556, lr=0.0000016, acc=0.980
INFO:root:[Epoch 4 Batch 2000/2349] loss=0.0431, lr=0.0000015, acc=0.980
INFO:root:[Epoch 4 Batch 2020/2349] loss=0.0563, lr=0.0000014, acc=0.980
INFO:root:[Epoch 4 Batch 2040/2349] loss=0.0556, lr=0.0000013, acc=0.980
INFO:root:[Epoch 4 Batch 2060/2349] loss=0.0733, lr=0.0000012, acc=0.980
INFO:root:[Epoch 4 Batch 2080/2349] loss=0.0640, lr=0.0000011, acc=0.980
INFO:root:[Epoch 4 Batch 2100/2349] loss=0.0629, lr=0.0000010, acc=0.980
INFO:root:[Epoch 4 Batch 2120/2349] loss=0.0422, lr=0.0000009, acc=0.980
INFO:root:[Epoch 4 Batch 2140/2349] loss=0.0708, lr=0.0000008, acc=0.980
INFO:root:[Epoch 4 Batch 2160/2349] loss=0.0477, lr=0.0000007, acc=0.980
INFO:root:[Epoch 4 Batch 2180/2349] loss=0.0877, lr=0.0000007, acc=0.980
INFO:root:[Epoch 4 Batch 2200/2349] loss=0.0550, lr=0.0000006, acc=0.980
INFO:root:[Epoch 4 Batch 2220/2349] loss=0.0581, lr=0.0000005, acc=0.980
INFO:root:[Epoch 4 Batch 2240/2349] loss=0.0392, lr=0.0000004, acc=0.980
INFO:root:[Epoch 4 Batch 2260/2349] loss=0.0531, lr=0.0000003, acc=0.980
INFO:root:[Epoch 4 Batch 2280/2349] loss=0.0452, lr=0.0000002, acc=0.980
INFO:root:[Epoch 4 Batch 2300/2349] loss=0.0864, lr=0.0000001, acc=0.980
INFO:root:[Epoch 4 Batch 2320/2349] loss=0.0621, lr=-0.0000000, acc=0.980
INFO:root:[Epoch 4 Batch 2340/2349] loss=0.0537, lr=-0.0000001, acc=0.980
INFO:root:Validation accuracy: 0.901
INFO:root:Time cost=1113.0s