CR_static.log

Namespace(batch_size=50, data_name='CR', dropout=0.5, epochs=200, gpu=0, log_interval=30, model_mode='static')
Use gpu0
maximum length (in tokens):  105
Done! Tokenizing Time=0.06s, #Sentences=3775
SentimentNet(
  (embedding): Embedding(5343 -> 300, float32)
  (encoder): ConvolutionalEncoder(
    (_convs): HybridConcurrent(
      (0): HybridSequential(
        (0): Conv1D(300 -> 100, kernel_size=(3,), stride=(1,))
        (1): HybridLambda(<lambda>)
        (2): Activation(relu)
      )
      (1): HybridSequential(
        (0): Conv1D(300 -> 100, kernel_size=(4,), stride=(1,))
        (1): HybridLambda(<lambda>)
        (2): Activation(relu)
      )
      (2): HybridSequential(
        (0): Conv1D(300 -> 100, kernel_size=(5,), stride=(1,))
        (1): HybridLambda(<lambda>)
        (2): Activation(relu)
      )
    )
  )
  (output): HybridSequential(
    (0): Dropout(p = 0.5, axes=())
    (1): Dense(None -> 2, linear)
  )
)
[Epoch 0 Batch 30/62] avg loss 0.013453, throughput 0.49332K wps
[Epoch 0 Batch 60/62] avg loss 0.013201, throughput 9.12905K wps
Begin Testing...
[Epoch 0] train avg loss 0.0135135, dev acc 0.6372, dev avg loss 0.657292, throughput 0.589541K wps
Observed Improvement.
Begin Testing...
[Epoch 1 Batch 30/62] avg loss 0.013074, throughput 9.17721K wps
[Epoch 1 Batch 60/62] avg loss 0.0131383, throughput 8.83377K wps
Begin Testing...
[Epoch 1] train avg loss 0.0132389, dev acc 0.6372, dev avg loss 0.653948, throughput 8.97021K wps
Observed Improvement.
Begin Testing...
[Epoch 2 Batch 30/62] avg loss 0.0130544, throughput 8.66364K wps
[Epoch 2 Batch 60/62] avg loss 0.0130481, throughput 9.07271K wps
Begin Testing...
[Epoch 2] train avg loss 0.0132125, dev acc 0.6372, dev avg loss 0.649604, throughput 8.83062K wps
Observed Improvement.
Begin Testing...
[Epoch 3 Batch 30/62] avg loss 0.0129246, throughput 9.11918K wps
[Epoch 3 Batch 60/62] avg loss 0.012915, throughput 8.60789K wps
Begin Testing...
[Epoch 3] train avg loss 0.0130879, dev acc 0.6372, dev avg loss 0.645271, throughput 8.83703K wps
Observed Improvement.
Begin Testing...
[Epoch 4 Batch 30/62] avg loss 0.0127787, throughput 8.99971K wps
[Epoch 4 Batch 60/62] avg loss 0.0128814, throughput 8.90885K wps
Begin Testing...
[Epoch 4] train avg loss 0.0129779, dev acc 0.6372, dev avg loss 0.641626, throughput 9.01854K wps
Observed Improvement.
Begin Testing...
[Epoch 5 Batch 30/62] avg loss 0.0127575, throughput 8.92341K wps
[Epoch 5 Batch 60/62] avg loss 0.0125757, throughput 8.87927K wps
Begin Testing...
[Epoch 5] train avg loss 0.0128468, dev acc 0.6372, dev avg loss 0.63822, throughput 8.986K wps
Observed Improvement.
Begin Testing...
[Epoch 6 Batch 30/62] avg loss 0.0126182, throughput 9.05278K wps
[Epoch 6 Batch 60/62] avg loss 0.012557, throughput 9.00891K wps
Begin Testing...
[Epoch 6] train avg loss 0.0127479, dev acc 0.6372, dev avg loss 0.634399, throughput 9.0268K wps
Observed Improvement.
Begin Testing...
[Epoch 7 Batch 30/62] avg loss 0.0123676, throughput 9.07123K wps
[Epoch 7 Batch 60/62] avg loss 0.012585, throughput 8.77266K wps
Begin Testing...
[Epoch 7] train avg loss 0.0126254, dev acc 0.6372, dev avg loss 0.630082, throughput 8.90005K wps
Observed Improvement.
Begin Testing...
[Epoch 8 Batch 30/62] avg loss 0.0124733, throughput 8.11682K wps
[Epoch 8 Batch 60/62] avg loss 0.0123281, throughput 8.9684K wps
Begin Testing...
[Epoch 8] train avg loss 0.0125728, dev acc 0.6372, dev avg loss 0.626247, throughput 8.51738K wps
Observed Improvement.
Begin Testing...
[Epoch 9 Batch 30/62] avg loss 0.0124185, throughput 8.91172K wps
[Epoch 9 Batch 60/62] avg loss 0.012148, throughput 8.92059K wps
Begin Testing...
[Epoch 9] train avg loss 0.0124306, dev acc 0.6372, dev avg loss 0.622376, throughput 8.95295K wps
Observed Improvement.
Begin Testing...
[Epoch 10 Batch 30/62] avg loss 0.0122605, throughput 9.01374K wps
[Epoch 10 Batch 60/62] avg loss 0.0123215, throughput 9.07611K wps
Begin Testing...
[Epoch 10] train avg loss 0.0124635, dev acc 0.6401, dev avg loss 0.618335, throughput 9.00136K wps
Observed Improvement.
Begin Testing...
[Epoch 11 Batch 30/62] avg loss 0.0121857, throughput 9.3083K wps
[Epoch 11 Batch 60/62] avg loss 0.0121149, throughput 9.10172K wps
Begin Testing...
[Epoch 11] train avg loss 0.0122647, dev acc 0.6372, dev avg loss 0.614826, throughput 9.23429K wps
[Epoch 12 Batch 30/62] avg loss 0.0120562, throughput 9.09189K wps
[Epoch 12 Batch 60/62] avg loss 0.0120224, throughput 8.9159K wps
Begin Testing...
[Epoch 12] train avg loss 0.0122215, dev acc 0.6401, dev avg loss 0.609992, throughput 8.96861K wps
Observed Improvement.
Begin Testing...
[Epoch 13 Batch 30/62] avg loss 0.0119838, throughput 9.02356K wps
[Epoch 13 Batch 60/62] avg loss 0.0117957, throughput 9.13158K wps
Begin Testing...
[Epoch 13] train avg loss 0.0119851, dev acc 0.6401, dev avg loss 0.605948, throughput 9.10396K wps
Observed Improvement.
Begin Testing...
[Epoch 14 Batch 30/62] avg loss 0.0117255, throughput 9.20371K wps
[Epoch 14 Batch 60/62] avg loss 0.0116741, throughput 9.1456K wps
Begin Testing...
[Epoch 14] train avg loss 0.0118635, dev acc 0.6490, dev avg loss 0.600683, throughput 9.20056K wps
Observed Improvement.
Begin Testing...
[Epoch 15 Batch 30/62] avg loss 0.0118932, throughput 9.0326K wps
[Epoch 15 Batch 60/62] avg loss 0.0115695, throughput 9.07056K wps
Begin Testing...
[Epoch 15] train avg loss 0.0119248, dev acc 0.6549, dev avg loss 0.59635, throughput 9.0842K wps
Observed Improvement.
Begin Testing...
[Epoch 16 Batch 30/62] avg loss 0.0114168, throughput 8.90957K wps
[Epoch 16 Batch 60/62] avg loss 0.011877, throughput 9.1071K wps
Begin Testing...
[Epoch 16] train avg loss 0.0118246, dev acc 0.6726, dev avg loss 0.592291, throughput 8.97878K wps
Observed Improvement.
Begin Testing...
[Epoch 17 Batch 30/62] avg loss 0.0114914, throughput 9.12496K wps
[Epoch 17 Batch 60/62] avg loss 0.0114783, throughput 8.88206K wps
Begin Testing...
[Epoch 17] train avg loss 0.0116381, dev acc 0.6608, dev avg loss 0.586603, throughput 9.03663K wps
[Epoch 18 Batch 30/62] avg loss 0.0114069, throughput 8.88985K wps
[Epoch 18 Batch 60/62] avg loss 0.0113029, throughput 9.20052K wps
Begin Testing...
[Epoch 18] train avg loss 0.0115518, dev acc 0.7139, dev avg loss 0.584607, throughput 9.0751K wps
Observed Improvement.
Begin Testing...
[Epoch 19 Batch 30/62] avg loss 0.0112828, throughput 9.03078K wps
[Epoch 19 Batch 60/62] avg loss 0.0111069, throughput 8.79403K wps
Begin Testing...
[Epoch 19] train avg loss 0.0113467, dev acc 0.6755, dev avg loss 0.576618, throughput 8.9452K wps
[Epoch 20 Batch 30/62] avg loss 0.0110237, throughput 9.15165K wps
[Epoch 20 Batch 60/62] avg loss 0.0111444, throughput 9.1099K wps
Begin Testing...
[Epoch 20] train avg loss 0.0112196, dev acc 0.6814, dev avg loss 0.571544, throughput 9.15182K wps
[Epoch 21 Batch 30/62] avg loss 0.0109504, throughput 8.91073K wps
[Epoch 21 Batch 60/62] avg loss 0.010932, throughput 9.06385K wps
Begin Testing...
[Epoch 21] train avg loss 0.0111048, dev acc 0.7198, dev avg loss 0.566694, throughput 9.02151K wps
Observed Improvement.
Begin Testing...
[Epoch 22 Batch 30/62] avg loss 0.0108412, throughput 9.03622K wps
[Epoch 22 Batch 60/62] avg loss 0.010773, throughput 9.0215K wps
Begin Testing...
[Epoch 22] train avg loss 0.0109251, dev acc 0.6932, dev avg loss 0.561649, throughput 9.0084K wps
[Epoch 23 Batch 30/62] avg loss 0.0109007, throughput 8.83497K wps
[Epoch 23 Batch 60/62] avg loss 0.0106117, throughput 9.25983K wps
Begin Testing...
[Epoch 23] train avg loss 0.0109197, dev acc 0.6991, dev avg loss 0.557275, throughput 9.07533K wps
[Epoch 24 Batch 30/62] avg loss 0.0107054, throughput 8.89435K wps
[Epoch 24 Batch 60/62] avg loss 0.0104663, throughput 8.60671K wps
Begin Testing...
[Epoch 24] train avg loss 0.0106969, dev acc 0.7168, dev avg loss 0.550998, throughput 8.72602K wps
[Epoch 25 Batch 30/62] avg loss 0.0105949, throughput 9.12345K wps
[Epoch 25 Batch 60/62] avg loss 0.0103349, throughput 9.21381K wps
Begin Testing...
[Epoch 25] train avg loss 0.0106174, dev acc 0.7139, dev avg loss 0.546022, throughput 9.19491K wps
[Epoch 26 Batch 30/62] avg loss 0.010135, throughput 9.05103K wps
[Epoch 26 Batch 60/62] avg loss 0.0105833, throughput 8.9891K wps
Begin Testing...
[Epoch 26] train avg loss 0.0104676, dev acc 0.7257, dev avg loss 0.541696, throughput 9.04878K wps
Observed Improvement.
Begin Testing...
[Epoch 27 Batch 30/62] avg loss 0.0103391, throughput 9.24173K wps
[Epoch 27 Batch 60/62] avg loss 0.0101502, throughput 9.10942K wps
Begin Testing...
[Epoch 27] train avg loss 0.0103526, dev acc 0.7168, dev avg loss 0.536232, throughput 9.13777K wps
[Epoch 28 Batch 30/62] avg loss 0.00999801, throughput 8.95888K wps
[Epoch 28 Batch 60/62] avg loss 0.0102347, throughput 8.8371K wps
Begin Testing...
[Epoch 28] train avg loss 0.0101968, dev acc 0.7316, dev avg loss 0.531448, throughput 8.87066K wps
Observed Improvement.
Begin Testing...
[Epoch 29 Batch 30/62] avg loss 0.00996894, throughput 8.91219K wps
[Epoch 29 Batch 60/62] avg loss 0.0100278, throughput 9.03408K wps
Begin Testing...
[Epoch 29] train avg loss 0.010146, dev acc 0.7286, dev avg loss 0.526901, throughput 8.94379K wps
[Epoch 30 Batch 30/62] avg loss 0.00992958, throughput 9.03941K wps
[Epoch 30 Batch 60/62] avg loss 0.00959382, throughput 9.07577K wps
Begin Testing...
[Epoch 30] train avg loss 0.00987068, dev acc 0.7286, dev avg loss 0.52216, throughput 9.08899K wps
[Epoch 31 Batch 30/62] avg loss 0.00956067, throughput 8.94866K wps
[Epoch 31 Batch 60/62] avg loss 0.00998356, throughput 8.94925K wps
Begin Testing...
[Epoch 31] train avg loss 0.00991217, dev acc 0.7286, dev avg loss 0.518666, throughput 8.91316K wps
[Epoch 32 Batch 30/62] avg loss 0.0096141, throughput 8.76619K wps
[Epoch 32 Batch 60/62] avg loss 0.00955195, throughput 9.05307K wps
Begin Testing...
[Epoch 32] train avg loss 0.00966685, dev acc 0.7316, dev avg loss 0.51362, throughput 8.87928K wps
Observed Improvement.
Begin Testing...
[Epoch 33 Batch 30/62] avg loss 0.00950129, throughput 8.97928K wps
[Epoch 33 Batch 60/62] avg loss 0.00953359, throughput 9.21216K wps
Begin Testing...
[Epoch 33] train avg loss 0.00965052, dev acc 0.7404, dev avg loss 0.508783, throughput 9.12611K wps
Observed Improvement.
Begin Testing...
[Epoch 34 Batch 30/62] avg loss 0.00933903, throughput 9.19204K wps
[Epoch 34 Batch 60/62] avg loss 0.00953598, throughput 8.94483K wps
Begin Testing...
[Epoch 34] train avg loss 0.00950503, dev acc 0.7316, dev avg loss 0.506524, throughput 9.11503K wps
[Epoch 35 Batch 30/62] avg loss 0.00922015, throughput 9.22312K wps
[Epoch 35 Batch 60/62] avg loss 0.0092717, throughput 9.02447K wps
Begin Testing...
[Epoch 35] train avg loss 0.00945783, dev acc 0.7463, dev avg loss 0.500936, throughput 9.15184K wps
Observed Improvement.
Begin Testing...
[Epoch 36 Batch 30/62] avg loss 0.00907356, throughput 9.06956K wps
[Epoch 36 Batch 60/62] avg loss 0.00925711, throughput 8.76336K wps
Begin Testing...
[Epoch 36] train avg loss 0.00926037, dev acc 0.7345, dev avg loss 0.499853, throughput 8.98965K wps
[Epoch 37 Batch 30/62] avg loss 0.00910382, throughput 9.25162K wps
[Epoch 37 Batch 60/62] avg loss 0.00901089, throughput 9.12349K wps
Begin Testing...
[Epoch 37] train avg loss 0.00916189, dev acc 0.7345, dev avg loss 0.496313, throughput 9.21512K wps
[Epoch 38 Batch 30/62] avg loss 0.00890501, throughput 9.29348K wps
[Epoch 38 Batch 60/62] avg loss 0.00907297, throughput 9.12434K wps
Begin Testing...
[Epoch 38] train avg loss 0.00909539, dev acc 0.7404, dev avg loss 0.492768, throughput 9.2325K wps
[Epoch 39 Batch 30/62] avg loss 0.00874948, throughput 9.12379K wps
[Epoch 39 Batch 60/62] avg loss 0.00882199, throughput 8.82559K wps
Begin Testing...
[Epoch 39] train avg loss 0.00895667, dev acc 0.7611, dev avg loss 0.486491, throughput 8.99236K wps
Observed Improvement.
Begin Testing...
[Epoch 40 Batch 30/62] avg loss 0.00877526, throughput 9.31788K wps
[Epoch 40 Batch 60/62] avg loss 0.00874203, throughput 9.0106K wps
Begin Testing...
[Epoch 40] train avg loss 0.00885403, dev acc 0.7581, dev avg loss 0.483959, throughput 9.18908K wps
[Epoch 41 Batch 30/62] avg loss 0.00861547, throughput 8.79846K wps
[Epoch 41 Batch 60/62] avg loss 0.00889995, throughput 9.02198K wps
Begin Testing...
[Epoch 41] train avg loss 0.00884213, dev acc 0.7404, dev avg loss 0.48495, throughput 8.94617K wps
[Epoch 42 Batch 30/62] avg loss 0.00846483, throughput 8.97131K wps
[Epoch 42 Batch 60/62] avg loss 0.00893218, throughput 9.11869K wps
Begin Testing...
[Epoch 42] train avg loss 0.00878803, dev acc 0.7463, dev avg loss 0.478549, throughput 9.02522K wps
[Epoch 43 Batch 30/62] avg loss 0.00840737, throughput 8.72396K wps
[Epoch 43 Batch 60/62] avg loss 0.00846597, throughput 8.95584K wps
Begin Testing...
[Epoch 43] train avg loss 0.00852082, dev acc 0.7552, dev avg loss 0.476659, throughput 8.88921K wps
[Epoch 44 Batch 30/62] avg loss 0.00825164, throughput 9.1735K wps
[Epoch 44 Batch 60/62] avg loss 0.0086298, throughput 8.95585K wps
Begin Testing...
[Epoch 44] train avg loss 0.00855496, dev acc 0.7463, dev avg loss 0.475103, throughput 9.0327K wps
[Epoch 45 Batch 30/62] avg loss 0.00841171, throughput 9.07456K wps
[Epoch 45 Batch 60/62] avg loss 0.00830181, throughput 8.92304K wps
Begin Testing...
[Epoch 45] train avg loss 0.00841617, dev acc 0.7581, dev avg loss 0.471742, throughput 9.0567K wps
[Epoch 46 Batch 30/62] avg loss 0.00797359, throughput 8.95727K wps
[Epoch 46 Batch 60/62] avg loss 0.00830619, throughput 9.11829K wps
Begin Testing...
[Epoch 46] train avg loss 0.00823579, dev acc 0.7522, dev avg loss 0.469274, throughput 9.06373K wps
[Epoch 47 Batch 30/62] avg loss 0.008164, throughput 9.15505K wps
[Epoch 47 Batch 60/62] avg loss 0.0080675, throughput 8.90252K wps
Begin Testing...
[Epoch 47] train avg loss 0.00817848, dev acc 0.7670, dev avg loss 0.465227, throughput 9.00252K wps
Observed Improvement.
Begin Testing...
[Epoch 48 Batch 30/62] avg loss 0.00804088, throughput 9.14932K wps
[Epoch 48 Batch 60/62] avg loss 0.007914, throughput 9.05112K wps
Begin Testing...
[Epoch 48] train avg loss 0.00806024, dev acc 0.7699, dev avg loss 0.464078, throughput 9.13131K wps
Observed Improvement.
Begin Testing...
[Epoch 49 Batch 30/62] avg loss 0.00817458, throughput 9.21813K wps
[Epoch 49 Batch 60/62] avg loss 0.00773359, throughput 8.93449K wps
Begin Testing...
[Epoch 49] train avg loss 0.00806214, dev acc 0.7552, dev avg loss 0.459824, throughput 9.05782K wps
[Epoch 50 Batch 30/62] avg loss 0.00823322, throughput 8.93999K wps
[Epoch 50 Batch 60/62] avg loss 0.00775749, throughput 8.95163K wps
Begin Testing...
[Epoch 50] train avg loss 0.00804411, dev acc 0.7729, dev avg loss 0.460917, throughput 8.92001K wps
Observed Improvement.
Begin Testing...
[Epoch 51 Batch 30/62] avg loss 0.00775539, throughput 9.11122K wps
[Epoch 51 Batch 60/62] avg loss 0.00785642, throughput 9.14545K wps
Begin Testing...
[Epoch 51] train avg loss 0.00790299, dev acc 0.7522, dev avg loss 0.456187, throughput 9.14812K wps
[Epoch 52 Batch 30/62] avg loss 0.00780409, throughput 9.30268K wps
[Epoch 52 Batch 60/62] avg loss 0.0077841, throughput 8.82176K wps
Begin Testing...
[Epoch 52] train avg loss 0.00784795, dev acc 0.7552, dev avg loss 0.45388, throughput 9.14103K wps
[Epoch 53 Batch 30/62] avg loss 0.00784294, throughput 9.09104K wps
[Epoch 53 Batch 60/62] avg loss 0.00753989, throughput 8.90841K wps
Begin Testing...
[Epoch 53] train avg loss 0.00780705, dev acc 0.7670, dev avg loss 0.452195, throughput 9.03255K wps
[Epoch 54 Batch 30/62] avg loss 0.00753026, throughput 9.25266K wps
[Epoch 54 Batch 60/62] avg loss 0.00758497, throughput 8.8184K wps
Begin Testing...
[Epoch 54] train avg loss 0.00762992, dev acc 0.7699, dev avg loss 0.45129, throughput 9.09115K wps
[Epoch 55 Batch 30/62] avg loss 0.00741803, throughput 9.14228K wps
[Epoch 55 Batch 60/62] avg loss 0.00750747, throughput 8.99334K wps
Begin Testing...
[Epoch 55] train avg loss 0.00764535, dev acc 0.7788, dev avg loss 0.45077, throughput 9.05066K wps
Observed Improvement.
Begin Testing...
[Epoch 56 Batch 30/62] avg loss 0.00742768, throughput 9.16388K wps
[Epoch 56 Batch 60/62] avg loss 0.00740477, throughput 8.78126K wps
Begin Testing...
[Epoch 56] train avg loss 0.00751038, dev acc 0.7788, dev avg loss 0.448754, throughput 8.93841K wps
Observed Improvement.
Begin Testing...
[Epoch 57 Batch 30/62] avg loss 0.00729724, throughput 8.94249K wps
[Epoch 57 Batch 60/62] avg loss 0.00764655, throughput 9.02877K wps
Begin Testing...
[Epoch 57] train avg loss 0.00755091, dev acc 0.7729, dev avg loss 0.445422, throughput 9.02003K wps
[Epoch 58 Batch 30/62] avg loss 0.00717416, throughput 9.10042K wps
[Epoch 58 Batch 60/62] avg loss 0.00735724, throughput 8.96535K wps
Begin Testing...
[Epoch 58] train avg loss 0.00732077, dev acc 0.7640, dev avg loss 0.442795, throughput 9.01293K wps
[Epoch 59 Batch 30/62] avg loss 0.00720923, throughput 8.94719K wps
[Epoch 59 Batch 60/62] avg loss 0.00732043, throughput 8.9918K wps
Begin Testing...
[Epoch 59] train avg loss 0.0073602, dev acc 0.7699, dev avg loss 0.441188, throughput 8.99949K wps
[Epoch 60 Batch 30/62] avg loss 0.00704739, throughput 8.97699K wps
[Epoch 60 Batch 60/62] avg loss 0.0071898, throughput 8.55141K wps
Begin Testing...
[Epoch 60] train avg loss 0.00720779, dev acc 0.7670, dev avg loss 0.440637, throughput 8.85061K wps
[Epoch 61 Batch 30/62] avg loss 0.0072143, throughput 9.08087K wps
[Epoch 61 Batch 60/62] avg loss 0.00690353, throughput 9.13586K wps
Begin Testing...
[Epoch 61] train avg loss 0.00711217, dev acc 0.7729, dev avg loss 0.438115, throughput 9.14008K wps
[Epoch 62 Batch 30/62] avg loss 0.0069226, throughput 9.12344K wps
[Epoch 62 Batch 60/62] avg loss 0.00702295, throughput 8.91584K wps
Begin Testing...
[Epoch 62] train avg loss 0.0071209, dev acc 0.7699, dev avg loss 0.436896, throughput 9.04998K wps
[Epoch 63 Batch 30/62] avg loss 0.00675408, throughput 9.12852K wps
[Epoch 63 Batch 60/62] avg loss 0.0071274, throughput 9.01125K wps
Begin Testing...
[Epoch 63] train avg loss 0.00706786, dev acc 0.7729, dev avg loss 0.435631, throughput 9.10021K wps
[Epoch 64 Batch 30/62] avg loss 0.006775, throughput 9.04138K wps
[Epoch 64 Batch 60/62] avg loss 0.00699634, throughput 8.95144K wps
Begin Testing...
[Epoch 64] train avg loss 0.00689939, dev acc 0.7729, dev avg loss 0.434392, throughput 8.93991K wps
[Epoch 65 Batch 30/62] avg loss 0.00673094, throughput 9.2376K wps
[Epoch 65 Batch 60/62] avg loss 0.0067916, throughput 9.13617K wps
Begin Testing...
[Epoch 65] train avg loss 0.00689955, dev acc 0.7935, dev avg loss 0.442285, throughput 9.16779K wps
Observed Improvement.
Begin Testing...
[Epoch 66 Batch 30/62] avg loss 0.0066437, throughput 8.95322K wps
[Epoch 66 Batch 60/62] avg loss 0.00660363, throughput 8.67632K wps
Begin Testing...
[Epoch 66] train avg loss 0.00668272, dev acc 0.7876, dev avg loss 0.433203, throughput 8.79881K wps
[Epoch 67 Batch 30/62] avg loss 0.00670346, throughput 9.14089K wps
[Epoch 67 Batch 60/62] avg loss 0.00660382, throughput 8.81072K wps
Begin Testing...
[Epoch 67] train avg loss 0.00670306, dev acc 0.7788, dev avg loss 0.431023, throughput 8.93328K wps
[Epoch 68 Batch 30/62] avg loss 0.00643375, throughput 9.23371K wps
[Epoch 68 Batch 60/62] avg loss 0.00655995, throughput 8.97087K wps
Begin Testing...
[Epoch 68] train avg loss 0.00656565, dev acc 0.7817, dev avg loss 0.428555, throughput 9.12207K wps
[Epoch 69 Batch 30/62] avg loss 0.00665443, throughput 9.0682K wps
[Epoch 69 Batch 60/62] avg loss 0.00633594, throughput 9.13622K wps
Begin Testing...
[Epoch 69] train avg loss 0.00654743, dev acc 0.7788, dev avg loss 0.427685, throughput 9.12301K wps
[Epoch 70 Batch 30/62] avg loss 0.00631656, throughput 9.19992K wps
[Epoch 70 Batch 60/62] avg loss 0.00651838, throughput 9.16821K wps
Begin Testing...
[Epoch 70] train avg loss 0.00646272, dev acc 0.7817, dev avg loss 0.42719, throughput 9.21321K wps
[Epoch 71 Batch 30/62] avg loss 0.00621552, throughput 8.96154K wps
[Epoch 71 Batch 60/62] avg loss 0.00639193, throughput 9.02224K wps
Begin Testing...
[Epoch 71] train avg loss 0.00639575, dev acc 0.7847, dev avg loss 0.424682, throughput 9.0197K wps
[Epoch 72 Batch 30/62] avg loss 0.00625032, throughput 9.11981K wps
[Epoch 72 Batch 60/62] avg loss 0.00625705, throughput 9.04386K wps
Begin Testing...
[Epoch 72] train avg loss 0.00633731, dev acc 0.7965, dev avg loss 0.430137, throughput 9.11046K wps
Observed Improvement.
Begin Testing...
[Epoch 73 Batch 30/62] avg loss 0.00625451, throughput 8.94292K wps
[Epoch 73 Batch 60/62] avg loss 0.00623312, throughput 9.04673K wps
Begin Testing...
[Epoch 73] train avg loss 0.00632865, dev acc 0.7817, dev avg loss 0.422402, throughput 9.02874K wps
[Epoch 74 Batch 30/62] avg loss 0.00616347, throughput 9.05903K wps
[Epoch 74 Batch 60/62] avg loss 0.00612093, throughput 8.83K wps
Begin Testing...
[Epoch 74] train avg loss 0.00622161, dev acc 0.7906, dev avg loss 0.422476, throughput 8.92923K wps
[Epoch 75 Batch 30/62] avg loss 0.00600764, throughput 9.05784K wps
[Epoch 75 Batch 60/62] avg loss 0.0063881, throughput 8.84396K wps
Begin Testing...
[Epoch 75] train avg loss 0.00623328, dev acc 0.7817, dev avg loss 0.42063, throughput 8.91742K wps
[Epoch 76 Batch 30/62] avg loss 0.00596074, throughput 9.15342K wps
[Epoch 76 Batch 60/62] avg loss 0.00605071, throughput 9.04625K wps
Begin Testing...
[Epoch 76] train avg loss 0.00606279, dev acc 0.7876, dev avg loss 0.419597, throughput 9.12582K wps
[Epoch 77 Batch 30/62] avg loss 0.00615905, throughput 8.77393K wps
[Epoch 77 Batch 60/62] avg loss 0.00575907, throughput 9.02636K wps
Begin Testing...
[Epoch 77] train avg loss 0.00606603, dev acc 0.7994, dev avg loss 0.419812, throughput 8.96211K wps
Observed Improvement.
Begin Testing...
[Epoch 78 Batch 30/62] avg loss 0.00583668, throughput 8.9682K wps
[Epoch 78 Batch 60/62] avg loss 0.0060122, throughput 8.86471K wps
Begin Testing...
[Epoch 78] train avg loss 0.00594904, dev acc 0.7935, dev avg loss 0.4176, throughput 8.98385K wps
[Epoch 79 Batch 30/62] avg loss 0.00563676, throughput 9.28441K wps
[Epoch 79 Batch 60/62] avg loss 0.00590633, throughput 8.932K wps
Begin Testing...
[Epoch 79] train avg loss 0.00586357, dev acc 0.7935, dev avg loss 0.416439, throughput 9.13438K wps
[Epoch 80 Batch 30/62] avg loss 0.00569952, throughput 9.02763K wps
[Epoch 80 Batch 60/62] avg loss 0.00580108, throughput 8.97127K wps
Begin Testing...
[Epoch 80] train avg loss 0.00580211, dev acc 0.7994, dev avg loss 0.415802, throughput 9.03062K wps
Observed Improvement.
Begin Testing...
[Epoch 81 Batch 30/62] avg loss 0.00573221, throughput 8.74117K wps
[Epoch 81 Batch 60/62] avg loss 0.00589445, throughput 8.95065K wps
Begin Testing...
[Epoch 81] train avg loss 0.00585067, dev acc 0.7994, dev avg loss 0.419817, throughput 8.82432K wps
Observed Improvement.
Begin Testing...
[Epoch 82 Batch 30/62] avg loss 0.00546648, throughput 9.23197K wps
[Epoch 82 Batch 60/62] avg loss 0.00568445, throughput 8.88261K wps
Begin Testing...
[Epoch 82] train avg loss 0.00562947, dev acc 0.7965, dev avg loss 0.414566, throughput 9.08614K wps
[Epoch 83 Batch 30/62] avg loss 0.0057972, throughput 9.07968K wps
[Epoch 83 Batch 60/62] avg loss 0.00553064, throughput 9.14001K wps
Begin Testing...
[Epoch 83] train avg loss 0.00571868, dev acc 0.7935, dev avg loss 0.413446, throughput 9.07807K wps
[Epoch 84 Batch 30/62] avg loss 0.00552332, throughput 9.15345K wps
[Epoch 84 Batch 60/62] avg loss 0.00561941, throughput 8.66251K wps
Begin Testing...
[Epoch 84] train avg loss 0.00557977, dev acc 0.7994, dev avg loss 0.416879, throughput 8.8866K wps
Observed Improvement.
Begin Testing...
[Epoch 85 Batch 30/62] avg loss 0.00585028, throughput 9.14508K wps
[Epoch 85 Batch 60/62] avg loss 0.00520061, throughput 8.80065K wps
Begin Testing...
[Epoch 85] train avg loss 0.00563304, dev acc 0.8112, dev avg loss 0.413212, throughput 8.9457K wps
Observed Improvement.
Begin Testing...
[Epoch 86 Batch 30/62] avg loss 0.00535972, throughput 9.10336K wps
[Epoch 86 Batch 60/62] avg loss 0.00561183, throughput 9.02806K wps
Begin Testing...
[Epoch 86] train avg loss 0.00556744, dev acc 0.8083, dev avg loss 0.412041, throughput 9.0962K wps
[Epoch 87 Batch 30/62] avg loss 0.00535416, throughput 9.09546K wps
[Epoch 87 Batch 60/62] avg loss 0.00561084, throughput 9.09988K wps
Begin Testing...
[Epoch 87] train avg loss 0.00559626, dev acc 0.8024, dev avg loss 0.409336, throughput 9.08204K wps
[Epoch 88 Batch 30/62] avg loss 0.0054894, throughput 9.11604K wps
[Epoch 88 Batch 60/62] avg loss 0.00527885, throughput 8.78904K wps
Begin Testing...
[Epoch 88] train avg loss 0.00540798, dev acc 0.8083, dev avg loss 0.409479, throughput 9.01068K wps
[Epoch 89 Batch 30/62] avg loss 0.00518409, throughput 8.83318K wps
[Epoch 89 Batch 60/62] avg loss 0.00526731, throughput 9.02334K wps
Begin Testing...
[Epoch 89] train avg loss 0.00531131, dev acc 0.8053, dev avg loss 0.408089, throughput 8.96164K wps
[Epoch 90 Batch 30/62] avg loss 0.00533525, throughput 8.96605K wps
[Epoch 90 Batch 60/62] avg loss 0.00512738, throughput 9.0132K wps
Begin Testing...
[Epoch 90] train avg loss 0.00526927, dev acc 0.8053, dev avg loss 0.408302, throughput 8.95139K wps
[Epoch 91 Batch 30/62] avg loss 0.00493801, throughput 9.22844K wps
[Epoch 91 Batch 60/62] avg loss 0.00528775, throughput 8.98636K wps
Begin Testing...
[Epoch 91] train avg loss 0.00521646, dev acc 0.8142, dev avg loss 0.410783, throughput 9.0778K wps
Observed Improvement.
Begin Testing...
[Epoch 92 Batch 30/62] avg loss 0.00506086, throughput 8.6871K wps
[Epoch 92 Batch 60/62] avg loss 0.00515272, throughput 8.98824K wps
Begin Testing...
[Epoch 92] train avg loss 0.00517724, dev acc 0.8053, dev avg loss 0.405349, throughput 8.82757K wps
[Epoch 93 Batch 30/62] avg loss 0.00518236, throughput 8.85026K wps
[Epoch 93 Batch 60/62] avg loss 0.00498202, throughput 8.99683K wps
Begin Testing...
[Epoch 93] train avg loss 0.00512521, dev acc 0.8083, dev avg loss 0.40516, throughput 8.94722K wps
[Epoch 94 Batch 30/62] avg loss 0.00486179, throughput 8.92582K wps
[Epoch 94 Batch 60/62] avg loss 0.00523425, throughput 8.89954K wps
Begin Testing...
[Epoch 94] train avg loss 0.00510718, dev acc 0.8083, dev avg loss 0.407278, throughput 8.93643K wps
[Epoch 95 Batch 30/62] avg loss 0.00495379, throughput 9.13593K wps
[Epoch 95 Batch 60/62] avg loss 0.00493725, throughput 8.78141K wps
Begin Testing...
[Epoch 95] train avg loss 0.00498022, dev acc 0.8083, dev avg loss 0.403255, throughput 8.92784K wps
[Epoch 96 Batch 30/62] avg loss 0.00474293, throughput 9.14296K wps
[Epoch 96 Batch 60/62] avg loss 0.00493662, throughput 8.79299K wps
Begin Testing...
[Epoch 96] train avg loss 0.00488028, dev acc 0.8083, dev avg loss 0.402639, throughput 8.99337K wps
[Epoch 97 Batch 30/62] avg loss 0.00480091, throughput 9.15901K wps
[Epoch 97 Batch 60/62] avg loss 0.00484629, throughput 8.89604K wps
Begin Testing...
[Epoch 97] train avg loss 0.00486135, dev acc 0.8053, dev avg loss 0.40221, throughput 9.0548K wps
[Epoch 98 Batch 30/62] avg loss 0.00473254, throughput 8.9285K wps
[Epoch 98 Batch 60/62] avg loss 0.00476596, throughput 9.02384K wps
Begin Testing...
[Epoch 98] train avg loss 0.00483632, dev acc 0.8142, dev avg loss 0.402328, throughput 9.00753K wps
Observed Improvement.
Begin Testing...
[Epoch 99 Batch 30/62] avg loss 0.00475428, throughput 9.09418K wps
[Epoch 99 Batch 60/62] avg loss 0.00463468, throughput 8.70993K wps
Begin Testing...
[Epoch 99] train avg loss 0.00478179, dev acc 0.8142, dev avg loss 0.403726, throughput 8.86199K wps
Observed Improvement.
Begin Testing...
[Epoch 100 Batch 30/62] avg loss 0.00463485, throughput 9.0661K wps
[Epoch 100 Batch 60/62] avg loss 0.00456497, throughput 9.11226K wps
Begin Testing...
[Epoch 100] train avg loss 0.00466355, dev acc 0.8142, dev avg loss 0.403493, throughput 9.11849K wps
Observed Improvement.
Begin Testing...
[Epoch 101 Batch 30/62] avg loss 0.00481887, throughput 9.09692K wps
[Epoch 101 Batch 60/62] avg loss 0.0045583, throughput 9.01726K wps
Begin Testing...
[Epoch 101] train avg loss 0.00475245, dev acc 0.8142, dev avg loss 0.402836, throughput 9.08722K wps
Observed Improvement.
Begin Testing...
[Epoch 102 Batch 30/62] avg loss 0.00448564, throughput 9.00009K wps
[Epoch 102 Batch 60/62] avg loss 0.00464981, throughput 8.91552K wps
Begin Testing...
[Epoch 102] train avg loss 0.00465742, dev acc 0.8024, dev avg loss 0.40219, throughput 8.98908K wps
[Epoch 103 Batch 30/62] avg loss 0.00452231, throughput 8.97358K wps
[Epoch 103 Batch 60/62] avg loss 0.00465211, throughput 9.15013K wps
Begin Testing...
[Epoch 103] train avg loss 0.00458741, dev acc 0.8024, dev avg loss 0.398434, throughput 9.09403K wps
[Epoch 104 Batch 30/62] avg loss 0.00454715, throughput 9.22589K wps
[Epoch 104 Batch 60/62] avg loss 0.00445088, throughput 9.06325K wps
Begin Testing...
[Epoch 104] train avg loss 0.00455996, dev acc 0.8171, dev avg loss 0.397579, throughput 9.17163K wps
Observed Improvement.
Begin Testing...
[Epoch 105 Batch 30/62] avg loss 0.00448134, throughput 9.22846K wps
[Epoch 105 Batch 60/62] avg loss 0.00430189, throughput 8.82099K wps
Begin Testing...
[Epoch 105] train avg loss 0.00447611, dev acc 0.8171, dev avg loss 0.397017, throughput 8.98474K wps
Observed Improvement.
Begin Testing...
[Epoch 106 Batch 30/62] avg loss 0.00447351, throughput 9.09657K wps
[Epoch 106 Batch 60/62] avg loss 0.00449086, throughput 9.11867K wps
Begin Testing...
[Epoch 106] train avg loss 0.00451789, dev acc 0.8201, dev avg loss 0.396602, throughput 9.13505K wps
Observed Improvement.
Begin Testing...
[Epoch 107 Batch 30/62] avg loss 0.00435187, throughput 8.98636K wps
[Epoch 107 Batch 60/62] avg loss 0.0043306, throughput 8.8987K wps
Begin Testing...
[Epoch 107] train avg loss 0.00444305, dev acc 0.8201, dev avg loss 0.396113, throughput 8.92181K wps
Observed Improvement.
Begin Testing...
[Epoch 108 Batch 30/62] avg loss 0.00427968, throughput 9.09344K wps
[Epoch 108 Batch 60/62] avg loss 0.00447551, throughput 8.72448K wps
Begin Testing...
[Epoch 108] train avg loss 0.00442618, dev acc 0.8230, dev avg loss 0.397202, throughput 8.89388K wps
Observed Improvement.
Begin Testing...
[Epoch 109 Batch 30/62] avg loss 0.00408007, throughput 9.03996K wps
[Epoch 109 Batch 60/62] avg loss 0.00440535, throughput 9.09747K wps
Begin Testing...
[Epoch 109] train avg loss 0.00427865, dev acc 0.8053, dev avg loss 0.397681, throughput 9.09712K wps
[Epoch 110 Batch 30/62] avg loss 0.00411403, throughput 9.23832K wps
[Epoch 110 Batch 60/62] avg loss 0.00427118, throughput 8.88109K wps
Begin Testing...
[Epoch 110] train avg loss 0.00426841, dev acc 0.8024, dev avg loss 0.396658, throughput 9.02305K wps
[Epoch 111 Batch 30/62] avg loss 0.00414061, throughput 9.2762K wps
[Epoch 111 Batch 60/62] avg loss 0.00406577, throughput 9.11527K wps
Begin Testing...
[Epoch 111] train avg loss 0.00423209, dev acc 0.8230, dev avg loss 0.394994, throughput 9.22254K wps
Observed Improvement.
Begin Testing...
[Epoch 112 Batch 30/62] avg loss 0.00412225, throughput 8.99377K wps
[Epoch 112 Batch 60/62] avg loss 0.00429047, throughput 9.09358K wps
Begin Testing...
[Epoch 112] train avg loss 0.0042493, dev acc 0.7994, dev avg loss 0.396303, throughput 9.01825K wps
[Epoch 113 Batch 30/62] avg loss 0.00397626, throughput 9.03309K wps
[Epoch 113 Batch 60/62] avg loss 0.00417353, throughput 8.97218K wps
Begin Testing...
[Epoch 113] train avg loss 0.00416474, dev acc 0.8083, dev avg loss 0.39578, throughput 9.03429K wps
[Epoch 114 Batch 30/62] avg loss 0.00403221, throughput 8.96323K wps
[Epoch 114 Batch 60/62] avg loss 0.00395257, throughput 8.86574K wps
Begin Testing...
[Epoch 114] train avg loss 0.00407784, dev acc 0.8053, dev avg loss 0.398034, throughput 8.94591K wps
[Epoch 115 Batch 30/62] avg loss 0.00417138, throughput 8.91629K wps
[Epoch 115 Batch 60/62] avg loss 0.00388626, throughput 8.83747K wps
Begin Testing...
[Epoch 115] train avg loss 0.00409309, dev acc 0.8201, dev avg loss 0.393904, throughput 8.854K wps
[Epoch 116 Batch 30/62] avg loss 0.00402621, throughput 8.7462K wps
[Epoch 116 Batch 60/62] avg loss 0.00398376, throughput 9.20851K wps
Begin Testing...
[Epoch 116] train avg loss 0.00405486, dev acc 0.8289, dev avg loss 0.394098, throughput 9.00486K wps
Observed Improvement.
Begin Testing...
[Epoch 117 Batch 30/62] avg loss 0.0039059, throughput 8.84499K wps
[Epoch 117 Batch 60/62] avg loss 0.00393177, throughput 9.14318K wps
Begin Testing...
[Epoch 117] train avg loss 0.003971, dev acc 0.8289, dev avg loss 0.394488, throughput 9.02212K wps
Observed Improvement.
Begin Testing...
[Epoch 118 Batch 30/62] avg loss 0.00392672, throughput 8.85206K wps
[Epoch 118 Batch 60/62] avg loss 0.00390342, throughput 8.94748K wps
Begin Testing...
[Epoch 118] train avg loss 0.00393953, dev acc 0.8083, dev avg loss 0.396862, throughput 8.94935K wps
[Epoch 119 Batch 30/62] avg loss 0.00400084, throughput 9.0748K wps
[Epoch 119 Batch 60/62] avg loss 0.00374766, throughput 8.80201K wps
Begin Testing...
[Epoch 119] train avg loss 0.00394947, dev acc 0.8053, dev avg loss 0.394647, throughput 8.92954K wps
[Epoch 120 Batch 30/62] avg loss 0.00387081, throughput 9.15477K wps
[Epoch 120 Batch 60/62] avg loss 0.0037549, throughput 8.92637K wps
Begin Testing...
[Epoch 120] train avg loss 0.00385584, dev acc 0.8289, dev avg loss 0.394982, throughput 9.0107K wps
Observed Improvement.
Begin Testing...
[Epoch 121 Batch 30/62] avg loss 0.00366665, throughput 8.98426K wps
[Epoch 121 Batch 60/62] avg loss 0.0037568, throughput 8.75759K wps
Begin Testing...
[Epoch 121] train avg loss 0.00375633, dev acc 0.8053, dev avg loss 0.395441, throughput 8.85356K wps
[Epoch 122 Batch 30/62] avg loss 0.00378129, throughput 9.1613K wps
[Epoch 122 Batch 60/62] avg loss 0.00370164, throughput 9.17264K wps
Begin Testing...
[Epoch 122] train avg loss 0.00376073, dev acc 0.8083, dev avg loss 0.393203, throughput 9.19701K wps
[Epoch 123 Batch 30/62] avg loss 0.00362482, throughput 8.76981K wps
[Epoch 123 Batch 60/62] avg loss 0.00367629, throughput 8.99487K wps
Begin Testing...
[Epoch 123] train avg loss 0.00366797, dev acc 0.8230, dev avg loss 0.390909, throughput 8.88998K wps
[Epoch 124 Batch 30/62] avg loss 0.00364845, throughput 9.27235K wps
[Epoch 124 Batch 60/62] avg loss 0.00380339, throughput 9.08394K wps
Begin Testing...
[Epoch 124] train avg loss 0.00382997, dev acc 0.8319, dev avg loss 0.39368, throughput 9.20464K wps
Observed Improvement.
Begin Testing...
[Epoch 125 Batch 30/62] avg loss 0.00366432, throughput 8.96753K wps
[Epoch 125 Batch 60/62] avg loss 0.00354528, throughput 8.82482K wps
Begin Testing...
[Epoch 125] train avg loss 0.00365373, dev acc 0.8201, dev avg loss 0.389834, throughput 8.9451K wps
[Epoch 126 Batch 30/62] avg loss 0.00378416, throughput 9.23985K wps
[Epoch 126 Batch 60/62] avg loss 0.00342159, throughput 8.98856K wps
Begin Testing...
[Epoch 126] train avg loss 0.00365428, dev acc 0.8142, dev avg loss 0.390618, throughput 9.07669K wps
[Epoch 127 Batch 30/62] avg loss 0.00363103, throughput 9.06534K wps
[Epoch 127 Batch 60/62] avg loss 0.00348902, throughput 8.76511K wps
Begin Testing...
[Epoch 127] train avg loss 0.00362081, dev acc 0.8142, dev avg loss 0.388904, throughput 8.89297K wps
[Epoch 128 Batch 30/62] avg loss 0.00347182, throughput 9.2482K wps
[Epoch 128 Batch 60/62] avg loss 0.00346593, throughput 8.89032K wps
Begin Testing...
[Epoch 128] train avg loss 0.00357137, dev acc 0.8289, dev avg loss 0.38827, throughput 9.0295K wps
[Epoch 129 Batch 30/62] avg loss 0.0033932, throughput 8.68615K wps
[Epoch 129 Batch 60/62] avg loss 0.00351125, throughput 9.10345K wps
Begin Testing...
[Epoch 129] train avg loss 0.0034876, dev acc 0.8201, dev avg loss 0.388266, throughput 8.92583K wps
[Epoch 130 Batch 30/62] avg loss 0.00352981, throughput 8.93529K wps
[Epoch 130 Batch 60/62] avg loss 0.00358471, throughput 9.00646K wps
Begin Testing...
[Epoch 130] train avg loss 0.00362349, dev acc 0.8201, dev avg loss 0.388051, throughput 8.94918K wps
[Epoch 131 Batch 30/62] avg loss 0.00345088, throughput 8.89187K wps
[Epoch 131 Batch 60/62] avg loss 0.0033036, throughput 9.06718K wps
Begin Testing...
[Epoch 131] train avg loss 0.0034338, dev acc 0.8112, dev avg loss 0.389243, throughput 8.96605K wps
[Epoch 132 Batch 30/62] avg loss 0.00343453, throughput 8.89566K wps
[Epoch 132 Batch 60/62] avg loss 0.00334551, throughput 8.7095K wps
Begin Testing...
[Epoch 132] train avg loss 0.0034884, dev acc 0.8230, dev avg loss 0.39956, throughput 8.78389K wps
[Epoch 133 Batch 30/62] avg loss 0.00316877, throughput 9.02328K wps
[Epoch 133 Batch 60/62] avg loss 0.00355992, throughput 9.05177K wps
Begin Testing...
[Epoch 133] train avg loss 0.0034157, dev acc 0.8260, dev avg loss 0.387647, throughput 9.0643K wps
[Epoch 134 Batch 30/62] avg loss 0.00342859, throughput 9.20945K wps
[Epoch 134 Batch 60/62] avg loss 0.00315565, throughput 8.79101K wps
Begin Testing...
[Epoch 134] train avg loss 0.00331059, dev acc 0.8142, dev avg loss 0.392398, throughput 9.02375K wps
[Epoch 135 Batch 30/62] avg loss 0.00326054, throughput 9.12689K wps
[Epoch 135 Batch 60/62] avg loss 0.00344253, throughput 8.88384K wps
Begin Testing...
[Epoch 135] train avg loss 0.00336511, dev acc 0.8083, dev avg loss 0.389527, throughput 8.97539K wps
[Epoch 136 Batch 30/62] avg loss 0.00337316, throughput 9.05139K wps
[Epoch 136 Batch 60/62] avg loss 0.00315617, throughput 8.97102K wps
Begin Testing...
[Epoch 136] train avg loss 0.00334597, dev acc 0.8112, dev avg loss 0.387593, throughput 9.03671K wps
[Epoch 137 Batch 30/62] avg loss 0.00320144, throughput 9.08666K wps
[Epoch 137 Batch 60/62] avg loss 0.00334787, throughput 9.03936K wps
Begin Testing...
[Epoch 137] train avg loss 0.00330091, dev acc 0.8260, dev avg loss 0.386417, throughput 9.08751K wps
[Epoch 138 Batch 30/62] avg loss 0.00307458, throughput 9.0602K wps
[Epoch 138 Batch 60/62] avg loss 0.00328355, throughput 9.03109K wps
Begin Testing...
[Epoch 138] train avg loss 0.0032182, dev acc 0.8112, dev avg loss 0.387444, throughput 9.08537K wps
[Epoch 139 Batch 30/62] avg loss 0.00313547, throughput 9.10462K wps
[Epoch 139 Batch 60/62] avg loss 0.00327855, throughput 9.09824K wps
Begin Testing...
[Epoch 139] train avg loss 0.0032224, dev acc 0.8171, dev avg loss 0.386554, throughput 9.08344K wps
[Epoch 140 Batch 30/62] avg loss 0.00301249, throughput 8.97486K wps
[Epoch 140 Batch 60/62] avg loss 0.00304567, throughput 9.07389K wps
Begin Testing...
[Epoch 140] train avg loss 0.00304191, dev acc 0.8260, dev avg loss 0.386758, throughput 9.04941K wps
[Epoch 141 Batch 30/62] avg loss 0.00303158, throughput 8.9675K wps
[Epoch 141 Batch 60/62] avg loss 0.00322976, throughput 8.82688K wps
Begin Testing...
[Epoch 141] train avg loss 0.00315499, dev acc 0.8319, dev avg loss 0.387379, throughput 8.86207K wps
Observed Improvement.
Begin Testing...
[Epoch 142 Batch 30/62] avg loss 0.00308603, throughput 9.1894K wps
[Epoch 142 Batch 60/62] avg loss 0.00310452, throughput 9.10372K wps
Begin Testing...
[Epoch 142] train avg loss 0.00312417, dev acc 0.8112, dev avg loss 0.386232, throughput 9.17468K wps
[Epoch 143 Batch 30/62] avg loss 0.00299578, throughput 9.24283K wps
[Epoch 143 Batch 60/62] avg loss 0.00308426, throughput 9.11159K wps
Begin Testing...
[Epoch 143] train avg loss 0.00311183, dev acc 0.8378, dev avg loss 0.389357, throughput 9.20676K wps
Observed Improvement.
Begin Testing...
[Epoch 144 Batch 30/62] avg loss 0.0030766, throughput 8.89996K wps
[Epoch 144 Batch 60/62] avg loss 0.00292835, throughput 8.83265K wps
Begin Testing...
[Epoch 144] train avg loss 0.00300049, dev acc 0.8260, dev avg loss 0.38562, throughput 8.84402K wps
[Epoch 145 Batch 30/62] avg loss 0.00287975, throughput 8.90416K wps
[Epoch 145 Batch 60/62] avg loss 0.00301667, throughput 8.86395K wps
Begin Testing...
[Epoch 145] train avg loss 0.00300767, dev acc 0.8378, dev avg loss 0.386467, throughput 8.91733K wps
Observed Improvement.
Begin Testing...
[Epoch 146 Batch 30/62] avg loss 0.00311585, throughput 8.9808K wps
[Epoch 146 Batch 60/62] avg loss 0.00309011, throughput 8.99024K wps
Begin Testing...
[Epoch 146] train avg loss 0.00313143, dev acc 0.8112, dev avg loss 0.38638, throughput 9.01623K wps
[Epoch 147 Batch 30/62] avg loss 0.00287536, throughput 8.96505K wps
[Epoch 147 Batch 60/62] avg loss 0.00298805, throughput 8.74396K wps
Begin Testing...
[Epoch 147] train avg loss 0.00298071, dev acc 0.8319, dev avg loss 0.385675, throughput 8.83364K wps
[Epoch 148 Batch 30/62] avg loss 0.00294141, throughput 9.29174K wps
[Epoch 148 Batch 60/62] avg loss 0.0027945, throughput 8.94962K wps
Begin Testing...
[Epoch 148] train avg loss 0.00287072, dev acc 0.8112, dev avg loss 0.388295, throughput 9.08718K wps
[Epoch 149 Batch 30/62] avg loss 0.00294438, throughput 8.76378K wps
[Epoch 149 Batch 60/62] avg loss 0.00286377, throughput 8.71107K wps
Begin Testing...
[Epoch 149] train avg loss 0.00292101, dev acc 0.8112, dev avg loss 0.386733, throughput 8.76501K wps
[Epoch 150 Batch 30/62] avg loss 0.00277799, throughput 9.26342K wps
[Epoch 150 Batch 60/62] avg loss 0.00291291, throughput 9.04197K wps
Begin Testing...
[Epoch 150] train avg loss 0.0028551, dev acc 0.8142, dev avg loss 0.38604, throughput 9.12527K wps
[Epoch 151 Batch 30/62] avg loss 0.00273367, throughput 9.24585K wps
[Epoch 151 Batch 60/62] avg loss 0.00286403, throughput 9.10739K wps
Begin Testing...
[Epoch 151] train avg loss 0.00282954, dev acc 0.8171, dev avg loss 0.393409, throughput 9.15496K wps
[Epoch 152 Batch 30/62] avg loss 0.00297258, throughput 9.07506K wps
[Epoch 152 Batch 60/62] avg loss 0.00261307, throughput 8.95487K wps
Begin Testing...
[Epoch 152] train avg loss 0.0028161, dev acc 0.8378, dev avg loss 0.385459, throughput 9.07102K wps
Observed Improvement.
Begin Testing...
[Epoch 153 Batch 30/62] avg loss 0.0028257, throughput 9.1263K wps
[Epoch 153 Batch 60/62] avg loss 0.00290172, throughput 9.02014K wps
Begin Testing...
[Epoch 153] train avg loss 0.00292476, dev acc 0.8083, dev avg loss 0.387764, throughput 9.0591K wps
[Epoch 154 Batch 30/62] avg loss 0.002469, throughput 8.98226K wps
[Epoch 154 Batch 60/62] avg loss 0.00280193, throughput 8.87798K wps
Begin Testing...
[Epoch 154] train avg loss 0.00266624, dev acc 0.8142, dev avg loss 0.38539, throughput 8.90888K wps
[Epoch 155 Batch 30/62] avg loss 0.00265952, throughput 8.95113K wps
[Epoch 155 Batch 60/62] avg loss 0.00266436, throughput 8.99345K wps
Begin Testing...
[Epoch 155] train avg loss 0.00267206, dev acc 0.8230, dev avg loss 0.384845, throughput 9.0048K wps
[Epoch 156 Batch 30/62] avg loss 0.00273382, throughput 8.84691K wps
[Epoch 156 Batch 60/62] avg loss 0.00266535, throughput 8.97226K wps
Begin Testing...
[Epoch 156] train avg loss 0.00272663, dev acc 0.8201, dev avg loss 0.384864, throughput 8.86111K wps
[Epoch 157 Batch 30/62] avg loss 0.00257144, throughput 8.85213K wps
[Epoch 157 Batch 60/62] avg loss 0.00272462, throughput 8.97378K wps
Begin Testing...
[Epoch 157] train avg loss 0.00272304, dev acc 0.8348, dev avg loss 0.38795, throughput 8.94584K wps
[Epoch 158 Batch 30/62] avg loss 0.00250772, throughput 9.0975K wps
[Epoch 158 Batch 60/62] avg loss 0.0027239, throughput 8.77626K wps
Begin Testing...
[Epoch 158] train avg loss 0.00264137, dev acc 0.8260, dev avg loss 0.384448, throughput 8.90463K wps
[Epoch 159 Batch 30/62] avg loss 0.00251818, throughput 9.09351K wps
[Epoch 159 Batch 60/62] avg loss 0.00268575, throughput 8.89715K wps
Begin Testing...
[Epoch 159] train avg loss 0.00265583, dev acc 0.8319, dev avg loss 0.384963, throughput 8.97078K wps
[Epoch 160 Batch 30/62] avg loss 0.00261706, throughput 8.70114K wps
[Epoch 160 Batch 60/62] avg loss 0.00264166, throughput 9.011K wps
Begin Testing...
[Epoch 160] train avg loss 0.00268361, dev acc 0.8230, dev avg loss 0.384172, throughput 8.91224K wps
[Epoch 161 Batch 30/62] avg loss 0.00254255, throughput 9.16162K wps
[Epoch 161 Batch 60/62] avg loss 0.002601, throughput 9.11739K wps
Begin Testing...
[Epoch 161] train avg loss 0.00264287, dev acc 0.8289, dev avg loss 0.385191, throughput 9.16888K wps
[Epoch 162 Batch 30/62] avg loss 0.0026255, throughput 9.07957K wps
[Epoch 162 Batch 60/62] avg loss 0.00246967, throughput 8.74736K wps
Begin Testing...
[Epoch 162] train avg loss 0.0025984, dev acc 0.8319, dev avg loss 0.385741, throughput 8.8972K wps
[Epoch 163 Batch 30/62] avg loss 0.00263516, throughput 9.01888K wps
[Epoch 163 Batch 60/62] avg loss 0.00255957, throughput 8.89012K wps
Begin Testing...
[Epoch 163] train avg loss 0.00265182, dev acc 0.8142, dev avg loss 0.389457, throughput 9.00003K wps
[Epoch 164 Batch 30/62] avg loss 0.00249055, throughput 9.14965K wps
[Epoch 164 Batch 60/62] avg loss 0.00248926, throughput 8.89118K wps
Begin Testing...
[Epoch 164] train avg loss 0.00251833, dev acc 0.8142, dev avg loss 0.387804, throughput 9.04365K wps
[Epoch 165 Batch 30/62] avg loss 0.0024376, throughput 9.01138K wps
[Epoch 165 Batch 60/62] avg loss 0.00239646, throughput 8.90779K wps
Begin Testing...
[Epoch 165] train avg loss 0.00252103, dev acc 0.8260, dev avg loss 0.394326, throughput 8.99655K wps
[Epoch 166 Batch 30/62] avg loss 0.00244358, throughput 8.93638K wps
[Epoch 166 Batch 60/62] avg loss 0.00243643, throughput 8.87414K wps
Begin Testing...
[Epoch 166] train avg loss 0.0024644, dev acc 0.8319, dev avg loss 0.385904, throughput 8.93929K wps
[Epoch 167 Batch 30/62] avg loss 0.00236888, throughput 9.28108K wps
[Epoch 167 Batch 60/62] avg loss 0.00243531, throughput 9.05999K wps
Begin Testing...
[Epoch 167] train avg loss 0.00242883, dev acc 0.8171, dev avg loss 0.390087, throughput 9.14214K wps
[Epoch 168 Batch 30/62] avg loss 0.00234956, throughput 9.09049K wps
[Epoch 168 Batch 60/62] avg loss 0.00235729, throughput 8.97349K wps
Begin Testing...
[Epoch 168] train avg loss 0.0024068, dev acc 0.8289, dev avg loss 0.385831, throughput 9.0644K wps
[Epoch 169 Batch 30/62] avg loss 0.00238348, throughput 9.11612K wps
[Epoch 169 Batch 60/62] avg loss 0.00231587, throughput 8.80005K wps
Begin Testing...
[Epoch 169] train avg loss 0.00236677, dev acc 0.8319, dev avg loss 0.385737, throughput 8.98726K wps
[Epoch 170 Batch 30/62] avg loss 0.0023455, throughput 8.88381K wps
[Epoch 170 Batch 60/62] avg loss 0.0023205, throughput 9.17899K wps
Begin Testing...
[Epoch 170] train avg loss 0.00236528, dev acc 0.8230, dev avg loss 0.385957, throughput 9.061K wps
[Epoch 171 Batch 30/62] avg loss 0.00239553, throughput 8.99071K wps
[Epoch 171 Batch 60/62] avg loss 0.00224999, throughput 8.92584K wps
Begin Testing...
[Epoch 171] train avg loss 0.00236973, dev acc 0.8289, dev avg loss 0.387862, throughput 8.98594K wps
[Epoch 172 Batch 30/62] avg loss 0.00221082, throughput 9.00781K wps
[Epoch 172 Batch 60/62] avg loss 0.00232742, throughput 9.16725K wps
Begin Testing...
[Epoch 172] train avg loss 0.00229024, dev acc 0.8171, dev avg loss 0.386486, throughput 9.11507K wps
[Epoch 173 Batch 30/62] avg loss 0.00241137, throughput 9.06164K wps
[Epoch 173 Batch 60/62] avg loss 0.00232549, throughput 9.01006K wps
Begin Testing...
[Epoch 173] train avg loss 0.00240301, dev acc 0.8142, dev avg loss 0.389315, throughput 9.0594K wps
[Epoch 174 Batch 30/62] avg loss 0.00232203, throughput 9.0645K wps
[Epoch 174 Batch 60/62] avg loss 0.00237456, throughput 8.80789K wps
Begin Testing...
[Epoch 174] train avg loss 0.00236854, dev acc 0.8142, dev avg loss 0.388228, throughput 8.96643K wps
[Epoch 175 Batch 30/62] avg loss 0.00230332, throughput 8.71042K wps
[Epoch 175 Batch 60/62] avg loss 0.00221422, throughput 8.7476K wps
Begin Testing...
[Epoch 175] train avg loss 0.00230661, dev acc 0.8142, dev avg loss 0.387034, throughput 8.73014K wps
[Epoch 176 Batch 30/62] avg loss 0.0022363, throughput 8.8928K wps
[Epoch 176 Batch 60/62] avg loss 0.00231771, throughput 9.05549K wps
Begin Testing...
[Epoch 176] train avg loss 0.00230853, dev acc 0.8201, dev avg loss 0.386038, throughput 8.99944K wps
[Epoch 177 Batch 30/62] avg loss 0.00218268, throughput 8.93965K wps
[Epoch 177 Batch 60/62] avg loss 0.00237543, throughput 9.10016K wps
Begin Testing...
[Epoch 177] train avg loss 0.00232505, dev acc 0.8319, dev avg loss 0.387037, throughput 9.05193K wps
[Epoch 178 Batch 30/62] avg loss 0.00222912, throughput 9.14117K wps
[Epoch 178 Batch 60/62] avg loss 0.00211809, throughput 8.83592K wps
Begin Testing...
[Epoch 178] train avg loss 0.0021887, dev acc 0.8171, dev avg loss 0.386669, throughput 9.00415K wps
[Epoch 179 Batch 30/62] avg loss 0.00214475, throughput 9.06011K wps
[Epoch 179 Batch 60/62] avg loss 0.00226045, throughput 9.12735K wps
Begin Testing...
[Epoch 179] train avg loss 0.00224149, dev acc 0.8319, dev avg loss 0.392723, throughput 9.12209K wps
[Epoch 180 Batch 30/62] avg loss 0.00228467, throughput 9.24062K wps
[Epoch 180 Batch 60/62] avg loss 0.00216203, throughput 8.9991K wps
Begin Testing...
[Epoch 180] train avg loss 0.00228581, dev acc 0.8319, dev avg loss 0.387428, throughput 9.14491K wps
[Epoch 181 Batch 30/62] avg loss 0.00208109, throughput 9.14997K wps
[Epoch 181 Batch 60/62] avg loss 0.00224599, throughput 8.82359K wps
Begin Testing...
[Epoch 181] train avg loss 0.00219262, dev acc 0.8378, dev avg loss 0.385287, throughput 8.95233K wps
Observed Improvement.
Begin Testing...
[Epoch 182 Batch 30/62] avg loss 0.00209194, throughput 9.17077K wps
[Epoch 182 Batch 60/62] avg loss 0.00206901, throughput 9.01963K wps
Begin Testing...
[Epoch 182] train avg loss 0.00210151, dev acc 0.8142, dev avg loss 0.387174, throughput 9.12534K wps
[Epoch 183 Batch 30/62] avg loss 0.00205285, throughput 9.21345K wps
[Epoch 183 Batch 60/62] avg loss 0.00202192, throughput 8.76028K wps
Begin Testing...
[Epoch 183] train avg loss 0.0020464, dev acc 0.8171, dev avg loss 0.386229, throughput 9.01315K wps
[Epoch 184 Batch 30/62] avg loss 0.0020957, throughput 9.07757K wps
[Epoch 184 Batch 60/62] avg loss 0.00211101, throughput 8.64738K wps
Begin Testing...
[Epoch 184] train avg loss 0.0021002, dev acc 0.8171, dev avg loss 0.387148, throughput 8.8503K wps
[Epoch 185 Batch 30/62] avg loss 0.00204122, throughput 8.86312K wps
[Epoch 185 Batch 60/62] avg loss 0.00200872, throughput 8.90304K wps
Begin Testing...
[Epoch 185] train avg loss 0.00203621, dev acc 0.8289, dev avg loss 0.385657, throughput 8.9186K wps
[Epoch 186 Batch 30/62] avg loss 0.00210962, throughput 9.0377K wps
[Epoch 186 Batch 60/62] avg loss 0.00199248, throughput 8.84605K wps
Begin Testing...
[Epoch 186] train avg loss 0.00207188, dev acc 0.8142, dev avg loss 0.387747, throughput 8.91134K wps
[Epoch 187 Batch 30/62] avg loss 0.00202853, throughput 9.24K wps
[Epoch 187 Batch 60/62] avg loss 0.00206433, throughput 8.88095K wps
Begin Testing...
[Epoch 187] train avg loss 0.002055, dev acc 0.8201, dev avg loss 0.386261, throughput 9.10208K wps
[Epoch 188 Batch 30/62] avg loss 0.002058, throughput 9.17438K wps
[Epoch 188 Batch 60/62] avg loss 0.00202129, throughput 8.97982K wps
Begin Testing...
[Epoch 188] train avg loss 0.00210409, dev acc 0.8142, dev avg loss 0.3931, throughput 9.0897K wps
[Epoch 189 Batch 30/62] avg loss 0.00187543, throughput 8.77577K wps
[Epoch 189 Batch 60/62] avg loss 0.00210152, throughput 8.79507K wps
Begin Testing...
[Epoch 189] train avg loss 0.00202438, dev acc 0.8142, dev avg loss 0.386707, throughput 8.81338K wps
[Epoch 190 Batch 30/62] avg loss 0.00195647, throughput 8.87785K wps
[Epoch 190 Batch 60/62] avg loss 0.0019984, throughput 8.92529K wps
Begin Testing...
[Epoch 190] train avg loss 0.00202082, dev acc 0.8348, dev avg loss 0.391263, throughput 8.89233K wps
[Epoch 191 Batch 30/62] avg loss 0.00199301, throughput 9.15071K wps
[Epoch 191 Batch 60/62] avg loss 0.00186164, throughput 8.70503K wps
Begin Testing...
[Epoch 191] train avg loss 0.001932, dev acc 0.8171, dev avg loss 0.385885, throughput 8.90595K wps
[Epoch 192 Batch 30/62] avg loss 0.00184429, throughput 9.11183K wps
[Epoch 192 Batch 60/62] avg loss 0.00184813, throughput 8.79999K wps
Begin Testing...
[Epoch 192] train avg loss 0.00186583, dev acc 0.8348, dev avg loss 0.386148, throughput 8.98915K wps
[Epoch 193 Batch 30/62] avg loss 0.0018866, throughput 8.81587K wps
[Epoch 193 Batch 60/62] avg loss 0.00201053, throughput 8.9879K wps
Begin Testing...
[Epoch 193] train avg loss 0.00198296, dev acc 0.8319, dev avg loss 0.386444, throughput 8.87949K wps
[Epoch 194 Batch 30/62] avg loss 0.00184493, throughput 9.00696K wps
[Epoch 194 Batch 60/62] avg loss 0.00197692, throughput 8.98098K wps
Begin Testing...
[Epoch 194] train avg loss 0.00191368, dev acc 0.8348, dev avg loss 0.386273, throughput 9.02563K wps
[Epoch 195 Batch 30/62] avg loss 0.00192174, throughput 8.91866K wps
[Epoch 195 Batch 60/62] avg loss 0.0019407, throughput 9.0953K wps
Begin Testing...
[Epoch 195] train avg loss 0.00195867, dev acc 0.8201, dev avg loss 0.386683, throughput 9.03139K wps
[Epoch 196 Batch 30/62] avg loss 0.00175984, throughput 9.00376K wps
[Epoch 196 Batch 60/62] avg loss 0.00194808, throughput 8.89158K wps
Begin Testing...
[Epoch 196] train avg loss 0.00188761, dev acc 0.8289, dev avg loss 0.386301, throughput 8.97849K wps
[Epoch 197 Batch 30/62] avg loss 0.00195063, throughput 9.12131K wps
[Epoch 197 Batch 60/62] avg loss 0.00188661, throughput 8.92956K wps
Begin Testing...
[Epoch 197] train avg loss 0.0019557, dev acc 0.8171, dev avg loss 0.388071, throughput 8.99829K wps
[Epoch 198 Batch 30/62] avg loss 0.00183054, throughput 8.89619K wps
[Epoch 198 Batch 60/62] avg loss 0.0020049, throughput 8.83201K wps
Begin Testing...
[Epoch 198] train avg loss 0.0019412, dev acc 0.8171, dev avg loss 0.38811, throughput 8.88405K wps
[Epoch 199 Batch 30/62] avg loss 0.00180548, throughput 8.90035K wps
[Epoch 199 Batch 60/62] avg loss 0.00190776, throughput 8.95555K wps
Begin Testing...
[Epoch 199] train avg loss 0.00186552, dev acc 0.8171, dev avg loss 0.387115, throughput 8.90257K wps
Test loss 0.336341, test acc 0.8382
Total time cost 178.38s
[Epoch 0 Batch 30/62] avg loss 0.0134163, throughput 8.41177K wps
[Epoch 0 Batch 60/62] avg loss 0.0130664, throughput 9.04938K wps
Begin Testing...
[Epoch 0] train avg loss 0.0133823, dev acc 0.6519, dev avg loss 0.647843, throughput 8.71654K wps
Observed Improvement.
Begin Testing...
[Epoch 1 Batch 30/62] avg loss 0.0133254, throughput 9.01347K wps
[Epoch 1 Batch 60/62] avg loss 0.0130449, throughput 8.97037K wps
Begin Testing...
[Epoch 1] train avg loss 0.0133406, dev acc 0.6519, dev avg loss 0.642652, throughput 9.00634K wps
Observed Improvement.
Begin Testing...
[Epoch 2 Batch 30/62] avg loss 0.0130125, throughput 9.29954K wps
[Epoch 2 Batch 60/62] avg loss 0.0129887, throughput 9.08217K wps
Begin Testing...
[Epoch 2] train avg loss 0.0131327, dev acc 0.6519, dev avg loss 0.637962, throughput 9.2052K wps
Observed Improvement.
Begin Testing...
[Epoch 3 Batch 30/62] avg loss 0.0129141, throughput 9.10869K wps
[Epoch 3 Batch 60/62] avg loss 0.0128605, throughput 9.13167K wps
Begin Testing...
[Epoch 3] train avg loss 0.0130658, dev acc 0.6519, dev avg loss 0.633172, throughput 9.14861K wps
Observed Improvement.
Begin Testing...
[Epoch 4 Batch 30/62] avg loss 0.0129844, throughput 9.16504K wps
[Epoch 4 Batch 60/62] avg loss 0.0126135, throughput 9.06129K wps
Begin Testing...
[Epoch 4] train avg loss 0.0130036, dev acc 0.6519, dev avg loss 0.628659, throughput 9.14272K wps
Observed Improvement.
Begin Testing...
[Epoch 5 Batch 30/62] avg loss 0.0126863, throughput 9.05309K wps
[Epoch 5 Batch 60/62] avg loss 0.012588, throughput 8.77224K wps
Begin Testing...
[Epoch 5] train avg loss 0.0127966, dev acc 0.6519, dev avg loss 0.624141, throughput 8.8697K wps
Observed Improvement.
Begin Testing...
[Epoch 6 Batch 30/62] avg loss 0.0125096, throughput 9.09121K wps
[Epoch 6 Batch 60/62] avg loss 0.0124855, throughput 9.01071K wps
Begin Testing...
[Epoch 6] train avg loss 0.0126885, dev acc 0.6519, dev avg loss 0.61958, throughput 9.07662K wps
Observed Improvement.
Begin Testing...
[Epoch 7 Batch 30/62] avg loss 0.012584, throughput 8.73849K wps
[Epoch 7 Batch 60/62] avg loss 0.0123118, throughput 9.02273K wps
Begin Testing...
[Epoch 7] train avg loss 0.0126047, dev acc 0.6519, dev avg loss 0.615267, throughput 8.90892K wps
Observed Improvement.
Begin Testing...
[Epoch 8 Batch 30/62] avg loss 0.0122131, throughput 8.83897K wps
[Epoch 8 Batch 60/62] avg loss 0.0124635, throughput 8.96118K wps
Begin Testing...
[Epoch 8] train avg loss 0.0124681, dev acc 0.6519, dev avg loss 0.610518, throughput 8.88394K wps
Observed Improvement.
Begin Testing...
[Epoch 9 Batch 30/62] avg loss 0.0122393, throughput 9.05765K wps
[Epoch 9 Batch 60/62] avg loss 0.0121978, throughput 8.98309K wps
Begin Testing...
[Epoch 9] train avg loss 0.0123418, dev acc 0.6519, dev avg loss 0.606135, throughput 9.00852K wps
Observed Improvement.
Begin Testing...
[Epoch 10 Batch 30/62] avg loss 0.0123481, throughput 8.9806K wps
[Epoch 10 Batch 60/62] avg loss 0.0120113, throughput 9.05236K wps
Begin Testing...
[Epoch 10] train avg loss 0.0122765, dev acc 0.6519, dev avg loss 0.60228, throughput 9.04733K wps
Observed Improvement.
Begin Testing...
[Epoch 11 Batch 30/62] avg loss 0.0120532, throughput 8.98666K wps
[Epoch 11 Batch 60/62] avg loss 0.0119619, throughput 8.97246K wps
Begin Testing...
[Epoch 11] train avg loss 0.0121272, dev acc 0.6519, dev avg loss 0.596909, throughput 9.01227K wps
Observed Improvement.
Begin Testing...
[Epoch 12 Batch 30/62] avg loss 0.0122185, throughput 8.91267K wps
[Epoch 12 Batch 60/62] avg loss 0.0118088, throughput 9.14744K wps
Begin Testing...
[Epoch 12] train avg loss 0.012189, dev acc 0.6549, dev avg loss 0.591824, throughput 9.05815K wps
Observed Improvement.
Begin Testing...
[Epoch 13 Batch 30/62] avg loss 0.0118687, throughput 9.20155K wps
[Epoch 13 Batch 60/62] avg loss 0.0119505, throughput 8.8175K wps
Begin Testing...
[Epoch 13] train avg loss 0.0120314, dev acc 0.6549, dev avg loss 0.586868, throughput 9.03935K wps
Observed Improvement.
Begin Testing...
[Epoch 14 Batch 30/62] avg loss 0.0116337, throughput 9.15052K wps
[Epoch 14 Batch 60/62] avg loss 0.0118354, throughput 8.63401K wps
Begin Testing...
[Epoch 14] train avg loss 0.0118519, dev acc 0.6578, dev avg loss 0.581732, throughput 8.87332K wps
Observed Improvement.
Begin Testing...
[Epoch 15 Batch 30/62] avg loss 0.0116925, throughput 9.17961K wps
[Epoch 15 Batch 60/62] avg loss 0.011594, throughput 9.07405K wps
Begin Testing...
[Epoch 15] train avg loss 0.011831, dev acc 0.6696, dev avg loss 0.577261, throughput 9.1544K wps
Observed Improvement.
Begin Testing...
[Epoch 16 Batch 30/62] avg loss 0.0116404, throughput 8.93808K wps
[Epoch 16 Batch 60/62] avg loss 0.0114595, throughput 9.01197K wps
Begin Testing...
[Epoch 16] train avg loss 0.0117125, dev acc 0.6696, dev avg loss 0.571356, throughput 9.00325K wps
Observed Improvement.
Begin Testing...
[Epoch 17 Batch 30/62] avg loss 0.0114011, throughput 8.59192K wps
[Epoch 17 Batch 60/62] avg loss 0.011354, throughput 9.10059K wps
Begin Testing...
[Epoch 17] train avg loss 0.011518, dev acc 0.6696, dev avg loss 0.565913, throughput 8.87447K wps
Observed Improvement.
Begin Testing...
[Epoch 18 Batch 30/62] avg loss 0.0112214, throughput 8.99251K wps
[Epoch 18 Batch 60/62] avg loss 0.0112658, throughput 9.02798K wps
Begin Testing...
[Epoch 18] train avg loss 0.0113783, dev acc 0.6696, dev avg loss 0.561139, throughput 9.04311K wps
Observed Improvement.
Begin Testing...
[Epoch 19 Batch 30/62] avg loss 0.0109826, throughput 9.04437K wps
[Epoch 19 Batch 60/62] avg loss 0.0112645, throughput 9.0876K wps
Begin Testing...
[Epoch 19] train avg loss 0.0112658, dev acc 0.7021, dev avg loss 0.555375, throughput 9.0983K wps
Observed Improvement.
Begin Testing...
[Epoch 20 Batch 30/62] avg loss 0.0111633, throughput 8.68538K wps
[Epoch 20 Batch 60/62] avg loss 0.0109988, throughput 8.89235K wps
Begin Testing...
[Epoch 20] train avg loss 0.0112315, dev acc 0.6726, dev avg loss 0.550143, throughput 8.82478K wps
[Epoch 21 Batch 30/62] avg loss 0.0110201, throughput 8.97672K wps
[Epoch 21 Batch 60/62] avg loss 0.0108763, throughput 8.93886K wps
Begin Testing...
[Epoch 21] train avg loss 0.0111301, dev acc 0.7198, dev avg loss 0.543702, throughput 8.91923K wps
Observed Improvement.
Begin Testing...
[Epoch 22 Batch 30/62] avg loss 0.010852, throughput 9.12011K wps
[Epoch 22 Batch 60/62] avg loss 0.0108121, throughput 9.07252K wps
Begin Testing...
[Epoch 22] train avg loss 0.0109664, dev acc 0.7021, dev avg loss 0.53791, throughput 9.06509K wps
[Epoch 23 Batch 30/62] avg loss 0.0108, throughput 8.99663K wps
[Epoch 23 Batch 60/62] avg loss 0.0107044, throughput 8.80377K wps
Begin Testing...
[Epoch 23] train avg loss 0.0109071, dev acc 0.7463, dev avg loss 0.53247, throughput 8.93589K wps
Observed Improvement.
Begin Testing...
[Epoch 24 Batch 30/62] avg loss 0.0104833, throughput 9.15011K wps
[Epoch 24 Batch 60/62] avg loss 0.0107127, throughput 9.06647K wps
Begin Testing...
[Epoch 24] train avg loss 0.0106819, dev acc 0.6991, dev avg loss 0.527581, throughput 9.07663K wps
[Epoch 25 Batch 30/62] avg loss 0.0106312, throughput 8.94512K wps
[Epoch 25 Batch 60/62] avg loss 0.01032, throughput 9.02934K wps
Begin Testing...
[Epoch 25] train avg loss 0.0105881, dev acc 0.7168, dev avg loss 0.520845, throughput 9.01492K wps
[Epoch 26 Batch 30/62] avg loss 0.0102467, throughput 8.87643K wps
[Epoch 26 Batch 60/62] avg loss 0.0103563, throughput 8.99136K wps
Begin Testing...
[Epoch 26] train avg loss 0.0104636, dev acc 0.7257, dev avg loss 0.515151, throughput 8.96949K wps
[Epoch 27 Batch 30/62] avg loss 0.0101609, throughput 8.82005K wps
[Epoch 27 Batch 60/62] avg loss 0.0102078, throughput 9.0171K wps
Begin Testing...
[Epoch 27] train avg loss 0.0103428, dev acc 0.7463, dev avg loss 0.508999, throughput 8.88448K wps
Observed Improvement.
Begin Testing...
[Epoch 28 Batch 30/62] avg loss 0.0101045, throughput 8.87173K wps
[Epoch 28 Batch 60/62] avg loss 0.00993968, throughput 9.13808K wps
Begin Testing...
[Epoch 28] train avg loss 0.0101674, dev acc 0.7434, dev avg loss 0.502989, throughput 8.99303K wps
[Epoch 29 Batch 30/62] avg loss 0.00993582, throughput 9.25566K wps
[Epoch 29 Batch 60/62] avg loss 0.00997976, throughput 8.97259K wps
Begin Testing...
[Epoch 29] train avg loss 0.010061, dev acc 0.7493, dev avg loss 0.497903, throughput 9.07758K wps
Observed Improvement.
Begin Testing...
[Epoch 30 Batch 30/62] avg loss 0.010077, throughput 9.09445K wps
[Epoch 30 Batch 60/62] avg loss 0.00956863, throughput 9.00411K wps
Begin Testing...
[Epoch 30] train avg loss 0.00996063, dev acc 0.7729, dev avg loss 0.492147, throughput 9.07681K wps
Observed Improvement.
Begin Testing...
[Epoch 31 Batch 30/62] avg loss 0.00971796, throughput 9.29306K wps
[Epoch 31 Batch 60/62] avg loss 0.00993029, throughput 9.07998K wps
Begin Testing...
[Epoch 31] train avg loss 0.00991146, dev acc 0.7463, dev avg loss 0.489244, throughput 9.16158K wps
[Epoch 32 Batch 30/62] avg loss 0.00966116, throughput 9.21145K wps
[Epoch 32 Batch 60/62] avg loss 0.00944399, throughput 9.12649K wps
Begin Testing...
[Epoch 32] train avg loss 0.00967895, dev acc 0.7699, dev avg loss 0.482192, throughput 9.14271K wps
[Epoch 33 Batch 30/62] avg loss 0.00945414, throughput 9.0355K wps
[Epoch 33 Batch 60/62] avg loss 0.00954656, throughput 8.96029K wps
Begin Testing...
[Epoch 33] train avg loss 0.00968482, dev acc 0.7876, dev avg loss 0.476442, throughput 9.0288K wps
Observed Improvement.
Begin Testing...
[Epoch 34 Batch 30/62] avg loss 0.00944773, throughput 8.94473K wps
[Epoch 34 Batch 60/62] avg loss 0.00936897, throughput 8.96914K wps
Begin Testing...
[Epoch 34] train avg loss 0.00956565, dev acc 0.7906, dev avg loss 0.471764, throughput 8.96964K wps
Observed Improvement.
Begin Testing...
[Epoch 35 Batch 30/62] avg loss 0.00952675, throughput 8.9743K wps
[Epoch 35 Batch 60/62] avg loss 0.00914793, throughput 8.90625K wps
Begin Testing...
[Epoch 35] train avg loss 0.00944909, dev acc 0.7729, dev avg loss 0.467768, throughput 8.92203K wps
[Epoch 36 Batch 30/62] avg loss 0.00901722, throughput 8.71914K wps
[Epoch 36 Batch 60/62] avg loss 0.00928084, throughput 9.03759K wps
Begin Testing...
[Epoch 36] train avg loss 0.00921298, dev acc 0.7788, dev avg loss 0.464877, throughput 8.90088K wps
[Epoch 37 Batch 30/62] avg loss 0.00895534, throughput 9.25576K wps
[Epoch 37 Batch 60/62] avg loss 0.00903449, throughput 8.69149K wps
Begin Testing...
[Epoch 37] train avg loss 0.00914387, dev acc 0.7817, dev avg loss 0.459607, throughput 8.99406K wps
[Epoch 38 Batch 30/62] avg loss 0.00899531, throughput 8.97771K wps
[Epoch 38 Batch 60/62] avg loss 0.00878652, throughput 9.02869K wps
Begin Testing...
[Epoch 38] train avg loss 0.00903834, dev acc 0.7994, dev avg loss 0.453862, throughput 8.97954K wps
Observed Improvement.
Begin Testing...
[Epoch 39 Batch 30/62] avg loss 0.00870428, throughput 9.01911K wps
[Epoch 39 Batch 60/62] avg loss 0.00899402, throughput 8.90791K wps
Begin Testing...
[Epoch 39] train avg loss 0.00894105, dev acc 0.7965, dev avg loss 0.449946, throughput 8.99487K wps
[Epoch 40 Batch 30/62] avg loss 0.00887742, throughput 8.98954K wps
[Epoch 40 Batch 60/62] avg loss 0.00855796, throughput 9.03235K wps
Begin Testing...
[Epoch 40] train avg loss 0.00880078, dev acc 0.7876, dev avg loss 0.447836, throughput 9.00003K wps
[Epoch 41 Batch 30/62] avg loss 0.00856983, throughput 8.80745K wps
[Epoch 41 Batch 60/62] avg loss 0.0085779, throughput 9.08132K wps
Begin Testing...
[Epoch 41] train avg loss 0.00874094, dev acc 0.7994, dev avg loss 0.442305, throughput 8.96992K wps
Observed Improvement.
Begin Testing...
[Epoch 42 Batch 30/62] avg loss 0.00845646, throughput 8.98937K wps
[Epoch 42 Batch 60/62] avg loss 0.00864121, throughput 9.08251K wps
Begin Testing...
[Epoch 42] train avg loss 0.00865531, dev acc 0.8024, dev avg loss 0.439528, throughput 9.05282K wps
Observed Improvement.
Begin Testing...
[Epoch 43 Batch 30/62] avg loss 0.00841153, throughput 9.00745K wps
[Epoch 43 Batch 60/62] avg loss 0.00847663, throughput 9.09698K wps
Begin Testing...
[Epoch 43] train avg loss 0.00848796, dev acc 0.7965, dev avg loss 0.437981, throughput 9.08022K wps
[Epoch 44 Batch 30/62] avg loss 0.00833372, throughput 9.16791K wps
[Epoch 44 Batch 60/62] avg loss 0.00859906, throughput 8.83501K wps
Begin Testing...
[Epoch 44] train avg loss 0.00848481, dev acc 0.8053, dev avg loss 0.432211, throughput 9.05251K wps
Observed Improvement.
Begin Testing...
[Epoch 45 Batch 30/62] avg loss 0.00822014, throughput 9.24532K wps
[Epoch 45 Batch 60/62] avg loss 0.0082423, throughput 8.68788K wps
Begin Testing...
[Epoch 45] train avg loss 0.00829651, dev acc 0.8024, dev avg loss 0.430191, throughput 8.93663K wps
[Epoch 46 Batch 30/62] avg loss 0.00807789, throughput 9.01176K wps
[Epoch 46 Batch 60/62] avg loss 0.00807911, throughput 8.92453K wps
Begin Testing...
[Epoch 46] train avg loss 0.0081846, dev acc 0.8053, dev avg loss 0.426188, throughput 9.00008K wps
Observed Improvement.
Begin Testing...
[Epoch 47 Batch 30/62] avg loss 0.00818511, throughput 9.01852K wps
[Epoch 47 Batch 60/62] avg loss 0.00802211, throughput 9.08139K wps
Begin Testing...
[Epoch 47] train avg loss 0.00819751, dev acc 0.8024, dev avg loss 0.423835, throughput 9.0718K wps
[Epoch 48 Batch 30/62] avg loss 0.008188, throughput 9.08944K wps
[Epoch 48 Batch 60/62] avg loss 0.00778592, throughput 9.10468K wps
Begin Testing...
[Epoch 48] train avg loss 0.00811545, dev acc 0.8053, dev avg loss 0.423647, throughput 9.12809K wps
Observed Improvement.
Begin Testing...
[Epoch 49 Batch 30/62] avg loss 0.00797287, throughput 9.23656K wps
[Epoch 49 Batch 60/62] avg loss 0.00788231, throughput 9.06219K wps
Begin Testing...
[Epoch 49] train avg loss 0.00808728, dev acc 0.8024, dev avg loss 0.422096, throughput 9.1722K wps
[Epoch 50 Batch 30/62] avg loss 0.00786101, throughput 9.18896K wps
[Epoch 50 Batch 60/62] avg loss 0.00762386, throughput 8.75964K wps
Begin Testing...
[Epoch 50] train avg loss 0.00781649, dev acc 0.8053, dev avg loss 0.419017, throughput 8.9472K wps
Observed Improvement.
Begin Testing...
[Epoch 51 Batch 30/62] avg loss 0.00767255, throughput 9.14088K wps
[Epoch 51 Batch 60/62] avg loss 0.00756198, throughput 9.04494K wps
Begin Testing...
[Epoch 51] train avg loss 0.00772644, dev acc 0.8112, dev avg loss 0.412746, throughput 9.12145K wps
Observed Improvement.
Begin Testing...
[Epoch 52 Batch 30/62] avg loss 0.00785498, throughput 9.21652K wps
[Epoch 52 Batch 60/62] avg loss 0.00765483, throughput 8.9953K wps
Begin Testing...
[Epoch 52] train avg loss 0.00783187, dev acc 0.8024, dev avg loss 0.411448, throughput 9.13409K wps
[Epoch 53 Batch 30/62] avg loss 0.0077819, throughput 9.02745K wps
[Epoch 53 Batch 60/62] avg loss 0.0074625, throughput 9.06372K wps
Begin Testing...
[Epoch 53] train avg loss 0.00770184, dev acc 0.8024, dev avg loss 0.413735, throughput 9.09365K wps
[Epoch 54 Batch 30/62] avg loss 0.0075563, throughput 8.86768K wps
[Epoch 54 Batch 60/62] avg loss 0.00735815, throughput 8.9069K wps
Begin Testing...
[Epoch 54] train avg loss 0.0075278, dev acc 0.8083, dev avg loss 0.406866, throughput 8.8529K wps
[Epoch 55 Batch 30/62] avg loss 0.00725839, throughput 9.15426K wps
[Epoch 55 Batch 60/62] avg loss 0.00748685, throughput 8.82298K wps
Begin Testing...
[Epoch 55] train avg loss 0.00750037, dev acc 0.8083, dev avg loss 0.406572, throughput 9.01905K wps
[Epoch 56 Batch 30/62] avg loss 0.0073352, throughput 9.02594K wps
[Epoch 56 Batch 60/62] avg loss 0.0072567, throughput 9.08055K wps
Begin Testing...
[Epoch 56] train avg loss 0.00735549, dev acc 0.8083, dev avg loss 0.408733, throughput 9.08626K wps
[Epoch 57 Batch 30/62] avg loss 0.00723593, throughput 8.99377K wps
[Epoch 57 Batch 60/62] avg loss 0.00720197, throughput 8.91172K wps
Begin Testing...
[Epoch 57] train avg loss 0.00727636, dev acc 0.8083, dev avg loss 0.403082, throughput 8.93372K wps
[Epoch 58 Batch 30/62] avg loss 0.00728764, throughput 9.0886K wps
[Epoch 58 Batch 60/62] avg loss 0.00719621, throughput 8.76863K wps
Begin Testing...
[Epoch 58] train avg loss 0.00733817, dev acc 0.7994, dev avg loss 0.397838, throughput 8.95074K wps
[Epoch 59 Batch 30/62] avg loss 0.00703767, throughput 9.08461K wps
[Epoch 59 Batch 60/62] avg loss 0.0070765, throughput 8.95886K wps
Begin Testing...
[Epoch 59] train avg loss 0.00719825, dev acc 0.8112, dev avg loss 0.400305, throughput 8.98795K wps
Observed Improvement.
Begin Testing...
[Epoch 60 Batch 30/62] avg loss 0.00701743, throughput 8.89458K wps
[Epoch 60 Batch 60/62] avg loss 0.00681901, throughput 9.07418K wps
Begin Testing...
[Epoch 60] train avg loss 0.00705747, dev acc 0.8112, dev avg loss 0.394026, throughput 9.01783K wps
Observed Improvement.
Begin Testing...
[Epoch 61 Batch 30/62] avg loss 0.00689397, throughput 9.19873K wps
[Epoch 61 Batch 60/62] avg loss 0.00696119, throughput 8.85398K wps
Begin Testing...
[Epoch 61] train avg loss 0.00704112, dev acc 0.8083, dev avg loss 0.392384, throughput 9.00335K wps
[Epoch 62 Batch 30/62] avg loss 0.00690189, throughput 9.16015K wps
[Epoch 62 Batch 60/62] avg loss 0.00659019, throughput 9.05018K wps
Begin Testing...
[Epoch 62] train avg loss 0.00682479, dev acc 0.8142, dev avg loss 0.397407, throughput 9.13402K wps
Observed Improvement.
Begin Testing...
[Epoch 63 Batch 30/62] avg loss 0.00682964, throughput 9.12532K wps
[Epoch 63 Batch 60/62] avg loss 0.00676559, throughput 8.67606K wps
Begin Testing...
[Epoch 63] train avg loss 0.0068755, dev acc 0.8024, dev avg loss 0.388961, throughput 8.87169K wps
[Epoch 64 Batch 30/62] avg loss 0.00692553, throughput 9.07185K wps
[Epoch 64 Batch 60/62] avg loss 0.00645377, throughput 9.07028K wps
Begin Testing...
[Epoch 64] train avg loss 0.00683656, dev acc 0.8083, dev avg loss 0.388082, throughput 9.10052K wps
[Epoch 65 Batch 30/62] avg loss 0.00668126, throughput 8.97823K wps
[Epoch 65 Batch 60/62] avg loss 0.00664449, throughput 8.89643K wps
Begin Testing...
[Epoch 65] train avg loss 0.00672433, dev acc 0.8053, dev avg loss 0.386399, throughput 8.97208K wps
[Epoch 66 Batch 30/62] avg loss 0.00627849, throughput 9.06787K wps
[Epoch 66 Batch 60/62] avg loss 0.00665795, throughput 9.07668K wps
Begin Testing...
[Epoch 66] train avg loss 0.00655057, dev acc 0.8112, dev avg loss 0.384362, throughput 9.10268K wps
[Epoch 67 Batch 30/62] avg loss 0.0061896, throughput 9.09654K wps
[Epoch 67 Batch 60/62] avg loss 0.00680125, throughput 9.05444K wps
Begin Testing...
[Epoch 67] train avg loss 0.00655285, dev acc 0.8112, dev avg loss 0.383204, throughput 9.04844K wps
[Epoch 68 Batch 30/62] avg loss 0.00630503, throughput 9.13653K wps
[Epoch 68 Batch 60/62] avg loss 0.00671292, throughput 9.0428K wps
Begin Testing...
[Epoch 68] train avg loss 0.00653378, dev acc 0.8142, dev avg loss 0.383141, throughput 9.11291K wps
Observed Improvement.
Begin Testing...
[Epoch 69 Batch 30/62] avg loss 0.00636182, throughput 9.09575K wps
[Epoch 69 Batch 60/62] avg loss 0.00625776, throughput 9.07361K wps
Begin Testing...
[Epoch 69] train avg loss 0.00643959, dev acc 0.8142, dev avg loss 0.380524, throughput 9.11609K wps
Observed Improvement.
Begin Testing...
[Epoch 70 Batch 30/62] avg loss 0.00603824, throughput 9.12803K wps
[Epoch 70 Batch 60/62] avg loss 0.00651607, throughput 8.93904K wps
Begin Testing...
[Epoch 70] train avg loss 0.00641401, dev acc 0.8230, dev avg loss 0.383578, throughput 9.05421K wps
Observed Improvement.
Begin Testing...
[Epoch 71 Batch 30/62] avg loss 0.00596851, throughput 9.26224K wps
[Epoch 71 Batch 60/62] avg loss 0.00645572, throughput 8.60132K wps
Begin Testing...
[Epoch 71] train avg loss 0.006314, dev acc 0.8053, dev avg loss 0.378459, throughput 8.90693K wps
[Epoch 72 Batch 30/62] avg loss 0.00609914, throughput 9.13638K wps
[Epoch 72 Batch 60/62] avg loss 0.00614282, throughput 9.12997K wps
Begin Testing...
[Epoch 72] train avg loss 0.00621953, dev acc 0.8201, dev avg loss 0.380503, throughput 9.1594K wps
[Epoch 73 Batch 30/62] avg loss 0.00603364, throughput 9.02165K wps
[Epoch 73 Batch 60/62] avg loss 0.00612426, throughput 9.14971K wps
Begin Testing...
[Epoch 73] train avg loss 0.0061752, dev acc 0.8142, dev avg loss 0.375629, throughput 9.11223K wps
[Epoch 74 Batch 30/62] avg loss 0.00617838, throughput 9.04436K wps
[Epoch 74 Batch 60/62] avg loss 0.0059106, throughput 8.90318K wps
Begin Testing...
[Epoch 74] train avg loss 0.00608102, dev acc 0.8142, dev avg loss 0.374164, throughput 8.93748K wps
[Epoch 75 Batch 30/62] avg loss 0.00592578, throughput 8.94213K wps
[Epoch 75 Batch 60/62] avg loss 0.0060131, throughput 8.63535K wps
Begin Testing...
[Epoch 75] train avg loss 0.0060537, dev acc 0.8083, dev avg loss 0.373531, throughput 8.77286K wps
[Epoch 76 Batch 30/62] avg loss 0.00585085, throughput 9.34087K wps
[Epoch 76 Batch 60/62] avg loss 0.00599092, throughput 9.01419K wps
Begin Testing...
[Epoch 76] train avg loss 0.00596755, dev acc 0.8260, dev avg loss 0.379407, throughput 9.14773K wps
Observed Improvement.
Begin Testing...
[Epoch 77 Batch 30/62] avg loss 0.00595988, throughput 9.07965K wps
[Epoch 77 Batch 60/62] avg loss 0.00568806, throughput 8.9464K wps
Begin Testing...
[Epoch 77] train avg loss 0.00589603, dev acc 0.8201, dev avg loss 0.375166, throughput 9.03984K wps
[Epoch 78 Batch 30/62] avg loss 0.0057061, throughput 8.91549K wps
[Epoch 78 Batch 60/62] avg loss 0.00590856, throughput 9.16774K wps
Begin Testing...
[Epoch 78] train avg loss 0.00588192, dev acc 0.8083, dev avg loss 0.370727, throughput 9.06572K wps
[Epoch 79 Batch 30/62] avg loss 0.00580555, throughput 8.72577K wps
[Epoch 79 Batch 60/62] avg loss 0.00556105, throughput 8.7564K wps
Begin Testing...
[Epoch 79] train avg loss 0.00576154, dev acc 0.8142, dev avg loss 0.370275, throughput 8.71721K wps
[Epoch 80 Batch 30/62] avg loss 0.00583489, throughput 8.94837K wps
[Epoch 80 Batch 60/62] avg loss 0.00558265, throughput 8.95298K wps
Begin Testing...
[Epoch 80] train avg loss 0.00585773, dev acc 0.8260, dev avg loss 0.383407, throughput 8.98038K wps
Observed Improvement.
Begin Testing...
[Epoch 81 Batch 30/62] avg loss 0.00570561, throughput 9.20274K wps
[Epoch 81 Batch 60/62] avg loss 0.00542967, throughput 8.99603K wps
Begin Testing...
[Epoch 81] train avg loss 0.00562395, dev acc 0.8201, dev avg loss 0.371632, throughput 9.11803K wps
[Epoch 82 Batch 30/62] avg loss 0.00560528, throughput 9.16746K wps
[Epoch 82 Batch 60/62] avg loss 0.00560915, throughput 9.01883K wps
Begin Testing...
[Epoch 82] train avg loss 0.00566593, dev acc 0.8112, dev avg loss 0.366963, throughput 9.12262K wps
[Epoch 83 Batch 30/62] avg loss 0.00537636, throughput 9.1752K wps
[Epoch 83 Batch 60/62] avg loss 0.00538792, throughput 9.08858K wps
Begin Testing...
[Epoch 83] train avg loss 0.00542026, dev acc 0.8201, dev avg loss 0.367479, throughput 9.15414K wps
[Epoch 84 Batch 30/62] avg loss 0.00533968, throughput 9.16508K wps
[Epoch 84 Batch 60/62] avg loss 0.00541029, throughput 8.97262K wps
Begin Testing...
[Epoch 84] train avg loss 0.00547109, dev acc 0.8201, dev avg loss 0.36859, throughput 9.09937K wps
[Epoch 85 Batch 30/62] avg loss 0.00528129, throughput 9.20338K wps
[Epoch 85 Batch 60/62] avg loss 0.00531506, throughput 9.04012K wps
Begin Testing...
[Epoch 85] train avg loss 0.00538868, dev acc 0.8201, dev avg loss 0.364961, throughput 9.15068K wps
[Epoch 86 Batch 30/62] avg loss 0.00518974, throughput 8.89197K wps
[Epoch 86 Batch 60/62] avg loss 0.00543602, throughput 9.11995K wps
Begin Testing...
[Epoch 86] train avg loss 0.00536122, dev acc 0.8201, dev avg loss 0.364312, throughput 9.03212K wps
[Epoch 87 Batch 30/62] avg loss 0.005184, throughput 8.84539K wps
[Epoch 87 Batch 60/62] avg loss 0.00529462, throughput 9.21504K wps
Begin Testing...
[Epoch 87] train avg loss 0.00529019, dev acc 0.8112, dev avg loss 0.362919, throughput 9.05648K wps
[Epoch 88 Batch 30/62] avg loss 0.0051191, throughput 9.01766K wps
[Epoch 88 Batch 60/62] avg loss 0.00501837, throughput 9.13252K wps
Begin Testing...
[Epoch 88] train avg loss 0.00515257, dev acc 0.8201, dev avg loss 0.363611, throughput 9.10542K wps
[Epoch 89 Batch 30/62] avg loss 0.0050698, throughput 9.10242K wps
[Epoch 89 Batch 60/62] avg loss 0.00530003, throughput 8.74892K wps
Begin Testing...
[Epoch 89] train avg loss 0.00527428, dev acc 0.8142, dev avg loss 0.361185, throughput 8.90598K wps
[Epoch 90 Batch 30/62] avg loss 0.00519332, throughput 9.09763K wps
[Epoch 90 Batch 60/62] avg loss 0.00508867, throughput 9.04898K wps
Begin Testing...
[Epoch 90] train avg loss 0.00523357, dev acc 0.8260, dev avg loss 0.364749, throughput 9.10123K wps
Observed Improvement.
Begin Testing...
[Epoch 91 Batch 30/62] avg loss 0.00512608, throughput 9.11103K wps
[Epoch 91 Batch 60/62] avg loss 0.00508929, throughput 9.0815K wps
Begin Testing...
[Epoch 91] train avg loss 0.00519981, dev acc 0.8112, dev avg loss 0.360887, throughput 9.12455K wps
[Epoch 92 Batch 30/62] avg loss 0.00491395, throughput 9.16141K wps
[Epoch 92 Batch 60/62] avg loss 0.00506883, throughput 9.08825K wps
Begin Testing...
[Epoch 92] train avg loss 0.00510282, dev acc 0.8201, dev avg loss 0.364184, throughput 9.14459K wps
[Epoch 93 Batch 30/62] avg loss 0.00477104, throughput 8.79731K wps
[Epoch 93 Batch 60/62] avg loss 0.00503535, throughput 9.05215K wps
Begin Testing...
[Epoch 93] train avg loss 0.00500431, dev acc 0.8112, dev avg loss 0.358856, throughput 8.96281K wps
[Epoch 94 Batch 30/62] avg loss 0.00479556, throughput 8.95445K wps
[Epoch 94 Batch 60/62] avg loss 0.00500209, throughput 8.98902K wps
Begin Testing...
[Epoch 94] train avg loss 0.00492282, dev acc 0.8230, dev avg loss 0.365324, throughput 9.00021K wps
[Epoch 95 Batch 30/62] avg loss 0.00480992, throughput 9.07513K wps
[Epoch 95 Batch 60/62] avg loss 0.00493361, throughput 9.1283K wps
Begin Testing...
[Epoch 95] train avg loss 0.0048891, dev acc 0.8171, dev avg loss 0.357666, throughput 9.13013K wps
[Epoch 96 Batch 30/62] avg loss 0.00481235, throughput 9.14299K wps
[Epoch 96 Batch 60/62] avg loss 0.00480206, throughput 8.88133K wps
Begin Testing...
[Epoch 96] train avg loss 0.00480657, dev acc 0.8260, dev avg loss 0.361747, throughput 9.04196K wps
Observed Improvement.
Begin Testing...
[Epoch 97 Batch 30/62] avg loss 0.00476665, throughput 9.13087K wps
[Epoch 97 Batch 60/62] avg loss 0.00475382, throughput 9.05035K wps
Begin Testing...
[Epoch 97] train avg loss 0.00482452, dev acc 0.8230, dev avg loss 0.36059, throughput 9.12228K wps
[Epoch 98 Batch 30/62] avg loss 0.00484202, throughput 9.15961K wps
[Epoch 98 Batch 60/62] avg loss 0.00452403, throughput 9.09566K wps
Begin Testing...
[Epoch 98] train avg loss 0.00473173, dev acc 0.8260, dev avg loss 0.362724, throughput 9.15853K wps
Observed Improvement.
Begin Testing...
[Epoch 99 Batch 30/62] avg loss 0.00441856, throughput 9.12447K wps
[Epoch 99 Batch 60/62] avg loss 0.0047949, throughput 9.0213K wps
Begin Testing...
[Epoch 99] train avg loss 0.00472019, dev acc 0.8171, dev avg loss 0.354204, throughput 9.102K wps
[Epoch 100 Batch 30/62] avg loss 0.00449051, throughput 9.13734K wps
[Epoch 100 Batch 60/62] avg loss 0.00460631, throughput 9.11413K wps
Begin Testing...
[Epoch 100] train avg loss 0.0045723, dev acc 0.8260, dev avg loss 0.361223, throughput 9.15641K wps
Observed Improvement.
Begin Testing...
[Epoch 101 Batch 30/62] avg loss 0.00427918, throughput 9.30091K wps
[Epoch 101 Batch 60/62] avg loss 0.00471386, throughput 8.94768K wps
Begin Testing...
[Epoch 101] train avg loss 0.00454421, dev acc 0.8289, dev avg loss 0.361838, throughput 9.08393K wps
Observed Improvement.
Begin Testing...
[Epoch 102 Batch 30/62] avg loss 0.00433906, throughput 8.95633K wps
[Epoch 102 Batch 60/62] avg loss 0.00434687, throughput 9.15762K wps
Begin Testing...
[Epoch 102] train avg loss 0.00439024, dev acc 0.8230, dev avg loss 0.354795, throughput 9.08127K wps
[Epoch 103 Batch 30/62] avg loss 0.00436572, throughput 9.18457K wps
[Epoch 103 Batch 60/62] avg loss 0.00437999, throughput 8.84928K wps
Begin Testing...
[Epoch 103] train avg loss 0.00442592, dev acc 0.8260, dev avg loss 0.353831, throughput 9.04658K wps
[Epoch 104 Batch 30/62] avg loss 0.00434808, throughput 9.05841K wps
[Epoch 104 Batch 60/62] avg loss 0.00449106, throughput 9.08735K wps
Begin Testing...
[Epoch 104] train avg loss 0.00448132, dev acc 0.8260, dev avg loss 0.351136, throughput 9.10391K wps
[Epoch 105 Batch 30/62] avg loss 0.00443038, throughput 8.5942K wps
[Epoch 105 Batch 60/62] avg loss 0.0042701, throughput 8.92345K wps
Begin Testing...
[Epoch 105] train avg loss 0.00435213, dev acc 0.8260, dev avg loss 0.35453, throughput 8.7443K wps
[Epoch 106 Batch 30/62] avg loss 0.00464425, throughput 9.06796K wps
[Epoch 106 Batch 60/62] avg loss 0.00418065, throughput 9.08798K wps
Begin Testing...
[Epoch 106] train avg loss 0.00442111, dev acc 0.8319, dev avg loss 0.356188, throughput 9.10963K wps
Observed Improvement.
Begin Testing...
[Epoch 107 Batch 30/62] avg loss 0.00413953, throughput 9.11085K wps
[Epoch 107 Batch 60/62] avg loss 0.00427057, throughput 8.85292K wps
Begin Testing...
[Epoch 107] train avg loss 0.00426541, dev acc 0.8171, dev avg loss 0.35015, throughput 8.97322K wps
[Epoch 108 Batch 30/62] avg loss 0.00408973, throughput 9.13922K wps
[Epoch 108 Batch 60/62] avg loss 0.00435018, throughput 9.10521K wps
Begin Testing...
[Epoch 108] train avg loss 0.0042402, dev acc 0.8289, dev avg loss 0.348839, throughput 9.15128K wps
[Epoch 109 Batch 30/62] avg loss 0.00412349, throughput 9.15896K wps
[Epoch 109 Batch 60/62] avg loss 0.00429289, throughput 8.97568K wps
Begin Testing...
[Epoch 109] train avg loss 0.00426445, dev acc 0.8260, dev avg loss 0.353961, throughput 9.09995K wps
[Epoch 110 Batch 30/62] avg loss 0.00399098, throughput 9.04523K wps
[Epoch 110 Batch 60/62] avg loss 0.00418279, throughput 8.80639K wps
Begin Testing...
[Epoch 110] train avg loss 0.00411331, dev acc 0.8319, dev avg loss 0.35678, throughput 8.90121K wps
Observed Improvement.
Begin Testing...
[Epoch 111 Batch 30/62] avg loss 0.00395332, throughput 9.17519K wps
[Epoch 111 Batch 60/62] avg loss 0.0042326, throughput 8.89696K wps
Begin Testing...
[Epoch 111] train avg loss 0.00410945, dev acc 0.8230, dev avg loss 0.350285, throughput 9.06397K wps
[Epoch 112 Batch 30/62] avg loss 0.00391282, throughput 9.18868K wps
[Epoch 112 Batch 60/62] avg loss 0.00409897, throughput 8.81533K wps
Begin Testing...
[Epoch 112] train avg loss 0.00400574, dev acc 0.8230, dev avg loss 0.348418, throughput 9.03082K wps
[Epoch 113 Batch 30/62] avg loss 0.00388474, throughput 9.19523K wps
[Epoch 113 Batch 60/62] avg loss 0.00405041, throughput 8.87044K wps
Begin Testing...
[Epoch 113] train avg loss 0.00401587, dev acc 0.8289, dev avg loss 0.346817, throughput 9.00768K wps
[Epoch 114 Batch 30/62] avg loss 0.00392287, throughput 8.4934K wps
[Epoch 114 Batch 60/62] avg loss 0.00373966, throughput 9.11805K wps
Begin Testing...
[Epoch 114] train avg loss 0.00395314, dev acc 0.8319, dev avg loss 0.346706, throughput 8.76703K wps
Observed Improvement.
Begin Testing...
[Epoch 115 Batch 30/62] avg loss 0.00390886, throughput 8.74669K wps
[Epoch 115 Batch 60/62] avg loss 0.00378617, throughput 9.19667K wps
Begin Testing...
[Epoch 115] train avg loss 0.00393336, dev acc 0.8378, dev avg loss 0.355198, throughput 8.98147K wps
Observed Improvement.
Begin Testing...
[Epoch 116 Batch 30/62] avg loss 0.0034159, throughput 8.5422K wps
[Epoch 116 Batch 60/62] avg loss 0.00406601, throughput 9.01098K wps
Begin Testing...
[Epoch 116] train avg loss 0.00381363, dev acc 0.8230, dev avg loss 0.34718, throughput 8.80499K wps
[Epoch 117 Batch 30/62] avg loss 0.00372139, throughput 8.88972K wps
[Epoch 117 Batch 60/62] avg loss 0.00386322, throughput 8.7045K wps
Begin Testing...
[Epoch 117] train avg loss 0.00391805, dev acc 0.8230, dev avg loss 0.345991, throughput 8.79467K wps
[Epoch 118 Batch 30/62] avg loss 0.00383582, throughput 8.88252K wps
[Epoch 118 Batch 60/62] avg loss 0.00389307, throughput 8.99424K wps
Begin Testing...
[Epoch 118] train avg loss 0.00391716, dev acc 0.8348, dev avg loss 0.359605, throughput 8.90547K wps
[Epoch 119 Batch 30/62] avg loss 0.00368738, throughput 8.95643K wps
[Epoch 119 Batch 60/62] avg loss 0.00360271, throughput 8.50977K wps
Begin Testing...
[Epoch 119] train avg loss 0.0036995, dev acc 0.8201, dev avg loss 0.346206, throughput 8.76163K wps
[Epoch 120 Batch 30/62] avg loss 0.00373368, throughput 8.98702K wps
[Epoch 120 Batch 60/62] avg loss 0.00371204, throughput 9.1485K wps
Begin Testing...
[Epoch 120] train avg loss 0.00379593, dev acc 0.8319, dev avg loss 0.344916, throughput 9.09398K wps
[Epoch 121 Batch 30/62] avg loss 0.00374859, throughput 9.16659K wps
[Epoch 121 Batch 60/62] avg loss 0.00344835, throughput 9.01373K wps
Begin Testing...
[Epoch 121] train avg loss 0.00360611, dev acc 0.8378, dev avg loss 0.357848, throughput 9.14358K wps
Observed Improvement.
Begin Testing...
[Epoch 122 Batch 30/62] avg loss 0.00361275, throughput 9.19442K wps
[Epoch 122 Batch 60/62] avg loss 0.00352306, throughput 8.83596K wps
Begin Testing...
[Epoch 122] train avg loss 0.00358901, dev acc 0.8260, dev avg loss 0.347716, throughput 9.02908K wps
[Epoch 123 Batch 30/62] avg loss 0.00363163, throughput 9.26193K wps
[Epoch 123 Batch 60/62] avg loss 0.00334991, throughput 9.10118K wps
Begin Testing...
[Epoch 123] train avg loss 0.00359714, dev acc 0.8230, dev avg loss 0.345606, throughput 9.14815K wps
[Epoch 124 Batch 30/62] avg loss 0.00366675, throughput 8.95453K wps
[Epoch 124 Batch 60/62] avg loss 0.00338193, throughput 9.13961K wps
Begin Testing...
[Epoch 124] train avg loss 0.00351939, dev acc 0.8437, dev avg loss 0.351159, throughput 9.07763K wps
Observed Improvement.
Begin Testing...
[Epoch 125 Batch 30/62] avg loss 0.00359938, throughput 9.08296K wps
[Epoch 125 Batch 60/62] avg loss 0.00342067, throughput 8.9646K wps
Begin Testing...
[Epoch 125] train avg loss 0.00351432, dev acc 0.8348, dev avg loss 0.356092, throughput 9.05603K wps
[Epoch 126 Batch 30/62] avg loss 0.00357089, throughput 8.8757K wps
[Epoch 126 Batch 60/62] avg loss 0.00347266, throughput 9.18482K wps
Begin Testing...
[Epoch 126] train avg loss 0.00353264, dev acc 0.8378, dev avg loss 0.358649, throughput 9.00364K wps
[Epoch 127 Batch 30/62] avg loss 0.00341477, throughput 9.1589K wps
[Epoch 127 Batch 60/62] avg loss 0.00343484, throughput 9.04239K wps
Begin Testing...
[Epoch 127] train avg loss 0.00345026, dev acc 0.8407, dev avg loss 0.353212, throughput 9.13098K wps
[Epoch 128 Batch 30/62] avg loss 0.00356066, throughput 9.03796K wps
[Epoch 128 Batch 60/62] avg loss 0.00328954, throughput 8.90654K wps
Begin Testing...
[Epoch 128] train avg loss 0.00347406, dev acc 0.8407, dev avg loss 0.348037, throughput 8.94457K wps
[Epoch 129 Batch 30/62] avg loss 0.00336136, throughput 9.10818K wps
[Epoch 129 Batch 60/62] avg loss 0.00336784, throughput 9.01876K wps
Begin Testing...
[Epoch 129] train avg loss 0.00344065, dev acc 0.8319, dev avg loss 0.342278, throughput 9.09446K wps
[Epoch 130 Batch 30/62] avg loss 0.0032558, throughput 9.19998K wps
[Epoch 130 Batch 60/62] avg loss 0.00326578, throughput 8.92685K wps
Begin Testing...
[Epoch 130] train avg loss 0.00333272, dev acc 0.8466, dev avg loss 0.350495, throughput 9.05831K wps
Observed Improvement.
Begin Testing...
[Epoch 131 Batch 30/62] avg loss 0.00310663, throughput 9.07548K wps
[Epoch 131 Batch 60/62] avg loss 0.00337404, throughput 9.16809K wps
Begin Testing...
[Epoch 131] train avg loss 0.00331316, dev acc 0.8319, dev avg loss 0.343344, throughput 9.13946K wps
[Epoch 132 Batch 30/62] avg loss 0.00336659, throughput 8.84554K wps
[Epoch 132 Batch 60/62] avg loss 0.00318008, throughput 9.03546K wps
Begin Testing...
[Epoch 132] train avg loss 0.00332969, dev acc 0.8319, dev avg loss 0.346539, throughput 8.97052K wps
[Epoch 133 Batch 30/62] avg loss 0.00331429, throughput 8.8761K wps
[Epoch 133 Batch 60/62] avg loss 0.00322098, throughput 9.10758K wps
Begin Testing...
[Epoch 133] train avg loss 0.00329677, dev acc 0.8378, dev avg loss 0.346538, throughput 9.02399K wps
[Epoch 134 Batch 30/62] avg loss 0.00313503, throughput 9.273K wps
[Epoch 134 Batch 60/62] avg loss 0.00304183, throughput 8.64744K wps
Begin Testing...
[Epoch 134] train avg loss 0.00310754, dev acc 0.8407, dev avg loss 0.346247, throughput 8.93262K wps
[Epoch 135 Batch 30/62] avg loss 0.00309997, throughput 8.74974K wps
[Epoch 135 Batch 60/62] avg loss 0.00302063, throughput 9.2065K wps
Begin Testing...
[Epoch 135] train avg loss 0.00320884, dev acc 0.8289, dev avg loss 0.342076, throughput 9.00642K wps
[Epoch 136 Batch 30/62] avg loss 0.00322585, throughput 9.07281K wps
[Epoch 136 Batch 60/62] avg loss 0.0030933, throughput 8.93089K wps
Begin Testing...
[Epoch 136] train avg loss 0.00319042, dev acc 0.8319, dev avg loss 0.340537, throughput 9.03492K wps
[Epoch 137 Batch 30/62] avg loss 0.00294234, throughput 9.0434K wps
[Epoch 137 Batch 60/62] avg loss 0.00303833, throughput 9.11376K wps
Begin Testing...
[Epoch 137] train avg loss 0.00304907, dev acc 0.8348, dev avg loss 0.340451, throughput 9.10689K wps
[Epoch 138 Batch 30/62] avg loss 0.00310732, throughput 8.96368K wps
[Epoch 138 Batch 60/62] avg loss 0.00307556, throughput 9.08825K wps
Begin Testing...
[Epoch 138] train avg loss 0.00308915, dev acc 0.8466, dev avg loss 0.350978, throughput 9.05759K wps
Observed Improvement.
Begin Testing...
[Epoch 139 Batch 30/62] avg loss 0.00305106, throughput 8.91017K wps
[Epoch 139 Batch 60/62] avg loss 0.00282471, throughput 9.09687K wps
Begin Testing...
[Epoch 139] train avg loss 0.00300681, dev acc 0.8289, dev avg loss 0.339391, throughput 9.02324K wps
[Epoch 140 Batch 30/62] avg loss 0.00317132, throughput 9.12939K wps
[Epoch 140 Batch 60/62] avg loss 0.00289278, throughput 8.50627K wps
Begin Testing...
[Epoch 140] train avg loss 0.0030511, dev acc 0.8437, dev avg loss 0.346451, throughput 8.80198K wps
[Epoch 141 Batch 30/62] avg loss 0.0030537, throughput 8.86392K wps
[Epoch 141 Batch 60/62] avg loss 0.00285895, throughput 9.1227K wps
Begin Testing...
[Epoch 141] train avg loss 0.00299521, dev acc 0.8348, dev avg loss 0.340203, throughput 8.99329K wps
[Epoch 142 Batch 30/62] avg loss 0.00290233, throughput 8.6602K wps
[Epoch 142 Batch 60/62] avg loss 0.0030162, throughput 9.09372K wps
Begin Testing...
[Epoch 142] train avg loss 0.00300214, dev acc 0.8378, dev avg loss 0.339925, throughput 8.90149K wps
[Epoch 143 Batch 30/62] avg loss 0.00299631, throughput 9.21145K wps
[Epoch 143 Batch 60/62] avg loss 0.00284045, throughput 9.01624K wps
Begin Testing...
[Epoch 143] train avg loss 0.00294818, dev acc 0.8466, dev avg loss 0.349732, throughput 9.14572K wps
Observed Improvement.
Begin Testing...
[Epoch 144 Batch 30/62] avg loss 0.00301802, throughput 8.72115K wps
[Epoch 144 Batch 60/62] avg loss 0.0026788, throughput 9.22617K wps
Begin Testing...
[Epoch 144] train avg loss 0.00286967, dev acc 0.8348, dev avg loss 0.341848, throughput 9.00198K wps
[Epoch 145 Batch 30/62] avg loss 0.00278344, throughput 9.02254K wps
[Epoch 145 Batch 60/62] avg loss 0.00284328, throughput 9.08539K wps
Begin Testing...
[Epoch 145] train avg loss 0.00284484, dev acc 0.8348, dev avg loss 0.341473, throughput 9.08335K wps
[Epoch 146 Batch 30/62] avg loss 0.0026617, throughput 9.09351K wps
[Epoch 146 Batch 60/62] avg loss 0.0029137, throughput 9.05816K wps
Begin Testing...
[Epoch 146] train avg loss 0.00283686, dev acc 0.8437, dev avg loss 0.346722, throughput 9.11229K wps
[Epoch 147 Batch 30/62] avg loss 0.00285514, throughput 9.3088K wps
[Epoch 147 Batch 60/62] avg loss 0.00270652, throughput 9.04726K wps
Begin Testing...
[Epoch 147] train avg loss 0.0028157, dev acc 0.8348, dev avg loss 0.342678, throughput 9.20295K wps
[Epoch 148 Batch 30/62] avg loss 0.00267712, throughput 9.12775K wps
[Epoch 148 Batch 60/62] avg loss 0.00269474, throughput 8.98285K wps
Begin Testing...
[Epoch 148] train avg loss 0.00275164, dev acc 0.8289, dev avg loss 0.338363, throughput 9.01149K wps
[Epoch 149 Batch 30/62] avg loss 0.00263934, throughput 9.0813K wps
[Epoch 149 Batch 60/62] avg loss 0.0027936, throughput 9.15006K wps
Begin Testing...
[Epoch 149] train avg loss 0.00280169, dev acc 0.8466, dev avg loss 0.339999, throughput 9.14121K wps
Observed Improvement.
Begin Testing...
[Epoch 150 Batch 30/62] avg loss 0.00291871, throughput 9.20415K wps
[Epoch 150 Batch 60/62] avg loss 0.00263413, throughput 9.13017K wps
Begin Testing...
[Epoch 150] train avg loss 0.00288392, dev acc 0.8378, dev avg loss 0.341258, throughput 9.19654K wps
[Epoch 151 Batch 30/62] avg loss 0.00257782, throughput 9.02718K wps
[Epoch 151 Batch 60/62] avg loss 0.00265198, throughput 8.89843K wps
Begin Testing...
[Epoch 151] train avg loss 0.00264953, dev acc 0.8407, dev avg loss 0.354789, throughput 8.94141K wps
[Epoch 152 Batch 30/62] avg loss 0.00259669, throughput 9.28844K wps
[Epoch 152 Batch 60/62] avg loss 0.00275454, throughput 9.13675K wps
Begin Testing...
[Epoch 152] train avg loss 0.00271768, dev acc 0.8407, dev avg loss 0.338718, throughput 9.23945K wps
[Epoch 153 Batch 30/62] avg loss 0.00264561, throughput 9.17775K wps
[Epoch 153 Batch 60/62] avg loss 0.00253495, throughput 8.96939K wps
Begin Testing...
[Epoch 153] train avg loss 0.00260525, dev acc 0.8319, dev avg loss 0.337026, throughput 9.10108K wps
[Epoch 154 Batch 30/62] avg loss 0.00257743, throughput 9.1652K wps
[Epoch 154 Batch 60/62] avg loss 0.00263132, throughput 9.07688K wps
Begin Testing...
[Epoch 154] train avg loss 0.00262224, dev acc 0.8466, dev avg loss 0.347727, throughput 9.14963K wps
Observed Improvement.
Begin Testing...
[Epoch 155 Batch 30/62] avg loss 0.00261711, throughput 8.9986K wps
[Epoch 155 Batch 60/62] avg loss 0.00257985, throughput 9.07937K wps
Begin Testing...
[Epoch 155] train avg loss 0.00263023, dev acc 0.8437, dev avg loss 0.347061, throughput 9.02049K wps
[Epoch 156 Batch 30/62] avg loss 0.00255334, throughput 8.83697K wps
[Epoch 156 Batch 60/62] avg loss 0.00242786, throughput 9.13101K wps
Begin Testing...
[Epoch 156] train avg loss 0.00252496, dev acc 0.8466, dev avg loss 0.337937, throughput 8.96212K wps
Observed Improvement.
Begin Testing...
[Epoch 157 Batch 30/62] avg loss 0.00263021, throughput 9.21664K wps
[Epoch 157 Batch 60/62] avg loss 0.00266399, throughput 8.97456K wps
Begin Testing...
[Epoch 157] train avg loss 0.00266916, dev acc 0.8319, dev avg loss 0.336356, throughput 9.12475K wps
[Epoch 158 Batch 30/62] avg loss 0.00232372, throughput 9.09187K wps
[Epoch 158 Batch 60/62] avg loss 0.00253377, throughput 9.06851K wps
Begin Testing...
[Epoch 158] train avg loss 0.00244985, dev acc 0.8466, dev avg loss 0.34479, throughput 9.11001K wps
Observed Improvement.
Begin Testing...
[Epoch 159 Batch 30/62] avg loss 0.00249882, throughput 8.81969K wps
[Epoch 159 Batch 60/62] avg loss 0.00246273, throughput 9.07185K wps
Begin Testing...
[Epoch 159] train avg loss 0.00252744, dev acc 0.8378, dev avg loss 0.336469, throughput 8.98011K wps
[Epoch 160 Batch 30/62] avg loss 0.00238445, throughput 8.96893K wps
[Epoch 160 Batch 60/62] avg loss 0.00250059, throughput 9.02993K wps
Begin Testing...
[Epoch 160] train avg loss 0.00245069, dev acc 0.8407, dev avg loss 0.340844, throughput 9.03382K wps
[Epoch 161 Batch 30/62] avg loss 0.00226284, throughput 9.08619K wps
[Epoch 161 Batch 60/62] avg loss 0.00259374, throughput 9.01593K wps
Begin Testing...
[Epoch 161] train avg loss 0.00246049, dev acc 0.8407, dev avg loss 0.340507, throughput 9.08171K wps
[Epoch 162 Batch 30/62] avg loss 0.00227335, throughput 8.92947K wps
[Epoch 162 Batch 60/62] avg loss 0.0024303, throughput 9.09729K wps
Begin Testing...
[Epoch 162] train avg loss 0.00240827, dev acc 0.8437, dev avg loss 0.337274, throughput 9.04991K wps
[Epoch 163 Batch 30/62] avg loss 0.00241276, throughput 9.01998K wps
[Epoch 163 Batch 60/62] avg loss 0.00249546, throughput 8.74781K wps
Begin Testing...
[Epoch 163] train avg loss 0.00251, dev acc 0.8437, dev avg loss 0.347872, throughput 8.84971K wps
[Epoch 164 Batch 30/62] avg loss 0.00224551, throughput 9.07855K wps
[Epoch 164 Batch 60/62] avg loss 0.00244826, throughput 8.86302K wps
Begin Testing...
[Epoch 164] train avg loss 0.00237606, dev acc 0.8378, dev avg loss 0.341782, throughput 8.97974K wps
[Epoch 165 Batch 30/62] avg loss 0.00238723, throughput 9.01599K wps
[Epoch 165 Batch 60/62] avg loss 0.00233817, throughput 9.09881K wps
Begin Testing...
[Epoch 165] train avg loss 0.00240469, dev acc 0.8437, dev avg loss 0.347132, throughput 9.0885K wps
[Epoch 166 Batch 30/62] avg loss 0.00225595, throughput 8.80129K wps
[Epoch 166 Batch 60/62] avg loss 0.00216735, throughput 9.05337K wps
Begin Testing...
[Epoch 166] train avg loss 0.00225836, dev acc 0.8407, dev avg loss 0.340175, throughput 8.9595K wps
[Epoch 167 Batch 30/62] avg loss 0.00223152, throughput 8.88285K wps
[Epoch 167 Batch 60/62] avg loss 0.00230865, throughput 8.8221K wps
Begin Testing...
[Epoch 167] train avg loss 0.00229585, dev acc 0.8407, dev avg loss 0.337349, throughput 8.83849K wps
[Epoch 168 Batch 30/62] avg loss 0.00225276, throughput 8.95173K wps
[Epoch 168 Batch 60/62] avg loss 0.00233294, throughput 9.18197K wps
Begin Testing...
[Epoch 168] train avg loss 0.00231475, dev acc 0.8407, dev avg loss 0.342716, throughput 9.07176K wps
[Epoch 169 Batch 30/62] avg loss 0.00226728, throughput 9.12546K wps
[Epoch 169 Batch 60/62] avg loss 0.00223574, throughput 9.05783K wps
Begin Testing...
[Epoch 169] train avg loss 0.00228085, dev acc 0.8407, dev avg loss 0.344311, throughput 9.1193K wps
[Epoch 170 Batch 30/62] avg loss 0.0021914, throughput 9.20211K wps
[Epoch 170 Batch 60/62] avg loss 0.0022677, throughput 9.0415K wps
Begin Testing...
[Epoch 170] train avg loss 0.0022607, dev acc 0.8407, dev avg loss 0.354327, throughput 9.1488K wps
[Epoch 171 Batch 30/62] avg loss 0.00225871, throughput 9.15158K wps
[Epoch 171 Batch 60/62] avg loss 0.00216477, throughput 8.96611K wps
Begin Testing...
[Epoch 171] train avg loss 0.00227025, dev acc 0.8407, dev avg loss 0.33667, throughput 9.04102K wps
[Epoch 172 Batch 30/62] avg loss 0.00222716, throughput 9.2332K wps
[Epoch 172 Batch 60/62] avg loss 0.00218259, throughput 9.10924K wps
Begin Testing...
[Epoch 172] train avg loss 0.00223988, dev acc 0.8319, dev avg loss 0.335795, throughput 9.19749K wps
[Epoch 173 Batch 30/62] avg loss 0.00219348, throughput 8.79468K wps
[Epoch 173 Batch 60/62] avg loss 0.00218644, throughput 8.85998K wps
Begin Testing...
[Epoch 173] train avg loss 0.00221128, dev acc 0.8407, dev avg loss 0.340362, throughput 8.81129K wps
[Epoch 174 Batch 30/62] avg loss 0.0021985, throughput 9.13799K wps
[Epoch 174 Batch 60/62] avg loss 0.00216496, throughput 8.85344K wps
Begin Testing...
[Epoch 174] train avg loss 0.00222368, dev acc 0.8437, dev avg loss 0.345065, throughput 8.97083K wps
[Epoch 175 Batch 30/62] avg loss 0.00214489, throughput 9.17486K wps
[Epoch 175 Batch 60/62] avg loss 0.00207272, throughput 9.01513K wps
Begin Testing...
[Epoch 175] train avg loss 0.00214317, dev acc 0.8466, dev avg loss 0.336333, throughput 9.11667K wps
Observed Improvement.
Begin Testing...
[Epoch 176 Batch 30/62] avg loss 0.00220455, throughput 8.86707K wps
[Epoch 176 Batch 60/62] avg loss 0.0020756, throughput 9.00128K wps
Begin Testing...
[Epoch 176] train avg loss 0.00213574, dev acc 0.8407, dev avg loss 0.340675, throughput 8.89682K wps
[Epoch 177 Batch 30/62] avg loss 0.00203908, throughput 9.03115K wps
[Epoch 177 Batch 60/62] avg loss 0.00196996, throughput 8.81323K wps
Begin Testing...
[Epoch 177] train avg loss 0.00201673, dev acc 0.8407, dev avg loss 0.335901, throughput 8.98208K wps
[Epoch 178 Batch 30/62] avg loss 0.00202572, throughput 9.26795K wps
[Epoch 178 Batch 60/62] avg loss 0.0021618, throughput 9.09562K wps
Begin Testing...
[Epoch 178] train avg loss 0.00212264, dev acc 0.8348, dev avg loss 0.362489, throughput 9.20257K wps
[Epoch 179 Batch 30/62] avg loss 0.0021771, throughput 9.24237K wps
[Epoch 179 Batch 60/62] avg loss 0.00215742, throughput 8.92611K wps
Begin Testing...
[Epoch 179] train avg loss 0.00218282, dev acc 0.8466, dev avg loss 0.338839, throughput 9.07367K wps
Observed Improvement.
Begin Testing...
[Epoch 180 Batch 30/62] avg loss 0.00201552, throughput 8.82306K wps
[Epoch 180 Batch 60/62] avg loss 0.00216094, throughput 8.55856K wps
Begin Testing...
[Epoch 180] train avg loss 0.00212008, dev acc 0.8466, dev avg loss 0.353116, throughput 8.6772K wps
Observed Improvement.
Begin Testing...
[Epoch 181 Batch 30/62] avg loss 0.00206961, throughput 8.98848K wps
[Epoch 181 Batch 60/62] avg loss 0.00197383, throughput 9.00882K wps
Begin Testing...
[Epoch 181] train avg loss 0.00205406, dev acc 0.8496, dev avg loss 0.347702, throughput 9.02911K wps
Observed Improvement.
Begin Testing...
[Epoch 182 Batch 30/62] avg loss 0.00205716, throughput 9.07901K wps
[Epoch 182 Batch 60/62] avg loss 0.00200492, throughput 9.03199K wps
Begin Testing...
[Epoch 182] train avg loss 0.00203158, dev acc 0.8466, dev avg loss 0.339381, throughput 9.08573K wps
[Epoch 183 Batch 30/62] avg loss 0.00199312, throughput 9.16686K wps
[Epoch 183 Batch 60/62] avg loss 0.00197854, throughput 9.03358K wps
Begin Testing...
[Epoch 183] train avg loss 0.00202475, dev acc 0.8437, dev avg loss 0.343715, throughput 9.13086K wps
[Epoch 184 Batch 30/62] avg loss 0.00196027, throughput 9.11016K wps
[Epoch 184 Batch 60/62] avg loss 0.0020647, throughput 9.12749K wps
Begin Testing...
[Epoch 184] train avg loss 0.0020365, dev acc 0.8525, dev avg loss 0.348846, throughput 9.1498K wps
Observed Improvement.
Begin Testing...
[Epoch 185 Batch 30/62] avg loss 0.00196135, throughput 9.05966K wps
[Epoch 185 Batch 60/62] avg loss 0.00198564, throughput 9.03872K wps
Begin Testing...
[Epoch 185] train avg loss 0.00198908, dev acc 0.8466, dev avg loss 0.340833, throughput 9.09952K wps
[Epoch 186 Batch 30/62] avg loss 0.00198789, throughput 9.25769K wps
[Epoch 186 Batch 60/62] avg loss 0.00192559, throughput 8.94345K wps
Begin Testing...
[Epoch 186] train avg loss 0.00200395, dev acc 0.8348, dev avg loss 0.357299, throughput 9.06504K wps
[Epoch 187 Batch 30/62] avg loss 0.00178949, throughput 9.15658K wps
[Epoch 187 Batch 60/62] avg loss 0.00204953, throughput 8.97132K wps
Begin Testing...
[Epoch 187] train avg loss 0.00192395, dev acc 0.8437, dev avg loss 0.344433, throughput 9.09354K wps
[Epoch 188 Batch 30/62] avg loss 0.00194225, throughput 8.90155K wps
[Epoch 188 Batch 60/62] avg loss 0.00200584, throughput 8.56665K wps
Begin Testing...
[Epoch 188] train avg loss 0.00199033, dev acc 0.8437, dev avg loss 0.34257, throughput 8.7633K wps
[Epoch 189 Batch 30/62] avg loss 0.00181668, throughput 9.12783K wps
[Epoch 189 Batch 60/62] avg loss 0.00189868, throughput 8.90609K wps
Begin Testing...
[Epoch 189] train avg loss 0.00188368, dev acc 0.8466, dev avg loss 0.338706, throughput 9.04735K wps
[Epoch 190 Batch 30/62] avg loss 0.00179382, throughput 9.08399K wps
[Epoch 190 Batch 60/62] avg loss 0.0019288, throughput 8.85648K wps
Begin Testing...
[Epoch 190] train avg loss 0.00189245, dev acc 0.8496, dev avg loss 0.336283, throughput 8.94565K wps
[Epoch 191 Batch 30/62] avg loss 0.0018485, throughput 9.1996K wps
[Epoch 191 Batch 60/62] avg loss 0.00191301, throughput 8.93307K wps
Begin Testing...
[Epoch 191] train avg loss 0.00188831, dev acc 0.8496, dev avg loss 0.339001, throughput 9.1143K wps
[Epoch 192 Batch 30/62] avg loss 0.00182122, throughput 9.08226K wps
[Epoch 192 Batch 60/62] avg loss 0.00180172, throughput 8.80605K wps
Begin Testing...
[Epoch 192] train avg loss 0.00184312, dev acc 0.8437, dev avg loss 0.344838, throughput 8.97658K wps
[Epoch 193 Batch 30/62] avg loss 0.00186689, throughput 9.18007K wps
[Epoch 193 Batch 60/62] avg loss 0.00176919, throughput 8.79902K wps
Begin Testing...
[Epoch 193] train avg loss 0.00184223, dev acc 0.8466, dev avg loss 0.347023, throughput 8.96205K wps
[Epoch 194 Batch 30/62] avg loss 0.00179645, throughput 8.76005K wps
[Epoch 194 Batch 60/62] avg loss 0.00187494, throughput 9.19254K wps
Begin Testing...
[Epoch 194] train avg loss 0.00192386, dev acc 0.8496, dev avg loss 0.337444, throughput 9.00312K wps
[Epoch 195 Batch 30/62] avg loss 0.00174098, throughput 9.09248K wps
[Epoch 195 Batch 60/62] avg loss 0.0017462, throughput 9.01329K wps
Begin Testing...
[Epoch 195] train avg loss 0.00175838, dev acc 0.8466, dev avg loss 0.347724, throughput 9.08337K wps
[Epoch 196 Batch 30/62] avg loss 0.0018407, throughput 9.03431K wps
[Epoch 196 Batch 60/62] avg loss 0.00174596, throughput 8.88008K wps
Begin Testing...
[Epoch 196] train avg loss 0.00180454, dev acc 0.8496, dev avg loss 0.339631, throughput 8.94706K wps
[Epoch 197 Batch 30/62] avg loss 0.00171026, throughput 9.19819K wps
[Epoch 197 Batch 60/62] avg loss 0.00180913, throughput 8.8485K wps
Begin Testing...
[Epoch 197] train avg loss 0.00181191, dev acc 0.8319, dev avg loss 0.368469, throughput 9.00287K wps
[Epoch 198 Batch 30/62] avg loss 0.00176073, throughput 9.11862K wps
[Epoch 198 Batch 60/62] avg loss 0.00171634, throughput 8.88402K wps
Begin Testing...
[Epoch 198] train avg loss 0.00174871, dev acc 0.8466, dev avg loss 0.352894, throughput 9.03126K wps
[Epoch 199 Batch 30/62] avg loss 0.0017788, throughput 9.00611K wps
[Epoch 199 Batch 60/62] avg loss 0.00168174, throughput 8.71902K wps
Begin Testing...
[Epoch 199] train avg loss 0.00178074, dev acc 0.8466, dev avg loss 0.337593, throughput 8.89407K wps
Test loss 0.368299, test acc 0.8143
Total time cost 155.84s
[Epoch 0 Batch 30/62] avg loss 0.0136328, throughput 8.22858K wps
[Epoch 0 Batch 60/62] avg loss 0.0131115, throughput 9.0235K wps
Begin Testing...
[Epoch 0] train avg loss 0.0135302, dev acc 0.6254, dev avg loss 0.663171, throughput 8.65639K wps
Observed Improvement.
Begin Testing...
[Epoch 1 Batch 30/62] avg loss 0.0130239, throughput 9.30222K wps
[Epoch 1 Batch 60/62] avg loss 0.0133158, throughput 9.13792K wps
Begin Testing...
[Epoch 1] train avg loss 0.0133352, dev acc 0.6254, dev avg loss 0.657406, throughput 9.24849K wps
Observed Improvement.
Begin Testing...
[Epoch 2 Batch 30/62] avg loss 0.0130798, throughput 9.11708K wps
[Epoch 2 Batch 60/62] avg loss 0.0130078, throughput 8.83944K wps
Begin Testing...
[Epoch 2] train avg loss 0.013258, dev acc 0.6254, dev avg loss 0.652956, throughput 8.99837K wps
Observed Improvement.
Begin Testing...
[Epoch 3 Batch 30/62] avg loss 0.0127757, throughput 9.0374K wps
[Epoch 3 Batch 60/62] avg loss 0.0129751, throughput 9.00788K wps
Begin Testing...
[Epoch 3] train avg loss 0.0130485, dev acc 0.6254, dev avg loss 0.648033, throughput 9.05679K wps
Observed Improvement.
Begin Testing...
[Epoch 4 Batch 30/62] avg loss 0.0128826, throughput 8.81179K wps
[Epoch 4 Batch 60/62] avg loss 0.0126724, throughput 9.09578K wps
Begin Testing...
[Epoch 4] train avg loss 0.0129361, dev acc 0.6254, dev avg loss 0.643695, throughput 8.93446K wps
Observed Improvement.
Begin Testing...
[Epoch 5 Batch 30/62] avg loss 0.0128013, throughput 9.12908K wps
[Epoch 5 Batch 60/62] avg loss 0.0127141, throughput 8.73358K wps
Begin Testing...
[Epoch 5] train avg loss 0.0129517, dev acc 0.6254, dev avg loss 0.639279, throughput 8.91103K wps
Observed Improvement.
Begin Testing...
[Epoch 6 Batch 30/62] avg loss 0.0124382, throughput 9.15215K wps
[Epoch 6 Batch 60/62] avg loss 0.0126861, throughput 9.04294K wps
Begin Testing...
[Epoch 6] train avg loss 0.0127116, dev acc 0.6254, dev avg loss 0.634175, throughput 9.12752K wps
Observed Improvement.
Begin Testing...
[Epoch 7 Batch 30/62] avg loss 0.0126126, throughput 9.19448K wps
[Epoch 7 Batch 60/62] avg loss 0.012463, throughput 9.08318K wps
Begin Testing...
[Epoch 7] train avg loss 0.0126884, dev acc 0.6254, dev avg loss 0.631601, throughput 9.13098K wps
Observed Improvement.
Begin Testing...
[Epoch 8 Batch 30/62] avg loss 0.0124368, throughput 8.99204K wps
[Epoch 8 Batch 60/62] avg loss 0.0125757, throughput 9.17987K wps
Begin Testing...
[Epoch 8] train avg loss 0.0126765, dev acc 0.6254, dev avg loss 0.625107, throughput 9.0653K wps
Observed Improvement.
Begin Testing...
[Epoch 9 Batch 30/62] avg loss 0.0122653, throughput 8.97825K wps
[Epoch 9 Batch 60/62] avg loss 0.0123805, throughput 8.56323K wps
Begin Testing...
[Epoch 9] train avg loss 0.0124944, dev acc 0.6254, dev avg loss 0.619844, throughput 8.7444K wps
Observed Improvement.
Begin Testing...
[Epoch 10 Batch 30/62] avg loss 0.0121578, throughput 8.71941K wps
[Epoch 10 Batch 60/62] avg loss 0.0124273, throughput 9.08362K wps
Begin Testing...
[Epoch 10] train avg loss 0.0124256, dev acc 0.6254, dev avg loss 0.615619, throughput 8.93242K wps
Observed Improvement.
Begin Testing...
[Epoch 11 Batch 30/62] avg loss 0.0122255, throughput 9.22503K wps
[Epoch 11 Batch 60/62] avg loss 0.0119896, throughput 9.08635K wps
Begin Testing...
[Epoch 11] train avg loss 0.0122159, dev acc 0.6254, dev avg loss 0.612145, throughput 9.18546K wps
Observed Improvement.
Begin Testing...
[Epoch 12 Batch 30/62] avg loss 0.0119478, throughput 8.9703K wps
[Epoch 12 Batch 60/62] avg loss 0.0120524, throughput 8.74097K wps
Begin Testing...
[Epoch 12] train avg loss 0.0121495, dev acc 0.6254, dev avg loss 0.60488, throughput 8.88999K wps
Observed Improvement.
Begin Testing...
[Epoch 13 Batch 30/62] avg loss 0.0121033, throughput 9.22975K wps
[Epoch 13 Batch 60/62] avg loss 0.0117445, throughput 8.7853K wps
Begin Testing...
[Epoch 13] train avg loss 0.0121273, dev acc 0.6283, dev avg loss 0.598943, throughput 8.96965K wps
Observed Improvement.
Begin Testing...
[Epoch 14 Batch 30/62] avg loss 0.011978, throughput 8.99757K wps
[Epoch 14 Batch 60/62] avg loss 0.0116692, throughput 9.09527K wps
Begin Testing...
[Epoch 14] train avg loss 0.0119719, dev acc 0.6283, dev avg loss 0.593686, throughput 9.05377K wps
Observed Improvement.
Begin Testing...
[Epoch 15 Batch 30/62] avg loss 0.0118371, throughput 9.10798K wps
[Epoch 15 Batch 60/62] avg loss 0.011456, throughput 8.67842K wps
Begin Testing...
[Epoch 15] train avg loss 0.0117392, dev acc 0.6254, dev avg loss 0.591204, throughput 8.96044K wps
[Epoch 16 Batch 30/62] avg loss 0.0116537, throughput 9.16814K wps
[Epoch 16 Batch 60/62] avg loss 0.0113116, throughput 9.08261K wps
Begin Testing...
[Epoch 16] train avg loss 0.0116547, dev acc 0.6667, dev avg loss 0.58053, throughput 9.1547K wps
Observed Improvement.
Begin Testing...
[Epoch 17 Batch 30/62] avg loss 0.0113985, throughput 8.91335K wps
[Epoch 17 Batch 60/62] avg loss 0.0114107, throughput 9.12613K wps
Begin Testing...
[Epoch 17] train avg loss 0.0115374, dev acc 0.6578, dev avg loss 0.574691, throughput 9.05143K wps
[Epoch 18 Batch 30/62] avg loss 0.0114437, throughput 9.16163K wps
[Epoch 18 Batch 60/62] avg loss 0.0112356, throughput 8.72919K wps
Begin Testing...
[Epoch 18] train avg loss 0.0115052, dev acc 0.6696, dev avg loss 0.568687, throughput 8.95155K wps
Observed Improvement.
Begin Testing...
[Epoch 19 Batch 30/62] avg loss 0.0113048, throughput 8.80779K wps
[Epoch 19 Batch 60/62] avg loss 0.0111572, throughput 8.95453K wps
Begin Testing...
[Epoch 19] train avg loss 0.0113765, dev acc 0.6667, dev avg loss 0.563629, throughput 8.85606K wps
[Epoch 20 Batch 30/62] avg loss 0.0109777, throughput 9.22499K wps
[Epoch 20 Batch 60/62] avg loss 0.011039, throughput 8.75828K wps
Begin Testing...
[Epoch 20] train avg loss 0.0111431, dev acc 0.6755, dev avg loss 0.555386, throughput 8.95634K wps
Observed Improvement.
Begin Testing...
[Epoch 21 Batch 30/62] avg loss 0.0110732, throughput 9.26524K wps
[Epoch 21 Batch 60/62] avg loss 0.0108945, throughput 9.02815K wps
Begin Testing...
[Epoch 21] train avg loss 0.0111097, dev acc 0.6755, dev avg loss 0.549011, throughput 9.15465K wps
Observed Improvement.
Begin Testing...
[Epoch 22 Batch 30/62] avg loss 0.0106881, throughput 8.85171K wps
[Epoch 22 Batch 60/62] avg loss 0.0109782, throughput 9.02974K wps
Begin Testing...
[Epoch 22] train avg loss 0.0109716, dev acc 0.7021, dev avg loss 0.542735, throughput 8.97923K wps
Observed Improvement.
Begin Testing...
[Epoch 23 Batch 30/62] avg loss 0.0105794, throughput 9.13783K wps
[Epoch 23 Batch 60/62] avg loss 0.0107781, throughput 9.17146K wps
Begin Testing...
[Epoch 23] train avg loss 0.0108151, dev acc 0.6814, dev avg loss 0.537173, throughput 9.18546K wps
[Epoch 24 Batch 30/62] avg loss 0.0107513, throughput 9.04415K wps
[Epoch 24 Batch 60/62] avg loss 0.0104695, throughput 8.72639K wps
Begin Testing...
[Epoch 24] train avg loss 0.010676, dev acc 0.6814, dev avg loss 0.533988, throughput 8.86453K wps
[Epoch 25 Batch 30/62] avg loss 0.0104023, throughput 8.8475K wps
[Epoch 25 Batch 60/62] avg loss 0.0102806, throughput 9.03308K wps
Begin Testing...
[Epoch 25] train avg loss 0.0104495, dev acc 0.7021, dev avg loss 0.524488, throughput 8.97472K wps
Observed Improvement.
Begin Testing...
[Epoch 26 Batch 30/62] avg loss 0.0102921, throughput 8.94864K wps
[Epoch 26 Batch 60/62] avg loss 0.0102537, throughput 9.088K wps
Begin Testing...
[Epoch 26] train avg loss 0.0103918, dev acc 0.6844, dev avg loss 0.521078, throughput 8.97506K wps
[Epoch 27 Batch 30/62] avg loss 0.0102633, throughput 9.03782K wps
[Epoch 27 Batch 60/62] avg loss 0.0100035, throughput 9.16244K wps
Begin Testing...
[Epoch 27] train avg loss 0.0102772, dev acc 0.6844, dev avg loss 0.515522, throughput 9.12865K wps
[Epoch 28 Batch 30/62] avg loss 0.0101077, throughput 8.83166K wps
[Epoch 28 Batch 60/62] avg loss 0.0099157, throughput 9.09947K wps
Begin Testing...
[Epoch 28] train avg loss 0.010199, dev acc 0.7316, dev avg loss 0.50744, throughput 8.994K wps
Observed Improvement.
Begin Testing...
[Epoch 29 Batch 30/62] avg loss 0.00993701, throughput 8.92699K wps
[Epoch 29 Batch 60/62] avg loss 0.00988887, throughput 9.20553K wps
Begin Testing...
[Epoch 29] train avg loss 0.0101038, dev acc 0.7345, dev avg loss 0.503028, throughput 9.09084K wps
Observed Improvement.
Begin Testing...
[Epoch 30 Batch 30/62] avg loss 0.00976211, throughput 9.02075K wps
[Epoch 30 Batch 60/62] avg loss 0.00977113, throughput 8.82242K wps
Begin Testing...
[Epoch 30] train avg loss 0.00998921, dev acc 0.7640, dev avg loss 0.496352, throughput 8.90295K wps
Observed Improvement.
Begin Testing...
[Epoch 31 Batch 30/62] avg loss 0.00967761, throughput 9.17339K wps
[Epoch 31 Batch 60/62] avg loss 0.00970636, throughput 8.97094K wps
Begin Testing...
[Epoch 31] train avg loss 0.00982396, dev acc 0.7729, dev avg loss 0.491757, throughput 9.1045K wps
Observed Improvement.
Begin Testing...
[Epoch 32 Batch 30/62] avg loss 0.00990996, throughput 8.97455K wps
[Epoch 32 Batch 60/62] avg loss 0.00937076, throughput 8.82142K wps
Begin Testing...
[Epoch 32] train avg loss 0.00983011, dev acc 0.7611, dev avg loss 0.487132, throughput 8.88972K wps
[Epoch 33 Batch 30/62] avg loss 0.00962463, throughput 9.21588K wps
[Epoch 33 Batch 60/62] avg loss 0.00920424, throughput 9.13207K wps
Begin Testing...
[Epoch 33] train avg loss 0.00950208, dev acc 0.7345, dev avg loss 0.48652, throughput 9.20348K wps
[Epoch 34 Batch 30/62] avg loss 0.00942144, throughput 9.06209K wps
[Epoch 34 Batch 60/62] avg loss 0.00948356, throughput 8.95003K wps
Begin Testing...
[Epoch 34] train avg loss 0.00955586, dev acc 0.7611, dev avg loss 0.479194, throughput 8.9855K wps
[Epoch 35 Batch 30/62] avg loss 0.00917677, throughput 8.88251K wps
[Epoch 35 Batch 60/62] avg loss 0.00919138, throughput 9.05088K wps
Begin Testing...
[Epoch 35] train avg loss 0.00937117, dev acc 0.7670, dev avg loss 0.474371, throughput 8.94755K wps
[Epoch 36 Batch 30/62] avg loss 0.00908051, throughput 9.22353K wps
[Epoch 36 Batch 60/62] avg loss 0.00916192, throughput 8.7984K wps
Begin Testing...
[Epoch 36] train avg loss 0.00927219, dev acc 0.7699, dev avg loss 0.471392, throughput 9.02917K wps
[Epoch 37 Batch 30/62] avg loss 0.00890883, throughput 9.26796K wps
[Epoch 37 Batch 60/62] avg loss 0.00914316, throughput 9.12816K wps
Begin Testing...
[Epoch 37] train avg loss 0.00908192, dev acc 0.7729, dev avg loss 0.467833, throughput 9.20855K wps
Observed Improvement.
Begin Testing...
[Epoch 38 Batch 30/62] avg loss 0.00896568, throughput 8.96085K wps
[Epoch 38 Batch 60/62] avg loss 0.00873255, throughput 8.96713K wps
Begin Testing...
[Epoch 38] train avg loss 0.00897665, dev acc 0.7699, dev avg loss 0.462886, throughput 8.9986K wps
[Epoch 39 Batch 30/62] avg loss 0.00879706, throughput 9.19293K wps
[Epoch 39 Batch 60/62] avg loss 0.00897729, throughput 9.08923K wps
Begin Testing...
[Epoch 39] train avg loss 0.00902332, dev acc 0.7758, dev avg loss 0.459219, throughput 9.17024K wps
Observed Improvement.
Begin Testing...
[Epoch 40 Batch 30/62] avg loss 0.00877282, throughput 8.8797K wps
[Epoch 40 Batch 60/62] avg loss 0.00882634, throughput 9.0701K wps
Begin Testing...
[Epoch 40] train avg loss 0.0090086, dev acc 0.7847, dev avg loss 0.456336, throughput 9.00398K wps
Observed Improvement.
Begin Testing...
[Epoch 41 Batch 30/62] avg loss 0.00885857, throughput 9.10814K wps
[Epoch 41 Batch 60/62] avg loss 0.00833636, throughput 8.84995K wps
Begin Testing...
[Epoch 41] train avg loss 0.00877863, dev acc 0.7788, dev avg loss 0.453478, throughput 9.01219K wps
[Epoch 42 Batch 30/62] avg loss 0.00848883, throughput 8.86941K wps
[Epoch 42 Batch 60/62] avg loss 0.00853936, throughput 8.88615K wps
Begin Testing...
[Epoch 42] train avg loss 0.00864274, dev acc 0.7906, dev avg loss 0.450586, throughput 8.91197K wps
Observed Improvement.
Begin Testing...
[Epoch 43 Batch 30/62] avg loss 0.00825694, throughput 9.17121K wps
[Epoch 43 Batch 60/62] avg loss 0.00878631, throughput 9.02721K wps
Begin Testing...
[Epoch 43] train avg loss 0.00861186, dev acc 0.7847, dev avg loss 0.44755, throughput 9.12656K wps
[Epoch 44 Batch 30/62] avg loss 0.0081197, throughput 9.11208K wps
[Epoch 44 Batch 60/62] avg loss 0.00843945, throughput 9.09486K wps
Begin Testing...
[Epoch 44] train avg loss 0.0083816, dev acc 0.7847, dev avg loss 0.445139, throughput 9.13118K wps
[Epoch 45 Batch 30/62] avg loss 0.0083521, throughput 9.10259K wps
[Epoch 45 Batch 60/62] avg loss 0.00825839, throughput 8.9692K wps
Begin Testing...
[Epoch 45] train avg loss 0.00836073, dev acc 0.7906, dev avg loss 0.44233, throughput 9.01636K wps
Observed Improvement.
Begin Testing...
[Epoch 46 Batch 30/62] avg loss 0.00827285, throughput 9.15405K wps
[Epoch 46 Batch 60/62] avg loss 0.00802702, throughput 8.71901K wps
Begin Testing...
[Epoch 46] train avg loss 0.0082255, dev acc 0.7847, dev avg loss 0.440746, throughput 8.89665K wps
[Epoch 47 Batch 30/62] avg loss 0.00812331, throughput 8.92979K wps
[Epoch 47 Batch 60/62] avg loss 0.00798371, throughput 9.24517K wps
Begin Testing...
[Epoch 47] train avg loss 0.00816436, dev acc 0.7876, dev avg loss 0.438487, throughput 9.07286K wps
[Epoch 48 Batch 30/62] avg loss 0.0080216, throughput 9.29954K wps
[Epoch 48 Batch 60/62] avg loss 0.00801904, throughput 9.04538K wps
Begin Testing...
[Epoch 48] train avg loss 0.00814031, dev acc 0.7965, dev avg loss 0.435142, throughput 9.13186K wps
Observed Improvement.
Begin Testing...
[Epoch 49 Batch 30/62] avg loss 0.00792067, throughput 9.23861K wps
[Epoch 49 Batch 60/62] avg loss 0.00792486, throughput 8.86146K wps
Begin Testing...
[Epoch 49] train avg loss 0.00808935, dev acc 0.7965, dev avg loss 0.433712, throughput 9.06872K wps
Observed Improvement.
Begin Testing...
[Epoch 50 Batch 30/62] avg loss 0.00784451, throughput 9.07222K wps
[Epoch 50 Batch 60/62] avg loss 0.00800082, throughput 8.7984K wps
Begin Testing...
[Epoch 50] train avg loss 0.00804001, dev acc 0.7817, dev avg loss 0.433848, throughput 8.96886K wps
[Epoch 51 Batch 30/62] avg loss 0.00803324, throughput 8.6848K wps
[Epoch 51 Batch 60/62] avg loss 0.00752392, throughput 9.15741K wps
Begin Testing...
[Epoch 51] train avg loss 0.00782483, dev acc 0.7994, dev avg loss 0.43026, throughput 8.90644K wps
Observed Improvement.
Begin Testing...
[Epoch 52 Batch 30/62] avg loss 0.00776276, throughput 9.11457K wps
[Epoch 52 Batch 60/62] avg loss 0.00762901, throughput 9.0212K wps
Begin Testing...
[Epoch 52] train avg loss 0.00778919, dev acc 0.7965, dev avg loss 0.42862, throughput 9.09146K wps
[Epoch 53 Batch 30/62] avg loss 0.00756719, throughput 8.90842K wps
[Epoch 53 Batch 60/62] avg loss 0.00779115, throughput 8.87519K wps
Begin Testing...
[Epoch 53] train avg loss 0.00777381, dev acc 0.8083, dev avg loss 0.426567, throughput 8.92771K wps
Observed Improvement.
Begin Testing...
[Epoch 54 Batch 30/62] avg loss 0.00773794, throughput 9.25315K wps
[Epoch 54 Batch 60/62] avg loss 0.00741894, throughput 9.05761K wps
Begin Testing...
[Epoch 54] train avg loss 0.00767355, dev acc 0.7965, dev avg loss 0.424613, throughput 9.1774K wps
[Epoch 55 Batch 30/62] avg loss 0.00727366, throughput 9.13237K wps
[Epoch 55 Batch 60/62] avg loss 0.00768577, throughput 9.01812K wps
Begin Testing...
[Epoch 55] train avg loss 0.00755537, dev acc 0.7965, dev avg loss 0.422074, throughput 9.09168K wps
[Epoch 56 Batch 30/62] avg loss 0.00751136, throughput 9.06938K wps
[Epoch 56 Batch 60/62] avg loss 0.0072694, throughput 9.03543K wps
Begin Testing...
[Epoch 56] train avg loss 0.00744633, dev acc 0.7935, dev avg loss 0.420436, throughput 9.07988K wps
[Epoch 57 Batch 30/62] avg loss 0.00734448, throughput 9.25255K wps
[Epoch 57 Batch 60/62] avg loss 0.0072255, throughput 8.81133K wps
Begin Testing...
[Epoch 57] train avg loss 0.0073243, dev acc 0.7994, dev avg loss 0.42015, throughput 9.06061K wps
[Epoch 58 Batch 30/62] avg loss 0.00724954, throughput 9.23597K wps
[Epoch 58 Batch 60/62] avg loss 0.00718177, throughput 9.03739K wps
Begin Testing...
[Epoch 58] train avg loss 0.00731448, dev acc 0.7965, dev avg loss 0.418265, throughput 9.16683K wps
[Epoch 59 Batch 30/62] avg loss 0.00695976, throughput 9.2822K wps
[Epoch 59 Batch 60/62] avg loss 0.0072812, throughput 9.08259K wps
Begin Testing...
[Epoch 59] train avg loss 0.00718014, dev acc 0.8083, dev avg loss 0.415689, throughput 9.202K wps
Observed Improvement.
Begin Testing...
[Epoch 60 Batch 30/62] avg loss 0.00700171, throughput 9.06316K wps
[Epoch 60 Batch 60/62] avg loss 0.00730277, throughput 9.06445K wps
Begin Testing...
[Epoch 60] train avg loss 0.00729117, dev acc 0.7965, dev avg loss 0.418558, throughput 9.08782K wps
[Epoch 61 Batch 30/62] avg loss 0.00710705, throughput 9.23598K wps
[Epoch 61 Batch 60/62] avg loss 0.00706125, throughput 9.15527K wps
Begin Testing...
[Epoch 61] train avg loss 0.00716318, dev acc 0.7994, dev avg loss 0.413646, throughput 9.16719K wps
[Epoch 62 Batch 30/62] avg loss 0.00692872, throughput 8.95193K wps
[Epoch 62 Batch 60/62] avg loss 0.00680014, throughput 8.88681K wps
Begin Testing...
[Epoch 62] train avg loss 0.00705917, dev acc 0.8142, dev avg loss 0.411658, throughput 8.95246K wps
Observed Improvement.
Begin Testing...
[Epoch 63 Batch 30/62] avg loss 0.00691219, throughput 8.76216K wps
[Epoch 63 Batch 60/62] avg loss 0.00674897, throughput 8.99857K wps
Begin Testing...
[Epoch 63] train avg loss 0.00696739, dev acc 0.8201, dev avg loss 0.413156, throughput 8.91547K wps
Observed Improvement.
Begin Testing...
[Epoch 64 Batch 30/62] avg loss 0.00671085, throughput 9.08047K wps
[Epoch 64 Batch 60/62] avg loss 0.00687222, throughput 8.71424K wps
Begin Testing...
[Epoch 64] train avg loss 0.00686046, dev acc 0.8171, dev avg loss 0.409372, throughput 8.89879K wps
[Epoch 65 Batch 30/62] avg loss 0.00666678, throughput 8.89837K wps
[Epoch 65 Batch 60/62] avg loss 0.00660849, throughput 8.95841K wps
Begin Testing...
[Epoch 65] train avg loss 0.00675619, dev acc 0.8201, dev avg loss 0.409194, throughput 8.9663K wps
Observed Improvement.
Begin Testing...
[Epoch 66 Batch 30/62] avg loss 0.0067596, throughput 8.97637K wps
[Epoch 66 Batch 60/62] avg loss 0.0067423, throughput 9.07003K wps
Begin Testing...
[Epoch 66] train avg loss 0.00693733, dev acc 0.7965, dev avg loss 0.409123, throughput 9.04351K wps
[Epoch 67 Batch 30/62] avg loss 0.00674431, throughput 9.04777K wps
[Epoch 67 Batch 60/62] avg loss 0.00643335, throughput 9.06842K wps
Begin Testing...
[Epoch 67] train avg loss 0.00667999, dev acc 0.7965, dev avg loss 0.408978, throughput 9.08168K wps
[Epoch 68 Batch 30/62] avg loss 0.0065159, throughput 9.27939K wps
[Epoch 68 Batch 60/62] avg loss 0.00660666, throughput 8.98664K wps
Begin Testing...
[Epoch 68] train avg loss 0.00664749, dev acc 0.8230, dev avg loss 0.404896, throughput 9.0879K wps
Observed Improvement.
Begin Testing...
[Epoch 69 Batch 30/62] avg loss 0.00671887, throughput 9.1297K wps
[Epoch 69 Batch 60/62] avg loss 0.00614632, throughput 9.09558K wps
Begin Testing...
[Epoch 69] train avg loss 0.00656097, dev acc 0.8201, dev avg loss 0.403897, throughput 9.075K wps
[Epoch 70 Batch 30/62] avg loss 0.00616338, throughput 8.93017K wps
[Epoch 70 Batch 60/62] avg loss 0.00664068, throughput 8.92976K wps
Begin Testing...
[Epoch 70] train avg loss 0.00645626, dev acc 0.8201, dev avg loss 0.402601, throughput 8.90718K wps
[Epoch 71 Batch 30/62] avg loss 0.00625665, throughput 9.11956K wps
[Epoch 71 Batch 60/62] avg loss 0.00639454, throughput 8.63248K wps
Begin Testing...
[Epoch 71] train avg loss 0.00645094, dev acc 0.8201, dev avg loss 0.401291, throughput 8.9031K wps
[Epoch 72 Batch 30/62] avg loss 0.0063296, throughput 8.93764K wps
[Epoch 72 Batch 60/62] avg loss 0.00629473, throughput 9.10511K wps
Begin Testing...
[Epoch 72] train avg loss 0.00637585, dev acc 0.8083, dev avg loss 0.403027, throughput 9.0518K wps
[Epoch 73 Batch 30/62] avg loss 0.00598838, throughput 9.17423K wps
[Epoch 73 Batch 60/62] avg loss 0.00625499, throughput 9.0908K wps
Begin Testing...
[Epoch 73] train avg loss 0.00619441, dev acc 0.8112, dev avg loss 0.403296, throughput 9.15513K wps
[Epoch 74 Batch 30/62] avg loss 0.0062505, throughput 9.33471K wps
[Epoch 74 Batch 60/62] avg loss 0.00606887, throughput 9.10722K wps
Begin Testing...
[Epoch 74] train avg loss 0.00619534, dev acc 0.8171, dev avg loss 0.40074, throughput 9.18371K wps
[Epoch 75 Batch 30/62] avg loss 0.00586628, throughput 9.24571K wps
[Epoch 75 Batch 60/62] avg loss 0.00594895, throughput 9.08136K wps
Begin Testing...
[Epoch 75] train avg loss 0.00599046, dev acc 0.8171, dev avg loss 0.398517, throughput 9.121K wps
[Epoch 76 Batch 30/62] avg loss 0.00583936, throughput 9.00802K wps
[Epoch 76 Batch 60/62] avg loss 0.00631986, throughput 9.12437K wps
Begin Testing...
[Epoch 76] train avg loss 0.00619577, dev acc 0.8230, dev avg loss 0.396623, throughput 9.09552K wps
Observed Improvement.
Begin Testing...
[Epoch 77 Batch 30/62] avg loss 0.00601536, throughput 9.00384K wps
[Epoch 77 Batch 60/62] avg loss 0.00592967, throughput 8.93323K wps
Begin Testing...
[Epoch 77] train avg loss 0.00606426, dev acc 0.8201, dev avg loss 0.395686, throughput 9.02115K wps
[Epoch 78 Batch 30/62] avg loss 0.00589239, throughput 9.11815K wps
[Epoch 78 Batch 60/62] avg loss 0.00613282, throughput 9.1292K wps
Begin Testing...
[Epoch 78] train avg loss 0.00608194, dev acc 0.8201, dev avg loss 0.394859, throughput 9.14196K wps
[Epoch 79 Batch 30/62] avg loss 0.0057249, throughput 8.94467K wps
[Epoch 79 Batch 60/62] avg loss 0.00563503, throughput 8.82182K wps
Begin Testing...
[Epoch 79] train avg loss 0.00581734, dev acc 0.8319, dev avg loss 0.393336, throughput 8.92053K wps
Observed Improvement.
Begin Testing...
[Epoch 80 Batch 30/62] avg loss 0.00597295, throughput 9.0179K wps
[Epoch 80 Batch 60/62] avg loss 0.00557641, throughput 8.99394K wps
Begin Testing...
[Epoch 80] train avg loss 0.00591391, dev acc 0.8201, dev avg loss 0.3941, throughput 9.03191K wps
[Epoch 81 Batch 30/62] avg loss 0.00563552, throughput 8.87695K wps
[Epoch 81 Batch 60/62] avg loss 0.00585717, throughput 9.11402K wps
Begin Testing...
[Epoch 81] train avg loss 0.00582411, dev acc 0.8260, dev avg loss 0.391969, throughput 8.98067K wps
[Epoch 82 Batch 30/62] avg loss 0.00562613, throughput 8.98019K wps
[Epoch 82 Batch 60/62] avg loss 0.00579428, throughput 8.78606K wps
Begin Testing...
[Epoch 82] train avg loss 0.00576237, dev acc 0.8230, dev avg loss 0.391805, throughput 8.91808K wps
[Epoch 83 Batch 30/62] avg loss 0.00551908, throughput 8.78741K wps
[Epoch 83 Batch 60/62] avg loss 0.00561052, throughput 8.8537K wps
Begin Testing...
[Epoch 83] train avg loss 0.00568327, dev acc 0.8171, dev avg loss 0.392295, throughput 8.85783K wps
[Epoch 84 Batch 30/62] avg loss 0.00556881, throughput 8.96956K wps
[Epoch 84 Batch 60/62] avg loss 0.0054024, throughput 9.0575K wps
Begin Testing...
[Epoch 84] train avg loss 0.00555235, dev acc 0.8230, dev avg loss 0.38981, throughput 9.04745K wps
[Epoch 85 Batch 30/62] avg loss 0.00547552, throughput 9.08553K wps
[Epoch 85 Batch 60/62] avg loss 0.00549104, throughput 9.09357K wps
Begin Testing...
[Epoch 85] train avg loss 0.00552734, dev acc 0.8230, dev avg loss 0.389128, throughput 9.1216K wps
[Epoch 86 Batch 30/62] avg loss 0.00533845, throughput 9.24465K wps
[Epoch 86 Batch 60/62] avg loss 0.00547939, throughput 9.16765K wps
Begin Testing...
[Epoch 86] train avg loss 0.00547671, dev acc 0.8230, dev avg loss 0.387709, throughput 9.23687K wps
[Epoch 87 Batch 30/62] avg loss 0.00532206, throughput 8.75209K wps
[Epoch 87 Batch 60/62] avg loss 0.00541401, throughput 8.89703K wps
Begin Testing...
[Epoch 87] train avg loss 0.00548327, dev acc 0.8201, dev avg loss 0.388918, throughput 8.79461K wps
[Epoch 88 Batch 30/62] avg loss 0.00517288, throughput 9.0819K wps
[Epoch 88 Batch 60/62] avg loss 0.00536673, throughput 8.71188K wps
Begin Testing...
[Epoch 88] train avg loss 0.00536632, dev acc 0.8230, dev avg loss 0.387611, throughput 8.87417K wps
[Epoch 89 Batch 30/62] avg loss 0.00532368, throughput 9.22106K wps
[Epoch 89 Batch 60/62] avg loss 0.00516472, throughput 9.02207K wps
Begin Testing...
[Epoch 89] train avg loss 0.00530925, dev acc 0.8171, dev avg loss 0.387537, throughput 9.15053K wps
[Epoch 90 Batch 30/62] avg loss 0.00498961, throughput 8.9302K wps
[Epoch 90 Batch 60/62] avg loss 0.00542963, throughput 8.71902K wps
Begin Testing...
[Epoch 90] train avg loss 0.00530959, dev acc 0.8260, dev avg loss 0.386342, throughput 8.797K wps
[Epoch 91 Batch 30/62] avg loss 0.00517276, throughput 9.06719K wps
[Epoch 91 Batch 60/62] avg loss 0.00507184, throughput 9.16078K wps
Begin Testing...
[Epoch 91] train avg loss 0.00517915, dev acc 0.8201, dev avg loss 0.384786, throughput 9.13058K wps
[Epoch 92 Batch 30/62] avg loss 0.00509004, throughput 9.10845K wps
[Epoch 92 Batch 60/62] avg loss 0.00507086, throughput 9.07746K wps
Begin Testing...
[Epoch 92] train avg loss 0.00518251, dev acc 0.8230, dev avg loss 0.383222, throughput 9.05329K wps
[Epoch 93 Batch 30/62] avg loss 0.00506843, throughput 9.01593K wps
[Epoch 93 Batch 60/62] avg loss 0.00513482, throughput 8.95568K wps
Begin Testing...
[Epoch 93] train avg loss 0.00530464, dev acc 0.8201, dev avg loss 0.382952, throughput 8.95696K wps
[Epoch 94 Batch 30/62] avg loss 0.00506553, throughput 9.04291K wps
[Epoch 94 Batch 60/62] avg loss 0.00493201, throughput 8.83169K wps
Begin Testing...
[Epoch 94] train avg loss 0.00504165, dev acc 0.8171, dev avg loss 0.384336, throughput 8.92407K wps
[Epoch 95 Batch 30/62] avg loss 0.00468898, throughput 9.05367K wps
[Epoch 95 Batch 60/62] avg loss 0.00509721, throughput 8.96889K wps
Begin Testing...
[Epoch 95] train avg loss 0.0049329, dev acc 0.8201, dev avg loss 0.38189, throughput 9.03738K wps
[Epoch 96 Batch 30/62] avg loss 0.00470265, throughput 9.14248K wps
[Epoch 96 Batch 60/62] avg loss 0.00512412, throughput 8.99487K wps
Begin Testing...
[Epoch 96] train avg loss 0.00505007, dev acc 0.8260, dev avg loss 0.382467, throughput 9.0986K wps
[Epoch 97 Batch 30/62] avg loss 0.00481767, throughput 8.97001K wps
[Epoch 97 Batch 60/62] avg loss 0.00461965, throughput 9.13754K wps
Begin Testing...
[Epoch 97] train avg loss 0.00475697, dev acc 0.8230, dev avg loss 0.3807, throughput 9.09167K wps
[Epoch 98 Batch 30/62] avg loss 0.00491282, throughput 9.14905K wps
[Epoch 98 Batch 60/62] avg loss 0.00461038, throughput 9.17474K wps
Begin Testing...
[Epoch 98] train avg loss 0.00484927, dev acc 0.8201, dev avg loss 0.378969, throughput 9.18784K wps
[Epoch 99 Batch 30/62] avg loss 0.00470328, throughput 8.95393K wps
[Epoch 99 Batch 60/62] avg loss 0.00483051, throughput 8.99398K wps
Begin Testing...
[Epoch 99] train avg loss 0.00482643, dev acc 0.8201, dev avg loss 0.379629, throughput 8.96451K wps
[Epoch 100 Batch 30/62] avg loss 0.00460221, throughput 9.11453K wps
[Epoch 100 Batch 60/62] avg loss 0.0046727, throughput 8.97814K wps
Begin Testing...
[Epoch 100] train avg loss 0.00475968, dev acc 0.8289, dev avg loss 0.37781, throughput 9.07653K wps
[Epoch 101 Batch 30/62] avg loss 0.00478284, throughput 9.05094K wps
[Epoch 101 Batch 60/62] avg loss 0.0043209, throughput 9.03321K wps
Begin Testing...
[Epoch 101] train avg loss 0.00464926, dev acc 0.8201, dev avg loss 0.379437, throughput 9.07279K wps
[Epoch 102 Batch 30/62] avg loss 0.00457343, throughput 9.07957K wps
[Epoch 102 Batch 60/62] avg loss 0.0045718, throughput 9.13351K wps
Begin Testing...
[Epoch 102] train avg loss 0.00460747, dev acc 0.8230, dev avg loss 0.3785, throughput 9.09179K wps
[Epoch 103 Batch 30/62] avg loss 0.00449635, throughput 9.12598K wps
[Epoch 103 Batch 60/62] avg loss 0.00472681, throughput 8.7996K wps
Begin Testing...
[Epoch 103] train avg loss 0.00464824, dev acc 0.8201, dev avg loss 0.376182, throughput 8.93857K wps
[Epoch 104 Batch 30/62] avg loss 0.00444067, throughput 9.10298K wps
[Epoch 104 Batch 60/62] avg loss 0.00458001, throughput 8.96926K wps
Begin Testing...
[Epoch 104] train avg loss 0.00460254, dev acc 0.8171, dev avg loss 0.384633, throughput 9.06448K wps
[Epoch 105 Batch 30/62] avg loss 0.00428184, throughput 9.08721K wps
[Epoch 105 Batch 60/62] avg loss 0.00442268, throughput 9.14814K wps
Begin Testing...
[Epoch 105] train avg loss 0.00438872, dev acc 0.8289, dev avg loss 0.374975, throughput 9.14851K wps
[Epoch 106 Batch 30/62] avg loss 0.00429298, throughput 9.2756K wps
[Epoch 106 Batch 60/62] avg loss 0.00448247, throughput 9.02945K wps
Begin Testing...
[Epoch 106] train avg loss 0.0044607, dev acc 0.8230, dev avg loss 0.379271, throughput 9.17751K wps
[Epoch 107 Batch 30/62] avg loss 0.00430285, throughput 9.15423K wps
[Epoch 107 Batch 60/62] avg loss 0.00434393, throughput 8.56859K wps
Begin Testing...
[Epoch 107] train avg loss 0.00432432, dev acc 0.8171, dev avg loss 0.377328, throughput 8.84705K wps
[Epoch 108 Batch 30/62] avg loss 0.00398321, throughput 9.20425K wps
[Epoch 108 Batch 60/62] avg loss 0.00454627, throughput 8.79523K wps
Begin Testing...
[Epoch 108] train avg loss 0.00430064, dev acc 0.8230, dev avg loss 0.373334, throughput 9.04099K wps
[Epoch 109 Batch 30/62] avg loss 0.00427702, throughput 9.03832K wps
[Epoch 109 Batch 60/62] avg loss 0.00417848, throughput 8.90166K wps
Begin Testing...
[Epoch 109] train avg loss 0.00426025, dev acc 0.8201, dev avg loss 0.373841, throughput 8.98055K wps
[Epoch 110 Batch 30/62] avg loss 0.00410663, throughput 8.92366K wps
[Epoch 110 Batch 60/62] avg loss 0.00437486, throughput 9.05592K wps
Begin Testing...
[Epoch 110] train avg loss 0.00424982, dev acc 0.8171, dev avg loss 0.375004, throughput 9.02282K wps
[Epoch 111 Batch 30/62] avg loss 0.00449542, throughput 9.08572K wps
[Epoch 111 Batch 60/62] avg loss 0.0040215, throughput 9.07367K wps
Begin Testing...
[Epoch 111] train avg loss 0.00428823, dev acc 0.8230, dev avg loss 0.377012, throughput 9.10728K wps
[Epoch 112 Batch 30/62] avg loss 0.00417316, throughput 8.91655K wps
[Epoch 112 Batch 60/62] avg loss 0.00407741, throughput 9.17195K wps
Begin Testing...
[Epoch 112] train avg loss 0.00417346, dev acc 0.8201, dev avg loss 0.371806, throughput 9.00305K wps
[Epoch 113 Batch 30/62] avg loss 0.00409862, throughput 9.09368K wps
[Epoch 113 Batch 60/62] avg loss 0.0040392, throughput 9.08045K wps
Begin Testing...
[Epoch 113] train avg loss 0.00407612, dev acc 0.8260, dev avg loss 0.370382, throughput 9.11806K wps
[Epoch 114 Batch 30/62] avg loss 0.0039647, throughput 8.86691K wps
[Epoch 114 Batch 60/62] avg loss 0.0042092, throughput 9.12029K wps
Begin Testing...
[Epoch 114] train avg loss 0.00418522, dev acc 0.8289, dev avg loss 0.370402, throughput 9.0244K wps
[Epoch 115 Batch 30/62] avg loss 0.00397454, throughput 9.16894K wps
[Epoch 115 Batch 60/62] avg loss 0.00398239, throughput 9.12855K wps
Begin Testing...
[Epoch 115] train avg loss 0.00406002, dev acc 0.8289, dev avg loss 0.372177, throughput 9.17714K wps
[Epoch 116 Batch 30/62] avg loss 0.00398754, throughput 8.53301K wps
[Epoch 116 Batch 60/62] avg loss 0.00383631, throughput 9.15627K wps
Begin Testing...
[Epoch 116] train avg loss 0.00392089, dev acc 0.8230, dev avg loss 0.370541, throughput 8.86797K wps
[Epoch 117 Batch 30/62] avg loss 0.00393737, throughput 9.16855K wps
[Epoch 117 Batch 60/62] avg loss 0.00389065, throughput 9.0467K wps
Begin Testing...
[Epoch 117] train avg loss 0.00399561, dev acc 0.8289, dev avg loss 0.368993, throughput 9.06251K wps
[Epoch 118 Batch 30/62] avg loss 0.00403545, throughput 9.00789K wps
[Epoch 118 Batch 60/62] avg loss 0.00389555, throughput 8.8132K wps
Begin Testing...
[Epoch 118] train avg loss 0.00400363, dev acc 0.8230, dev avg loss 0.367797, throughput 8.94025K wps
[Epoch 119 Batch 30/62] avg loss 0.00385862, throughput 9.17827K wps
[Epoch 119 Batch 60/62] avg loss 0.00385715, throughput 9.03647K wps
Begin Testing...
[Epoch 119] train avg loss 0.00390417, dev acc 0.8230, dev avg loss 0.367426, throughput 9.13785K wps
[Epoch 120 Batch 30/62] avg loss 0.00366774, throughput 8.91296K wps
[Epoch 120 Batch 60/62] avg loss 0.00392941, throughput 9.11894K wps
Begin Testing...
[Epoch 120] train avg loss 0.00385084, dev acc 0.8230, dev avg loss 0.367109, throughput 9.04681K wps
[Epoch 121 Batch 30/62] avg loss 0.00377636, throughput 9.27129K wps
[Epoch 121 Batch 60/62] avg loss 0.00379251, throughput 9.04349K wps
Begin Testing...
[Epoch 121] train avg loss 0.00381351, dev acc 0.8201, dev avg loss 0.367185, throughput 9.18159K wps
[Epoch 122 Batch 30/62] avg loss 0.00374042, throughput 9.01088K wps
[Epoch 122 Batch 60/62] avg loss 0.00367734, throughput 8.65531K wps
Begin Testing...
[Epoch 122] train avg loss 0.00374488, dev acc 0.8230, dev avg loss 0.366523, throughput 8.8166K wps
[Epoch 123 Batch 30/62] avg loss 0.00355468, throughput 8.7889K wps
[Epoch 123 Batch 60/62] avg loss 0.00381863, throughput 8.78967K wps
Begin Testing...
[Epoch 123] train avg loss 0.00372565, dev acc 0.8201, dev avg loss 0.367711, throughput 8.84039K wps
[Epoch 124 Batch 30/62] avg loss 0.00363341, throughput 9.12958K wps
[Epoch 124 Batch 60/62] avg loss 0.00352372, throughput 8.85641K wps
Begin Testing...
[Epoch 124] train avg loss 0.00365663, dev acc 0.8260, dev avg loss 0.37065, throughput 9.03467K wps
[Epoch 125 Batch 30/62] avg loss 0.00352759, throughput 8.86468K wps
[Epoch 125 Batch 60/62] avg loss 0.00359748, throughput 9.1475K wps
Begin Testing...
[Epoch 125] train avg loss 0.00364594, dev acc 0.8171, dev avg loss 0.366817, throughput 9.03504K wps
[Epoch 126 Batch 30/62] avg loss 0.00379777, throughput 8.98769K wps
[Epoch 126 Batch 60/62] avg loss 0.00329806, throughput 8.77976K wps
Begin Testing...
[Epoch 126] train avg loss 0.00359877, dev acc 0.8348, dev avg loss 0.365941, throughput 8.85164K wps
Observed Improvement.
Begin Testing...
[Epoch 127 Batch 30/62] avg loss 0.00351589, throughput 9.16902K wps
[Epoch 127 Batch 60/62] avg loss 0.00347891, throughput 9.13293K wps
Begin Testing...
[Epoch 127] train avg loss 0.00358433, dev acc 0.8289, dev avg loss 0.370825, throughput 9.17632K wps
[Epoch 128 Batch 30/62] avg loss 0.0035362, throughput 9.04676K wps
[Epoch 128 Batch 60/62] avg loss 0.00350508, throughput 8.99039K wps
Begin Testing...
[Epoch 128] train avg loss 0.00357042, dev acc 0.8230, dev avg loss 0.36478, throughput 8.98363K wps
[Epoch 129 Batch 30/62] avg loss 0.00340152, throughput 9.16646K wps
[Epoch 129 Batch 60/62] avg loss 0.00347487, throughput 9.12575K wps
Begin Testing...
[Epoch 129] train avg loss 0.00346748, dev acc 0.8348, dev avg loss 0.364757, throughput 9.17113K wps
Observed Improvement.
Begin Testing...
[Epoch 130 Batch 30/62] avg loss 0.00344355, throughput 8.9402K wps
[Epoch 130 Batch 60/62] avg loss 0.00327116, throughput 9.0791K wps
Begin Testing...
[Epoch 130] train avg loss 0.00339303, dev acc 0.8230, dev avg loss 0.365281, throughput 9.03911K wps
[Epoch 131 Batch 30/62] avg loss 0.00333259, throughput 8.79089K wps
[Epoch 131 Batch 60/62] avg loss 0.00348801, throughput 8.93335K wps
Begin Testing...
[Epoch 131] train avg loss 0.00346078, dev acc 0.8319, dev avg loss 0.364459, throughput 8.8472K wps
[Epoch 132 Batch 30/62] avg loss 0.00324689, throughput 9.16261K wps
[Epoch 132 Batch 60/62] avg loss 0.00351931, throughput 9.01985K wps
Begin Testing...
[Epoch 132] train avg loss 0.0034249, dev acc 0.8230, dev avg loss 0.363363, throughput 9.11638K wps
[Epoch 133 Batch 30/62] avg loss 0.00322694, throughput 8.99502K wps
[Epoch 133 Batch 60/62] avg loss 0.00343051, throughput 8.8553K wps
Begin Testing...
[Epoch 133] train avg loss 0.00336583, dev acc 0.8260, dev avg loss 0.367183, throughput 8.8884K wps
[Epoch 134 Batch 30/62] avg loss 0.00310717, throughput 9.27762K wps
[Epoch 134 Batch 60/62] avg loss 0.00331607, throughput 8.92044K wps
Begin Testing...
[Epoch 134] train avg loss 0.00324477, dev acc 0.8201, dev avg loss 0.363443, throughput 9.12463K wps
[Epoch 135 Batch 30/62] avg loss 0.00319094, throughput 9.21296K wps
[Epoch 135 Batch 60/62] avg loss 0.00337262, throughput 8.74584K wps
Begin Testing...
[Epoch 135] train avg loss 0.00333559, dev acc 0.8378, dev avg loss 0.363203, throughput 8.98282K wps
Observed Improvement.
Begin Testing...
[Epoch 136 Batch 30/62] avg loss 0.00319443, throughput 8.8662K wps
[Epoch 136 Batch 60/62] avg loss 0.00327442, throughput 9.01009K wps
Begin Testing...
[Epoch 136] train avg loss 0.00324142, dev acc 0.8319, dev avg loss 0.362026, throughput 8.97203K wps
[Epoch 137 Batch 30/62] avg loss 0.00325275, throughput 9.00815K wps
[Epoch 137 Batch 60/62] avg loss 0.00322704, throughput 9.09768K wps
Begin Testing...
[Epoch 137] train avg loss 0.00334124, dev acc 0.8319, dev avg loss 0.36244, throughput 9.03737K wps
[Epoch 138 Batch 30/62] avg loss 0.00307216, throughput 8.92376K wps
[Epoch 138 Batch 60/62] avg loss 0.00329621, throughput 9.16217K wps
Begin Testing...
[Epoch 138] train avg loss 0.00322126, dev acc 0.8378, dev avg loss 0.362814, throughput 9.07533K wps
Observed Improvement.
Begin Testing...
[Epoch 139 Batch 30/62] avg loss 0.00321586, throughput 9.11683K wps
[Epoch 139 Batch 60/62] avg loss 0.00314451, throughput 8.73077K wps
Begin Testing...
[Epoch 139] train avg loss 0.00317896, dev acc 0.8289, dev avg loss 0.363059, throughput 8.94606K wps
[Epoch 140 Batch 30/62] avg loss 0.0031351, throughput 9.11043K wps
[Epoch 140 Batch 60/62] avg loss 0.00310501, throughput 8.89199K wps
Begin Testing...
[Epoch 140] train avg loss 0.0031663, dev acc 0.8289, dev avg loss 0.366828, throughput 9.03334K wps
[Epoch 141 Batch 30/62] avg loss 0.00315103, throughput 9.04432K wps
[Epoch 141 Batch 60/62] avg loss 0.00300467, throughput 9.16574K wps
Begin Testing...
[Epoch 141] train avg loss 0.00312301, dev acc 0.8319, dev avg loss 0.3599, throughput 9.13468K wps
[Epoch 142 Batch 30/62] avg loss 0.00311135, throughput 9.02377K wps
[Epoch 142 Batch 60/62] avg loss 0.00305566, throughput 9.15793K wps
Begin Testing...
[Epoch 142] train avg loss 0.00313032, dev acc 0.8289, dev avg loss 0.360936, throughput 9.08914K wps
[Epoch 143 Batch 30/62] avg loss 0.00284853, throughput 9.13675K wps
[Epoch 143 Batch 60/62] avg loss 0.00305147, throughput 8.8507K wps
Begin Testing...
[Epoch 143] train avg loss 0.00297683, dev acc 0.8437, dev avg loss 0.360771, throughput 9.04962K wps
Observed Improvement.
Begin Testing...
[Epoch 144 Batch 30/62] avg loss 0.00284303, throughput 8.67647K wps
[Epoch 144 Batch 60/62] avg loss 0.00305421, throughput 8.9412K wps
Begin Testing...
[Epoch 144] train avg loss 0.00303482, dev acc 0.8260, dev avg loss 0.366663, throughput 8.79093K wps
[Epoch 145 Batch 30/62] avg loss 0.00293251, throughput 9.06356K wps
[Epoch 145 Batch 60/62] avg loss 0.00311631, throughput 8.94095K wps
Begin Testing...
[Epoch 145] train avg loss 0.00304164, dev acc 0.8260, dev avg loss 0.366133, throughput 9.03504K wps
[Epoch 146 Batch 30/62] avg loss 0.00297141, throughput 8.97227K wps
[Epoch 146 Batch 60/62] avg loss 0.0028445, throughput 9.1271K wps
Begin Testing...
[Epoch 146] train avg loss 0.00290406, dev acc 0.8289, dev avg loss 0.365379, throughput 9.08135K wps
[Epoch 147 Batch 30/62] avg loss 0.00287221, throughput 8.87925K wps
[Epoch 147 Batch 60/62] avg loss 0.00309087, throughput 9.11887K wps
Begin Testing...
[Epoch 147] train avg loss 0.00300871, dev acc 0.8319, dev avg loss 0.360001, throughput 9.02911K wps
[Epoch 148 Batch 30/62] avg loss 0.0028632, throughput 9.13204K wps
[Epoch 148 Batch 60/62] avg loss 0.00299272, throughput 8.97394K wps
Begin Testing...
[Epoch 148] train avg loss 0.00296359, dev acc 0.8319, dev avg loss 0.359735, throughput 9.08148K wps
[Epoch 149 Batch 30/62] avg loss 0.00274742, throughput 9.16654K wps
[Epoch 149 Batch 60/62] avg loss 0.0028491, throughput 9.13808K wps
Begin Testing...
[Epoch 149] train avg loss 0.002916, dev acc 0.8378, dev avg loss 0.358066, throughput 9.18362K wps
[Epoch 150 Batch 30/62] avg loss 0.00306134, throughput 9.20024K wps
[Epoch 150 Batch 60/62] avg loss 0.00279081, throughput 9.08189K wps
Begin Testing...
[Epoch 150] train avg loss 0.00299079, dev acc 0.8407, dev avg loss 0.35794, throughput 9.11821K wps
[Epoch 151 Batch 30/62] avg loss 0.00279653, throughput 9.19976K wps
[Epoch 151 Batch 60/62] avg loss 0.00276794, throughput 9.13671K wps
Begin Testing...
[Epoch 151] train avg loss 0.00282228, dev acc 0.8407, dev avg loss 0.35796, throughput 9.19681K wps
[Epoch 152 Batch 30/62] avg loss 0.00288302, throughput 9.14428K wps
[Epoch 152 Batch 60/62] avg loss 0.00258913, throughput 8.98123K wps
Begin Testing...
[Epoch 152] train avg loss 0.00274784, dev acc 0.8407, dev avg loss 0.35788, throughput 9.03668K wps
[Epoch 153 Batch 30/62] avg loss 0.00268989, throughput 9.11547K wps
[Epoch 153 Batch 60/62] avg loss 0.0026636, throughput 8.98452K wps
Begin Testing...
[Epoch 153] train avg loss 0.00271897, dev acc 0.8407, dev avg loss 0.357505, throughput 9.02034K wps
[Epoch 154 Batch 30/62] avg loss 0.00267162, throughput 9.12429K wps
[Epoch 154 Batch 60/62] avg loss 0.00279647, throughput 9.08677K wps
Begin Testing...
[Epoch 154] train avg loss 0.0028081, dev acc 0.8378, dev avg loss 0.35757, throughput 9.15372K wps
[Epoch 155 Batch 30/62] avg loss 0.00274563, throughput 9.25844K wps
[Epoch 155 Batch 60/62] avg loss 0.00274589, throughput 8.66836K wps
Begin Testing...
[Epoch 155] train avg loss 0.00277122, dev acc 0.8378, dev avg loss 0.35737, throughput 9.01908K wps
[Epoch 156 Batch 30/62] avg loss 0.00254051, throughput 9.02819K wps
[Epoch 156 Batch 60/62] avg loss 0.00263584, throughput 8.81263K wps
Begin Testing...
[Epoch 156] train avg loss 0.00259257, dev acc 0.8437, dev avg loss 0.357368, throughput 8.89399K wps
Observed Improvement.
Begin Testing...
[Epoch 157 Batch 30/62] avg loss 0.0025297, throughput 9.1795K wps
[Epoch 157 Batch 60/62] avg loss 0.00279867, throughput 8.93924K wps
Begin Testing...
[Epoch 157] train avg loss 0.00269315, dev acc 0.8407, dev avg loss 0.35775, throughput 9.01648K wps
[Epoch 158 Batch 30/62] avg loss 0.00270127, throughput 9.03303K wps
[Epoch 158 Batch 60/62] avg loss 0.00253934, throughput 8.98957K wps
Begin Testing...
[Epoch 158] train avg loss 0.00265364, dev acc 0.8437, dev avg loss 0.357345, throughput 9.04111K wps
Observed Improvement.
Begin Testing...
[Epoch 159 Batch 30/62] avg loss 0.00255667, throughput 9.14686K wps
[Epoch 159 Batch 60/62] avg loss 0.00255022, throughput 8.93639K wps
Begin Testing...
[Epoch 159] train avg loss 0.00262587, dev acc 0.8230, dev avg loss 0.36799, throughput 9.0146K wps
[Epoch 160 Batch 30/62] avg loss 0.00256119, throughput 8.96836K wps
[Epoch 160 Batch 60/62] avg loss 0.00267676, throughput 8.92568K wps
Begin Testing...
[Epoch 160] train avg loss 0.00265214, dev acc 0.8437, dev avg loss 0.356938, throughput 8.99529K wps
Observed Improvement.
Begin Testing...
[Epoch 161 Batch 30/62] avg loss 0.00231812, throughput 8.88415K wps
[Epoch 161 Batch 60/62] avg loss 0.00289911, throughput 9.03356K wps
Begin Testing...
[Epoch 161] train avg loss 0.00261042, dev acc 0.8437, dev avg loss 0.357527, throughput 8.93829K wps
Observed Improvement.
Begin Testing...
[Epoch 162 Batch 30/62] avg loss 0.00248351, throughput 9.15061K wps
[Epoch 162 Batch 60/62] avg loss 0.0024396, throughput 9.04779K wps
Begin Testing...
[Epoch 162] train avg loss 0.00247845, dev acc 0.8437, dev avg loss 0.356587, throughput 9.08475K wps
Observed Improvement.
Begin Testing...
[Epoch 163 Batch 30/62] avg loss 0.00248578, throughput 8.56756K wps
[Epoch 163 Batch 60/62] avg loss 0.00252425, throughput 9.12181K wps
Begin Testing...
[Epoch 163] train avg loss 0.00256848, dev acc 0.8437, dev avg loss 0.356426, throughput 8.87187K wps
Observed Improvement.
Begin Testing...
[Epoch 164 Batch 30/62] avg loss 0.00255899, throughput 8.88317K wps
[Epoch 164 Batch 60/62] avg loss 0.00246095, throughput 8.95308K wps
Begin Testing...
[Epoch 164] train avg loss 0.00251593, dev acc 0.8437, dev avg loss 0.356146, throughput 8.88725K wps
Observed Improvement.
Begin Testing...
[Epoch 165 Batch 30/62] avg loss 0.00240283, throughput 8.88366K wps
[Epoch 165 Batch 60/62] avg loss 0.00253796, throughput 8.67274K wps
Begin Testing...
[Epoch 165] train avg loss 0.00248062, dev acc 0.8407, dev avg loss 0.356416, throughput 8.85274K wps
[Epoch 166 Batch 30/62] avg loss 0.00259297, throughput 9.04916K wps
[Epoch 166 Batch 60/62] avg loss 0.00243627, throughput 9.09705K wps
Begin Testing...
[Epoch 166] train avg loss 0.00253663, dev acc 0.8466, dev avg loss 0.356172, throughput 9.04094K wps
Observed Improvement.
Begin Testing...
[Epoch 167 Batch 30/62] avg loss 0.0024051, throughput 9.26902K wps
[Epoch 167 Batch 60/62] avg loss 0.00236763, throughput 8.94273K wps
Begin Testing...
[Epoch 167] train avg loss 0.00240236, dev acc 0.8407, dev avg loss 0.357214, throughput 9.07319K wps
[Epoch 168 Batch 30/62] avg loss 0.00228046, throughput 8.95384K wps
[Epoch 168 Batch 60/62] avg loss 0.00245275, throughput 8.97232K wps
Begin Testing...
[Epoch 168] train avg loss 0.00239, dev acc 0.8260, dev avg loss 0.358801, throughput 8.93015K wps
[Epoch 169 Batch 30/62] avg loss 0.00245573, throughput 8.98082K wps
[Epoch 169 Batch 60/62] avg loss 0.00225297, throughput 9.08699K wps
Begin Testing...
[Epoch 169] train avg loss 0.00240356, dev acc 0.8407, dev avg loss 0.357245, throughput 9.0642K wps
[Epoch 170 Batch 30/62] avg loss 0.00230978, throughput 8.75351K wps
[Epoch 170 Batch 60/62] avg loss 0.00244468, throughput 9.00685K wps
Begin Testing...
[Epoch 170] train avg loss 0.00238696, dev acc 0.8289, dev avg loss 0.360083, throughput 8.89855K wps
[Epoch 171 Batch 30/62] avg loss 0.00236092, throughput 8.90395K wps
[Epoch 171 Batch 60/62] avg loss 0.00230441, throughput 9.09018K wps
Begin Testing...
[Epoch 171] train avg loss 0.00235465, dev acc 0.8437, dev avg loss 0.355711, throughput 9.03291K wps
[Epoch 172 Batch 30/62] avg loss 0.00222653, throughput 9.0758K wps
[Epoch 172 Batch 60/62] avg loss 0.00235444, throughput 9.16647K wps
Begin Testing...
[Epoch 172] train avg loss 0.00231354, dev acc 0.8437, dev avg loss 0.356051, throughput 9.14901K wps
[Epoch 173 Batch 30/62] avg loss 0.00235332, throughput 8.87722K wps
[Epoch 173 Batch 60/62] avg loss 0.00239247, throughput 9.14653K wps
Begin Testing...
[Epoch 173] train avg loss 0.00239383, dev acc 0.8555, dev avg loss 0.354686, throughput 9.04457K wps
Observed Improvement.
Begin Testing...
[Epoch 174 Batch 30/62] avg loss 0.00229196, throughput 9.07497K wps
[Epoch 174 Batch 60/62] avg loss 0.00226135, throughput 8.98507K wps
Begin Testing...
[Epoch 174] train avg loss 0.00232145, dev acc 0.8466, dev avg loss 0.354252, throughput 9.0605K wps
[Epoch 175 Batch 30/62] avg loss 0.00219291, throughput 8.89103K wps
[Epoch 175 Batch 60/62] avg loss 0.00214529, throughput 9.13176K wps
Begin Testing...
[Epoch 175] train avg loss 0.00222419, dev acc 0.8466, dev avg loss 0.353754, throughput 9.03731K wps
[Epoch 176 Batch 30/62] avg loss 0.00211508, throughput 9.14958K wps
[Epoch 176 Batch 60/62] avg loss 0.00223637, throughput 9.03151K wps
Begin Testing...
[Epoch 176] train avg loss 0.00223663, dev acc 0.8496, dev avg loss 0.353721, throughput 9.06198K wps
[Epoch 177 Batch 30/62] avg loss 0.00210169, throughput 9.09633K wps
[Epoch 177 Batch 60/62] avg loss 0.00232394, throughput 9.07461K wps
Begin Testing...
[Epoch 177] train avg loss 0.00222194, dev acc 0.8555, dev avg loss 0.353441, throughput 9.03757K wps
Observed Improvement.
Begin Testing...
[Epoch 178 Batch 30/62] avg loss 0.00217089, throughput 8.92486K wps
[Epoch 178 Batch 60/62] avg loss 0.00218444, throughput 8.88706K wps
Begin Testing...
[Epoch 178] train avg loss 0.00220762, dev acc 0.8496, dev avg loss 0.353275, throughput 8.94339K wps
[Epoch 179 Batch 30/62] avg loss 0.00222091, throughput 8.95781K wps
[Epoch 179 Batch 60/62] avg loss 0.00210182, throughput 8.85167K wps
Begin Testing...
[Epoch 179] train avg loss 0.00218877, dev acc 0.8555, dev avg loss 0.353533, throughput 8.91971K wps
Observed Improvement.
Begin Testing...
[Epoch 180 Batch 30/62] avg loss 0.00221697, throughput 9.10302K wps
[Epoch 180 Batch 60/62] avg loss 0.00221442, throughput 8.99014K wps
Begin Testing...
[Epoch 180] train avg loss 0.00222765, dev acc 0.8496, dev avg loss 0.35335, throughput 9.00995K wps
[Epoch 181 Batch 30/62] avg loss 0.00221004, throughput 9.06592K wps
[Epoch 181 Batch 60/62] avg loss 0.00203859, throughput 9.06583K wps
Begin Testing...
[Epoch 181] train avg loss 0.00212588, dev acc 0.8437, dev avg loss 0.353795, throughput 9.04519K wps
[Epoch 182 Batch 30/62] avg loss 0.0021667, throughput 9.2268K wps
[Epoch 182 Batch 60/62] avg loss 0.00206106, throughput 8.97278K wps
Begin Testing...
[Epoch 182] train avg loss 0.00212721, dev acc 0.8496, dev avg loss 0.352944, throughput 9.13197K wps
[Epoch 183 Batch 30/62] avg loss 0.00211447, throughput 9.25049K wps
[Epoch 183 Batch 60/62] avg loss 0.00206051, throughput 9.15181K wps
Begin Testing...
[Epoch 183] train avg loss 0.00209405, dev acc 0.8525, dev avg loss 0.353201, throughput 9.22715K wps
[Epoch 184 Batch 30/62] avg loss 0.00217937, throughput 9.26676K wps
[Epoch 184 Batch 60/62] avg loss 0.00197079, throughput 9.13151K wps
Begin Testing...
[Epoch 184] train avg loss 0.00207954, dev acc 0.8525, dev avg loss 0.353839, throughput 9.22776K wps
[Epoch 185 Batch 30/62] avg loss 0.00207845, throughput 9.18411K wps
[Epoch 185 Batch 60/62] avg loss 0.00201802, throughput 9.0971K wps
Begin Testing...
[Epoch 185] train avg loss 0.00207692, dev acc 0.8525, dev avg loss 0.353252, throughput 9.16693K wps
[Epoch 186 Batch 30/62] avg loss 0.00189036, throughput 9.12336K wps
[Epoch 186 Batch 60/62] avg loss 0.00209977, throughput 9.04119K wps
Begin Testing...
[Epoch 186] train avg loss 0.00205708, dev acc 0.8378, dev avg loss 0.355221, throughput 9.11222K wps
[Epoch 187 Batch 30/62] avg loss 0.00210784, throughput 9.26342K wps
[Epoch 187 Batch 60/62] avg loss 0.00211261, throughput 8.97274K wps
Begin Testing...
[Epoch 187] train avg loss 0.00214063, dev acc 0.8525, dev avg loss 0.352962, throughput 9.10222K wps
[Epoch 188 Batch 30/62] avg loss 0.00199734, throughput 9.0836K wps
[Epoch 188 Batch 60/62] avg loss 0.00196379, throughput 8.69155K wps
Begin Testing...
[Epoch 188] train avg loss 0.00200876, dev acc 0.8407, dev avg loss 0.354908, throughput 8.85806K wps
[Epoch 189 Batch 30/62] avg loss 0.00208887, throughput 9.08049K wps
[Epoch 189 Batch 60/62] avg loss 0.00200561, throughput 8.97802K wps
Begin Testing...
[Epoch 189] train avg loss 0.00205964, dev acc 0.8407, dev avg loss 0.353798, throughput 9.05986K wps
[Epoch 190 Batch 30/62] avg loss 0.00214441, throughput 8.8863K wps
[Epoch 190 Batch 60/62] avg loss 0.00191454, throughput 8.97085K wps
Begin Testing...
[Epoch 190] train avg loss 0.00203598, dev acc 0.8319, dev avg loss 0.35531, throughput 8.91217K wps
[Epoch 191 Batch 30/62] avg loss 0.00207363, throughput 8.89491K wps
[Epoch 191 Batch 60/62] avg loss 0.00195585, throughput 8.97826K wps
Begin Testing...
[Epoch 191] train avg loss 0.00204406, dev acc 0.8289, dev avg loss 0.355224, throughput 8.92193K wps
[Epoch 192 Batch 30/62] avg loss 0.00193029, throughput 9.12726K wps
[Epoch 192 Batch 60/62] avg loss 0.00197867, throughput 8.94557K wps
Begin Testing...
[Epoch 192] train avg loss 0.00198079, dev acc 0.8555, dev avg loss 0.35209, throughput 9.02096K wps
Observed Improvement.
Begin Testing...
[Epoch 193 Batch 30/62] avg loss 0.00178731, throughput 9.07498K wps
[Epoch 193 Batch 60/62] avg loss 0.00198315, throughput 8.81014K wps
Begin Testing...
[Epoch 193] train avg loss 0.00191493, dev acc 0.8466, dev avg loss 0.353871, throughput 8.92697K wps
[Epoch 194 Batch 30/62] avg loss 0.00193875, throughput 8.76267K wps
[Epoch 194 Batch 60/62] avg loss 0.00195955, throughput 9.14153K wps
Begin Testing...
[Epoch 194] train avg loss 0.00196019, dev acc 0.8555, dev avg loss 0.352909, throughput 8.98037K wps
Observed Improvement.
Begin Testing...
[Epoch 195 Batch 30/62] avg loss 0.00187083, throughput 9.20857K wps
[Epoch 195 Batch 60/62] avg loss 0.00190843, throughput 8.86313K wps
Begin Testing...
[Epoch 195] train avg loss 0.00193962, dev acc 0.8142, dev avg loss 0.372349, throughput 9.08554K wps
[Epoch 196 Batch 30/62] avg loss 0.00189224, throughput 9.09757K wps
[Epoch 196 Batch 60/62] avg loss 0.00196454, throughput 9.02992K wps
Begin Testing...
[Epoch 196] train avg loss 0.00194079, dev acc 0.8555, dev avg loss 0.352464, throughput 9.09549K wps
Observed Improvement.
Begin Testing...
[Epoch 197 Batch 30/62] avg loss 0.00193088, throughput 8.93652K wps
[Epoch 197 Batch 60/62] avg loss 0.00188076, throughput 9.08312K wps
Begin Testing...
[Epoch 197] train avg loss 0.0019297, dev acc 0.8466, dev avg loss 0.352339, throughput 9.03773K wps
[Epoch 198 Batch 30/62] avg loss 0.00183728, throughput 9.03781K wps
[Epoch 198 Batch 60/62] avg loss 0.00186751, throughput 8.63251K wps
Begin Testing...
[Epoch 198] train avg loss 0.00189116, dev acc 0.8555, dev avg loss 0.352064, throughput 8.80755K wps
Observed Improvement.
Begin Testing...
[Epoch 199 Batch 30/62] avg loss 0.00169654, throughput 9.18936K wps
[Epoch 199 Batch 60/62] avg loss 0.0018293, throughput 9.12589K wps
Begin Testing...
[Epoch 199] train avg loss 0.00178646, dev acc 0.8525, dev avg loss 0.352391, throughput 9.1854K wps
Test loss 0.352538, test acc 0.8302
Total time cost 155.53s
[Epoch 0 Batch 30/62] avg loss 0.0134267, throughput 8.49625K wps
[Epoch 0 Batch 60/62] avg loss 0.0130099, throughput 9.10886K wps
Begin Testing...
[Epoch 0] train avg loss 0.0134135, dev acc 0.6578, dev avg loss 0.637954, throughput 8.83152K wps
Observed Improvement.
Begin Testing...
[Epoch 1 Batch 30/62] avg loss 0.0130752, throughput 9.07468K wps
[Epoch 1 Batch 60/62] avg loss 0.0129899, throughput 9.05112K wps
Begin Testing...
[Epoch 1] train avg loss 0.0132076, dev acc 0.6578, dev avg loss 0.634356, throughput 9.09389K wps
Observed Improvement.
Begin Testing...
[Epoch 2 Batch 30/62] avg loss 0.0131668, throughput 9.22894K wps
[Epoch 2 Batch 60/62] avg loss 0.0127779, throughput 9.00602K wps
Begin Testing...
[Epoch 2] train avg loss 0.01315, dev acc 0.6578, dev avg loss 0.630443, throughput 9.14355K wps
Observed Improvement.
Begin Testing...
[Epoch 3 Batch 30/62] avg loss 0.0130087, throughput 8.94731K wps
[Epoch 3 Batch 60/62] avg loss 0.0127009, throughput 8.88535K wps
Begin Testing...
[Epoch 3] train avg loss 0.0130346, dev acc 0.6578, dev avg loss 0.625548, throughput 8.88375K wps
Observed Improvement.
Begin Testing...
[Epoch 4 Batch 30/62] avg loss 0.0126184, throughput 9.10941K wps
[Epoch 4 Batch 60/62] avg loss 0.0128797, throughput 8.88483K wps
Begin Testing...
[Epoch 4] train avg loss 0.0129001, dev acc 0.6578, dev avg loss 0.622195, throughput 8.96221K wps
Observed Improvement.
Begin Testing...
[Epoch 5 Batch 30/62] avg loss 0.0127439, throughput 8.88012K wps
[Epoch 5 Batch 60/62] avg loss 0.0124663, throughput 9.12163K wps
Begin Testing...
[Epoch 5] train avg loss 0.0128541, dev acc 0.6578, dev avg loss 0.619754, throughput 9.03076K wps
Observed Improvement.
Begin Testing...
[Epoch 6 Batch 30/62] avg loss 0.0125428, throughput 8.94355K wps
[Epoch 6 Batch 60/62] avg loss 0.0126097, throughput 8.83533K wps
Begin Testing...
[Epoch 6] train avg loss 0.0127305, dev acc 0.6578, dev avg loss 0.614604, throughput 8.90417K wps
Observed Improvement.
Begin Testing...
[Epoch 7 Batch 30/62] avg loss 0.0123205, throughput 9.0289K wps
[Epoch 7 Batch 60/62] avg loss 0.0125078, throughput 8.94396K wps
Begin Testing...
[Epoch 7] train avg loss 0.0125996, dev acc 0.6578, dev avg loss 0.61054, throughput 9.01891K wps
Observed Improvement.
Begin Testing...
[Epoch 8 Batch 30/62] avg loss 0.0122988, throughput 8.95663K wps
[Epoch 8 Batch 60/62] avg loss 0.012595, throughput 9.17493K wps
Begin Testing...
[Epoch 8] train avg loss 0.0125788, dev acc 0.6578, dev avg loss 0.60563, throughput 9.09356K wps
Observed Improvement.
Begin Testing...
[Epoch 9 Batch 30/62] avg loss 0.0122483, throughput 9.16241K wps
[Epoch 9 Batch 60/62] avg loss 0.0122308, throughput 8.76912K wps
Begin Testing...
[Epoch 9] train avg loss 0.0123937, dev acc 0.6578, dev avg loss 0.601684, throughput 8.93192K wps
Observed Improvement.
Begin Testing...
[Epoch 10 Batch 30/62] avg loss 0.012111, throughput 8.80007K wps
[Epoch 10 Batch 60/62] avg loss 0.0121278, throughput 8.94568K wps
Begin Testing...
[Epoch 10] train avg loss 0.0122642, dev acc 0.6578, dev avg loss 0.596837, throughput 8.84752K wps
Observed Improvement.
Begin Testing...
[Epoch 11 Batch 30/62] avg loss 0.0120547, throughput 9.0285K wps
[Epoch 11 Batch 60/62] avg loss 0.0120285, throughput 9.07456K wps
Begin Testing...
[Epoch 11] train avg loss 0.0122202, dev acc 0.6578, dev avg loss 0.592672, throughput 9.06253K wps
Observed Improvement.
Begin Testing...
[Epoch 12 Batch 30/62] avg loss 0.0119965, throughput 9.027K wps
[Epoch 12 Batch 60/62] avg loss 0.0119875, throughput 8.93955K wps
Begin Testing...
[Epoch 12] train avg loss 0.0121458, dev acc 0.6608, dev avg loss 0.588809, throughput 9.01378K wps
Observed Improvement.
Begin Testing...
[Epoch 13 Batch 30/62] avg loss 0.0118589, throughput 8.96596K wps
[Epoch 13 Batch 60/62] avg loss 0.0117892, throughput 8.96235K wps
Begin Testing...
[Epoch 13] train avg loss 0.0119959, dev acc 0.6608, dev avg loss 0.584312, throughput 8.99483K wps
Observed Improvement.
Begin Testing...
[Epoch 14 Batch 30/62] avg loss 0.011705, throughput 8.99183K wps
[Epoch 14 Batch 60/62] avg loss 0.0117677, throughput 8.92761K wps
Begin Testing...
[Epoch 14] train avg loss 0.0118684, dev acc 0.6578, dev avg loss 0.578991, throughput 8.99041K wps
[Epoch 15 Batch 30/62] avg loss 0.0116297, throughput 8.95437K wps
[Epoch 15 Batch 60/62] avg loss 0.0116021, throughput 9.10175K wps
Begin Testing...
[Epoch 15] train avg loss 0.0118092, dev acc 0.6726, dev avg loss 0.575795, throughput 9.02245K wps
Observed Improvement.
Begin Testing...
[Epoch 16 Batch 30/62] avg loss 0.0114291, throughput 9.09345K wps
[Epoch 16 Batch 60/62] avg loss 0.0116589, throughput 8.95427K wps
Begin Testing...
[Epoch 16] train avg loss 0.0116715, dev acc 0.6696, dev avg loss 0.569712, throughput 9.05138K wps
[Epoch 17 Batch 30/62] avg loss 0.0114889, throughput 9.07872K wps
[Epoch 17 Batch 60/62] avg loss 0.0113589, throughput 9.06701K wps
Begin Testing...
[Epoch 17] train avg loss 0.011581, dev acc 0.6667, dev avg loss 0.564298, throughput 9.10504K wps
[Epoch 18 Batch 30/62] avg loss 0.0113096, throughput 8.85613K wps
[Epoch 18 Batch 60/62] avg loss 0.0110824, throughput 8.9174K wps
Begin Testing...
[Epoch 18] train avg loss 0.0113504, dev acc 0.7345, dev avg loss 0.563814, throughput 8.86724K wps
Observed Improvement.
Begin Testing...
[Epoch 19 Batch 30/62] avg loss 0.0113291, throughput 9.00755K wps
[Epoch 19 Batch 60/62] avg loss 0.0110364, throughput 9.08378K wps
Begin Testing...
[Epoch 19] train avg loss 0.0113139, dev acc 0.6932, dev avg loss 0.55433, throughput 9.07574K wps
[Epoch 20 Batch 30/62] avg loss 0.0110013, throughput 9.0335K wps
[Epoch 20 Batch 60/62] avg loss 0.0110562, throughput 8.91312K wps
Begin Testing...
[Epoch 20] train avg loss 0.0111422, dev acc 0.6903, dev avg loss 0.54896, throughput 8.93529K wps
[Epoch 21 Batch 30/62] avg loss 0.0109371, throughput 8.9747K wps
[Epoch 21 Batch 60/62] avg loss 0.0108161, throughput 8.99352K wps
Begin Testing...
[Epoch 21] train avg loss 0.0109751, dev acc 0.7109, dev avg loss 0.543767, throughput 8.96891K wps
[Epoch 22 Batch 30/62] avg loss 0.0107258, throughput 9.14814K wps
[Epoch 22 Batch 60/62] avg loss 0.0107302, throughput 8.98485K wps
Begin Testing...
[Epoch 22] train avg loss 0.010866, dev acc 0.7227, dev avg loss 0.538718, throughput 9.09199K wps
[Epoch 23 Batch 30/62] avg loss 0.010795, throughput 9.06266K wps
[Epoch 23 Batch 60/62] avg loss 0.010654, throughput 9.10771K wps
Begin Testing...
[Epoch 23] train avg loss 0.0107945, dev acc 0.7050, dev avg loss 0.533386, throughput 9.09826K wps
[Epoch 24 Batch 30/62] avg loss 0.0104751, throughput 8.98614K wps
[Epoch 24 Batch 60/62] avg loss 0.0104443, throughput 9.133K wps
Begin Testing...
[Epoch 24] train avg loss 0.0106427, dev acc 0.7522, dev avg loss 0.52965, throughput 9.04267K wps
Observed Improvement.
Begin Testing...
[Epoch 25 Batch 30/62] avg loss 0.0104825, throughput 8.78555K wps
[Epoch 25 Batch 60/62] avg loss 0.0102521, throughput 8.70367K wps
Begin Testing...
[Epoch 25] train avg loss 0.0105087, dev acc 0.7670, dev avg loss 0.524805, throughput 8.79363K wps
Observed Improvement.
Begin Testing...
[Epoch 26 Batch 30/62] avg loss 0.0102572, throughput 9.28679K wps
[Epoch 26 Batch 60/62] avg loss 0.0101626, throughput 9.1151K wps
Begin Testing...
[Epoch 26] train avg loss 0.0103683, dev acc 0.7522, dev avg loss 0.518795, throughput 9.22683K wps
[Epoch 27 Batch 30/62] avg loss 0.0102428, throughput 9.13579K wps
[Epoch 27 Batch 60/62] avg loss 0.0100377, throughput 9.10576K wps
Begin Testing...
[Epoch 27] train avg loss 0.0102525, dev acc 0.7434, dev avg loss 0.513442, throughput 9.14599K wps
[Epoch 28 Batch 30/62] avg loss 0.0100343, throughput 9.19017K wps
[Epoch 28 Batch 60/62] avg loss 0.0100292, throughput 9.05877K wps
Begin Testing...
[Epoch 28] train avg loss 0.0101936, dev acc 0.7640, dev avg loss 0.509104, throughput 9.15344K wps
[Epoch 29 Batch 30/62] avg loss 0.0097866, throughput 8.97744K wps
[Epoch 29 Batch 60/62] avg loss 0.00998984, throughput 9.00713K wps
Begin Testing...
[Epoch 29] train avg loss 0.00998685, dev acc 0.7670, dev avg loss 0.504415, throughput 8.97404K wps
Observed Improvement.
Begin Testing...
[Epoch 30 Batch 30/62] avg loss 0.00972612, throughput 9.11004K wps
[Epoch 30 Batch 60/62] avg loss 0.00977816, throughput 9.11115K wps
Begin Testing...
[Epoch 30] train avg loss 0.0098562, dev acc 0.7876, dev avg loss 0.500229, throughput 9.09727K wps
Observed Improvement.
Begin Testing...
[Epoch 31 Batch 30/62] avg loss 0.00975579, throughput 9.29138K wps
[Epoch 31 Batch 60/62] avg loss 0.00943392, throughput 8.8511K wps
Begin Testing...
[Epoch 31] train avg loss 0.00967066, dev acc 0.7994, dev avg loss 0.497216, throughput 9.0466K wps
Observed Improvement.
Begin Testing...
[Epoch 32 Batch 30/62] avg loss 0.00950955, throughput 8.88238K wps
[Epoch 32 Batch 60/62] avg loss 0.0094535, throughput 9.16808K wps
Begin Testing...
[Epoch 32] train avg loss 0.00959946, dev acc 0.7463, dev avg loss 0.492522, throughput 9.05056K wps
[Epoch 33 Batch 30/62] avg loss 0.00933424, throughput 9.02189K wps
[Epoch 33 Batch 60/62] avg loss 0.00922912, throughput 9.03636K wps
Begin Testing...
[Epoch 33] train avg loss 0.00937996, dev acc 0.7758, dev avg loss 0.487127, throughput 9.0589K wps
[Epoch 34 Batch 30/62] avg loss 0.00928157, throughput 8.88507K wps
[Epoch 34 Batch 60/62] avg loss 0.00935326, throughput 8.66335K wps
Begin Testing...
[Epoch 34] train avg loss 0.00940299, dev acc 0.7876, dev avg loss 0.483182, throughput 8.8382K wps
[Epoch 35 Batch 30/62] avg loss 0.00925579, throughput 9.24109K wps
[Epoch 35 Batch 60/62] avg loss 0.00926954, throughput 9.00748K wps
Begin Testing...
[Epoch 35] train avg loss 0.00939184, dev acc 0.7935, dev avg loss 0.47963, throughput 9.15914K wps
[Epoch 36 Batch 30/62] avg loss 0.00905709, throughput 9.0767K wps
[Epoch 36 Batch 60/62] avg loss 0.00899933, throughput 9.10519K wps
Begin Testing...
[Epoch 36] train avg loss 0.00913058, dev acc 0.8083, dev avg loss 0.476482, throughput 9.12083K wps
Observed Improvement.
Begin Testing...
[Epoch 37 Batch 30/62] avg loss 0.00892778, throughput 9.19292K wps
[Epoch 37 Batch 60/62] avg loss 0.00898688, throughput 8.65686K wps
Begin Testing...
[Epoch 37] train avg loss 0.00910665, dev acc 0.8083, dev avg loss 0.479109, throughput 8.91761K wps
Observed Improvement.
Begin Testing...
[Epoch 38 Batch 30/62] avg loss 0.00904295, throughput 8.79786K wps
[Epoch 38 Batch 60/62] avg loss 0.00876799, throughput 8.59508K wps
Begin Testing...
[Epoch 38] train avg loss 0.00903849, dev acc 0.8112, dev avg loss 0.47017, throughput 8.69263K wps
Observed Improvement.
Begin Testing...
[Epoch 39 Batch 30/62] avg loss 0.00859666, throughput 9.1932K wps
[Epoch 39 Batch 60/62] avg loss 0.00884438, throughput 9.01778K wps
Begin Testing...
[Epoch 39] train avg loss 0.00880798, dev acc 0.8024, dev avg loss 0.466165, throughput 9.13498K wps
[Epoch 40 Batch 30/62] avg loss 0.00848399, throughput 9.10193K wps
[Epoch 40 Batch 60/62] avg loss 0.00881425, throughput 8.99221K wps
Begin Testing...
[Epoch 40] train avg loss 0.00873888, dev acc 0.8024, dev avg loss 0.462919, throughput 9.08224K wps
[Epoch 41 Batch 30/62] avg loss 0.00878866, throughput 9.13406K wps
[Epoch 41 Batch 60/62] avg loss 0.00830699, throughput 9.08628K wps
Begin Testing...
[Epoch 41] train avg loss 0.00867226, dev acc 0.8142, dev avg loss 0.45978, throughput 9.13777K wps
Observed Improvement.
Begin Testing...
[Epoch 42 Batch 30/62] avg loss 0.00855816, throughput 8.87938K wps
[Epoch 42 Batch 60/62] avg loss 0.00839088, throughput 9.12636K wps
Begin Testing...
[Epoch 42] train avg loss 0.00860505, dev acc 0.8142, dev avg loss 0.456791, throughput 9.03133K wps
Observed Improvement.
Begin Testing...
[Epoch 43 Batch 30/62] avg loss 0.00852409, throughput 8.96887K wps
[Epoch 43 Batch 60/62] avg loss 0.00830311, throughput 9.09017K wps
Begin Testing...
[Epoch 43] train avg loss 0.00850778, dev acc 0.8053, dev avg loss 0.454069, throughput 9.05907K wps
[Epoch 44 Batch 30/62] avg loss 0.00804692, throughput 9.21588K wps
[Epoch 44 Batch 60/62] avg loss 0.00856706, throughput 8.73957K wps
Begin Testing...
[Epoch 44] train avg loss 0.00838284, dev acc 0.7817, dev avg loss 0.454157, throughput 8.95212K wps
[Epoch 45 Batch 30/62] avg loss 0.00823652, throughput 8.88438K wps
[Epoch 45 Batch 60/62] avg loss 0.00834598, throughput 8.76144K wps
Begin Testing...
[Epoch 45] train avg loss 0.00839875, dev acc 0.8083, dev avg loss 0.448724, throughput 8.81162K wps
[Epoch 46 Batch 30/62] avg loss 0.00804635, throughput 9.14251K wps
[Epoch 46 Batch 60/62] avg loss 0.00815168, throughput 8.98353K wps
Begin Testing...
[Epoch 46] train avg loss 0.00813858, dev acc 0.8083, dev avg loss 0.446344, throughput 9.038K wps
[Epoch 47 Batch 30/62] avg loss 0.00812912, throughput 9.19399K wps
[Epoch 47 Batch 60/62] avg loss 0.00790683, throughput 9.0708K wps
Begin Testing...
[Epoch 47] train avg loss 0.00811673, dev acc 0.8112, dev avg loss 0.443817, throughput 9.15703K wps
[Epoch 48 Batch 30/62] avg loss 0.00797974, throughput 9.20413K wps
[Epoch 48 Batch 60/62] avg loss 0.00764916, throughput 8.7954K wps
Begin Testing...
[Epoch 48] train avg loss 0.00787506, dev acc 0.8142, dev avg loss 0.442526, throughput 9.01665K wps
Observed Improvement.
Begin Testing...
[Epoch 49 Batch 30/62] avg loss 0.00800404, throughput 9.18047K wps
[Epoch 49 Batch 60/62] avg loss 0.00764901, throughput 8.94365K wps
Begin Testing...
[Epoch 49] train avg loss 0.00789885, dev acc 0.8230, dev avg loss 0.440001, throughput 9.09267K wps
Observed Improvement.
Begin Testing...
[Epoch 50 Batch 30/62] avg loss 0.00803121, throughput 8.91596K wps
[Epoch 50 Batch 60/62] avg loss 0.00760389, throughput 8.66713K wps
Begin Testing...
[Epoch 50] train avg loss 0.00791688, dev acc 0.8201, dev avg loss 0.43765, throughput 8.80733K wps
[Epoch 51 Batch 30/62] avg loss 0.00784869, throughput 9.08192K wps
[Epoch 51 Batch 60/62] avg loss 0.00753502, throughput 8.99968K wps
Begin Testing...
[Epoch 51] train avg loss 0.0077728, dev acc 0.8142, dev avg loss 0.435193, throughput 9.00989K wps
[Epoch 52 Batch 30/62] avg loss 0.00750413, throughput 9.18937K wps
[Epoch 52 Batch 60/62] avg loss 0.00760569, throughput 8.88545K wps
Begin Testing...
[Epoch 52] train avg loss 0.00760475, dev acc 0.8319, dev avg loss 0.434386, throughput 9.06515K wps
Observed Improvement.
Begin Testing...
[Epoch 53 Batch 30/62] avg loss 0.00776582, throughput 9.04588K wps
[Epoch 53 Batch 60/62] avg loss 0.00733594, throughput 8.96956K wps
Begin Testing...
[Epoch 53] train avg loss 0.0076354, dev acc 0.8142, dev avg loss 0.432018, throughput 9.04012K wps
[Epoch 54 Batch 30/62] avg loss 0.00742495, throughput 9.00624K wps
[Epoch 54 Batch 60/62] avg loss 0.00746771, throughput 8.67469K wps
Begin Testing...
[Epoch 54] train avg loss 0.00753942, dev acc 0.8171, dev avg loss 0.429991, throughput 8.83619K wps
[Epoch 55 Batch 30/62] avg loss 0.00715585, throughput 9.05542K wps
[Epoch 55 Batch 60/62] avg loss 0.00734241, throughput 9.12742K wps
Begin Testing...
[Epoch 55] train avg loss 0.00734785, dev acc 0.8378, dev avg loss 0.429579, throughput 9.1227K wps
Observed Improvement.
Begin Testing...
[Epoch 56 Batch 30/62] avg loss 0.00730797, throughput 9.10886K wps
[Epoch 56 Batch 60/62] avg loss 0.00739085, throughput 9.18195K wps
Begin Testing...
[Epoch 56] train avg loss 0.00742754, dev acc 0.8201, dev avg loss 0.425445, throughput 9.17365K wps
[Epoch 57 Batch 30/62] avg loss 0.0071079, throughput 9.12448K wps
[Epoch 57 Batch 60/62] avg loss 0.00720712, throughput 9.10896K wps
Begin Testing...
[Epoch 57] train avg loss 0.00721379, dev acc 0.8201, dev avg loss 0.423636, throughput 9.14608K wps
[Epoch 58 Batch 30/62] avg loss 0.00697587, throughput 8.33148K wps
[Epoch 58 Batch 60/62] avg loss 0.00718073, throughput 9.04501K wps
Begin Testing...
[Epoch 58] train avg loss 0.00715177, dev acc 0.8201, dev avg loss 0.422124, throughput 8.70621K wps
[Epoch 59 Batch 30/62] avg loss 0.00709635, throughput 8.92019K wps
[Epoch 59 Batch 60/62] avg loss 0.00690122, throughput 9.15146K wps
Begin Testing...
[Epoch 59] train avg loss 0.00705902, dev acc 0.8201, dev avg loss 0.420443, throughput 9.06118K wps
[Epoch 60 Batch 30/62] avg loss 0.0070565, throughput 9.18302K wps
[Epoch 60 Batch 60/62] avg loss 0.00677278, throughput 8.94429K wps
Begin Testing...
[Epoch 60] train avg loss 0.00701495, dev acc 0.8348, dev avg loss 0.419573, throughput 9.03494K wps
[Epoch 61 Batch 30/62] avg loss 0.00708427, throughput 9.12676K wps
[Epoch 61 Batch 60/62] avg loss 0.00670657, throughput 8.83407K wps
Begin Testing...
[Epoch 61] train avg loss 0.00694841, dev acc 0.8319, dev avg loss 0.417148, throughput 9.00648K wps
[Epoch 62 Batch 30/62] avg loss 0.00669118, throughput 8.96124K wps
[Epoch 62 Batch 60/62] avg loss 0.00691144, throughput 8.99116K wps
Begin Testing...
[Epoch 62] train avg loss 0.00689682, dev acc 0.8201, dev avg loss 0.416014, throughput 9.0044K wps
[Epoch 63 Batch 30/62] avg loss 0.00658337, throughput 8.98856K wps
[Epoch 63 Batch 60/62] avg loss 0.00669687, throughput 8.9816K wps
Begin Testing...
[Epoch 63] train avg loss 0.0066935, dev acc 0.8112, dev avg loss 0.416917, throughput 9.01701K wps
[Epoch 64 Batch 30/62] avg loss 0.0066532, throughput 8.69673K wps
[Epoch 64 Batch 60/62] avg loss 0.00678552, throughput 8.65485K wps
Begin Testing...
[Epoch 64] train avg loss 0.00678549, dev acc 0.8201, dev avg loss 0.413299, throughput 8.71035K wps
[Epoch 65 Batch 30/62] avg loss 0.00672629, throughput 8.92165K wps
[Epoch 65 Batch 60/62] avg loss 0.00665369, throughput 8.88208K wps
Begin Testing...
[Epoch 65] train avg loss 0.00676424, dev acc 0.8378, dev avg loss 0.411794, throughput 8.93621K wps
Observed Improvement.
Begin Testing...
[Epoch 66 Batch 30/62] avg loss 0.00670642, throughput 8.86064K wps
[Epoch 66 Batch 60/62] avg loss 0.00635686, throughput 9.19508K wps
Begin Testing...
[Epoch 66] train avg loss 0.00668218, dev acc 0.8378, dev avg loss 0.409856, throughput 9.00646K wps
Observed Improvement.
Begin Testing...
[Epoch 67 Batch 30/62] avg loss 0.00651789, throughput 9.09254K wps
[Epoch 67 Batch 60/62] avg loss 0.00649637, throughput 8.92714K wps
Begin Testing...
[Epoch 67] train avg loss 0.00652717, dev acc 0.8378, dev avg loss 0.408902, throughput 9.03299K wps
Observed Improvement.
Begin Testing...
[Epoch 68 Batch 30/62] avg loss 0.00654271, throughput 8.97892K wps
[Epoch 68 Batch 60/62] avg loss 0.00602223, throughput 9.01232K wps
Begin Testing...
[Epoch 68] train avg loss 0.00642917, dev acc 0.8319, dev avg loss 0.407588, throughput 9.02441K wps
[Epoch 69 Batch 30/62] avg loss 0.00638735, throughput 8.99801K wps
[Epoch 69 Batch 60/62] avg loss 0.00629163, throughput 8.99651K wps
Begin Testing...
[Epoch 69] train avg loss 0.00644667, dev acc 0.8348, dev avg loss 0.406653, throughput 8.98453K wps
[Epoch 70 Batch 30/62] avg loss 0.0060983, throughput 8.9573K wps
[Epoch 70 Batch 60/62] avg loss 0.0062969, throughput 9.05969K wps
Begin Testing...
[Epoch 70] train avg loss 0.00626264, dev acc 0.8348, dev avg loss 0.406761, throughput 8.99028K wps
[Epoch 71 Batch 30/62] avg loss 0.00622193, throughput 9K wps
[Epoch 71 Batch 60/62] avg loss 0.00608515, throughput 9.02261K wps
Begin Testing...
[Epoch 71] train avg loss 0.00627204, dev acc 0.8407, dev avg loss 0.404265, throughput 9.03974K wps
Observed Improvement.
Begin Testing...
[Epoch 72 Batch 30/62] avg loss 0.00600217, throughput 9.02136K wps
[Epoch 72 Batch 60/62] avg loss 0.00639613, throughput 9.14585K wps
Begin Testing...
[Epoch 72] train avg loss 0.00625483, dev acc 0.8407, dev avg loss 0.404237, throughput 9.11365K wps
Observed Improvement.
Begin Testing...
[Epoch 73 Batch 30/62] avg loss 0.00623059, throughput 9.2379K wps
[Epoch 73 Batch 60/62] avg loss 0.00588788, throughput 8.98407K wps
Begin Testing...
[Epoch 73] train avg loss 0.00618653, dev acc 0.8437, dev avg loss 0.402209, throughput 9.13628K wps
Observed Improvement.
Begin Testing...
[Epoch 74 Batch 30/62] avg loss 0.00610223, throughput 8.97832K wps
[Epoch 74 Batch 60/62] avg loss 0.00613583, throughput 8.92161K wps
Begin Testing...
[Epoch 74] train avg loss 0.00618768, dev acc 0.8437, dev avg loss 0.400798, throughput 9.00988K wps
Observed Improvement.
Begin Testing...
[Epoch 75 Batch 30/62] avg loss 0.00581569, throughput 9.25425K wps
[Epoch 75 Batch 60/62] avg loss 0.00604495, throughput 9.14214K wps
Begin Testing...
[Epoch 75] train avg loss 0.00599966, dev acc 0.8437, dev avg loss 0.400104, throughput 9.18246K wps
Observed Improvement.
Begin Testing...
[Epoch 76 Batch 30/62] avg loss 0.00611145, throughput 9.01615K wps
[Epoch 76 Batch 60/62] avg loss 0.00565477, throughput 8.97872K wps
Begin Testing...
[Epoch 76] train avg loss 0.00598036, dev acc 0.8378, dev avg loss 0.400397, throughput 9.0222K wps
[Epoch 77 Batch 30/62] avg loss 0.00561949, throughput 8.86764K wps
[Epoch 77 Batch 60/62] avg loss 0.00593224, throughput 9.11227K wps
Begin Testing...
[Epoch 77] train avg loss 0.00584392, dev acc 0.8319, dev avg loss 0.403267, throughput 9.02263K wps
[Epoch 78 Batch 30/62] avg loss 0.00574868, throughput 9.22181K wps
[Epoch 78 Batch 60/62] avg loss 0.00569667, throughput 9.03872K wps
Begin Testing...
[Epoch 78] train avg loss 0.00575393, dev acc 0.8378, dev avg loss 0.396811, throughput 9.11332K wps
[Epoch 79 Batch 30/62] avg loss 0.00569534, throughput 9.15108K wps
[Epoch 79 Batch 60/62] avg loss 0.00579388, throughput 9.10948K wps
Begin Testing...
[Epoch 79] train avg loss 0.00586434, dev acc 0.8407, dev avg loss 0.397037, throughput 9.15997K wps
[Epoch 80 Batch 30/62] avg loss 0.00567025, throughput 9.19279K wps
[Epoch 80 Batch 60/62] avg loss 0.00545283, throughput 9.00735K wps
Begin Testing...
[Epoch 80] train avg loss 0.00567452, dev acc 0.8378, dev avg loss 0.395356, throughput 9.09093K wps
[Epoch 81 Batch 30/62] avg loss 0.00554545, throughput 9.25234K wps
[Epoch 81 Batch 60/62] avg loss 0.00545095, throughput 8.94573K wps
Begin Testing...
[Epoch 81] train avg loss 0.00562884, dev acc 0.8378, dev avg loss 0.394637, throughput 9.06232K wps
[Epoch 82 Batch 30/62] avg loss 0.00561043, throughput 9.06802K wps
[Epoch 82 Batch 60/62] avg loss 0.00552334, throughput 9.00456K wps
Begin Testing...
[Epoch 82] train avg loss 0.00563189, dev acc 0.8348, dev avg loss 0.394183, throughput 9.06598K wps
[Epoch 83 Batch 30/62] avg loss 0.00545287, throughput 9.14961K wps
[Epoch 83 Batch 60/62] avg loss 0.00548863, throughput 8.97008K wps
Begin Testing...
[Epoch 83] train avg loss 0.00549271, dev acc 0.8348, dev avg loss 0.392852, throughput 9.08634K wps
[Epoch 84 Batch 30/62] avg loss 0.00527846, throughput 9.14908K wps
[Epoch 84 Batch 60/62] avg loss 0.00541444, throughput 9.06378K wps
Begin Testing...
[Epoch 84] train avg loss 0.00533961, dev acc 0.8348, dev avg loss 0.391974, throughput 9.0875K wps
[Epoch 85 Batch 30/62] avg loss 0.0055192, throughput 9.25857K wps
[Epoch 85 Batch 60/62] avg loss 0.00536998, throughput 8.9537K wps
Begin Testing...
[Epoch 85] train avg loss 0.00547667, dev acc 0.8407, dev avg loss 0.390994, throughput 9.12442K wps
[Epoch 86 Batch 30/62] avg loss 0.00513126, throughput 9.22981K wps
[Epoch 86 Batch 60/62] avg loss 0.00531293, throughput 8.99972K wps
Begin Testing...
[Epoch 86] train avg loss 0.0053762, dev acc 0.8319, dev avg loss 0.394051, throughput 9.0933K wps
[Epoch 87 Batch 30/62] avg loss 0.00516998, throughput 9.02681K wps
[Epoch 87 Batch 60/62] avg loss 0.00514359, throughput 9.17851K wps
Begin Testing...
[Epoch 87] train avg loss 0.00525187, dev acc 0.8407, dev avg loss 0.389891, throughput 9.13273K wps
[Epoch 88 Batch 30/62] avg loss 0.00518949, throughput 9.262K wps
[Epoch 88 Batch 60/62] avg loss 0.00509161, throughput 9.14526K wps
Begin Testing...
[Epoch 88] train avg loss 0.00519989, dev acc 0.8378, dev avg loss 0.389496, throughput 9.23164K wps
[Epoch 89 Batch 30/62] avg loss 0.00496751, throughput 9.2331K wps
[Epoch 89 Batch 60/62] avg loss 0.00496813, throughput 9.05229K wps
Begin Testing...
[Epoch 89] train avg loss 0.00500528, dev acc 0.8378, dev avg loss 0.388561, throughput 9.14445K wps
[Epoch 90 Batch 30/62] avg loss 0.00511253, throughput 9.1374K wps
[Epoch 90 Batch 60/62] avg loss 0.00501465, throughput 9.0156K wps
Begin Testing...
[Epoch 90] train avg loss 0.00510294, dev acc 0.8378, dev avg loss 0.388571, throughput 9.10538K wps
[Epoch 91 Batch 30/62] avg loss 0.00487831, throughput 8.99293K wps
[Epoch 91 Batch 60/62] avg loss 0.00483441, throughput 9.14071K wps
Begin Testing...
[Epoch 91] train avg loss 0.00493297, dev acc 0.8348, dev avg loss 0.388727, throughput 9.04847K wps
[Epoch 92 Batch 30/62] avg loss 0.00483132, throughput 9.29956K wps
[Epoch 92 Batch 60/62] avg loss 0.00497941, throughput 9.11874K wps
Begin Testing...
[Epoch 92] train avg loss 0.00493149, dev acc 0.8378, dev avg loss 0.386777, throughput 9.23495K wps
[Epoch 93 Batch 30/62] avg loss 0.00496427, throughput 9.23617K wps
[Epoch 93 Batch 60/62] avg loss 0.00489505, throughput 8.90139K wps
Begin Testing...
[Epoch 93] train avg loss 0.00499861, dev acc 0.8378, dev avg loss 0.386113, throughput 9.05642K wps
[Epoch 94 Batch 30/62] avg loss 0.00479797, throughput 9.03499K wps
[Epoch 94 Batch 60/62] avg loss 0.00486431, throughput 9.089K wps
Begin Testing...
[Epoch 94] train avg loss 0.0048537, dev acc 0.8407, dev avg loss 0.387982, throughput 9.09327K wps
[Epoch 95 Batch 30/62] avg loss 0.00465742, throughput 9.15391K wps
[Epoch 95 Batch 60/62] avg loss 0.00498866, throughput 8.90213K wps
Begin Testing...
[Epoch 95] train avg loss 0.00483443, dev acc 0.8378, dev avg loss 0.385616, throughput 9.05486K wps
[Epoch 96 Batch 30/62] avg loss 0.00489737, throughput 8.96476K wps
[Epoch 96 Batch 60/62] avg loss 0.0045652, throughput 8.99202K wps
Begin Testing...
[Epoch 96] train avg loss 0.00481035, dev acc 0.8260, dev avg loss 0.385364, throughput 8.94531K wps
[Epoch 97 Batch 30/62] avg loss 0.0046827, throughput 8.97842K wps
[Epoch 97 Batch 60/62] avg loss 0.00475507, throughput 9.01796K wps
Begin Testing...
[Epoch 97] train avg loss 0.00479268, dev acc 0.8378, dev avg loss 0.384673, throughput 9.02838K wps
[Epoch 98 Batch 30/62] avg loss 0.00458107, throughput 9.10178K wps
[Epoch 98 Batch 60/62] avg loss 0.00458989, throughput 9.07644K wps
Begin Testing...
[Epoch 98] train avg loss 0.00462581, dev acc 0.8378, dev avg loss 0.384072, throughput 9.1296K wps
[Epoch 99 Batch 30/62] avg loss 0.00463554, throughput 9.20246K wps
[Epoch 99 Batch 60/62] avg loss 0.00437481, throughput 8.73722K wps
Begin Testing...
[Epoch 99] train avg loss 0.00453105, dev acc 0.8348, dev avg loss 0.383909, throughput 8.93914K wps
[Epoch 100 Batch 30/62] avg loss 0.00471669, throughput 9.23999K wps
[Epoch 100 Batch 60/62] avg loss 0.00452876, throughput 8.95163K wps
Begin Testing...
[Epoch 100] train avg loss 0.00468337, dev acc 0.8378, dev avg loss 0.38253, throughput 9.13871K wps
[Epoch 101 Batch 30/62] avg loss 0.00451688, throughput 8.93944K wps
[Epoch 101 Batch 60/62] avg loss 0.00435805, throughput 9.10198K wps
Begin Testing...
[Epoch 101] train avg loss 0.00446479, dev acc 0.8289, dev avg loss 0.381648, throughput 9.05143K wps
[Epoch 102 Batch 30/62] avg loss 0.0042618, throughput 9.0198K wps
[Epoch 102 Batch 60/62] avg loss 0.00452787, throughput 9.15829K wps
Begin Testing...
[Epoch 102] train avg loss 0.00442103, dev acc 0.8289, dev avg loss 0.381176, throughput 9.1173K wps
[Epoch 103 Batch 30/62] avg loss 0.00455635, throughput 9.26273K wps
[Epoch 103 Batch 60/62] avg loss 0.00414123, throughput 8.99321K wps
Begin Testing...
[Epoch 103] train avg loss 0.00440424, dev acc 0.8289, dev avg loss 0.381379, throughput 9.14686K wps
[Epoch 104 Batch 30/62] avg loss 0.00437864, throughput 9.22995K wps
[Epoch 104 Batch 60/62] avg loss 0.00460786, throughput 8.82895K wps
Begin Testing...
[Epoch 104] train avg loss 0.00453587, dev acc 0.8407, dev avg loss 0.381564, throughput 8.99817K wps
[Epoch 105 Batch 30/62] avg loss 0.00417084, throughput 9.10416K wps
[Epoch 105 Batch 60/62] avg loss 0.0041272, throughput 9.15039K wps
Begin Testing...
[Epoch 105] train avg loss 0.00419927, dev acc 0.8437, dev avg loss 0.38273, throughput 9.15797K wps
Observed Improvement.
Begin Testing...
[Epoch 106 Batch 30/62] avg loss 0.0043038, throughput 9.21394K wps
[Epoch 106 Batch 60/62] avg loss 0.0042486, throughput 9.03482K wps
Begin Testing...
[Epoch 106] train avg loss 0.00429746, dev acc 0.8289, dev avg loss 0.380704, throughput 9.15458K wps
[Epoch 107 Batch 30/62] avg loss 0.00428, throughput 8.71143K wps
[Epoch 107 Batch 60/62] avg loss 0.00419186, throughput 9.09539K wps
Begin Testing...
[Epoch 107] train avg loss 0.00427841, dev acc 0.8289, dev avg loss 0.380284, throughput 8.92999K wps
[Epoch 108 Batch 30/62] avg loss 0.00408646, throughput 8.9011K wps
[Epoch 108 Batch 60/62] avg loss 0.00415774, throughput 9.00855K wps
Begin Testing...
[Epoch 108] train avg loss 0.00421787, dev acc 0.8319, dev avg loss 0.380618, throughput 9.03158K wps
[Epoch 109 Batch 30/62] avg loss 0.00412978, throughput 9.18761K wps
[Epoch 109 Batch 60/62] avg loss 0.00387939, throughput 9.07166K wps
Begin Testing...
[Epoch 109] train avg loss 0.00408052, dev acc 0.8289, dev avg loss 0.381641, throughput 9.09779K wps
[Epoch 110 Batch 30/62] avg loss 0.00400921, throughput 9.10408K wps
[Epoch 110 Batch 60/62] avg loss 0.00416135, throughput 8.98322K wps
Begin Testing...
[Epoch 110] train avg loss 0.00413777, dev acc 0.8437, dev avg loss 0.379945, throughput 9.07543K wps
Observed Improvement.
Begin Testing...
[Epoch 111 Batch 30/62] avg loss 0.00404156, throughput 9.00652K wps
[Epoch 111 Batch 60/62] avg loss 0.003907, throughput 9.09493K wps
Begin Testing...
[Epoch 111] train avg loss 0.00404363, dev acc 0.8466, dev avg loss 0.380743, throughput 9.0269K wps
Observed Improvement.
Begin Testing...
[Epoch 112 Batch 30/62] avg loss 0.00422329, throughput 9.19936K wps
[Epoch 112 Batch 60/62] avg loss 0.0038524, throughput 9.0032K wps
Begin Testing...
[Epoch 112] train avg loss 0.00408294, dev acc 0.8260, dev avg loss 0.377205, throughput 9.06961K wps
[Epoch 113 Batch 30/62] avg loss 0.00375483, throughput 9.17284K wps
[Epoch 113 Batch 60/62] avg loss 0.00427239, throughput 8.87595K wps
Begin Testing...
[Epoch 113] train avg loss 0.00404884, dev acc 0.8378, dev avg loss 0.377816, throughput 9.05489K wps
[Epoch 114 Batch 30/62] avg loss 0.0040373, throughput 8.94969K wps
[Epoch 114 Batch 60/62] avg loss 0.00393702, throughput 9.0977K wps
Begin Testing...
[Epoch 114] train avg loss 0.00399295, dev acc 0.8378, dev avg loss 0.378138, throughput 9.05438K wps
[Epoch 115 Batch 30/62] avg loss 0.00379725, throughput 9.19229K wps
[Epoch 115 Batch 60/62] avg loss 0.00388401, throughput 9.00345K wps
Begin Testing...
[Epoch 115] train avg loss 0.00387916, dev acc 0.8378, dev avg loss 0.377376, throughput 9.07021K wps
[Epoch 116 Batch 30/62] avg loss 0.00400235, throughput 9.02913K wps
[Epoch 116 Batch 60/62] avg loss 0.00381748, throughput 9.1372K wps
Begin Testing...
[Epoch 116] train avg loss 0.00396714, dev acc 0.8319, dev avg loss 0.376851, throughput 9.11412K wps
[Epoch 117 Batch 30/62] avg loss 0.00379301, throughput 9.07346K wps
[Epoch 117 Batch 60/62] avg loss 0.00371492, throughput 9.11824K wps
Begin Testing...
[Epoch 117] train avg loss 0.00384585, dev acc 0.8378, dev avg loss 0.376383, throughput 9.12744K wps
[Epoch 118 Batch 30/62] avg loss 0.00360313, throughput 8.9343K wps
[Epoch 118 Batch 60/62] avg loss 0.00376599, throughput 9.1411K wps
Begin Testing...
[Epoch 118] train avg loss 0.00372793, dev acc 0.8289, dev avg loss 0.375701, throughput 9.06746K wps
[Epoch 119 Batch 30/62] avg loss 0.00371489, throughput 8.69975K wps
[Epoch 119 Batch 60/62] avg loss 0.00382874, throughput 8.66034K wps
Begin Testing...
[Epoch 119] train avg loss 0.00381818, dev acc 0.8319, dev avg loss 0.375731, throughput 8.65527K wps
[Epoch 120 Batch 30/62] avg loss 0.00362999, throughput 9.03592K wps
[Epoch 120 Batch 60/62] avg loss 0.00375513, throughput 9.06084K wps
Begin Testing...
[Epoch 120] train avg loss 0.00369906, dev acc 0.8260, dev avg loss 0.375443, throughput 9.07869K wps
[Epoch 121 Batch 30/62] avg loss 0.00370938, throughput 9.21554K wps
[Epoch 121 Batch 60/62] avg loss 0.00378554, throughput 8.67873K wps
Begin Testing...
[Epoch 121] train avg loss 0.00382688, dev acc 0.8260, dev avg loss 0.379706, throughput 8.92028K wps
[Epoch 122 Batch 30/62] avg loss 0.00358645, throughput 9.16311K wps
[Epoch 122 Batch 60/62] avg loss 0.00350121, throughput 8.91555K wps
Begin Testing...
[Epoch 122] train avg loss 0.00357281, dev acc 0.8260, dev avg loss 0.375471, throughput 9.09588K wps
[Epoch 123 Batch 30/62] avg loss 0.00321452, throughput 9.17199K wps
[Epoch 123 Batch 60/62] avg loss 0.00387733, throughput 9.08984K wps
Begin Testing...
[Epoch 123] train avg loss 0.00363761, dev acc 0.8260, dev avg loss 0.377989, throughput 9.15881K wps
[Epoch 124 Batch 30/62] avg loss 0.00339925, throughput 9.20045K wps
[Epoch 124 Batch 60/62] avg loss 0.00347954, throughput 9.01311K wps
Begin Testing...
[Epoch 124] train avg loss 0.00348131, dev acc 0.8437, dev avg loss 0.382727, throughput 9.05919K wps
[Epoch 125 Batch 30/62] avg loss 0.00355013, throughput 9.13993K wps
[Epoch 125 Batch 60/62] avg loss 0.0035461, throughput 8.80035K wps
Begin Testing...
[Epoch 125] train avg loss 0.00358062, dev acc 0.8407, dev avg loss 0.376074, throughput 8.94588K wps
[Epoch 126 Batch 30/62] avg loss 0.00353826, throughput 8.85421K wps
[Epoch 126 Batch 60/62] avg loss 0.00352411, throughput 8.94858K wps
Begin Testing...
[Epoch 126] train avg loss 0.00357649, dev acc 0.8171, dev avg loss 0.375896, throughput 8.88729K wps
[Epoch 127 Batch 30/62] avg loss 0.00359439, throughput 9.00853K wps
[Epoch 127 Batch 60/62] avg loss 0.0032896, throughput 8.84139K wps
Begin Testing...
[Epoch 127] train avg loss 0.00355002, dev acc 0.8260, dev avg loss 0.374193, throughput 8.95994K wps
[Epoch 128 Batch 30/62] avg loss 0.00345893, throughput 8.86505K wps
[Epoch 128 Batch 60/62] avg loss 0.00330587, throughput 8.85159K wps
Begin Testing...
[Epoch 128] train avg loss 0.00345551, dev acc 0.8260, dev avg loss 0.374904, throughput 8.89545K wps
[Epoch 129 Batch 30/62] avg loss 0.00338963, throughput 9.21162K wps
[Epoch 129 Batch 60/62] avg loss 0.00329151, throughput 8.87315K wps
Begin Testing...
[Epoch 129] train avg loss 0.00335934, dev acc 0.8319, dev avg loss 0.374256, throughput 9.06892K wps
[Epoch 130 Batch 30/62] avg loss 0.00324213, throughput 9.15133K wps
[Epoch 130 Batch 60/62] avg loss 0.00346984, throughput 8.9283K wps
Begin Testing...
[Epoch 130] train avg loss 0.00339979, dev acc 0.8201, dev avg loss 0.375456, throughput 9.06934K wps
[Epoch 131 Batch 30/62] avg loss 0.00322897, throughput 9.04099K wps
[Epoch 131 Batch 60/62] avg loss 0.00331711, throughput 9.131K wps
Begin Testing...
[Epoch 131] train avg loss 0.00330576, dev acc 0.8230, dev avg loss 0.376584, throughput 9.11887K wps
[Epoch 132 Batch 30/62] avg loss 0.00321295, throughput 8.98737K wps
[Epoch 132 Batch 60/62] avg loss 0.00326956, throughput 8.91704K wps
Begin Testing...
[Epoch 132] train avg loss 0.00326497, dev acc 0.8230, dev avg loss 0.373629, throughput 8.98395K wps
[Epoch 133 Batch 30/62] avg loss 0.00313112, throughput 9.27338K wps
[Epoch 133 Batch 60/62] avg loss 0.00324048, throughput 8.78816K wps
Begin Testing...
[Epoch 133] train avg loss 0.00321869, dev acc 0.8201, dev avg loss 0.374701, throughput 9.05847K wps
[Epoch 134 Batch 30/62] avg loss 0.00310067, throughput 9.05013K wps
[Epoch 134 Batch 60/62] avg loss 0.00319228, throughput 9.10921K wps
Begin Testing...
[Epoch 134] train avg loss 0.00316801, dev acc 0.8289, dev avg loss 0.373971, throughput 9.11013K wps
[Epoch 135 Batch 30/62] avg loss 0.00318059, throughput 9.02183K wps
[Epoch 135 Batch 60/62] avg loss 0.00317584, throughput 9.07659K wps
Begin Testing...
[Epoch 135] train avg loss 0.00322068, dev acc 0.8319, dev avg loss 0.375001, throughput 9.07555K wps
[Epoch 136 Batch 30/62] avg loss 0.00299043, throughput 8.97707K wps
[Epoch 136 Batch 60/62] avg loss 0.00310567, throughput 8.8035K wps
Begin Testing...
[Epoch 136] train avg loss 0.00315327, dev acc 0.8260, dev avg loss 0.373057, throughput 8.88005K wps
[Epoch 137 Batch 30/62] avg loss 0.0031695, throughput 9.21026K wps
[Epoch 137 Batch 60/62] avg loss 0.00299401, throughput 9.09576K wps
Begin Testing...
[Epoch 137] train avg loss 0.0031044, dev acc 0.8319, dev avg loss 0.373869, throughput 9.17711K wps
[Epoch 138 Batch 30/62] avg loss 0.00305802, throughput 9.14682K wps
[Epoch 138 Batch 60/62] avg loss 0.00302942, throughput 8.95827K wps
Begin Testing...
[Epoch 138] train avg loss 0.00307596, dev acc 0.8319, dev avg loss 0.373607, throughput 9.08375K wps
[Epoch 139 Batch 30/62] avg loss 0.00299411, throughput 9.01018K wps
[Epoch 139 Batch 60/62] avg loss 0.00307156, throughput 8.97433K wps
Begin Testing...
[Epoch 139] train avg loss 0.00305472, dev acc 0.8378, dev avg loss 0.374574, throughput 9.0172K wps
[Epoch 140 Batch 30/62] avg loss 0.00310231, throughput 9.27205K wps
[Epoch 140 Batch 60/62] avg loss 0.00284643, throughput 8.66286K wps
Begin Testing...
[Epoch 140] train avg loss 0.00299965, dev acc 0.8407, dev avg loss 0.375143, throughput 9.02078K wps
[Epoch 141 Batch 30/62] avg loss 0.00288743, throughput 8.97388K wps
[Epoch 141 Batch 60/62] avg loss 0.00289559, throughput 9.01555K wps
Begin Testing...
[Epoch 141] train avg loss 0.00292147, dev acc 0.8289, dev avg loss 0.372713, throughput 8.96857K wps
[Epoch 142 Batch 30/62] avg loss 0.00300697, throughput 8.87816K wps
[Epoch 142 Batch 60/62] avg loss 0.00298866, throughput 9.04844K wps
Begin Testing...
[Epoch 142] train avg loss 0.0030602, dev acc 0.8319, dev avg loss 0.37254, throughput 8.99555K wps
[Epoch 143 Batch 30/62] avg loss 0.00280717, throughput 8.73564K wps
[Epoch 143 Batch 60/62] avg loss 0.0029411, throughput 9.29642K wps
Begin Testing...
[Epoch 143] train avg loss 0.00290526, dev acc 0.8319, dev avg loss 0.373013, throughput 9.04301K wps
[Epoch 144 Batch 30/62] avg loss 0.00295755, throughput 8.98388K wps
[Epoch 144 Batch 60/62] avg loss 0.00273658, throughput 9.07647K wps
Begin Testing...
[Epoch 144] train avg loss 0.00287015, dev acc 0.8289, dev avg loss 0.373455, throughput 9.00401K wps
[Epoch 145 Batch 30/62] avg loss 0.00289245, throughput 8.82782K wps
[Epoch 145 Batch 60/62] avg loss 0.00289986, throughput 9.15335K wps
Begin Testing...
[Epoch 145] train avg loss 0.00295326, dev acc 0.8319, dev avg loss 0.373869, throughput 9.02043K wps
[Epoch 146 Batch 30/62] avg loss 0.00288768, throughput 9.15902K wps
[Epoch 146 Batch 60/62] avg loss 0.00286233, throughput 8.68402K wps
Begin Testing...
[Epoch 146] train avg loss 0.002926, dev acc 0.8230, dev avg loss 0.373284, throughput 8.92835K wps
[Epoch 147 Batch 30/62] avg loss 0.00282928, throughput 9.10453K wps
[Epoch 147 Batch 60/62] avg loss 0.00261362, throughput 9.06693K wps
Begin Testing...
[Epoch 147] train avg loss 0.00274862, dev acc 0.8466, dev avg loss 0.380156, throughput 9.11445K wps
Observed Improvement.
Begin Testing...
[Epoch 148 Batch 30/62] avg loss 0.0026734, throughput 8.89946K wps
[Epoch 148 Batch 60/62] avg loss 0.00282661, throughput 9.10278K wps
Begin Testing...
[Epoch 148] train avg loss 0.00278004, dev acc 0.8466, dev avg loss 0.377043, throughput 9.03144K wps
Observed Improvement.
Begin Testing...
[Epoch 149 Batch 30/62] avg loss 0.00272666, throughput 9.14434K wps
[Epoch 149 Batch 60/62] avg loss 0.00275616, throughput 8.60037K wps
Begin Testing...
[Epoch 149] train avg loss 0.0027423, dev acc 0.8289, dev avg loss 0.372798, throughput 8.85889K wps
[Epoch 150 Batch 30/62] avg loss 0.00268804, throughput 9.11788K wps
[Epoch 150 Batch 60/62] avg loss 0.00272255, throughput 8.77406K wps
Begin Testing...
[Epoch 150] train avg loss 0.00271965, dev acc 0.8289, dev avg loss 0.3725, throughput 8.91224K wps
[Epoch 151 Batch 30/62] avg loss 0.00278031, throughput 9.0385K wps
[Epoch 151 Batch 60/62] avg loss 0.00262249, throughput 9.03545K wps
Begin Testing...
[Epoch 151] train avg loss 0.00273048, dev acc 0.8319, dev avg loss 0.372234, throughput 9.06745K wps
[Epoch 152 Batch 30/62] avg loss 0.00267499, throughput 8.84602K wps
[Epoch 152 Batch 60/62] avg loss 0.00263859, throughput 9.14981K wps
Begin Testing...
[Epoch 152] train avg loss 0.0026764, dev acc 0.8230, dev avg loss 0.372318, throughput 9.02735K wps
[Epoch 153 Batch 30/62] avg loss 0.00263855, throughput 9.23941K wps
[Epoch 153 Batch 60/62] avg loss 0.00277887, throughput 9.1268K wps
Begin Testing...
[Epoch 153] train avg loss 0.00271571, dev acc 0.8319, dev avg loss 0.372109, throughput 9.20678K wps
[Epoch 154 Batch 30/62] avg loss 0.00271721, throughput 9.25907K wps
[Epoch 154 Batch 60/62] avg loss 0.00262348, throughput 8.86074K wps
Begin Testing...
[Epoch 154] train avg loss 0.00274082, dev acc 0.8319, dev avg loss 0.372409, throughput 9.11317K wps
[Epoch 155 Batch 30/62] avg loss 0.00257621, throughput 9.17215K wps
[Epoch 155 Batch 60/62] avg loss 0.00247521, throughput 8.8618K wps
Begin Testing...
[Epoch 155] train avg loss 0.00260111, dev acc 0.8260, dev avg loss 0.372411, throughput 8.97329K wps
[Epoch 156 Batch 30/62] avg loss 0.00265246, throughput 8.91042K wps
[Epoch 156 Batch 60/62] avg loss 0.00244221, throughput 8.92262K wps
Begin Testing...
[Epoch 156] train avg loss 0.00258924, dev acc 0.8378, dev avg loss 0.374058, throughput 8.95288K wps
[Epoch 157 Batch 30/62] avg loss 0.00247101, throughput 9.12051K wps
[Epoch 157 Batch 60/62] avg loss 0.0026127, throughput 8.72127K wps
Begin Testing...
[Epoch 157] train avg loss 0.00259695, dev acc 0.8289, dev avg loss 0.372591, throughput 8.89643K wps
[Epoch 158 Batch 30/62] avg loss 0.00243646, throughput 9.09158K wps
[Epoch 158 Batch 60/62] avg loss 0.00256753, throughput 8.90985K wps
Begin Testing...
[Epoch 158] train avg loss 0.00251034, dev acc 0.8230, dev avg loss 0.37506, throughput 9.03292K wps
[Epoch 159 Batch 30/62] avg loss 0.00272063, throughput 9.13936K wps
[Epoch 159 Batch 60/62] avg loss 0.00239385, throughput 8.80279K wps
Begin Testing...
[Epoch 159] train avg loss 0.00261053, dev acc 0.8378, dev avg loss 0.373416, throughput 8.93655K wps
[Epoch 160 Batch 30/62] avg loss 0.0024012, throughput 8.93122K wps
[Epoch 160 Batch 60/62] avg loss 0.00249191, throughput 8.98193K wps
Begin Testing...
[Epoch 160] train avg loss 0.00246923, dev acc 0.8230, dev avg loss 0.374178, throughput 8.94119K wps
[Epoch 161 Batch 30/62] avg loss 0.00271683, throughput 8.94041K wps
[Epoch 161 Batch 60/62] avg loss 0.00236901, throughput 9.03242K wps
Begin Testing...
[Epoch 161] train avg loss 0.00258933, dev acc 0.8260, dev avg loss 0.372644, throughput 8.9833K wps
[Epoch 162 Batch 30/62] avg loss 0.00257401, throughput 9.21056K wps
[Epoch 162 Batch 60/62] avg loss 0.00247411, throughput 8.88825K wps
Begin Testing...
[Epoch 162] train avg loss 0.0025322, dev acc 0.8319, dev avg loss 0.372806, throughput 9.07645K wps
[Epoch 163 Batch 30/62] avg loss 0.00232623, throughput 9.23327K wps
[Epoch 163 Batch 60/62] avg loss 0.00248275, throughput 8.90642K wps
Begin Testing...
[Epoch 163] train avg loss 0.0024189, dev acc 0.8289, dev avg loss 0.372657, throughput 9.05761K wps
[Epoch 164 Batch 30/62] avg loss 0.00247121, throughput 9.10891K wps
[Epoch 164 Batch 60/62] avg loss 0.00230371, throughput 8.83073K wps
Begin Testing...
[Epoch 164] train avg loss 0.002415, dev acc 0.8319, dev avg loss 0.373415, throughput 8.95482K wps
[Epoch 165 Batch 30/62] avg loss 0.00243042, throughput 8.97965K wps
[Epoch 165 Batch 60/62] avg loss 0.00228423, throughput 8.98496K wps
Begin Testing...
[Epoch 165] train avg loss 0.00238502, dev acc 0.8260, dev avg loss 0.373708, throughput 9.01627K wps
[Epoch 166 Batch 30/62] avg loss 0.00232747, throughput 8.96123K wps
[Epoch 166 Batch 60/62] avg loss 0.00238772, throughput 9.04184K wps
Begin Testing...
[Epoch 166] train avg loss 0.00236967, dev acc 0.8289, dev avg loss 0.373614, throughput 9.03441K wps
[Epoch 167 Batch 30/62] avg loss 0.00226201, throughput 9.14343K wps
[Epoch 167 Batch 60/62] avg loss 0.00231076, throughput 9.16117K wps
Begin Testing...
[Epoch 167] train avg loss 0.00231351, dev acc 0.8466, dev avg loss 0.37916, throughput 9.18582K wps
Observed Improvement.
Begin Testing...
[Epoch 168 Batch 30/62] avg loss 0.00230444, throughput 9.21029K wps
[Epoch 168 Batch 60/62] avg loss 0.00220818, throughput 8.95528K wps
Begin Testing...
[Epoch 168] train avg loss 0.0022919, dev acc 0.8319, dev avg loss 0.374451, throughput 9.11325K wps
[Epoch 169 Batch 30/62] avg loss 0.00221649, throughput 9.15184K wps
[Epoch 169 Batch 60/62] avg loss 0.00223191, throughput 9.02041K wps
Begin Testing...
[Epoch 169] train avg loss 0.00225503, dev acc 0.8348, dev avg loss 0.376219, throughput 9.10645K wps
[Epoch 170 Batch 30/62] avg loss 0.00227903, throughput 8.95128K wps
[Epoch 170 Batch 60/62] avg loss 0.00229603, throughput 9.08609K wps
Begin Testing...
[Epoch 170] train avg loss 0.00231142, dev acc 0.8319, dev avg loss 0.375086, throughput 9.00415K wps
[Epoch 171 Batch 30/62] avg loss 0.00240348, throughput 8.89304K wps
[Epoch 171 Batch 60/62] avg loss 0.00212707, throughput 8.8696K wps
Begin Testing...
[Epoch 171] train avg loss 0.00235144, dev acc 0.8437, dev avg loss 0.377537, throughput 8.86946K wps
[Epoch 172 Batch 30/62] avg loss 0.00213563, throughput 9.16272K wps
[Epoch 172 Batch 60/62] avg loss 0.00221953, throughput 8.99545K wps
Begin Testing...
[Epoch 172] train avg loss 0.00219106, dev acc 0.8319, dev avg loss 0.374873, throughput 9.10643K wps
[Epoch 173 Batch 30/62] avg loss 0.00226815, throughput 9.21412K wps
[Epoch 173 Batch 60/62] avg loss 0.00217231, throughput 8.9519K wps
Begin Testing...
[Epoch 173] train avg loss 0.00224211, dev acc 0.8289, dev avg loss 0.374533, throughput 9.05149K wps
[Epoch 174 Batch 30/62] avg loss 0.00218239, throughput 9.15073K wps
[Epoch 174 Batch 60/62] avg loss 0.0020917, throughput 8.98651K wps
Begin Testing...
[Epoch 174] train avg loss 0.00217197, dev acc 0.8407, dev avg loss 0.378096, throughput 9.03386K wps
[Epoch 175 Batch 30/62] avg loss 0.00217779, throughput 9.13876K wps
[Epoch 175 Batch 60/62] avg loss 0.00211801, throughput 8.99901K wps
Begin Testing...
[Epoch 175] train avg loss 0.00220735, dev acc 0.8348, dev avg loss 0.375843, throughput 9.04605K wps
[Epoch 176 Batch 30/62] avg loss 0.00199675, throughput 9.00852K wps
[Epoch 176 Batch 60/62] avg loss 0.002035, throughput 8.61269K wps
Begin Testing...
[Epoch 176] train avg loss 0.00205585, dev acc 0.8289, dev avg loss 0.374773, throughput 8.77906K wps
[Epoch 177 Batch 30/62] avg loss 0.0020762, throughput 9.08237K wps
[Epoch 177 Batch 60/62] avg loss 0.00226874, throughput 9.13494K wps
Begin Testing...
[Epoch 177] train avg loss 0.00226027, dev acc 0.8437, dev avg loss 0.379893, throughput 9.1388K wps
[Epoch 178 Batch 30/62] avg loss 0.00203599, throughput 9.0816K wps
[Epoch 178 Batch 60/62] avg loss 0.0021572, throughput 9.02231K wps
Begin Testing...
[Epoch 178] train avg loss 0.00209851, dev acc 0.8289, dev avg loss 0.374879, throughput 9.08241K wps
[Epoch 179 Batch 30/62] avg loss 0.00204898, throughput 8.99813K wps
[Epoch 179 Batch 60/62] avg loss 0.00212777, throughput 8.91247K wps
Begin Testing...
[Epoch 179] train avg loss 0.00211195, dev acc 0.8407, dev avg loss 0.378772, throughput 8.98629K wps
[Epoch 180 Batch 30/62] avg loss 0.00210993, throughput 8.98188K wps
[Epoch 180 Batch 60/62] avg loss 0.0019131, throughput 8.92953K wps
Begin Testing...
[Epoch 180] train avg loss 0.00204993, dev acc 0.8289, dev avg loss 0.375074, throughput 8.9865K wps
[Epoch 181 Batch 30/62] avg loss 0.0021545, throughput 9.0821K wps
[Epoch 181 Batch 60/62] avg loss 0.00184887, throughput 9.12615K wps
Begin Testing...
[Epoch 181] train avg loss 0.002001, dev acc 0.8319, dev avg loss 0.376478, throughput 9.11829K wps
[Epoch 182 Batch 30/62] avg loss 0.00202476, throughput 9.09728K wps
[Epoch 182 Batch 60/62] avg loss 0.00206338, throughput 8.81983K wps
Begin Testing...
[Epoch 182] train avg loss 0.00205801, dev acc 0.8319, dev avg loss 0.376704, throughput 8.92561K wps
[Epoch 183 Batch 30/62] avg loss 0.00203776, throughput 9.12029K wps
[Epoch 183 Batch 60/62] avg loss 0.00201785, throughput 8.91225K wps
Begin Testing...
[Epoch 183] train avg loss 0.00203472, dev acc 0.8348, dev avg loss 0.376919, throughput 9.04336K wps
[Epoch 184 Batch 30/62] avg loss 0.00211209, throughput 8.9358K wps
[Epoch 184 Batch 60/62] avg loss 0.00189389, throughput 9.25839K wps
Begin Testing...
[Epoch 184] train avg loss 0.00201398, dev acc 0.8319, dev avg loss 0.375939, throughput 9.12441K wps
[Epoch 185 Batch 30/62] avg loss 0.00203061, throughput 9.0426K wps
[Epoch 185 Batch 60/62] avg loss 0.00202317, throughput 9.12924K wps
Begin Testing...
[Epoch 185] train avg loss 0.00207484, dev acc 0.8289, dev avg loss 0.375772, throughput 9.10529K wps
[Epoch 186 Batch 30/62] avg loss 0.00191763, throughput 9.06115K wps
[Epoch 186 Batch 60/62] avg loss 0.00203146, throughput 8.89956K wps
Begin Testing...
[Epoch 186] train avg loss 0.00202943, dev acc 0.8319, dev avg loss 0.376597, throughput 9.00866K wps
[Epoch 187 Batch 30/62] avg loss 0.00187403, throughput 9.0684K wps
[Epoch 187 Batch 60/62] avg loss 0.00195957, throughput 8.78817K wps
Begin Testing...
[Epoch 187] train avg loss 0.00191965, dev acc 0.8319, dev avg loss 0.374981, throughput 8.90246K wps
[Epoch 188 Batch 30/62] avg loss 0.00190022, throughput 9.10199K wps
[Epoch 188 Batch 60/62] avg loss 0.00196388, throughput 9.15168K wps
Begin Testing...
[Epoch 188] train avg loss 0.00200181, dev acc 0.8260, dev avg loss 0.377061, throughput 9.11186K wps
[Epoch 189 Batch 30/62] avg loss 0.00194394, throughput 9.24824K wps
[Epoch 189 Batch 60/62] avg loss 0.0018125, throughput 8.63656K wps
Begin Testing...
[Epoch 189] train avg loss 0.00188858, dev acc 0.8319, dev avg loss 0.374598, throughput 8.96854K wps
[Epoch 190 Batch 30/62] avg loss 0.00184175, throughput 9.28012K wps
[Epoch 190 Batch 60/62] avg loss 0.00198609, throughput 8.84659K wps
Begin Testing...
[Epoch 190] train avg loss 0.00193628, dev acc 0.8319, dev avg loss 0.374866, throughput 9.03603K wps
[Epoch 191 Batch 30/62] avg loss 0.00186817, throughput 8.92898K wps
[Epoch 191 Batch 60/62] avg loss 0.00183344, throughput 8.8661K wps
Begin Testing...
[Epoch 191] train avg loss 0.00186376, dev acc 0.8496, dev avg loss 0.378735, throughput 8.86768K wps
Observed Improvement.
Begin Testing...
[Epoch 192 Batch 30/62] avg loss 0.00172807, throughput 8.84631K wps
[Epoch 192 Batch 60/62] avg loss 0.00187708, throughput 8.82455K wps
Begin Testing...
[Epoch 192] train avg loss 0.00182105, dev acc 0.8260, dev avg loss 0.376643, throughput 8.83137K wps
[Epoch 193 Batch 30/62] avg loss 0.00190927, throughput 9.02993K wps
[Epoch 193 Batch 60/62] avg loss 0.00177188, throughput 9.10398K wps
Begin Testing...
[Epoch 193] train avg loss 0.00187772, dev acc 0.8319, dev avg loss 0.376186, throughput 9.0999K wps
[Epoch 194 Batch 30/62] avg loss 0.00173703, throughput 9.12983K wps
[Epoch 194 Batch 60/62] avg loss 0.00174175, throughput 8.93768K wps
Begin Testing...
[Epoch 194] train avg loss 0.00178512, dev acc 0.8260, dev avg loss 0.376366, throughput 8.9981K wps
[Epoch 195 Batch 30/62] avg loss 0.00179013, throughput 8.94014K wps
[Epoch 195 Batch 60/62] avg loss 0.001796, throughput 9.03188K wps
Begin Testing...
[Epoch 195] train avg loss 0.00180062, dev acc 0.8319, dev avg loss 0.376579, throughput 9.02281K wps
[Epoch 196 Batch 30/62] avg loss 0.0016807, throughput 9.0976K wps
[Epoch 196 Batch 60/62] avg loss 0.00185266, throughput 9.07829K wps
Begin Testing...
[Epoch 196] train avg loss 0.00182688, dev acc 0.8319, dev avg loss 0.378057, throughput 9.07599K wps
[Epoch 197 Batch 30/62] avg loss 0.00178273, throughput 9.10652K wps
[Epoch 197 Batch 60/62] avg loss 0.00190337, throughput 8.7123K wps
Begin Testing...
[Epoch 197] train avg loss 0.00186036, dev acc 0.8348, dev avg loss 0.37671, throughput 8.89826K wps
[Epoch 198 Batch 30/62] avg loss 0.00178064, throughput 8.85035K wps
[Epoch 198 Batch 60/62] avg loss 0.0016538, throughput 9.19484K wps
Begin Testing...
[Epoch 198] train avg loss 0.00171961, dev acc 0.8319, dev avg loss 0.376174, throughput 9.05037K wps
[Epoch 199 Batch 30/62] avg loss 0.00173113, throughput 9.12669K wps
[Epoch 199 Batch 60/62] avg loss 0.00171196, throughput 9.07329K wps
Begin Testing...
[Epoch 199] train avg loss 0.00172305, dev acc 0.8289, dev avg loss 0.37723, throughput 9.0834K wps
Test loss 0.403587, test acc 0.8249
Total time cost 154.80s
[Epoch 0 Batch 30/62] avg loss 0.0134793, throughput 8.34145K wps
[Epoch 0 Batch 60/62] avg loss 0.0129771, throughput 9.08422K wps
Begin Testing...
[Epoch 0] train avg loss 0.0133989, dev acc 0.6254, dev avg loss 0.659936, throughput 8.68925K wps
Observed Improvement.
Begin Testing...
[Epoch 1 Batch 30/62] avg loss 0.0133288, throughput 9.0578K wps
[Epoch 1 Batch 60/62] avg loss 0.0129215, throughput 8.71691K wps
Begin Testing...
[Epoch 1] train avg loss 0.0133164, dev acc 0.6254, dev avg loss 0.655957, throughput 8.96859K wps
Observed Improvement.
Begin Testing...
[Epoch 2 Batch 30/62] avg loss 0.013151, throughput 9.20527K wps
[Epoch 2 Batch 60/62] avg loss 0.0130181, throughput 8.99063K wps
Begin Testing...
[Epoch 2] train avg loss 0.0132655, dev acc 0.6254, dev avg loss 0.652006, throughput 9.0828K wps
Observed Improvement.
Begin Testing...
[Epoch 3 Batch 30/62] avg loss 0.0129778, throughput 9.19584K wps
[Epoch 3 Batch 60/62] avg loss 0.0128044, throughput 9.05549K wps
Begin Testing...
[Epoch 3] train avg loss 0.0130463, dev acc 0.6254, dev avg loss 0.648464, throughput 9.15526K wps
Observed Improvement.
Begin Testing...
[Epoch 4 Batch 30/62] avg loss 0.0128823, throughput 9.33382K wps
[Epoch 4 Batch 60/62] avg loss 0.0128236, throughput 8.99451K wps
Begin Testing...
[Epoch 4] train avg loss 0.0130005, dev acc 0.6254, dev avg loss 0.643953, throughput 9.18895K wps
Observed Improvement.
Begin Testing...
[Epoch 5 Batch 30/62] avg loss 0.0125789, throughput 9.27476K wps
[Epoch 5 Batch 60/62] avg loss 0.0127455, throughput 8.97218K wps
Begin Testing...
[Epoch 5] train avg loss 0.0128276, dev acc 0.6254, dev avg loss 0.640498, throughput 9.15146K wps
Observed Improvement.
Begin Testing...
[Epoch 6 Batch 30/62] avg loss 0.0126208, throughput 9.15601K wps
[Epoch 6 Batch 60/62] avg loss 0.0127068, throughput 9.10077K wps
Begin Testing...
[Epoch 6] train avg loss 0.0128128, dev acc 0.6254, dev avg loss 0.6369, throughput 9.14707K wps
Observed Improvement.
Begin Testing...
[Epoch 7 Batch 30/62] avg loss 0.0126499, throughput 9.23361K wps
[Epoch 7 Batch 60/62] avg loss 0.012529, throughput 9.01213K wps
Begin Testing...
[Epoch 7] train avg loss 0.012812, dev acc 0.6254, dev avg loss 0.633011, throughput 9.15023K wps
Observed Improvement.
Begin Testing...
[Epoch 8 Batch 30/62] avg loss 0.0123017, throughput 9.09612K wps
[Epoch 8 Batch 60/62] avg loss 0.0126195, throughput 9.12622K wps
Begin Testing...
[Epoch 8] train avg loss 0.0126231, dev acc 0.6254, dev avg loss 0.62941, throughput 9.09323K wps
Observed Improvement.
Begin Testing...
[Epoch 9 Batch 30/62] avg loss 0.0124922, throughput 8.92907K wps
[Epoch 9 Batch 60/62] avg loss 0.0122144, throughput 9.1049K wps
Begin Testing...
[Epoch 9] train avg loss 0.0125424, dev acc 0.6254, dev avg loss 0.62688, throughput 9.03898K wps
Observed Improvement.
Begin Testing...
[Epoch 10 Batch 30/62] avg loss 0.012362, throughput 9.07968K wps
[Epoch 10 Batch 60/62] avg loss 0.0120914, throughput 9.03263K wps
Begin Testing...
[Epoch 10] train avg loss 0.0124415, dev acc 0.6254, dev avg loss 0.621744, throughput 9.08353K wps
Observed Improvement.
Begin Testing...
[Epoch 11 Batch 30/62] avg loss 0.0119275, throughput 9.00539K wps
[Epoch 11 Batch 60/62] avg loss 0.0122377, throughput 9.05355K wps
Begin Testing...
[Epoch 11] train avg loss 0.01224, dev acc 0.6254, dev avg loss 0.617833, throughput 9.06259K wps
Observed Improvement.
Begin Testing...
[Epoch 12 Batch 30/62] avg loss 0.0119658, throughput 9.05178K wps
[Epoch 12 Batch 60/62] avg loss 0.0121967, throughput 8.9771K wps
Begin Testing...
[Epoch 12] train avg loss 0.0122766, dev acc 0.6254, dev avg loss 0.614091, throughput 9.04656K wps
Observed Improvement.
Begin Testing...
[Epoch 13 Batch 30/62] avg loss 0.0117985, throughput 9.15749K wps
[Epoch 13 Batch 60/62] avg loss 0.0120485, throughput 8.7927K wps
Begin Testing...
[Epoch 13] train avg loss 0.0120855, dev acc 0.6313, dev avg loss 0.609885, throughput 8.94554K wps
Observed Improvement.
Begin Testing...
[Epoch 14 Batch 30/62] avg loss 0.0117836, throughput 9.28528K wps
[Epoch 14 Batch 60/62] avg loss 0.0119846, throughput 8.78963K wps
Begin Testing...
[Epoch 14] train avg loss 0.0120073, dev acc 0.6254, dev avg loss 0.607258, throughput 9.06372K wps
[Epoch 15 Batch 30/62] avg loss 0.0116826, throughput 9.0637K wps
[Epoch 15 Batch 60/62] avg loss 0.0117161, throughput 9.04468K wps
Begin Testing...
[Epoch 15] train avg loss 0.0118611, dev acc 0.6401, dev avg loss 0.601358, throughput 9.0862K wps
Observed Improvement.
Begin Testing...
[Epoch 16 Batch 30/62] avg loss 0.0118929, throughput 9.08853K wps
[Epoch 16 Batch 60/62] avg loss 0.0113212, throughput 8.82749K wps
Begin Testing...
[Epoch 16] train avg loss 0.0118149, dev acc 0.6372, dev avg loss 0.597238, throughput 8.93446K wps
[Epoch 17 Batch 30/62] avg loss 0.0113572, throughput 8.94887K wps
[Epoch 17 Batch 60/62] avg loss 0.0115605, throughput 9.05705K wps
Begin Testing...
[Epoch 17] train avg loss 0.0116186, dev acc 0.6608, dev avg loss 0.592466, throughput 9.03255K wps
Observed Improvement.
Begin Testing...
[Epoch 18 Batch 30/62] avg loss 0.0112804, throughput 9.08532K wps
[Epoch 18 Batch 60/62] avg loss 0.0113483, throughput 9.30461K wps
Begin Testing...
[Epoch 18] train avg loss 0.0114372, dev acc 0.6342, dev avg loss 0.590287, throughput 9.22149K wps
[Epoch 19 Batch 30/62] avg loss 0.0113228, throughput 8.77094K wps
[Epoch 19 Batch 60/62] avg loss 0.0111329, throughput 9.14371K wps
Begin Testing...
[Epoch 19] train avg loss 0.0113573, dev acc 0.6401, dev avg loss 0.584746, throughput 8.9881K wps
[Epoch 20 Batch 30/62] avg loss 0.0113911, throughput 9.06228K wps
[Epoch 20 Batch 60/62] avg loss 0.0110874, throughput 8.85676K wps
Begin Testing...
[Epoch 20] train avg loss 0.0113673, dev acc 0.6608, dev avg loss 0.578666, throughput 9.03391K wps
Observed Improvement.
Begin Testing...
[Epoch 21 Batch 30/62] avg loss 0.0112109, throughput 9.1769K wps
[Epoch 21 Batch 60/62] avg loss 0.010771, throughput 8.99925K wps
Begin Testing...
[Epoch 21] train avg loss 0.0111013, dev acc 0.6519, dev avg loss 0.576007, throughput 9.11777K wps
[Epoch 22 Batch 30/62] avg loss 0.0108562, throughput 8.93011K wps
[Epoch 22 Batch 60/62] avg loss 0.0109369, throughput 8.976K wps
Begin Testing...
[Epoch 22] train avg loss 0.0110457, dev acc 0.7050, dev avg loss 0.568186, throughput 8.97677K wps
Observed Improvement.
Begin Testing...
[Epoch 23 Batch 30/62] avg loss 0.0107312, throughput 9.14972K wps
[Epoch 23 Batch 60/62] avg loss 0.0106419, throughput 9.10929K wps
Begin Testing...
[Epoch 23] train avg loss 0.0108352, dev acc 0.7080, dev avg loss 0.563375, throughput 9.15927K wps
Observed Improvement.
Begin Testing...
[Epoch 24 Batch 30/62] avg loss 0.0103931, throughput 8.03123K wps
[Epoch 24 Batch 60/62] avg loss 0.0108253, throughput 8.0022K wps
Begin Testing...
[Epoch 24] train avg loss 0.0107872, dev acc 0.7493, dev avg loss 0.559531, throughput 8.02794K wps
Observed Improvement.
Begin Testing...
[Epoch 25 Batch 30/62] avg loss 0.0105648, throughput 7.60337K wps
[Epoch 25 Batch 60/62] avg loss 0.0103571, throughput 7.66845K wps
Begin Testing...
[Epoch 25] train avg loss 0.0106264, dev acc 0.7434, dev avg loss 0.554361, throughput 7.63301K wps
[Epoch 26 Batch 30/62] avg loss 0.0104827, throughput 8.34071K wps
[Epoch 26 Batch 60/62] avg loss 0.0104407, throughput 8.21964K wps
Begin Testing...
[Epoch 26] train avg loss 0.0105521, dev acc 0.7198, dev avg loss 0.549436, throughput 8.2786K wps
[Epoch 27 Batch 30/62] avg loss 0.010174, throughput 8.2833K wps
[Epoch 27 Batch 60/62] avg loss 0.0105697, throughput 8.1194K wps
Begin Testing...
[Epoch 27] train avg loss 0.0104724, dev acc 0.7257, dev avg loss 0.54508, throughput 8.21565K wps
[Epoch 28 Batch 30/62] avg loss 0.010106, throughput 8.31014K wps
[Epoch 28 Batch 60/62] avg loss 0.0101286, throughput 8.16741K wps
Begin Testing...
[Epoch 28] train avg loss 0.0102563, dev acc 0.7257, dev avg loss 0.540618, throughput 8.2346K wps
[Epoch 29 Batch 30/62] avg loss 0.010151, throughput 8.58876K wps
[Epoch 29 Batch 60/62] avg loss 0.00972431, throughput 9.17663K wps
Begin Testing...
[Epoch 29] train avg loss 0.0100821, dev acc 0.7463, dev avg loss 0.535646, throughput 8.91002K wps
[Epoch 30 Batch 30/62] avg loss 0.00996574, throughput 9.31217K wps
[Epoch 30 Batch 60/62] avg loss 0.00992725, throughput 8.86647K wps
Begin Testing...
[Epoch 30] train avg loss 0.0100173, dev acc 0.7404, dev avg loss 0.5316, throughput 9.11446K wps
[Epoch 31 Batch 30/62] avg loss 0.00978945, throughput 9.18251K wps
[Epoch 31 Batch 60/62] avg loss 0.00975327, throughput 9.0596K wps
Begin Testing...
[Epoch 31] train avg loss 0.00989171, dev acc 0.7640, dev avg loss 0.527306, throughput 9.14875K wps
Observed Improvement.
Begin Testing...
[Epoch 32 Batch 30/62] avg loss 0.00958851, throughput 9.26382K wps
[Epoch 32 Batch 60/62] avg loss 0.00960943, throughput 8.85507K wps
Begin Testing...
[Epoch 32] train avg loss 0.00981422, dev acc 0.7581, dev avg loss 0.524192, throughput 9.11001K wps
[Epoch 33 Batch 30/62] avg loss 0.00973214, throughput 9.11879K wps
[Epoch 33 Batch 60/62] avg loss 0.00939648, throughput 9.01568K wps
Begin Testing...
[Epoch 33] train avg loss 0.00968733, dev acc 0.7552, dev avg loss 0.520088, throughput 9.09518K wps
[Epoch 34 Batch 30/62] avg loss 0.00930243, throughput 9.13888K wps
[Epoch 34 Batch 60/62] avg loss 0.00973241, throughput 8.7571K wps
Begin Testing...
[Epoch 34] train avg loss 0.00966664, dev acc 0.7552, dev avg loss 0.516554, throughput 8.91888K wps
[Epoch 35 Batch 30/62] avg loss 0.00928331, throughput 8.9999K wps
[Epoch 35 Batch 60/62] avg loss 0.00938289, throughput 8.92538K wps
Begin Testing...
[Epoch 35] train avg loss 0.00953452, dev acc 0.7729, dev avg loss 0.51168, throughput 8.99607K wps
Observed Improvement.
Begin Testing...
[Epoch 36 Batch 30/62] avg loss 0.0091558, throughput 9.14531K wps
[Epoch 36 Batch 60/62] avg loss 0.00936666, throughput 8.81222K wps
Begin Testing...
[Epoch 36] train avg loss 0.00947296, dev acc 0.7758, dev avg loss 0.508327, throughput 8.95687K wps
Observed Improvement.
Begin Testing...
[Epoch 37 Batch 30/62] avg loss 0.00900431, throughput 9.00447K wps
[Epoch 37 Batch 60/62] avg loss 0.00923196, throughput 8.99615K wps
Begin Testing...
[Epoch 37] train avg loss 0.0091482, dev acc 0.7788, dev avg loss 0.505044, throughput 9.03271K wps
Observed Improvement.
Begin Testing...
[Epoch 38 Batch 30/62] avg loss 0.00912185, throughput 9.07326K wps
[Epoch 38 Batch 60/62] avg loss 0.00904435, throughput 9.06261K wps
Begin Testing...
[Epoch 38] train avg loss 0.00923227, dev acc 0.7788, dev avg loss 0.503015, throughput 9.10452K wps
Observed Improvement.
Begin Testing...
[Epoch 39 Batch 30/62] avg loss 0.00921867, throughput 9.1734K wps
[Epoch 39 Batch 60/62] avg loss 0.00864065, throughput 9.0881K wps
Begin Testing...
[Epoch 39] train avg loss 0.00904911, dev acc 0.7817, dev avg loss 0.497667, throughput 9.1576K wps
Observed Improvement.
Begin Testing...
[Epoch 40 Batch 30/62] avg loss 0.00865225, throughput 9.00687K wps
[Epoch 40 Batch 60/62] avg loss 0.00900748, throughput 9.06788K wps
Begin Testing...
[Epoch 40] train avg loss 0.00892283, dev acc 0.7847, dev avg loss 0.494617, throughput 9.02888K wps
Observed Improvement.
Begin Testing...
[Epoch 41 Batch 30/62] avg loss 0.00860627, throughput 9.07965K wps
[Epoch 41 Batch 60/62] avg loss 0.00881029, throughput 8.91483K wps
Begin Testing...
[Epoch 41] train avg loss 0.00892238, dev acc 0.7552, dev avg loss 0.49407, throughput 9.01675K wps
[Epoch 42 Batch 30/62] avg loss 0.00862958, throughput 9.17771K wps
[Epoch 42 Batch 60/62] avg loss 0.00846994, throughput 8.98878K wps
Begin Testing...
[Epoch 42] train avg loss 0.00864036, dev acc 0.7699, dev avg loss 0.48984, throughput 9.0505K wps
[Epoch 43 Batch 30/62] avg loss 0.00826338, throughput 9.04999K wps
[Epoch 43 Batch 60/62] avg loss 0.00864736, throughput 8.93958K wps
Begin Testing...
[Epoch 43] train avg loss 0.00861966, dev acc 0.7817, dev avg loss 0.489863, throughput 8.96807K wps
[Epoch 44 Batch 30/62] avg loss 0.00832313, throughput 8.79115K wps
[Epoch 44 Batch 60/62] avg loss 0.00858802, throughput 9.16683K wps
Begin Testing...
[Epoch 44] train avg loss 0.00864292, dev acc 0.7729, dev avg loss 0.48278, throughput 8.96534K wps
[Epoch 45 Batch 30/62] avg loss 0.00846337, throughput 9.13661K wps
[Epoch 45 Batch 60/62] avg loss 0.00848745, throughput 8.67003K wps
Begin Testing...
[Epoch 45] train avg loss 0.00852214, dev acc 0.7876, dev avg loss 0.479817, throughput 8.86171K wps
Observed Improvement.
Begin Testing...
[Epoch 46 Batch 30/62] avg loss 0.00811179, throughput 9.17503K wps
[Epoch 46 Batch 60/62] avg loss 0.00852034, throughput 9.09733K wps
Begin Testing...
[Epoch 46] train avg loss 0.00840069, dev acc 0.7906, dev avg loss 0.477298, throughput 9.1644K wps
Observed Improvement.
Begin Testing...
[Epoch 47 Batch 30/62] avg loss 0.00801606, throughput 8.82597K wps
[Epoch 47 Batch 60/62] avg loss 0.00835611, throughput 8.71879K wps
Begin Testing...
[Epoch 47] train avg loss 0.00825316, dev acc 0.7876, dev avg loss 0.474875, throughput 8.80921K wps
[Epoch 48 Batch 30/62] avg loss 0.00802509, throughput 8.67718K wps
[Epoch 48 Batch 60/62] avg loss 0.00824079, throughput 8.95291K wps
Begin Testing...
[Epoch 48] train avg loss 0.00826799, dev acc 0.7817, dev avg loss 0.472296, throughput 8.81241K wps
[Epoch 49 Batch 30/62] avg loss 0.00779762, throughput 9.02552K wps
[Epoch 49 Batch 60/62] avg loss 0.00829036, throughput 9.02425K wps
Begin Testing...
[Epoch 49] train avg loss 0.0081199, dev acc 0.7847, dev avg loss 0.469934, throughput 9.04277K wps
[Epoch 50 Batch 30/62] avg loss 0.00785918, throughput 9.10995K wps
[Epoch 50 Batch 60/62] avg loss 0.00801579, throughput 8.91798K wps
Begin Testing...
[Epoch 50] train avg loss 0.00799061, dev acc 0.7758, dev avg loss 0.468456, throughput 9.04125K wps
[Epoch 51 Batch 30/62] avg loss 0.00817298, throughput 9.26911K wps
[Epoch 51 Batch 60/62] avg loss 0.00777812, throughput 8.92029K wps
Begin Testing...
[Epoch 51] train avg loss 0.00807504, dev acc 0.7965, dev avg loss 0.465873, throughput 9.04418K wps
Observed Improvement.
Begin Testing...
[Epoch 52 Batch 30/62] avg loss 0.00771876, throughput 9.13043K wps
[Epoch 52 Batch 60/62] avg loss 0.00781287, throughput 9.03767K wps
Begin Testing...
[Epoch 52] train avg loss 0.00784314, dev acc 0.7935, dev avg loss 0.46483, throughput 9.11257K wps
[Epoch 53 Batch 30/62] avg loss 0.00772974, throughput 9.13148K wps
[Epoch 53 Batch 60/62] avg loss 0.00782944, throughput 9.14412K wps
Begin Testing...
[Epoch 53] train avg loss 0.00786915, dev acc 0.7758, dev avg loss 0.464797, throughput 9.16405K wps
[Epoch 54 Batch 30/62] avg loss 0.00766668, throughput 8.97706K wps
[Epoch 54 Batch 60/62] avg loss 0.00753636, throughput 9.01549K wps
Begin Testing...
[Epoch 54] train avg loss 0.00773656, dev acc 0.7994, dev avg loss 0.462374, throughput 9.03227K wps
Observed Improvement.
Begin Testing...
[Epoch 55 Batch 30/62] avg loss 0.00765818, throughput 8.91917K wps
[Epoch 55 Batch 60/62] avg loss 0.00747734, throughput 8.88197K wps
Begin Testing...
[Epoch 55] train avg loss 0.00766812, dev acc 0.7729, dev avg loss 0.458508, throughput 8.92398K wps
[Epoch 56 Batch 30/62] avg loss 0.00738471, throughput 9.23932K wps
[Epoch 56 Batch 60/62] avg loss 0.00770878, throughput 8.76085K wps
Begin Testing...
[Epoch 56] train avg loss 0.00766474, dev acc 0.7788, dev avg loss 0.461777, throughput 8.96677K wps
[Epoch 57 Batch 30/62] avg loss 0.00743561, throughput 9.37869K wps
[Epoch 57 Batch 60/62] avg loss 0.00747675, throughput 9.13484K wps
Begin Testing...
[Epoch 57] train avg loss 0.00755549, dev acc 0.7817, dev avg loss 0.453693, throughput 9.2771K wps
[Epoch 58 Batch 30/62] avg loss 0.00741186, throughput 9.09131K wps
[Epoch 58 Batch 60/62] avg loss 0.00738301, throughput 9.08443K wps
Begin Testing...
[Epoch 58] train avg loss 0.00745896, dev acc 0.7847, dev avg loss 0.454828, throughput 9.11991K wps
[Epoch 59 Batch 30/62] avg loss 0.0070411, throughput 9.27248K wps
[Epoch 59 Batch 60/62] avg loss 0.00750352, throughput 8.9431K wps
Begin Testing...
[Epoch 59] train avg loss 0.00731006, dev acc 0.7817, dev avg loss 0.450357, throughput 9.13194K wps
[Epoch 60 Batch 30/62] avg loss 0.00700579, throughput 9.16568K wps
[Epoch 60 Batch 60/62] avg loss 0.00716109, throughput 8.84923K wps
Begin Testing...
[Epoch 60] train avg loss 0.00713645, dev acc 0.7994, dev avg loss 0.454949, throughput 8.97458K wps
Observed Improvement.
Begin Testing...
[Epoch 61 Batch 30/62] avg loss 0.00711775, throughput 9.1964K wps
[Epoch 61 Batch 60/62] avg loss 0.00705909, throughput 8.99001K wps
Begin Testing...
[Epoch 61] train avg loss 0.00722552, dev acc 0.8053, dev avg loss 0.446081, throughput 9.11861K wps
Observed Improvement.
Begin Testing...
[Epoch 62 Batch 30/62] avg loss 0.00702746, throughput 9.25263K wps
[Epoch 62 Batch 60/62] avg loss 0.00678207, throughput 8.96308K wps
Begin Testing...
[Epoch 62] train avg loss 0.00700191, dev acc 0.8053, dev avg loss 0.444342, throughput 9.08187K wps
Observed Improvement.
Begin Testing...
[Epoch 63 Batch 30/62] avg loss 0.00710548, throughput 8.68739K wps
[Epoch 63 Batch 60/62] avg loss 0.00687362, throughput 9.2131K wps
Begin Testing...
[Epoch 63] train avg loss 0.00705767, dev acc 0.7965, dev avg loss 0.442348, throughput 8.91638K wps
[Epoch 64 Batch 30/62] avg loss 0.00672885, throughput 8.83243K wps
[Epoch 64 Batch 60/62] avg loss 0.00710105, throughput 8.79926K wps
Begin Testing...
[Epoch 64] train avg loss 0.0070233, dev acc 0.7847, dev avg loss 0.445153, throughput 8.85398K wps
[Epoch 65 Batch 30/62] avg loss 0.00685505, throughput 8.99851K wps
[Epoch 65 Batch 60/62] avg loss 0.00671715, throughput 8.64999K wps
Begin Testing...
[Epoch 65] train avg loss 0.00692548, dev acc 0.7876, dev avg loss 0.445547, throughput 8.84585K wps
[Epoch 66 Batch 30/62] avg loss 0.00695195, throughput 9.06557K wps
[Epoch 66 Batch 60/62] avg loss 0.00670954, throughput 8.7968K wps
Begin Testing...
[Epoch 66] train avg loss 0.00698839, dev acc 0.7847, dev avg loss 0.441517, throughput 8.91166K wps
[Epoch 67 Batch 30/62] avg loss 0.00658006, throughput 9.05079K wps
[Epoch 67 Batch 60/62] avg loss 0.00682787, throughput 8.89344K wps
Begin Testing...
[Epoch 67] train avg loss 0.00686816, dev acc 0.7935, dev avg loss 0.437922, throughput 9.00371K wps
[Epoch 68 Batch 30/62] avg loss 0.00637328, throughput 9.12468K wps
[Epoch 68 Batch 60/62] avg loss 0.00666944, throughput 8.94473K wps
Begin Testing...
[Epoch 68] train avg loss 0.00664761, dev acc 0.8083, dev avg loss 0.434911, throughput 9.06492K wps
Observed Improvement.
Begin Testing...
[Epoch 69 Batch 30/62] avg loss 0.00673907, throughput 9.23498K wps
[Epoch 69 Batch 60/62] avg loss 0.0064474, throughput 9.03811K wps
Begin Testing...
[Epoch 69] train avg loss 0.00664685, dev acc 0.8083, dev avg loss 0.432757, throughput 9.15948K wps
Observed Improvement.
Begin Testing...
[Epoch 70 Batch 30/62] avg loss 0.00667133, throughput 9.01211K wps
[Epoch 70 Batch 60/62] avg loss 0.00633324, throughput 9.04135K wps
Begin Testing...
[Epoch 70] train avg loss 0.00656033, dev acc 0.8083, dev avg loss 0.431588, throughput 9.00673K wps
Observed Improvement.
Begin Testing...
[Epoch 71 Batch 30/62] avg loss 0.00624926, throughput 8.84854K wps
[Epoch 71 Batch 60/62] avg loss 0.00632539, throughput 8.80567K wps
Begin Testing...
[Epoch 71] train avg loss 0.00635891, dev acc 0.8083, dev avg loss 0.43051, throughput 8.89969K wps
Observed Improvement.
Begin Testing...
[Epoch 72 Batch 30/62] avg loss 0.00624617, throughput 9.08217K wps
[Epoch 72 Batch 60/62] avg loss 0.00626138, throughput 8.97282K wps
Begin Testing...
[Epoch 72] train avg loss 0.00637846, dev acc 0.8083, dev avg loss 0.430136, throughput 8.99456K wps
Observed Improvement.
Begin Testing...
[Epoch 73 Batch 30/62] avg loss 0.00618355, throughput 9.28187K wps
[Epoch 73 Batch 60/62] avg loss 0.00642252, throughput 9.03016K wps
Begin Testing...
[Epoch 73] train avg loss 0.00638564, dev acc 0.8024, dev avg loss 0.427706, throughput 9.18621K wps
[Epoch 74 Batch 30/62] avg loss 0.00620055, throughput 9.05658K wps
[Epoch 74 Batch 60/62] avg loss 0.00614475, throughput 8.98531K wps
Begin Testing...
[Epoch 74] train avg loss 0.00625293, dev acc 0.8083, dev avg loss 0.427617, throughput 9.00358K wps
Observed Improvement.
Begin Testing...
[Epoch 75 Batch 30/62] avg loss 0.00610704, throughput 9.10584K wps
[Epoch 75 Batch 60/62] avg loss 0.00620173, throughput 8.83783K wps
Begin Testing...
[Epoch 75] train avg loss 0.00627795, dev acc 0.8024, dev avg loss 0.425156, throughput 8.95578K wps
[Epoch 76 Batch 30/62] avg loss 0.00620074, throughput 9.13137K wps
[Epoch 76 Batch 60/62] avg loss 0.00591787, throughput 8.88512K wps
Begin Testing...
[Epoch 76] train avg loss 0.00611365, dev acc 0.8053, dev avg loss 0.42341, throughput 8.99179K wps
[Epoch 77 Batch 30/62] avg loss 0.005711, throughput 9.01361K wps
[Epoch 77 Batch 60/62] avg loss 0.00609378, throughput 9.05867K wps
Begin Testing...
[Epoch 77] train avg loss 0.00602968, dev acc 0.7935, dev avg loss 0.423225, throughput 8.99979K wps
[Epoch 78 Batch 30/62] avg loss 0.00579307, throughput 9.01856K wps
[Epoch 78 Batch 60/62] avg loss 0.00620817, throughput 8.99188K wps
Begin Testing...
[Epoch 78] train avg loss 0.00612213, dev acc 0.8112, dev avg loss 0.421082, throughput 9.03674K wps
Observed Improvement.
Begin Testing...
[Epoch 79 Batch 30/62] avg loss 0.00560924, throughput 9.1055K wps
[Epoch 79 Batch 60/62] avg loss 0.00610083, throughput 8.93744K wps
Begin Testing...
[Epoch 79] train avg loss 0.00594513, dev acc 0.8083, dev avg loss 0.42256, throughput 9.03616K wps
[Epoch 80 Batch 30/62] avg loss 0.00561489, throughput 9.26826K wps
[Epoch 80 Batch 60/62] avg loss 0.00603666, throughput 8.94483K wps
Begin Testing...
[Epoch 80] train avg loss 0.00598307, dev acc 0.8024, dev avg loss 0.424483, throughput 9.08001K wps
[Epoch 81 Batch 30/62] avg loss 0.00579381, throughput 9.2447K wps
[Epoch 81 Batch 60/62] avg loss 0.00574586, throughput 8.63266K wps
Begin Testing...
[Epoch 81] train avg loss 0.00582919, dev acc 0.8083, dev avg loss 0.42195, throughput 8.9081K wps
[Epoch 82 Batch 30/62] avg loss 0.00541197, throughput 9.18906K wps
[Epoch 82 Batch 60/62] avg loss 0.00593201, throughput 9.07629K wps
Begin Testing...
[Epoch 82] train avg loss 0.00571012, dev acc 0.8171, dev avg loss 0.417754, throughput 9.15438K wps
Observed Improvement.
Begin Testing...
[Epoch 83 Batch 30/62] avg loss 0.00576491, throughput 8.92045K wps
[Epoch 83 Batch 60/62] avg loss 0.00553608, throughput 8.84419K wps
Begin Testing...
[Epoch 83] train avg loss 0.0057243, dev acc 0.8053, dev avg loss 0.417158, throughput 8.85669K wps
[Epoch 84 Batch 30/62] avg loss 0.00555618, throughput 9.24711K wps
[Epoch 84 Batch 60/62] avg loss 0.00585866, throughput 8.98721K wps
Begin Testing...
[Epoch 84] train avg loss 0.00578235, dev acc 0.8112, dev avg loss 0.417515, throughput 9.10076K wps
[Epoch 85 Batch 30/62] avg loss 0.00564539, throughput 9.08095K wps
[Epoch 85 Batch 60/62] avg loss 0.00534449, throughput 9.03864K wps
Begin Testing...
[Epoch 85] train avg loss 0.00555788, dev acc 0.8083, dev avg loss 0.414393, throughput 9.09151K wps
[Epoch 86 Batch 30/62] avg loss 0.00571617, throughput 8.87762K wps
[Epoch 86 Batch 60/62] avg loss 0.00525522, throughput 8.77261K wps
Begin Testing...
[Epoch 86] train avg loss 0.00556323, dev acc 0.8142, dev avg loss 0.414164, throughput 8.86071K wps
[Epoch 87 Batch 30/62] avg loss 0.00544976, throughput 8.6385K wps
[Epoch 87 Batch 60/62] avg loss 0.00547899, throughput 9.25852K wps
Begin Testing...
[Epoch 87] train avg loss 0.00554182, dev acc 0.8142, dev avg loss 0.414572, throughput 8.97344K wps
[Epoch 88 Batch 30/62] avg loss 0.00566279, throughput 9.31592K wps
[Epoch 88 Batch 60/62] avg loss 0.00509804, throughput 9.0372K wps
Begin Testing...
[Epoch 88] train avg loss 0.00551136, dev acc 0.8112, dev avg loss 0.411667, throughput 9.20339K wps
[Epoch 89 Batch 30/62] avg loss 0.00545457, throughput 8.94112K wps
[Epoch 89 Batch 60/62] avg loss 0.00513443, throughput 8.96691K wps
Begin Testing...
[Epoch 89] train avg loss 0.00535633, dev acc 0.8142, dev avg loss 0.411846, throughput 8.99251K wps
[Epoch 90 Batch 30/62] avg loss 0.00545503, throughput 9.07556K wps
[Epoch 90 Batch 60/62] avg loss 0.00501498, throughput 8.97744K wps
Begin Testing...
[Epoch 90] train avg loss 0.00529419, dev acc 0.8171, dev avg loss 0.410564, throughput 9.05345K wps
Observed Improvement.
Begin Testing...
[Epoch 91 Batch 30/62] avg loss 0.00560455, throughput 8.78172K wps
[Epoch 91 Batch 60/62] avg loss 0.00489393, throughput 9.15495K wps
Begin Testing...
[Epoch 91] train avg loss 0.00532821, dev acc 0.8112, dev avg loss 0.409256, throughput 8.99597K wps
[Epoch 92 Batch 30/62] avg loss 0.00522451, throughput 9.12831K wps
[Epoch 92 Batch 60/62] avg loss 0.00503458, throughput 9.0072K wps
Begin Testing...
[Epoch 92] train avg loss 0.00518276, dev acc 0.8171, dev avg loss 0.409596, throughput 9.09976K wps
Observed Improvement.
Begin Testing...
[Epoch 93 Batch 30/62] avg loss 0.00515602, throughput 9.23376K wps
[Epoch 93 Batch 60/62] avg loss 0.00492811, throughput 9.03263K wps
Begin Testing...
[Epoch 93] train avg loss 0.00513847, dev acc 0.8142, dev avg loss 0.408784, throughput 9.16094K wps
[Epoch 94 Batch 30/62] avg loss 0.00498037, throughput 9.21101K wps
[Epoch 94 Batch 60/62] avg loss 0.00517799, throughput 9.05376K wps
Begin Testing...
[Epoch 94] train avg loss 0.00515368, dev acc 0.8171, dev avg loss 0.40716, throughput 9.15789K wps
Observed Improvement.
Begin Testing...
[Epoch 95 Batch 30/62] avg loss 0.00518586, throughput 8.85111K wps
[Epoch 95 Batch 60/62] avg loss 0.00466863, throughput 8.76126K wps
Begin Testing...
[Epoch 95] train avg loss 0.00498447, dev acc 0.8142, dev avg loss 0.406532, throughput 8.83723K wps
[Epoch 96 Batch 30/62] avg loss 0.00511942, throughput 9.07114K wps
[Epoch 96 Batch 60/62] avg loss 0.00486505, throughput 9.20593K wps
Begin Testing...
[Epoch 96] train avg loss 0.00507091, dev acc 0.8201, dev avg loss 0.407863, throughput 9.15594K wps
Observed Improvement.
Begin Testing...
[Epoch 97 Batch 30/62] avg loss 0.00488997, throughput 9.01062K wps
[Epoch 97 Batch 60/62] avg loss 0.00483937, throughput 8.85387K wps
Begin Testing...
[Epoch 97] train avg loss 0.0049689, dev acc 0.8112, dev avg loss 0.405483, throughput 8.95702K wps
[Epoch 98 Batch 30/62] avg loss 0.00465978, throughput 9.0116K wps
[Epoch 98 Batch 60/62] avg loss 0.00499572, throughput 9.13921K wps
Begin Testing...
[Epoch 98] train avg loss 0.00494393, dev acc 0.8171, dev avg loss 0.405343, throughput 9.10003K wps
[Epoch 99 Batch 30/62] avg loss 0.00445682, throughput 9.20396K wps
[Epoch 99 Batch 60/62] avg loss 0.00504802, throughput 9.06179K wps
Begin Testing...
[Epoch 99] train avg loss 0.00478353, dev acc 0.8112, dev avg loss 0.404462, throughput 9.15972K wps
[Epoch 100 Batch 30/62] avg loss 0.00457185, throughput 9.12916K wps
[Epoch 100 Batch 60/62] avg loss 0.00466035, throughput 8.97186K wps
Begin Testing...
[Epoch 100] train avg loss 0.00476782, dev acc 0.8230, dev avg loss 0.405146, throughput 9.07978K wps
Observed Improvement.
Begin Testing...
[Epoch 101 Batch 30/62] avg loss 0.00473115, throughput 9.17161K wps
[Epoch 101 Batch 60/62] avg loss 0.00459104, throughput 8.95847K wps
Begin Testing...
[Epoch 101] train avg loss 0.0047418, dev acc 0.8142, dev avg loss 0.402845, throughput 9.05022K wps
[Epoch 102 Batch 30/62] avg loss 0.00466521, throughput 9.05857K wps
[Epoch 102 Batch 60/62] avg loss 0.00456347, throughput 8.97127K wps
Begin Testing...
[Epoch 102] train avg loss 0.00468415, dev acc 0.8142, dev avg loss 0.406005, throughput 9.08455K wps
[Epoch 103 Batch 30/62] avg loss 0.00448616, throughput 8.95345K wps
[Epoch 103 Batch 60/62] avg loss 0.00454617, throughput 8.93397K wps
Begin Testing...
[Epoch 103] train avg loss 0.00465284, dev acc 0.8142, dev avg loss 0.402283, throughput 8.93018K wps
[Epoch 104 Batch 30/62] avg loss 0.00432156, throughput 9.09789K wps
[Epoch 104 Batch 60/62] avg loss 0.00475395, throughput 9.0945K wps
Begin Testing...
[Epoch 104] train avg loss 0.00465868, dev acc 0.8142, dev avg loss 0.401472, throughput 9.12323K wps
[Epoch 105 Batch 30/62] avg loss 0.00470117, throughput 9.04284K wps
[Epoch 105 Batch 60/62] avg loss 0.00451776, throughput 9.07365K wps
Begin Testing...
[Epoch 105] train avg loss 0.00464243, dev acc 0.8201, dev avg loss 0.402581, throughput 9.08911K wps
[Epoch 106 Batch 30/62] avg loss 0.00421396, throughput 9.18497K wps
[Epoch 106 Batch 60/62] avg loss 0.00476538, throughput 9.05701K wps
Begin Testing...
[Epoch 106] train avg loss 0.00453559, dev acc 0.8230, dev avg loss 0.40261, throughput 9.14688K wps
Observed Improvement.
Begin Testing...
[Epoch 107 Batch 30/62] avg loss 0.00427197, throughput 9.26012K wps
[Epoch 107 Batch 60/62] avg loss 0.00454411, throughput 9.07076K wps
Begin Testing...
[Epoch 107] train avg loss 0.00442546, dev acc 0.8142, dev avg loss 0.399675, throughput 9.20257K wps
[Epoch 108 Batch 30/62] avg loss 0.00437752, throughput 8.88494K wps
[Epoch 108 Batch 60/62] avg loss 0.00434792, throughput 8.71573K wps
Begin Testing...
[Epoch 108] train avg loss 0.00442148, dev acc 0.8171, dev avg loss 0.399501, throughput 8.85672K wps
[Epoch 109 Batch 30/62] avg loss 0.00442632, throughput 8.82088K wps
[Epoch 109 Batch 60/62] avg loss 0.0042439, throughput 8.96841K wps
Begin Testing...
[Epoch 109] train avg loss 0.00439645, dev acc 0.8171, dev avg loss 0.398656, throughput 8.92945K wps
[Epoch 110 Batch 30/62] avg loss 0.00410728, throughput 9.11396K wps
[Epoch 110 Batch 60/62] avg loss 0.00433783, throughput 9.12911K wps
Begin Testing...
[Epoch 110] train avg loss 0.00431104, dev acc 0.8171, dev avg loss 0.398478, throughput 9.15118K wps
[Epoch 111 Batch 30/62] avg loss 0.0041946, throughput 9.18092K wps
[Epoch 111 Batch 60/62] avg loss 0.00437602, throughput 8.9966K wps
Begin Testing...
[Epoch 111] train avg loss 0.0043904, dev acc 0.8230, dev avg loss 0.400834, throughput 9.11508K wps
Observed Improvement.
Begin Testing...
[Epoch 112 Batch 30/62] avg loss 0.00440578, throughput 9.06826K wps
[Epoch 112 Batch 60/62] avg loss 0.00397307, throughput 8.85829K wps
Begin Testing...
[Epoch 112] train avg loss 0.00421377, dev acc 0.8230, dev avg loss 0.397445, throughput 8.99628K wps
Observed Improvement.
Begin Testing...
[Epoch 113 Batch 30/62] avg loss 0.00409219, throughput 9.04992K wps
[Epoch 113 Batch 60/62] avg loss 0.00412867, throughput 9.1491K wps
Begin Testing...
[Epoch 113] train avg loss 0.00420075, dev acc 0.8201, dev avg loss 0.400986, throughput 9.12948K wps
[Epoch 114 Batch 30/62] avg loss 0.00398162, throughput 9.00784K wps
[Epoch 114 Batch 60/62] avg loss 0.0042308, throughput 9.1406K wps
Begin Testing...
[Epoch 114] train avg loss 0.00411104, dev acc 0.8171, dev avg loss 0.399603, throughput 9.10558K wps
[Epoch 115 Batch 30/62] avg loss 0.00408546, throughput 9.21021K wps
[Epoch 115 Batch 60/62] avg loss 0.00401174, throughput 9.09967K wps
Begin Testing...
[Epoch 115] train avg loss 0.00409081, dev acc 0.8201, dev avg loss 0.396512, throughput 9.18301K wps
[Epoch 116 Batch 30/62] avg loss 0.00381525, throughput 8.88762K wps
[Epoch 116 Batch 60/62] avg loss 0.00417645, throughput 9.01487K wps
Begin Testing...
[Epoch 116] train avg loss 0.00399483, dev acc 0.8201, dev avg loss 0.396375, throughput 8.98547K wps
[Epoch 117 Batch 30/62] avg loss 0.00407111, throughput 9.23365K wps
[Epoch 117 Batch 60/62] avg loss 0.00391019, throughput 8.95311K wps
Begin Testing...
[Epoch 117] train avg loss 0.00401522, dev acc 0.8230, dev avg loss 0.396445, throughput 9.11393K wps
Observed Improvement.
Begin Testing...
[Epoch 118 Batch 30/62] avg loss 0.00383584, throughput 9.21499K wps
[Epoch 118 Batch 60/62] avg loss 0.00409131, throughput 9.08606K wps
Begin Testing...
[Epoch 118] train avg loss 0.00404166, dev acc 0.8142, dev avg loss 0.404803, throughput 9.16681K wps
[Epoch 119 Batch 30/62] avg loss 0.00404664, throughput 8.77784K wps
[Epoch 119 Batch 60/62] avg loss 0.0037588, throughput 8.98299K wps
Begin Testing...
[Epoch 119] train avg loss 0.0039507, dev acc 0.8230, dev avg loss 0.395251, throughput 8.85511K wps
Observed Improvement.
Begin Testing...
[Epoch 120 Batch 30/62] avg loss 0.00379824, throughput 8.84997K wps
[Epoch 120 Batch 60/62] avg loss 0.00379566, throughput 8.87263K wps
Begin Testing...
[Epoch 120] train avg loss 0.00381888, dev acc 0.8171, dev avg loss 0.39505, throughput 8.8518K wps
[Epoch 121 Batch 30/62] avg loss 0.00386036, throughput 9.31736K wps
[Epoch 121 Batch 60/62] avg loss 0.00347202, throughput 8.9582K wps
Begin Testing...
[Epoch 121] train avg loss 0.003733, dev acc 0.8201, dev avg loss 0.394996, throughput 9.16703K wps
[Epoch 122 Batch 30/62] avg loss 0.00371324, throughput 9.15793K wps
[Epoch 122 Batch 60/62] avg loss 0.00386963, throughput 9.09413K wps
Begin Testing...
[Epoch 122] train avg loss 0.00381793, dev acc 0.8201, dev avg loss 0.396058, throughput 9.15901K wps
[Epoch 123 Batch 30/62] avg loss 0.00370753, throughput 8.81779K wps
[Epoch 123 Batch 60/62] avg loss 0.0036735, throughput 9.00434K wps
Begin Testing...
[Epoch 123] train avg loss 0.00376607, dev acc 0.8142, dev avg loss 0.397235, throughput 8.88299K wps
[Epoch 124 Batch 30/62] avg loss 0.00370078, throughput 9.29115K wps
[Epoch 124 Batch 60/62] avg loss 0.00381625, throughput 8.92099K wps
Begin Testing...
[Epoch 124] train avg loss 0.0037771, dev acc 0.8230, dev avg loss 0.395265, throughput 9.07781K wps
Observed Improvement.
Begin Testing...
[Epoch 125 Batch 30/62] avg loss 0.00363758, throughput 8.62746K wps
[Epoch 125 Batch 60/62] avg loss 0.0037587, throughput 9.23998K wps
Begin Testing...
[Epoch 125] train avg loss 0.00371275, dev acc 0.8142, dev avg loss 0.395916, throughput 8.95806K wps
[Epoch 126 Batch 30/62] avg loss 0.00356516, throughput 9.04099K wps
[Epoch 126 Batch 60/62] avg loss 0.00347753, throughput 9.18888K wps
Begin Testing...
[Epoch 126] train avg loss 0.00355488, dev acc 0.8171, dev avg loss 0.39377, throughput 9.14441K wps
[Epoch 127 Batch 30/62] avg loss 0.00345491, throughput 9.27521K wps
[Epoch 127 Batch 60/62] avg loss 0.00355179, throughput 8.76088K wps
Begin Testing...
[Epoch 127] train avg loss 0.00354231, dev acc 0.8201, dev avg loss 0.393287, throughput 9.04162K wps
[Epoch 128 Batch 30/62] avg loss 0.00358875, throughput 9.15918K wps
[Epoch 128 Batch 60/62] avg loss 0.00349937, throughput 8.94187K wps
Begin Testing...
[Epoch 128] train avg loss 0.00354625, dev acc 0.8230, dev avg loss 0.394019, throughput 9.07723K wps
Observed Improvement.
Begin Testing...
[Epoch 129 Batch 30/62] avg loss 0.00377649, throughput 8.91957K wps
[Epoch 129 Batch 60/62] avg loss 0.00330427, throughput 8.96469K wps
Begin Testing...
[Epoch 129] train avg loss 0.0035634, dev acc 0.8201, dev avg loss 0.394731, throughput 8.91941K wps
[Epoch 130 Batch 30/62] avg loss 0.00366568, throughput 9.03502K wps
[Epoch 130 Batch 60/62] avg loss 0.00334294, throughput 8.85271K wps
Begin Testing...
[Epoch 130] train avg loss 0.00359427, dev acc 0.8230, dev avg loss 0.396523, throughput 8.93193K wps
Observed Improvement.
Begin Testing...
[Epoch 131 Batch 30/62] avg loss 0.00331607, throughput 8.77977K wps
[Epoch 131 Batch 60/62] avg loss 0.00342713, throughput 9.22848K wps
Begin Testing...
[Epoch 131] train avg loss 0.00348193, dev acc 0.8201, dev avg loss 0.39317, throughput 9.03088K wps
[Epoch 132 Batch 30/62] avg loss 0.00329068, throughput 8.95309K wps
[Epoch 132 Batch 60/62] avg loss 0.00339461, throughput 9.04656K wps
Begin Testing...
[Epoch 132] train avg loss 0.00336064, dev acc 0.8201, dev avg loss 0.394094, throughput 8.95751K wps
[Epoch 133 Batch 30/62] avg loss 0.00323006, throughput 9.00339K wps
[Epoch 133 Batch 60/62] avg loss 0.00341548, throughput 9.03372K wps
Begin Testing...
[Epoch 133] train avg loss 0.00338219, dev acc 0.8201, dev avg loss 0.392493, throughput 8.9857K wps
[Epoch 134 Batch 30/62] avg loss 0.0033072, throughput 9.10265K wps
[Epoch 134 Batch 60/62] avg loss 0.00341848, throughput 9.06929K wps
Begin Testing...
[Epoch 134] train avg loss 0.00345444, dev acc 0.8201, dev avg loss 0.392866, throughput 9.11038K wps
[Epoch 135 Batch 30/62] avg loss 0.00326052, throughput 9.03862K wps
[Epoch 135 Batch 60/62] avg loss 0.00328953, throughput 8.86694K wps
Begin Testing...
[Epoch 135] train avg loss 0.00330153, dev acc 0.8171, dev avg loss 0.392453, throughput 8.92084K wps
[Epoch 136 Batch 30/62] avg loss 0.00337178, throughput 8.94949K wps
[Epoch 136 Batch 60/62] avg loss 0.00325115, throughput 9.01168K wps
Begin Testing...
[Epoch 136] train avg loss 0.00332056, dev acc 0.8260, dev avg loss 0.393174, throughput 9.01501K wps
Observed Improvement.
Begin Testing...
[Epoch 137 Batch 30/62] avg loss 0.003201, throughput 8.77701K wps
[Epoch 137 Batch 60/62] avg loss 0.00325484, throughput 9.16109K wps
Begin Testing...
[Epoch 137] train avg loss 0.00323012, dev acc 0.8260, dev avg loss 0.392378, throughput 8.99863K wps
Observed Improvement.
Begin Testing...
[Epoch 138 Batch 30/62] avg loss 0.0030921, throughput 9.27299K wps
[Epoch 138 Batch 60/62] avg loss 0.00315651, throughput 8.94091K wps
Begin Testing...
[Epoch 138] train avg loss 0.00318129, dev acc 0.8201, dev avg loss 0.392702, throughput 9.07487K wps
[Epoch 139 Batch 30/62] avg loss 0.00313525, throughput 9.04555K wps
[Epoch 139 Batch 60/62] avg loss 0.00322509, throughput 8.73788K wps
Begin Testing...
[Epoch 139] train avg loss 0.00320753, dev acc 0.8260, dev avg loss 0.397936, throughput 8.8685K wps
Observed Improvement.
Begin Testing...
[Epoch 140 Batch 30/62] avg loss 0.00324585, throughput 9.26549K wps
[Epoch 140 Batch 60/62] avg loss 0.0030244, throughput 8.95229K wps
Begin Testing...
[Epoch 140] train avg loss 0.00319051, dev acc 0.8171, dev avg loss 0.390743, throughput 9.07242K wps
[Epoch 141 Batch 30/62] avg loss 0.00297394, throughput 9.20306K wps
[Epoch 141 Batch 60/62] avg loss 0.00308043, throughput 8.83998K wps
Begin Testing...
[Epoch 141] train avg loss 0.00305806, dev acc 0.8260, dev avg loss 0.391604, throughput 9.00087K wps
Observed Improvement.
Begin Testing...
[Epoch 142 Batch 30/62] avg loss 0.00300664, throughput 9.09534K wps
[Epoch 142 Batch 60/62] avg loss 0.00313192, throughput 8.95735K wps
Begin Testing...
[Epoch 142] train avg loss 0.00313494, dev acc 0.8171, dev avg loss 0.392037, throughput 9.0554K wps
[Epoch 143 Batch 30/62] avg loss 0.00299815, throughput 9.12077K wps
[Epoch 143 Batch 60/62] avg loss 0.00302653, throughput 9.19029K wps
Begin Testing...
[Epoch 143] train avg loss 0.00304424, dev acc 0.8171, dev avg loss 0.395984, throughput 9.18247K wps
[Epoch 144 Batch 30/62] avg loss 0.00299565, throughput 9.25606K wps
[Epoch 144 Batch 60/62] avg loss 0.00305609, throughput 9.20213K wps
Begin Testing...
[Epoch 144] train avg loss 0.00305648, dev acc 0.8201, dev avg loss 0.392428, throughput 9.2543K wps
[Epoch 145 Batch 30/62] avg loss 0.00321602, throughput 8.99995K wps
[Epoch 145 Batch 60/62] avg loss 0.00291847, throughput 8.9695K wps
Begin Testing...
[Epoch 145] train avg loss 0.00308045, dev acc 0.8230, dev avg loss 0.392577, throughput 9.01836K wps
[Epoch 146 Batch 30/62] avg loss 0.00289988, throughput 9.16725K wps
[Epoch 146 Batch 60/62] avg loss 0.00308144, throughput 9.09576K wps
Begin Testing...
[Epoch 146] train avg loss 0.00299043, dev acc 0.8201, dev avg loss 0.391907, throughput 9.15989K wps
[Epoch 147 Batch 30/62] avg loss 0.00288356, throughput 9.15989K wps
[Epoch 147 Batch 60/62] avg loss 0.00305579, throughput 8.99853K wps
Begin Testing...
[Epoch 147] train avg loss 0.00299696, dev acc 0.8260, dev avg loss 0.392169, throughput 9.10832K wps
Observed Improvement.
Begin Testing...
[Epoch 148 Batch 30/62] avg loss 0.0028769, throughput 9.06405K wps
[Epoch 148 Batch 60/62] avg loss 0.00284572, throughput 9.02579K wps
Begin Testing...
[Epoch 148] train avg loss 0.00288648, dev acc 0.8230, dev avg loss 0.390831, throughput 9.01071K wps
[Epoch 149 Batch 30/62] avg loss 0.00282018, throughput 9.04169K wps
[Epoch 149 Batch 60/62] avg loss 0.00276702, throughput 8.85503K wps
Begin Testing...
[Epoch 149] train avg loss 0.00284863, dev acc 0.8260, dev avg loss 0.39018, throughput 8.90909K wps
Observed Improvement.
Begin Testing...
[Epoch 150 Batch 30/62] avg loss 0.00293906, throughput 9.27806K wps
[Epoch 150 Batch 60/62] avg loss 0.00281813, throughput 9.04338K wps
Begin Testing...
[Epoch 150] train avg loss 0.00293365, dev acc 0.8230, dev avg loss 0.392252, throughput 9.17312K wps
[Epoch 151 Batch 30/62] avg loss 0.0029007, throughput 9.20902K wps
[Epoch 151 Batch 60/62] avg loss 0.00274467, throughput 8.92137K wps
Begin Testing...
[Epoch 151] train avg loss 0.00284849, dev acc 0.8260, dev avg loss 0.390088, throughput 9.12817K wps
Observed Improvement.
Begin Testing...
[Epoch 152 Batch 30/62] avg loss 0.00264753, throughput 9.16997K wps
[Epoch 152 Batch 60/62] avg loss 0.00293895, throughput 8.74498K wps
Begin Testing...
[Epoch 152] train avg loss 0.00280014, dev acc 0.8230, dev avg loss 0.390044, throughput 8.93269K wps
[Epoch 153 Batch 30/62] avg loss 0.00268596, throughput 9.2099K wps
[Epoch 153 Batch 60/62] avg loss 0.00289917, throughput 9.04741K wps
Begin Testing...
[Epoch 153] train avg loss 0.00280962, dev acc 0.8201, dev avg loss 0.389325, throughput 9.15519K wps
[Epoch 154 Batch 30/62] avg loss 0.00291977, throughput 9.07286K wps
[Epoch 154 Batch 60/62] avg loss 0.00266689, throughput 8.94589K wps
Begin Testing...
[Epoch 154] train avg loss 0.00280869, dev acc 0.8230, dev avg loss 0.389192, throughput 8.99048K wps
[Epoch 155 Batch 30/62] avg loss 0.00273617, throughput 8.97794K wps
[Epoch 155 Batch 60/62] avg loss 0.00265491, throughput 9.1019K wps
Begin Testing...
[Epoch 155] train avg loss 0.00271914, dev acc 0.8201, dev avg loss 0.390483, throughput 9.07147K wps
[Epoch 156 Batch 30/62] avg loss 0.00279895, throughput 9.11874K wps
[Epoch 156 Batch 60/62] avg loss 0.00262161, throughput 8.80814K wps
Begin Testing...
[Epoch 156] train avg loss 0.00273592, dev acc 0.8230, dev avg loss 0.388977, throughput 8.98443K wps
[Epoch 157 Batch 30/62] avg loss 0.00254962, throughput 9.04546K wps
[Epoch 157 Batch 60/62] avg loss 0.00278872, throughput 8.8071K wps
Begin Testing...
[Epoch 157] train avg loss 0.00270975, dev acc 0.8260, dev avg loss 0.389061, throughput 8.95099K wps
Observed Improvement.
Begin Testing...
[Epoch 158 Batch 30/62] avg loss 0.0024904, throughput 8.91638K wps
[Epoch 158 Batch 60/62] avg loss 0.00278995, throughput 8.99843K wps
Begin Testing...
[Epoch 158] train avg loss 0.00273754, dev acc 0.8230, dev avg loss 0.388831, throughput 8.98964K wps
[Epoch 159 Batch 30/62] avg loss 0.0026251, throughput 9.30607K wps
[Epoch 159 Batch 60/62] avg loss 0.00270359, throughput 8.9404K wps
Begin Testing...
[Epoch 159] train avg loss 0.002727, dev acc 0.8171, dev avg loss 0.39141, throughput 9.07529K wps
[Epoch 160 Batch 30/62] avg loss 0.00263521, throughput 9.1508K wps
[Epoch 160 Batch 60/62] avg loss 0.00256865, throughput 9.20543K wps
Begin Testing...
[Epoch 160] train avg loss 0.0026168, dev acc 0.8289, dev avg loss 0.389355, throughput 9.19315K wps
Observed Improvement.
Begin Testing...
[Epoch 161 Batch 30/62] avg loss 0.00257117, throughput 8.8129K wps
[Epoch 161 Batch 60/62] avg loss 0.00254581, throughput 9.12978K wps
Begin Testing...
[Epoch 161] train avg loss 0.00258028, dev acc 0.8260, dev avg loss 0.38869, throughput 9.00082K wps
[Epoch 162 Batch 30/62] avg loss 0.00262009, throughput 8.91239K wps
[Epoch 162 Batch 60/62] avg loss 0.00251793, throughput 8.68754K wps
Begin Testing...
[Epoch 162] train avg loss 0.00266238, dev acc 0.8230, dev avg loss 0.389414, throughput 8.77319K wps
[Epoch 163 Batch 30/62] avg loss 0.00247111, throughput 9.15182K wps
[Epoch 163 Batch 60/62] avg loss 0.0026621, throughput 8.72086K wps
Begin Testing...
[Epoch 163] train avg loss 0.00267206, dev acc 0.8260, dev avg loss 0.392113, throughput 8.91783K wps
[Epoch 164 Batch 30/62] avg loss 0.00251285, throughput 9.11685K wps
[Epoch 164 Batch 60/62] avg loss 0.00245158, throughput 9.06226K wps
Begin Testing...
[Epoch 164] train avg loss 0.00255961, dev acc 0.8230, dev avg loss 0.389413, throughput 9.12402K wps
[Epoch 165 Batch 30/62] avg loss 0.0024151, throughput 9.20002K wps
[Epoch 165 Batch 60/62] avg loss 0.0025178, throughput 9.0293K wps
Begin Testing...
[Epoch 165] train avg loss 0.00251145, dev acc 0.8260, dev avg loss 0.391297, throughput 9.06983K wps
[Epoch 166 Batch 30/62] avg loss 0.0024198, throughput 8.97808K wps
[Epoch 166 Batch 60/62] avg loss 0.0024088, throughput 9.16201K wps
Begin Testing...
[Epoch 166] train avg loss 0.00242734, dev acc 0.8230, dev avg loss 0.389638, throughput 9.08025K wps
[Epoch 167 Batch 30/62] avg loss 0.00223839, throughput 9.23381K wps
[Epoch 167 Batch 60/62] avg loss 0.00259136, throughput 9.0217K wps
Begin Testing...
[Epoch 167] train avg loss 0.00242068, dev acc 0.8289, dev avg loss 0.389298, throughput 9.15735K wps
Observed Improvement.
Begin Testing...
[Epoch 168 Batch 30/62] avg loss 0.00237038, throughput 9.32164K wps
[Epoch 168 Batch 60/62] avg loss 0.00237066, throughput 9.13995K wps
Begin Testing...
[Epoch 168] train avg loss 0.00244202, dev acc 0.8230, dev avg loss 0.390293, throughput 9.25639K wps
[Epoch 169 Batch 30/62] avg loss 0.00235737, throughput 9.00111K wps
[Epoch 169 Batch 60/62] avg loss 0.00244201, throughput 9.02954K wps
Begin Testing...
[Epoch 169] train avg loss 0.00241839, dev acc 0.8319, dev avg loss 0.388819, throughput 9.04557K wps
Observed Improvement.
Begin Testing...
[Epoch 170 Batch 30/62] avg loss 0.00243748, throughput 8.98468K wps
[Epoch 170 Batch 60/62] avg loss 0.00221637, throughput 9.03298K wps
Begin Testing...
[Epoch 170] train avg loss 0.00233661, dev acc 0.8230, dev avg loss 0.391229, throughput 9.04174K wps
[Epoch 171 Batch 30/62] avg loss 0.00241262, throughput 9.18288K wps
[Epoch 171 Batch 60/62] avg loss 0.00247152, throughput 8.9582K wps
Begin Testing...
[Epoch 171] train avg loss 0.00246452, dev acc 0.8260, dev avg loss 0.391088, throughput 9.10217K wps
[Epoch 172 Batch 30/62] avg loss 0.00225962, throughput 9.09004K wps
[Epoch 172 Batch 60/62] avg loss 0.00231232, throughput 8.52622K wps
Begin Testing...
[Epoch 172] train avg loss 0.00235002, dev acc 0.8319, dev avg loss 0.38886, throughput 8.78441K wps
Observed Improvement.
Begin Testing...
[Epoch 173 Batch 30/62] avg loss 0.00225776, throughput 8.65456K wps
[Epoch 173 Batch 60/62] avg loss 0.00236676, throughput 8.99648K wps
Begin Testing...
[Epoch 173] train avg loss 0.00234981, dev acc 0.8230, dev avg loss 0.390864, throughput 8.80842K wps
[Epoch 174 Batch 30/62] avg loss 0.0022472, throughput 8.94634K wps
[Epoch 174 Batch 60/62] avg loss 0.00233449, throughput 8.92526K wps
Begin Testing...
[Epoch 174] train avg loss 0.00235872, dev acc 0.8201, dev avg loss 0.391877, throughput 8.9733K wps
[Epoch 175 Batch 30/62] avg loss 0.00227015, throughput 9.1685K wps
[Epoch 175 Batch 60/62] avg loss 0.00229712, throughput 8.99911K wps
Begin Testing...
[Epoch 175] train avg loss 0.00227793, dev acc 0.8289, dev avg loss 0.388902, throughput 9.04951K wps
[Epoch 176 Batch 30/62] avg loss 0.00213953, throughput 9.17661K wps
[Epoch 176 Batch 60/62] avg loss 0.0023493, throughput 9.03009K wps
Begin Testing...
[Epoch 176] train avg loss 0.00229353, dev acc 0.8230, dev avg loss 0.389478, throughput 9.13419K wps
[Epoch 177 Batch 30/62] avg loss 0.00222037, throughput 9.15855K wps
[Epoch 177 Batch 60/62] avg loss 0.00223138, throughput 9.13344K wps
Begin Testing...
[Epoch 177] train avg loss 0.00224796, dev acc 0.8289, dev avg loss 0.388512, throughput 9.12989K wps
[Epoch 178 Batch 30/62] avg loss 0.00228997, throughput 8.91456K wps
[Epoch 178 Batch 60/62] avg loss 0.00226454, throughput 8.94417K wps
Begin Testing...
[Epoch 178] train avg loss 0.00231087, dev acc 0.8230, dev avg loss 0.389013, throughput 8.91006K wps
[Epoch 179 Batch 30/62] avg loss 0.00220217, throughput 9.07366K wps
[Epoch 179 Batch 60/62] avg loss 0.00218008, throughput 9.06858K wps
Begin Testing...
[Epoch 179] train avg loss 0.00220372, dev acc 0.8230, dev avg loss 0.388649, throughput 9.10427K wps
[Epoch 180 Batch 30/62] avg loss 0.00208279, throughput 9.22279K wps
[Epoch 180 Batch 60/62] avg loss 0.00230609, throughput 9.04259K wps
Begin Testing...
[Epoch 180] train avg loss 0.00223031, dev acc 0.8260, dev avg loss 0.390052, throughput 9.10218K wps
[Epoch 181 Batch 30/62] avg loss 0.00203308, throughput 8.95137K wps
[Epoch 181 Batch 60/62] avg loss 0.00221824, throughput 9.01863K wps
Begin Testing...
[Epoch 181] train avg loss 0.00213421, dev acc 0.8260, dev avg loss 0.388956, throughput 9.01973K wps
[Epoch 182 Batch 30/62] avg loss 0.00206458, throughput 8.7872K wps
[Epoch 182 Batch 60/62] avg loss 0.00200301, throughput 8.92531K wps
Begin Testing...
[Epoch 182] train avg loss 0.00206245, dev acc 0.8230, dev avg loss 0.388525, throughput 8.8957K wps
[Epoch 183 Batch 30/62] avg loss 0.00215077, throughput 9.1887K wps
[Epoch 183 Batch 60/62] avg loss 0.00219822, throughput 9.00544K wps
Begin Testing...
[Epoch 183] train avg loss 0.0021846, dev acc 0.8230, dev avg loss 0.389236, throughput 9.14365K wps
[Epoch 184 Batch 30/62] avg loss 0.00195463, throughput 8.85595K wps
[Epoch 184 Batch 60/62] avg loss 0.00206049, throughput 9.20664K wps
Begin Testing...
[Epoch 184] train avg loss 0.00201137, dev acc 0.8230, dev avg loss 0.391478, throughput 9.05962K wps
[Epoch 185 Batch 30/62] avg loss 0.0020564, throughput 9.22309K wps
[Epoch 185 Batch 60/62] avg loss 0.00195614, throughput 8.8274K wps
Begin Testing...
[Epoch 185] train avg loss 0.00201625, dev acc 0.8230, dev avg loss 0.389545, throughput 9.00671K wps
[Epoch 186 Batch 30/62] avg loss 0.00204428, throughput 9.24838K wps
[Epoch 186 Batch 60/62] avg loss 0.00205572, throughput 8.91487K wps
Begin Testing...
[Epoch 186] train avg loss 0.00205023, dev acc 0.8201, dev avg loss 0.394051, throughput 9.10587K wps
[Epoch 187 Batch 30/62] avg loss 0.00205537, throughput 9.24758K wps
[Epoch 187 Batch 60/62] avg loss 0.00204329, throughput 9.09798K wps
Begin Testing...
[Epoch 187] train avg loss 0.00204326, dev acc 0.8230, dev avg loss 0.390263, throughput 9.19618K wps
[Epoch 188 Batch 30/62] avg loss 0.00200467, throughput 9.00205K wps
[Epoch 188 Batch 60/62] avg loss 0.00203844, throughput 9.04963K wps
Begin Testing...
[Epoch 188] train avg loss 0.00204428, dev acc 0.8260, dev avg loss 0.390125, throughput 9.05859K wps
[Epoch 189 Batch 30/62] avg loss 0.00192147, throughput 9.28K wps
[Epoch 189 Batch 60/62] avg loss 0.00205678, throughput 9.17096K wps
Begin Testing...
[Epoch 189] train avg loss 0.00201794, dev acc 0.8230, dev avg loss 0.389949, throughput 9.20089K wps
[Epoch 190 Batch 30/62] avg loss 0.00197842, throughput 9.09772K wps
[Epoch 190 Batch 60/62] avg loss 0.00184815, throughput 9.09929K wps
Begin Testing...
[Epoch 190] train avg loss 0.00193679, dev acc 0.8230, dev avg loss 0.390031, throughput 9.12947K wps
[Epoch 191 Batch 30/62] avg loss 0.00206305, throughput 8.79703K wps
[Epoch 191 Batch 60/62] avg loss 0.00195974, throughput 9.12919K wps
Begin Testing...
[Epoch 191] train avg loss 0.00201982, dev acc 0.8171, dev avg loss 0.392761, throughput 8.94559K wps
[Epoch 192 Batch 30/62] avg loss 0.00192617, throughput 8.81522K wps
[Epoch 192 Batch 60/62] avg loss 0.0020201, throughput 9.02129K wps
Begin Testing...
[Epoch 192] train avg loss 0.00199567, dev acc 0.8230, dev avg loss 0.390326, throughput 8.95334K wps
[Epoch 193 Batch 30/62] avg loss 0.00184696, throughput 8.87296K wps
[Epoch 193 Batch 60/62] avg loss 0.00198847, throughput 8.91685K wps
Begin Testing...
[Epoch 193] train avg loss 0.00193773, dev acc 0.8201, dev avg loss 0.393172, throughput 8.88573K wps
[Epoch 194 Batch 30/62] avg loss 0.00194323, throughput 9.2024K wps
[Epoch 194 Batch 60/62] avg loss 0.00186059, throughput 9.06895K wps
Begin Testing...
[Epoch 194] train avg loss 0.00196811, dev acc 0.8260, dev avg loss 0.393164, throughput 9.09789K wps
[Epoch 195 Batch 30/62] avg loss 0.00194774, throughput 9.08346K wps
[Epoch 195 Batch 60/62] avg loss 0.00183798, throughput 9.15975K wps
Begin Testing...
[Epoch 195] train avg loss 0.0019047, dev acc 0.8230, dev avg loss 0.390582, throughput 9.15089K wps
[Epoch 196 Batch 30/62] avg loss 0.00188702, throughput 9.08859K wps
[Epoch 196 Batch 60/62] avg loss 0.00191214, throughput 9.0553K wps
Begin Testing...
[Epoch 196] train avg loss 0.00191341, dev acc 0.8289, dev avg loss 0.391163, throughput 9.10517K wps
[Epoch 197 Batch 30/62] avg loss 0.0017843, throughput 8.66505K wps
[Epoch 197 Batch 60/62] avg loss 0.0019262, throughput 9.04664K wps
Begin Testing...
[Epoch 197] train avg loss 0.0018607, dev acc 0.8260, dev avg loss 0.390539, throughput 8.81683K wps
[Epoch 198 Batch 30/62] avg loss 0.00179608, throughput 9.31282K wps
[Epoch 198 Batch 60/62] avg loss 0.0019086, throughput 8.75018K wps
Begin Testing...
[Epoch 198] train avg loss 0.00184786, dev acc 0.8230, dev avg loss 0.390313, throughput 8.99601K wps
[Epoch 199 Batch 30/62] avg loss 0.00191382, throughput 9.16945K wps
[Epoch 199 Batch 60/62] avg loss 0.00170203, throughput 8.8768K wps
Begin Testing...
[Epoch 199] train avg loss 0.00183023, dev acc 0.8260, dev avg loss 0.390356, throughput 9.05934K wps
Test loss 0.343406, test acc 0.8541
Total time cost 156.06s
[Epoch 0 Batch 30/62] avg loss 0.0132876, throughput 8.45561K wps
[Epoch 0 Batch 60/62] avg loss 0.0132553, throughput 9.11975K wps
Begin Testing...
[Epoch 0] train avg loss 0.0134769, dev acc 0.6224, dev avg loss 0.66151, throughput 8.81549K wps
Observed Improvement.
Begin Testing...
[Epoch 1 Batch 30/62] avg loss 0.0131731, throughput 9.22331K wps
[Epoch 1 Batch 60/62] avg loss 0.0131966, throughput 8.86874K wps
Begin Testing...
[Epoch 1] train avg loss 0.0133936, dev acc 0.6224, dev avg loss 0.657367, throughput 9.0755K wps
Observed Improvement.
Begin Testing...
[Epoch 2 Batch 30/62] avg loss 0.0132028, throughput 9.14476K wps
[Epoch 2 Batch 60/62] avg loss 0.01296, throughput 8.93478K wps
Begin Testing...
[Epoch 2] train avg loss 0.0132441, dev acc 0.6224, dev avg loss 0.654896, throughput 9.0629K wps
Observed Improvement.
Begin Testing...
[Epoch 3 Batch 30/62] avg loss 0.0128897, throughput 9.12656K wps
[Epoch 3 Batch 60/62] avg loss 0.0129723, throughput 9.1488K wps
Begin Testing...
[Epoch 3] train avg loss 0.0130761, dev acc 0.6224, dev avg loss 0.651682, throughput 9.16637K wps
Observed Improvement.
Begin Testing...
[Epoch 4 Batch 30/62] avg loss 0.0130138, throughput 9.31273K wps
[Epoch 4 Batch 60/62] avg loss 0.012727, throughput 9.14506K wps
Begin Testing...
[Epoch 4] train avg loss 0.0130722, dev acc 0.6224, dev avg loss 0.646035, throughput 9.25329K wps
Observed Improvement.
Begin Testing...
[Epoch 5 Batch 30/62] avg loss 0.0129382, throughput 9.08778K wps
[Epoch 5 Batch 60/62] avg loss 0.0126058, throughput 9.05058K wps
Begin Testing...
[Epoch 5] train avg loss 0.0129262, dev acc 0.6224, dev avg loss 0.642694, throughput 9.10106K wps
Observed Improvement.
Begin Testing...
[Epoch 6 Batch 30/62] avg loss 0.0127627, throughput 9.16848K wps
[Epoch 6 Batch 60/62] avg loss 0.0124784, throughput 8.76503K wps
Begin Testing...
[Epoch 6] train avg loss 0.0127801, dev acc 0.6224, dev avg loss 0.639923, throughput 8.95723K wps
Observed Improvement.
Begin Testing...
[Epoch 7 Batch 30/62] avg loss 0.0124817, throughput 9.20965K wps
[Epoch 7 Batch 60/62] avg loss 0.0128187, throughput 9.03786K wps
Begin Testing...
[Epoch 7] train avg loss 0.0128032, dev acc 0.6224, dev avg loss 0.634223, throughput 9.15476K wps
Observed Improvement.
Begin Testing...
[Epoch 8 Batch 30/62] avg loss 0.0123953, throughput 8.87943K wps
[Epoch 8 Batch 60/62] avg loss 0.0125247, throughput 8.92204K wps
Begin Testing...
[Epoch 8] train avg loss 0.0125943, dev acc 0.6224, dev avg loss 0.6311, throughput 8.88654K wps
Observed Improvement.
Begin Testing...
[Epoch 9 Batch 30/62] avg loss 0.0125783, throughput 8.87702K wps
[Epoch 9 Batch 60/62] avg loss 0.0123451, throughput 8.94013K wps
Begin Testing...
[Epoch 9] train avg loss 0.0125935, dev acc 0.6224, dev avg loss 0.628773, throughput 8.94798K wps
Observed Improvement.
Begin Testing...
[Epoch 10 Batch 30/62] avg loss 0.0123979, throughput 9.0942K wps
[Epoch 10 Batch 60/62] avg loss 0.0121884, throughput 9.08981K wps
Begin Testing...
[Epoch 10] train avg loss 0.0124025, dev acc 0.6224, dev avg loss 0.623944, throughput 9.07222K wps
Observed Improvement.
Begin Testing...
[Epoch 11 Batch 30/62] avg loss 0.0122545, throughput 9.22811K wps
[Epoch 11 Batch 60/62] avg loss 0.0121519, throughput 8.86702K wps
Begin Testing...
[Epoch 11] train avg loss 0.0124046, dev acc 0.6224, dev avg loss 0.618164, throughput 9.07465K wps
Observed Improvement.
Begin Testing...
[Epoch 12 Batch 30/62] avg loss 0.0121331, throughput 9.24537K wps
[Epoch 12 Batch 60/62] avg loss 0.0121441, throughput 8.88856K wps
Begin Testing...
[Epoch 12] train avg loss 0.0122708, dev acc 0.6224, dev avg loss 0.614699, throughput 9.12063K wps
Observed Improvement.
Begin Testing...
[Epoch 13 Batch 30/62] avg loss 0.0119992, throughput 9.20981K wps
[Epoch 13 Batch 60/62] avg loss 0.0118928, throughput 9.00477K wps
Begin Testing...
[Epoch 13] train avg loss 0.0120834, dev acc 0.6224, dev avg loss 0.610038, throughput 9.13336K wps
Observed Improvement.
Begin Testing...
[Epoch 14 Batch 30/62] avg loss 0.0117267, throughput 9.22468K wps
[Epoch 14 Batch 60/62] avg loss 0.0119447, throughput 8.72394K wps
Begin Testing...
[Epoch 14] train avg loss 0.0119995, dev acc 0.6254, dev avg loss 0.605136, throughput 8.94251K wps
Observed Improvement.
Begin Testing...
[Epoch 15 Batch 30/62] avg loss 0.0118905, throughput 8.80423K wps
[Epoch 15 Batch 60/62] avg loss 0.0117623, throughput 8.75252K wps
Begin Testing...
[Epoch 15] train avg loss 0.0119933, dev acc 0.6490, dev avg loss 0.599952, throughput 8.80025K wps
Observed Improvement.
Begin Testing...
[Epoch 16 Batch 30/62] avg loss 0.0116099, throughput 8.89971K wps
[Epoch 16 Batch 60/62] avg loss 0.0117253, throughput 9.08545K wps
Begin Testing...
[Epoch 16] train avg loss 0.0118701, dev acc 0.6519, dev avg loss 0.594921, throughput 9.02122K wps
Observed Improvement.
Begin Testing...
[Epoch 17 Batch 30/62] avg loss 0.0115125, throughput 9.08299K wps
[Epoch 17 Batch 60/62] avg loss 0.0115343, throughput 8.91813K wps
Begin Testing...
[Epoch 17] train avg loss 0.0116716, dev acc 0.6342, dev avg loss 0.591668, throughput 9.02387K wps
[Epoch 18 Batch 30/62] avg loss 0.0116093, throughput 9.25618K wps
[Epoch 18 Batch 60/62] avg loss 0.0112707, throughput 9.14785K wps
Begin Testing...
[Epoch 18] train avg loss 0.0116359, dev acc 0.6431, dev avg loss 0.586719, throughput 9.2089K wps
[Epoch 19 Batch 30/62] avg loss 0.0111942, throughput 9.19855K wps
[Epoch 19 Batch 60/62] avg loss 0.0113517, throughput 9.06941K wps
Begin Testing...
[Epoch 19] train avg loss 0.0114023, dev acc 0.6608, dev avg loss 0.580141, throughput 9.16072K wps
Observed Improvement.
Begin Testing...
[Epoch 20 Batch 30/62] avg loss 0.0112884, throughput 9.02488K wps
[Epoch 20 Batch 60/62] avg loss 0.01125, throughput 9.10574K wps
Begin Testing...
[Epoch 20] train avg loss 0.0113931, dev acc 0.6667, dev avg loss 0.575206, throughput 9.09768K wps
Observed Improvement.
Begin Testing...
[Epoch 21 Batch 30/62] avg loss 0.0110551, throughput 9.11714K wps
[Epoch 21 Batch 60/62] avg loss 0.0109772, throughput 8.92851K wps
Begin Testing...
[Epoch 21] train avg loss 0.0112012, dev acc 0.6814, dev avg loss 0.569235, throughput 9.05602K wps
Observed Improvement.
Begin Testing...
[Epoch 22 Batch 30/62] avg loss 0.0108906, throughput 9.18931K wps
[Epoch 22 Batch 60/62] avg loss 0.0109161, throughput 9.0969K wps
Begin Testing...
[Epoch 22] train avg loss 0.0110333, dev acc 0.6755, dev avg loss 0.565071, throughput 9.16948K wps
[Epoch 23 Batch 30/62] avg loss 0.0108322, throughput 8.77868K wps
[Epoch 23 Batch 60/62] avg loss 0.0109007, throughput 9.26747K wps
Begin Testing...
[Epoch 23] train avg loss 0.0109815, dev acc 0.6962, dev avg loss 0.557993, throughput 9.04912K wps
Observed Improvement.
Begin Testing...
[Epoch 24 Batch 30/62] avg loss 0.0104915, throughput 9.02784K wps
[Epoch 24 Batch 60/62] avg loss 0.0106607, throughput 8.88969K wps
Begin Testing...
[Epoch 24] train avg loss 0.0107238, dev acc 0.6873, dev avg loss 0.553753, throughput 8.99255K wps
[Epoch 25 Batch 30/62] avg loss 0.0105539, throughput 9.13876K wps
[Epoch 25 Batch 60/62] avg loss 0.0103674, throughput 9.03205K wps
Begin Testing...
[Epoch 25] train avg loss 0.0106305, dev acc 0.7198, dev avg loss 0.546778, throughput 9.11254K wps
Observed Improvement.
Begin Testing...
[Epoch 26 Batch 30/62] avg loss 0.0105213, throughput 8.90056K wps
[Epoch 26 Batch 60/62] avg loss 0.0103132, throughput 9.05982K wps
Begin Testing...
[Epoch 26] train avg loss 0.0105651, dev acc 0.7316, dev avg loss 0.541361, throughput 8.96162K wps
Observed Improvement.
Begin Testing...
[Epoch 27 Batch 30/62] avg loss 0.0100189, throughput 9.18659K wps
[Epoch 27 Batch 60/62] avg loss 0.0104297, throughput 8.85759K wps
Begin Testing...
[Epoch 27] train avg loss 0.0104011, dev acc 0.7581, dev avg loss 0.536001, throughput 9.03006K wps
Observed Improvement.
Begin Testing...
[Epoch 28 Batch 30/62] avg loss 0.0100161, throughput 9.23895K wps
[Epoch 28 Batch 60/62] avg loss 0.0103444, throughput 9.00357K wps
Begin Testing...
[Epoch 28] train avg loss 0.0102928, dev acc 0.7227, dev avg loss 0.532478, throughput 9.08504K wps
[Epoch 29 Batch 30/62] avg loss 0.0101713, throughput 9.12397K wps
[Epoch 29 Batch 60/62] avg loss 0.00988469, throughput 8.83402K wps
Begin Testing...
[Epoch 29] train avg loss 0.010175, dev acc 0.7345, dev avg loss 0.527136, throughput 9.05047K wps
[Epoch 30 Batch 30/62] avg loss 0.01017, throughput 9.09714K wps
[Epoch 30 Batch 60/62] avg loss 0.00975744, throughput 9.11167K wps
Begin Testing...
[Epoch 30] train avg loss 0.0101047, dev acc 0.7345, dev avg loss 0.523196, throughput 9.13383K wps
[Epoch 31 Batch 30/62] avg loss 0.00978476, throughput 9.33656K wps
[Epoch 31 Batch 60/62] avg loss 0.00964161, throughput 8.82522K wps
Begin Testing...
[Epoch 31] train avg loss 0.00986816, dev acc 0.7640, dev avg loss 0.516502, throughput 9.10263K wps
Observed Improvement.
Begin Testing...
[Epoch 32 Batch 30/62] avg loss 0.00977155, throughput 9.06995K wps
[Epoch 32 Batch 60/62] avg loss 0.0096413, throughput 8.67747K wps
Begin Testing...
[Epoch 32] train avg loss 0.0098111, dev acc 0.7404, dev avg loss 0.515401, throughput 8.84548K wps
[Epoch 33 Batch 30/62] avg loss 0.00970585, throughput 8.86616K wps
[Epoch 33 Batch 60/62] avg loss 0.00949489, throughput 9.22248K wps
Begin Testing...
[Epoch 33] train avg loss 0.00972615, dev acc 0.7640, dev avg loss 0.507288, throughput 9.07331K wps
Observed Improvement.
Begin Testing...
[Epoch 34 Batch 30/62] avg loss 0.00953053, throughput 9.23215K wps
[Epoch 34 Batch 60/62] avg loss 0.00945092, throughput 9.14017K wps
Begin Testing...
[Epoch 34] train avg loss 0.00963935, dev acc 0.7670, dev avg loss 0.503342, throughput 9.21188K wps
Observed Improvement.
Begin Testing...
[Epoch 35 Batch 30/62] avg loss 0.00936077, throughput 8.99924K wps
[Epoch 35 Batch 60/62] avg loss 0.0093663, throughput 8.97645K wps
Begin Testing...
[Epoch 35] train avg loss 0.00949699, dev acc 0.7581, dev avg loss 0.502348, throughput 9.0196K wps
[Epoch 36 Batch 30/62] avg loss 0.00924312, throughput 8.89064K wps
[Epoch 36 Batch 60/62] avg loss 0.00938918, throughput 8.82178K wps
Begin Testing...
[Epoch 36] train avg loss 0.00942501, dev acc 0.7670, dev avg loss 0.498053, throughput 8.89108K wps
Observed Improvement.
Begin Testing...
[Epoch 37 Batch 30/62] avg loss 0.00923564, throughput 9.24479K wps
[Epoch 37 Batch 60/62] avg loss 0.00896775, throughput 8.87604K wps
Begin Testing...
[Epoch 37] train avg loss 0.00926659, dev acc 0.7758, dev avg loss 0.491135, throughput 9.10233K wps
Observed Improvement.
Begin Testing...
[Epoch 38 Batch 30/62] avg loss 0.00912311, throughput 9.11919K wps
[Epoch 38 Batch 60/62] avg loss 0.00885499, throughput 8.9464K wps
Begin Testing...
[Epoch 38] train avg loss 0.00908254, dev acc 0.7463, dev avg loss 0.496743, throughput 9.06636K wps
[Epoch 39 Batch 30/62] avg loss 0.00896807, throughput 8.87276K wps
[Epoch 39 Batch 60/62] avg loss 0.00882336, throughput 9.17707K wps
Begin Testing...
[Epoch 39] train avg loss 0.0090144, dev acc 0.7758, dev avg loss 0.483477, throughput 9.05754K wps
Observed Improvement.
Begin Testing...
[Epoch 40 Batch 30/62] avg loss 0.00898926, throughput 9.18717K wps
[Epoch 40 Batch 60/62] avg loss 0.00869694, throughput 9.0509K wps
Begin Testing...
[Epoch 40] train avg loss 0.0089965, dev acc 0.7699, dev avg loss 0.4808, throughput 9.11458K wps
[Epoch 41 Batch 30/62] avg loss 0.00881641, throughput 9.16886K wps
[Epoch 41 Batch 60/62] avg loss 0.00852921, throughput 8.89846K wps
Begin Testing...
[Epoch 41] train avg loss 0.00882386, dev acc 0.7699, dev avg loss 0.479483, throughput 8.99643K wps
[Epoch 42 Batch 30/62] avg loss 0.0084994, throughput 9.14413K wps
[Epoch 42 Batch 60/62] avg loss 0.00873453, throughput 9.04207K wps
Begin Testing...
[Epoch 42] train avg loss 0.00876293, dev acc 0.7788, dev avg loss 0.472783, throughput 9.06765K wps
Observed Improvement.
Begin Testing...
[Epoch 43 Batch 30/62] avg loss 0.00860046, throughput 9.22304K wps
[Epoch 43 Batch 60/62] avg loss 0.00839171, throughput 9.02643K wps
Begin Testing...
[Epoch 43] train avg loss 0.00860392, dev acc 0.7817, dev avg loss 0.471513, throughput 9.15215K wps
Observed Improvement.
Begin Testing...
[Epoch 44 Batch 30/62] avg loss 0.00845894, throughput 9.10115K wps
[Epoch 44 Batch 60/62] avg loss 0.00841086, throughput 9.09923K wps
Begin Testing...
[Epoch 44] train avg loss 0.00852773, dev acc 0.7817, dev avg loss 0.467022, throughput 9.13155K wps
Observed Improvement.
Begin Testing...
[Epoch 45 Batch 30/62] avg loss 0.00845697, throughput 9.02079K wps
[Epoch 45 Batch 60/62] avg loss 0.00824676, throughput 9.10679K wps
Begin Testing...
[Epoch 45] train avg loss 0.00846504, dev acc 0.7729, dev avg loss 0.469515, throughput 9.09414K wps
[Epoch 46 Batch 30/62] avg loss 0.00820148, throughput 9.03413K wps
[Epoch 46 Batch 60/62] avg loss 0.00829459, throughput 9.04172K wps
Begin Testing...
[Epoch 46] train avg loss 0.00838788, dev acc 0.7876, dev avg loss 0.462893, throughput 9.06553K wps
Observed Improvement.
Begin Testing...
[Epoch 47 Batch 30/62] avg loss 0.00818826, throughput 9.05901K wps
[Epoch 47 Batch 60/62] avg loss 0.00820274, throughput 8.89243K wps
Begin Testing...
[Epoch 47] train avg loss 0.00827926, dev acc 0.7847, dev avg loss 0.462999, throughput 9.0077K wps
[Epoch 48 Batch 30/62] avg loss 0.00803796, throughput 9.1773K wps
[Epoch 48 Batch 60/62] avg loss 0.00816644, throughput 9.03683K wps
Begin Testing...
[Epoch 48] train avg loss 0.00826223, dev acc 0.7847, dev avg loss 0.456449, throughput 9.13517K wps
[Epoch 49 Batch 30/62] avg loss 0.00807189, throughput 8.94966K wps
[Epoch 49 Batch 60/62] avg loss 0.00788774, throughput 9.0672K wps
Begin Testing...
[Epoch 49] train avg loss 0.00807222, dev acc 0.7876, dev avg loss 0.45514, throughput 8.98511K wps
Observed Improvement.
Begin Testing...
[Epoch 50 Batch 30/62] avg loss 0.0078571, throughput 9.11012K wps
[Epoch 50 Batch 60/62] avg loss 0.00811324, throughput 8.81973K wps
Begin Testing...
[Epoch 50] train avg loss 0.00803195, dev acc 0.7876, dev avg loss 0.456562, throughput 9.0403K wps
Observed Improvement.
Begin Testing...
[Epoch 51 Batch 30/62] avg loss 0.00777182, throughput 9.32042K wps
[Epoch 51 Batch 60/62] avg loss 0.00758011, throughput 9.0329K wps
Begin Testing...
[Epoch 51] train avg loss 0.00780664, dev acc 0.7906, dev avg loss 0.44834, throughput 9.20909K wps
Observed Improvement.
Begin Testing...
[Epoch 52 Batch 30/62] avg loss 0.00762567, throughput 9.09117K wps
[Epoch 52 Batch 60/62] avg loss 0.00784403, throughput 8.71907K wps
Begin Testing...
[Epoch 52] train avg loss 0.00780426, dev acc 0.7935, dev avg loss 0.44628, throughput 8.88406K wps
Observed Improvement.
Begin Testing...
[Epoch 53 Batch 30/62] avg loss 0.00747622, throughput 9.01305K wps
[Epoch 53 Batch 60/62] avg loss 0.00759051, throughput 9.06284K wps
Begin Testing...
[Epoch 53] train avg loss 0.00764888, dev acc 0.7994, dev avg loss 0.443675, throughput 9.06918K wps
Observed Improvement.
Begin Testing...
[Epoch 54 Batch 30/62] avg loss 0.00759654, throughput 8.94556K wps
[Epoch 54 Batch 60/62] avg loss 0.00747443, throughput 8.9268K wps
Begin Testing...
[Epoch 54] train avg loss 0.00758043, dev acc 0.7994, dev avg loss 0.441572, throughput 8.91285K wps
Observed Improvement.
Begin Testing...
[Epoch 55 Batch 30/62] avg loss 0.00729817, throughput 8.92136K wps
[Epoch 55 Batch 60/62] avg loss 0.00746863, throughput 8.96447K wps
Begin Testing...
[Epoch 55] train avg loss 0.00747847, dev acc 0.7876, dev avg loss 0.447753, throughput 8.97716K wps
[Epoch 56 Batch 30/62] avg loss 0.00720056, throughput 8.94013K wps
[Epoch 56 Batch 60/62] avg loss 0.00766667, throughput 9.24609K wps
Begin Testing...
[Epoch 56] train avg loss 0.00750793, dev acc 0.8053, dev avg loss 0.437375, throughput 9.11865K wps
Observed Improvement.
Begin Testing...
[Epoch 57 Batch 30/62] avg loss 0.00746082, throughput 8.95064K wps
[Epoch 57 Batch 60/62] avg loss 0.00743178, throughput 9.10106K wps
Begin Testing...
[Epoch 57] train avg loss 0.00758818, dev acc 0.8024, dev avg loss 0.436416, throughput 9.01621K wps
[Epoch 58 Batch 30/62] avg loss 0.00708922, throughput 9.05661K wps
[Epoch 58 Batch 60/62] avg loss 0.00728631, throughput 8.85055K wps
Begin Testing...
[Epoch 58] train avg loss 0.00727611, dev acc 0.8053, dev avg loss 0.434465, throughput 8.92571K wps
Observed Improvement.
Begin Testing...
[Epoch 59 Batch 30/62] avg loss 0.00709474, throughput 8.96948K wps
[Epoch 59 Batch 60/62] avg loss 0.00709165, throughput 8.99538K wps
Begin Testing...
[Epoch 59] train avg loss 0.00718059, dev acc 0.8024, dev avg loss 0.432752, throughput 8.96051K wps
[Epoch 60 Batch 30/62] avg loss 0.00713214, throughput 9.08374K wps
[Epoch 60 Batch 60/62] avg loss 0.00725407, throughput 9.17997K wps
Begin Testing...
[Epoch 60] train avg loss 0.00729645, dev acc 0.7935, dev avg loss 0.429651, throughput 9.11357K wps
[Epoch 61 Batch 30/62] avg loss 0.00707573, throughput 9.16969K wps
[Epoch 61 Batch 60/62] avg loss 0.00694688, throughput 9.08434K wps
Begin Testing...
[Epoch 61] train avg loss 0.00712673, dev acc 0.7994, dev avg loss 0.429887, throughput 9.15563K wps
[Epoch 62 Batch 30/62] avg loss 0.00675083, throughput 9.26344K wps
[Epoch 62 Batch 60/62] avg loss 0.00696232, throughput 9.18261K wps
Begin Testing...
[Epoch 62] train avg loss 0.00698866, dev acc 0.7965, dev avg loss 0.426316, throughput 9.18608K wps
[Epoch 63 Batch 30/62] avg loss 0.0070295, throughput 8.97661K wps
[Epoch 63 Batch 60/62] avg loss 0.00672416, throughput 9.03446K wps
Begin Testing...
[Epoch 63] train avg loss 0.00694359, dev acc 0.7994, dev avg loss 0.425432, throughput 8.98448K wps
[Epoch 64 Batch 30/62] avg loss 0.00700647, throughput 9.19932K wps
[Epoch 64 Batch 60/62] avg loss 0.00665317, throughput 9.01688K wps
Begin Testing...
[Epoch 64] train avg loss 0.00693751, dev acc 0.7994, dev avg loss 0.423305, throughput 9.13793K wps
[Epoch 65 Batch 30/62] avg loss 0.00658017, throughput 9.24586K wps
[Epoch 65 Batch 60/62] avg loss 0.0069029, throughput 9.0247K wps
Begin Testing...
[Epoch 65] train avg loss 0.00684717, dev acc 0.8024, dev avg loss 0.421776, throughput 9.1623K wps
[Epoch 66 Batch 30/62] avg loss 0.0068067, throughput 8.66372K wps
[Epoch 66 Batch 60/62] avg loss 0.0066818, throughput 8.96968K wps
Begin Testing...
[Epoch 66] train avg loss 0.00679954, dev acc 0.7994, dev avg loss 0.430576, throughput 8.84968K wps
[Epoch 67 Batch 30/62] avg loss 0.00672231, throughput 8.94852K wps
[Epoch 67 Batch 60/62] avg loss 0.00644797, throughput 8.69288K wps
Begin Testing...
[Epoch 67] train avg loss 0.0066501, dev acc 0.8024, dev avg loss 0.423926, throughput 8.8029K wps
[Epoch 68 Batch 30/62] avg loss 0.00646009, throughput 9.09708K wps
[Epoch 68 Batch 60/62] avg loss 0.00648803, throughput 8.98066K wps
Begin Testing...
[Epoch 68] train avg loss 0.00664014, dev acc 0.8024, dev avg loss 0.423383, throughput 9.06985K wps
[Epoch 69 Batch 30/62] avg loss 0.00653673, throughput 9.25451K wps
[Epoch 69 Batch 60/62] avg loss 0.00612906, throughput 8.83295K wps
Begin Testing...
[Epoch 69] train avg loss 0.00645372, dev acc 0.8053, dev avg loss 0.418917, throughput 9.0868K wps
Observed Improvement.
Begin Testing...
[Epoch 70 Batch 30/62] avg loss 0.0064329, throughput 8.96297K wps
[Epoch 70 Batch 60/62] avg loss 0.00629598, throughput 9.08476K wps
Begin Testing...
[Epoch 70] train avg loss 0.0064453, dev acc 0.8053, dev avg loss 0.414889, throughput 9.05249K wps
Observed Improvement.
Begin Testing...
[Epoch 71 Batch 30/62] avg loss 0.00638181, throughput 9.12334K wps
[Epoch 71 Batch 60/62] avg loss 0.0063818, throughput 8.9356K wps
Begin Testing...
[Epoch 71] train avg loss 0.00641589, dev acc 0.8053, dev avg loss 0.415934, throughput 9.00542K wps
Observed Improvement.
Begin Testing...
[Epoch 72 Batch 30/62] avg loss 0.006524, throughput 8.99555K wps
[Epoch 72 Batch 60/62] avg loss 0.00610418, throughput 8.99824K wps
Begin Testing...
[Epoch 72] train avg loss 0.00643829, dev acc 0.8024, dev avg loss 0.41264, throughput 8.96046K wps
[Epoch 73 Batch 30/62] avg loss 0.00631432, throughput 9.15941K wps
[Epoch 73 Batch 60/62] avg loss 0.00588179, throughput 9.0124K wps
Begin Testing...
[Epoch 73] train avg loss 0.00612201, dev acc 0.8053, dev avg loss 0.412663, throughput 9.12065K wps
Observed Improvement.
Begin Testing...
[Epoch 74 Batch 30/62] avg loss 0.00618474, throughput 8.9061K wps
[Epoch 74 Batch 60/62] avg loss 0.00611096, throughput 9.10481K wps
Begin Testing...
[Epoch 74] train avg loss 0.00624688, dev acc 0.8083, dev avg loss 0.41114, throughput 9.03523K wps
Observed Improvement.
Begin Testing...
[Epoch 75 Batch 30/62] avg loss 0.00590113, throughput 9.04836K wps
[Epoch 75 Batch 60/62] avg loss 0.00605265, throughput 9.01191K wps
Begin Testing...
[Epoch 75] train avg loss 0.00604335, dev acc 0.8142, dev avg loss 0.407884, throughput 9.06058K wps
Observed Improvement.
Begin Testing...
[Epoch 76 Batch 30/62] avg loss 0.00597757, throughput 9.12479K wps
[Epoch 76 Batch 60/62] avg loss 0.00588778, throughput 9.10126K wps
Begin Testing...
[Epoch 76] train avg loss 0.00601998, dev acc 0.8142, dev avg loss 0.409253, throughput 9.14264K wps
Observed Improvement.
Begin Testing...
[Epoch 77 Batch 30/62] avg loss 0.00618954, throughput 9.20355K wps
[Epoch 77 Batch 60/62] avg loss 0.0057835, throughput 9.06855K wps
Begin Testing...
[Epoch 77] train avg loss 0.00604728, dev acc 0.8112, dev avg loss 0.404398, throughput 9.16554K wps
[Epoch 78 Batch 30/62] avg loss 0.00588274, throughput 9.24419K wps
[Epoch 78 Batch 60/62] avg loss 0.00577986, throughput 9.07115K wps
Begin Testing...
[Epoch 78] train avg loss 0.00592791, dev acc 0.8083, dev avg loss 0.403152, throughput 9.12002K wps
[Epoch 79 Batch 30/62] avg loss 0.00580821, throughput 8.91125K wps
[Epoch 79 Batch 60/62] avg loss 0.00577278, throughput 8.82213K wps
Begin Testing...
[Epoch 79] train avg loss 0.00590993, dev acc 0.8142, dev avg loss 0.40266, throughput 8.90133K wps
Observed Improvement.
Begin Testing...
[Epoch 80 Batch 30/62] avg loss 0.00566944, throughput 8.98197K wps
[Epoch 80 Batch 60/62] avg loss 0.00595017, throughput 9.09596K wps
Begin Testing...
[Epoch 80] train avg loss 0.00588677, dev acc 0.8112, dev avg loss 0.404107, throughput 9.0716K wps
[Epoch 81 Batch 30/62] avg loss 0.00549659, throughput 9.21833K wps
[Epoch 81 Batch 60/62] avg loss 0.00563485, throughput 8.8827K wps
Begin Testing...
[Epoch 81] train avg loss 0.00562422, dev acc 0.8112, dev avg loss 0.401564, throughput 9.08097K wps
[Epoch 82 Batch 30/62] avg loss 0.00572382, throughput 8.97286K wps
[Epoch 82 Batch 60/62] avg loss 0.00551136, throughput 8.86274K wps
Begin Testing...
[Epoch 82] train avg loss 0.00566646, dev acc 0.8083, dev avg loss 0.40687, throughput 8.90643K wps
[Epoch 83 Batch 30/62] avg loss 0.00549234, throughput 9.1589K wps
[Epoch 83 Batch 60/62] avg loss 0.00550252, throughput 9.06772K wps
Begin Testing...
[Epoch 83] train avg loss 0.00556847, dev acc 0.8171, dev avg loss 0.400588, throughput 9.07212K wps
Observed Improvement.
Begin Testing...
[Epoch 84 Batch 30/62] avg loss 0.00550064, throughput 8.57971K wps
[Epoch 84 Batch 60/62] avg loss 0.0053013, throughput 9.13932K wps
Begin Testing...
[Epoch 84] train avg loss 0.00547818, dev acc 0.8083, dev avg loss 0.396702, throughput 8.88127K wps
[Epoch 85 Batch 30/62] avg loss 0.005385, throughput 8.91169K wps
[Epoch 85 Batch 60/62] avg loss 0.0054127, throughput 9.12126K wps
Begin Testing...
[Epoch 85] train avg loss 0.0055466, dev acc 0.8142, dev avg loss 0.397101, throughput 9.0379K wps
[Epoch 86 Batch 30/62] avg loss 0.00540365, throughput 8.89797K wps
[Epoch 86 Batch 60/62] avg loss 0.00514419, throughput 8.91592K wps
Begin Testing...
[Epoch 86] train avg loss 0.00533682, dev acc 0.8112, dev avg loss 0.395086, throughput 8.87586K wps
[Epoch 87 Batch 30/62] avg loss 0.00522818, throughput 9.04114K wps
[Epoch 87 Batch 60/62] avg loss 0.00532519, throughput 9.08168K wps
Begin Testing...
[Epoch 87] train avg loss 0.00540125, dev acc 0.8142, dev avg loss 0.396612, throughput 9.09594K wps
[Epoch 88 Batch 30/62] avg loss 0.00522114, throughput 8.92998K wps
[Epoch 88 Batch 60/62] avg loss 0.00540974, throughput 8.65511K wps
Begin Testing...
[Epoch 88] train avg loss 0.00535974, dev acc 0.8201, dev avg loss 0.39832, throughput 8.76915K wps
Observed Improvement.
Begin Testing...
[Epoch 89 Batch 30/62] avg loss 0.00521054, throughput 8.72473K wps
[Epoch 89 Batch 60/62] avg loss 0.0052141, throughput 8.92494K wps
Begin Testing...
[Epoch 89] train avg loss 0.00527471, dev acc 0.8171, dev avg loss 0.396411, throughput 8.86201K wps
[Epoch 90 Batch 30/62] avg loss 0.00490167, throughput 8.91428K wps
[Epoch 90 Batch 60/62] avg loss 0.00535828, throughput 9.14378K wps
Begin Testing...
[Epoch 90] train avg loss 0.00522072, dev acc 0.8112, dev avg loss 0.392256, throughput 9.05783K wps
[Epoch 91 Batch 30/62] avg loss 0.0049004, throughput 8.87584K wps
[Epoch 91 Batch 60/62] avg loss 0.00516429, throughput 8.9974K wps
Begin Testing...
[Epoch 91] train avg loss 0.0051201, dev acc 0.8142, dev avg loss 0.391519, throughput 8.96779K wps
[Epoch 92 Batch 30/62] avg loss 0.00515745, throughput 9.11584K wps
[Epoch 92 Batch 60/62] avg loss 0.00524234, throughput 9.1484K wps
Begin Testing...
[Epoch 92] train avg loss 0.0052225, dev acc 0.8201, dev avg loss 0.397081, throughput 9.1602K wps
Observed Improvement.
Begin Testing...
[Epoch 93 Batch 30/62] avg loss 0.00489463, throughput 8.91094K wps
[Epoch 93 Batch 60/62] avg loss 0.00503653, throughput 8.97188K wps
Begin Testing...
[Epoch 93] train avg loss 0.00497562, dev acc 0.8201, dev avg loss 0.395723, throughput 8.96717K wps
Observed Improvement.
Begin Testing...
[Epoch 94 Batch 30/62] avg loss 0.00467676, throughput 8.62998K wps
[Epoch 94 Batch 60/62] avg loss 0.00510395, throughput 8.77013K wps
Begin Testing...
[Epoch 94] train avg loss 0.00494843, dev acc 0.8171, dev avg loss 0.391459, throughput 8.68452K wps
[Epoch 95 Batch 30/62] avg loss 0.00497095, throughput 9.15742K wps
[Epoch 95 Batch 60/62] avg loss 0.00472933, throughput 9.04109K wps
Begin Testing...
[Epoch 95] train avg loss 0.00488375, dev acc 0.8201, dev avg loss 0.393667, throughput 9.12876K wps
Observed Improvement.
Begin Testing...
[Epoch 96 Batch 30/62] avg loss 0.00491664, throughput 8.9496K wps
[Epoch 96 Batch 60/62] avg loss 0.00503736, throughput 9.00481K wps
Begin Testing...
[Epoch 96] train avg loss 0.00499143, dev acc 0.8171, dev avg loss 0.389711, throughput 9.00345K wps
[Epoch 97 Batch 30/62] avg loss 0.0048957, throughput 8.75162K wps
[Epoch 97 Batch 60/62] avg loss 0.00495094, throughput 8.8079K wps
Begin Testing...
[Epoch 97] train avg loss 0.00494018, dev acc 0.8112, dev avg loss 0.39882, throughput 8.80169K wps
[Epoch 98 Batch 30/62] avg loss 0.00442995, throughput 8.92575K wps
[Epoch 98 Batch 60/62] avg loss 0.00490703, throughput 9.15548K wps
Begin Testing...
[Epoch 98] train avg loss 0.00470108, dev acc 0.8142, dev avg loss 0.386994, throughput 9.03435K wps
[Epoch 99 Batch 30/62] avg loss 0.00473233, throughput 8.83893K wps
[Epoch 99 Batch 60/62] avg loss 0.00466081, throughput 8.99383K wps
Begin Testing...
[Epoch 99] train avg loss 0.0047361, dev acc 0.8112, dev avg loss 0.384915, throughput 8.88844K wps
[Epoch 100 Batch 30/62] avg loss 0.00467506, throughput 9.11835K wps
[Epoch 100 Batch 60/62] avg loss 0.00442251, throughput 9.07617K wps
Begin Testing...
[Epoch 100] train avg loss 0.00462128, dev acc 0.8201, dev avg loss 0.389764, throughput 9.12824K wps
Observed Improvement.
Begin Testing...
[Epoch 101 Batch 30/62] avg loss 0.00465674, throughput 8.93805K wps
[Epoch 101 Batch 60/62] avg loss 0.00457755, throughput 8.88385K wps
Begin Testing...
[Epoch 101] train avg loss 0.00470789, dev acc 0.8230, dev avg loss 0.387246, throughput 8.89035K wps
Observed Improvement.
Begin Testing...
[Epoch 102 Batch 30/62] avg loss 0.00463771, throughput 9.21976K wps
[Epoch 102 Batch 60/62] avg loss 0.00449965, throughput 9.05076K wps
Begin Testing...
[Epoch 102] train avg loss 0.00469929, dev acc 0.8053, dev avg loss 0.407393, throughput 9.15827K wps
[Epoch 103 Batch 30/62] avg loss 0.0043875, throughput 8.9667K wps
[Epoch 103 Batch 60/62] avg loss 0.00467099, throughput 9.03181K wps
Begin Testing...
[Epoch 103] train avg loss 0.0045509, dev acc 0.8171, dev avg loss 0.397873, throughput 9.04245K wps
[Epoch 104 Batch 30/62] avg loss 0.00439218, throughput 9.2001K wps
[Epoch 104 Batch 60/62] avg loss 0.00445879, throughput 9.06621K wps
Begin Testing...
[Epoch 104] train avg loss 0.00443517, dev acc 0.8171, dev avg loss 0.382957, throughput 9.16072K wps
[Epoch 105 Batch 30/62] avg loss 0.00454518, throughput 8.62535K wps
[Epoch 105 Batch 60/62] avg loss 0.0041696, throughput 9.09392K wps
Begin Testing...
[Epoch 105] train avg loss 0.00440152, dev acc 0.8171, dev avg loss 0.382525, throughput 8.84261K wps
[Epoch 106 Batch 30/62] avg loss 0.00424241, throughput 9.05797K wps
[Epoch 106 Batch 60/62] avg loss 0.0043575, throughput 9.05319K wps
Begin Testing...
[Epoch 106] train avg loss 0.00436901, dev acc 0.8171, dev avg loss 0.381564, throughput 9.07572K wps
[Epoch 107 Batch 30/62] avg loss 0.00420301, throughput 9.15753K wps
[Epoch 107 Batch 60/62] avg loss 0.00451859, throughput 8.88588K wps
Begin Testing...
[Epoch 107] train avg loss 0.00445029, dev acc 0.8230, dev avg loss 0.383555, throughput 8.97866K wps
Observed Improvement.
Begin Testing...
[Epoch 108 Batch 30/62] avg loss 0.00410498, throughput 8.65678K wps
[Epoch 108 Batch 60/62] avg loss 0.00422221, throughput 9.16181K wps
Begin Testing...
[Epoch 108] train avg loss 0.00419237, dev acc 0.8230, dev avg loss 0.385498, throughput 8.92755K wps
Observed Improvement.
Begin Testing...
[Epoch 109 Batch 30/62] avg loss 0.00411892, throughput 9.02274K wps
[Epoch 109 Batch 60/62] avg loss 0.00441594, throughput 8.97647K wps
Begin Testing...
[Epoch 109] train avg loss 0.00429861, dev acc 0.8260, dev avg loss 0.383127, throughput 9.03265K wps
Observed Improvement.
Begin Testing...
[Epoch 110 Batch 30/62] avg loss 0.00393865, throughput 9.11943K wps
[Epoch 110 Batch 60/62] avg loss 0.00429726, throughput 8.76734K wps
Begin Testing...
[Epoch 110] train avg loss 0.00416778, dev acc 0.8230, dev avg loss 0.381937, throughput 8.98018K wps
[Epoch 111 Batch 30/62] avg loss 0.00402233, throughput 8.90159K wps
[Epoch 111 Batch 60/62] avg loss 0.00422732, throughput 9.05687K wps
Begin Testing...
[Epoch 111] train avg loss 0.00419967, dev acc 0.8230, dev avg loss 0.384028, throughput 9.01204K wps
[Epoch 112 Batch 30/62] avg loss 0.00426016, throughput 8.92641K wps
[Epoch 112 Batch 60/62] avg loss 0.00409574, throughput 8.89854K wps
Begin Testing...
[Epoch 112] train avg loss 0.00420436, dev acc 0.8230, dev avg loss 0.380387, throughput 8.8943K wps
[Epoch 113 Batch 30/62] avg loss 0.00403022, throughput 8.82753K wps
[Epoch 113 Batch 60/62] avg loss 0.00400967, throughput 9.13064K wps
Begin Testing...
[Epoch 113] train avg loss 0.00411146, dev acc 0.8230, dev avg loss 0.382802, throughput 9.00843K wps
[Epoch 114 Batch 30/62] avg loss 0.00384874, throughput 9.15832K wps
[Epoch 114 Batch 60/62] avg loss 0.00403038, throughput 8.89386K wps
Begin Testing...
[Epoch 114] train avg loss 0.00403154, dev acc 0.8201, dev avg loss 0.378537, throughput 9.05395K wps
[Epoch 115 Batch 30/62] avg loss 0.00364477, throughput 8.92743K wps
[Epoch 115 Batch 60/62] avg loss 0.00416312, throughput 9.01044K wps
Begin Testing...
[Epoch 115] train avg loss 0.00393701, dev acc 0.8201, dev avg loss 0.377444, throughput 8.95563K wps
[Epoch 116 Batch 30/62] avg loss 0.00406087, throughput 9.08753K wps
[Epoch 116 Batch 60/62] avg loss 0.00377475, throughput 8.96407K wps
Begin Testing...
[Epoch 116] train avg loss 0.00396241, dev acc 0.8230, dev avg loss 0.384312, throughput 9.05629K wps
[Epoch 117 Batch 30/62] avg loss 0.00369699, throughput 8.71959K wps
[Epoch 117 Batch 60/62] avg loss 0.00390615, throughput 9.0468K wps
Begin Testing...
[Epoch 117] train avg loss 0.00388933, dev acc 0.8083, dev avg loss 0.375571, throughput 8.91654K wps
[Epoch 118 Batch 30/62] avg loss 0.00368436, throughput 8.98355K wps
[Epoch 118 Batch 60/62] avg loss 0.0040851, throughput 8.87246K wps
Begin Testing...
[Epoch 118] train avg loss 0.00391377, dev acc 0.8201, dev avg loss 0.383581, throughput 8.89362K wps
[Epoch 119 Batch 30/62] avg loss 0.00388593, throughput 8.94614K wps
[Epoch 119 Batch 60/62] avg loss 0.00373382, throughput 8.98128K wps
Begin Testing...
[Epoch 119] train avg loss 0.00382176, dev acc 0.8201, dev avg loss 0.375301, throughput 8.94234K wps
[Epoch 120 Batch 30/62] avg loss 0.00391155, throughput 8.8893K wps
[Epoch 120 Batch 60/62] avg loss 0.00357455, throughput 9.18993K wps
Begin Testing...
[Epoch 120] train avg loss 0.00377411, dev acc 0.8230, dev avg loss 0.382387, throughput 9.06301K wps
[Epoch 121 Batch 30/62] avg loss 0.00379054, throughput 8.89239K wps
[Epoch 121 Batch 60/62] avg loss 0.00382734, throughput 8.90688K wps
Begin Testing...
[Epoch 121] train avg loss 0.00382384, dev acc 0.8260, dev avg loss 0.379938, throughput 8.93249K wps
Observed Improvement.
Begin Testing...
[Epoch 122 Batch 30/62] avg loss 0.00368108, throughput 9.23693K wps
[Epoch 122 Batch 60/62] avg loss 0.003633, throughput 8.95775K wps
Begin Testing...
[Epoch 122] train avg loss 0.00368171, dev acc 0.8201, dev avg loss 0.388462, throughput 9.05636K wps
[Epoch 123 Batch 30/62] avg loss 0.00355442, throughput 8.80679K wps
[Epoch 123 Batch 60/62] avg loss 0.00374591, throughput 8.86806K wps
Begin Testing...
[Epoch 123] train avg loss 0.00364107, dev acc 0.8171, dev avg loss 0.382355, throughput 8.86565K wps
[Epoch 124 Batch 30/62] avg loss 0.00375054, throughput 9.1581K wps
[Epoch 124 Batch 60/62] avg loss 0.00354839, throughput 8.9351K wps
Begin Testing...
[Epoch 124] train avg loss 0.00366989, dev acc 0.8230, dev avg loss 0.374763, throughput 8.99864K wps
[Epoch 125 Batch 30/62] avg loss 0.00358242, throughput 9.01026K wps
[Epoch 125 Batch 60/62] avg loss 0.00345341, throughput 9.10104K wps
Begin Testing...
[Epoch 125] train avg loss 0.00357659, dev acc 0.8171, dev avg loss 0.392788, throughput 8.99944K wps
[Epoch 126 Batch 30/62] avg loss 0.00365378, throughput 9.21525K wps
[Epoch 126 Batch 60/62] avg loss 0.00355528, throughput 9.08292K wps
Begin Testing...
[Epoch 126] train avg loss 0.00364445, dev acc 0.8083, dev avg loss 0.40573, throughput 9.11661K wps
[Epoch 127 Batch 30/62] avg loss 0.00344423, throughput 9.08959K wps
[Epoch 127 Batch 60/62] avg loss 0.00345539, throughput 8.9592K wps
Begin Testing...
[Epoch 127] train avg loss 0.00352303, dev acc 0.8201, dev avg loss 0.38299, throughput 9.05575K wps
[Epoch 128 Batch 30/62] avg loss 0.00349642, throughput 9.1383K wps
[Epoch 128 Batch 60/62] avg loss 0.00343111, throughput 9.0341K wps
Begin Testing...
[Epoch 128] train avg loss 0.00351297, dev acc 0.8230, dev avg loss 0.376907, throughput 9.11348K wps
[Epoch 129 Batch 30/62] avg loss 0.00331811, throughput 9.07286K wps
[Epoch 129 Batch 60/62] avg loss 0.00347854, throughput 8.82095K wps
Begin Testing...
[Epoch 129] train avg loss 0.00345564, dev acc 0.8230, dev avg loss 0.372809, throughput 8.92117K wps
[Epoch 130 Batch 30/62] avg loss 0.00334717, throughput 9.17597K wps
[Epoch 130 Batch 60/62] avg loss 0.00338832, throughput 9.10656K wps
Begin Testing...
[Epoch 130] train avg loss 0.00338845, dev acc 0.8230, dev avg loss 0.372997, throughput 9.17021K wps
[Epoch 131 Batch 30/62] avg loss 0.0035496, throughput 9.23859K wps
[Epoch 131 Batch 60/62] avg loss 0.00320273, throughput 9.04844K wps
Begin Testing...
[Epoch 131] train avg loss 0.00343735, dev acc 0.8201, dev avg loss 0.388405, throughput 9.17016K wps
[Epoch 132 Batch 30/62] avg loss 0.00337962, throughput 9.0495K wps
[Epoch 132 Batch 60/62] avg loss 0.00342607, throughput 9.03951K wps
Begin Testing...
[Epoch 132] train avg loss 0.00342501, dev acc 0.8260, dev avg loss 0.373785, throughput 9.0772K wps
Observed Improvement.
Begin Testing...
[Epoch 133 Batch 30/62] avg loss 0.00305639, throughput 9.12766K wps
[Epoch 133 Batch 60/62] avg loss 0.00349583, throughput 8.88662K wps
Begin Testing...
[Epoch 133] train avg loss 0.00333299, dev acc 0.8230, dev avg loss 0.374444, throughput 9.04255K wps
[Epoch 134 Batch 30/62] avg loss 0.00341646, throughput 8.9855K wps
[Epoch 134 Batch 60/62] avg loss 0.00301744, throughput 9.025K wps
Begin Testing...
[Epoch 134] train avg loss 0.00320781, dev acc 0.8201, dev avg loss 0.381079, throughput 9.03148K wps
[Epoch 135 Batch 30/62] avg loss 0.00325125, throughput 8.94949K wps
[Epoch 135 Batch 60/62] avg loss 0.00336153, throughput 9.0449K wps
Begin Testing...
[Epoch 135] train avg loss 0.0033201, dev acc 0.8201, dev avg loss 0.370647, throughput 9.03127K wps
[Epoch 136 Batch 30/62] avg loss 0.00333606, throughput 9.23693K wps
[Epoch 136 Batch 60/62] avg loss 0.00300705, throughput 9.02007K wps
Begin Testing...
[Epoch 136] train avg loss 0.00316778, dev acc 0.8260, dev avg loss 0.373069, throughput 9.09916K wps
Observed Improvement.
Begin Testing...
[Epoch 137 Batch 30/62] avg loss 0.00299857, throughput 8.80844K wps
[Epoch 137 Batch 60/62] avg loss 0.00323723, throughput 8.79459K wps
Begin Testing...
[Epoch 137] train avg loss 0.0031526, dev acc 0.8289, dev avg loss 0.367817, throughput 8.78471K wps
Observed Improvement.
Begin Testing...
[Epoch 138 Batch 30/62] avg loss 0.00303109, throughput 9.25152K wps
[Epoch 138 Batch 60/62] avg loss 0.00325301, throughput 9.11783K wps
Begin Testing...
[Epoch 138] train avg loss 0.00319132, dev acc 0.8201, dev avg loss 0.376077, throughput 9.21269K wps
[Epoch 139 Batch 30/62] avg loss 0.00321293, throughput 9.18634K wps
[Epoch 139 Batch 60/62] avg loss 0.002936, throughput 9.14193K wps
Begin Testing...
[Epoch 139] train avg loss 0.00311546, dev acc 0.8260, dev avg loss 0.372787, throughput 9.19152K wps
[Epoch 140 Batch 30/62] avg loss 0.0031253, throughput 9.03714K wps
[Epoch 140 Batch 60/62] avg loss 0.00300746, throughput 8.92605K wps
Begin Testing...
[Epoch 140] train avg loss 0.00310381, dev acc 0.8201, dev avg loss 0.381472, throughput 8.96757K wps
[Epoch 141 Batch 30/62] avg loss 0.00310263, throughput 9.03756K wps
[Epoch 141 Batch 60/62] avg loss 0.00300582, throughput 8.77592K wps
Begin Testing...
[Epoch 141] train avg loss 0.00309314, dev acc 0.8260, dev avg loss 0.369461, throughput 8.89158K wps
[Epoch 142 Batch 30/62] avg loss 0.00293814, throughput 9.3248K wps
[Epoch 142 Batch 60/62] avg loss 0.00305529, throughput 9.00433K wps
Begin Testing...
[Epoch 142] train avg loss 0.00302527, dev acc 0.8319, dev avg loss 0.370823, throughput 9.18892K wps
Observed Improvement.
Begin Testing...
[Epoch 143 Batch 30/62] avg loss 0.00308956, throughput 8.95287K wps
[Epoch 143 Batch 60/62] avg loss 0.00285354, throughput 9.0249K wps
Begin Testing...
[Epoch 143] train avg loss 0.00300755, dev acc 0.8289, dev avg loss 0.368701, throughput 8.97235K wps
[Epoch 144 Batch 30/62] avg loss 0.00306199, throughput 9.1894K wps
[Epoch 144 Batch 60/62] avg loss 0.00292144, throughput 8.92151K wps
Begin Testing...
[Epoch 144] train avg loss 0.0030423, dev acc 0.8201, dev avg loss 0.365356, throughput 9.02318K wps
[Epoch 145 Batch 30/62] avg loss 0.0028816, throughput 9.13892K wps
[Epoch 145 Batch 60/62] avg loss 0.00288503, throughput 9.13595K wps
Begin Testing...
[Epoch 145] train avg loss 0.00297259, dev acc 0.8083, dev avg loss 0.412386, throughput 9.16358K wps
[Epoch 146 Batch 30/62] avg loss 0.00301826, throughput 9.24818K wps
[Epoch 146 Batch 60/62] avg loss 0.00274648, throughput 9.10644K wps
Begin Testing...
[Epoch 146] train avg loss 0.00291507, dev acc 0.8260, dev avg loss 0.365232, throughput 9.2014K wps
[Epoch 147 Batch 30/62] avg loss 0.00266209, throughput 9.11839K wps
[Epoch 147 Batch 60/62] avg loss 0.00294635, throughput 8.96346K wps
Begin Testing...
[Epoch 147] train avg loss 0.0028186, dev acc 0.8171, dev avg loss 0.38028, throughput 9.07064K wps
[Epoch 148 Batch 30/62] avg loss 0.00281905, throughput 8.79807K wps
[Epoch 148 Batch 60/62] avg loss 0.00289061, throughput 8.89826K wps
Begin Testing...
[Epoch 148] train avg loss 0.00290076, dev acc 0.8289, dev avg loss 0.365735, throughput 8.83412K wps
[Epoch 149 Batch 30/62] avg loss 0.00280403, throughput 9.2402K wps
[Epoch 149 Batch 60/62] avg loss 0.002984, throughput 9.04906K wps
Begin Testing...
[Epoch 149] train avg loss 0.00292443, dev acc 0.8289, dev avg loss 0.364107, throughput 9.12124K wps
[Epoch 150 Batch 30/62] avg loss 0.00263752, throughput 8.9451K wps
[Epoch 150 Batch 60/62] avg loss 0.00290338, throughput 8.72509K wps
Begin Testing...
[Epoch 150] train avg loss 0.00278501, dev acc 0.8171, dev avg loss 0.37708, throughput 8.8184K wps
[Epoch 151 Batch 30/62] avg loss 0.00276223, throughput 8.86862K wps
[Epoch 151 Batch 60/62] avg loss 0.00271762, throughput 8.85895K wps
Begin Testing...
[Epoch 151] train avg loss 0.0027634, dev acc 0.8171, dev avg loss 0.379795, throughput 8.86144K wps
[Epoch 152 Batch 30/62] avg loss 0.00294336, throughput 9.11148K wps
[Epoch 152 Batch 60/62] avg loss 0.00267392, throughput 8.99853K wps
Begin Testing...
[Epoch 152] train avg loss 0.00285498, dev acc 0.8260, dev avg loss 0.373472, throughput 9.08438K wps
[Epoch 153 Batch 30/62] avg loss 0.00276191, throughput 9.21378K wps
[Epoch 153 Batch 60/62] avg loss 0.00276143, throughput 8.90863K wps
Begin Testing...
[Epoch 153] train avg loss 0.00283877, dev acc 0.8171, dev avg loss 0.380866, throughput 9.04305K wps
[Epoch 154 Batch 30/62] avg loss 0.00258561, throughput 8.91561K wps
[Epoch 154 Batch 60/62] avg loss 0.00275357, throughput 9.08176K wps
Begin Testing...
[Epoch 154] train avg loss 0.00273426, dev acc 0.8319, dev avg loss 0.363809, throughput 9.02661K wps
Observed Improvement.
Begin Testing...
[Epoch 155 Batch 30/62] avg loss 0.00263489, throughput 9.00471K wps
[Epoch 155 Batch 60/62] avg loss 0.00272242, throughput 8.82817K wps
Begin Testing...
[Epoch 155] train avg loss 0.0027047, dev acc 0.8260, dev avg loss 0.363343, throughput 8.94683K wps
[Epoch 156 Batch 30/62] avg loss 0.00252948, throughput 9.13605K wps
[Epoch 156 Batch 60/62] avg loss 0.00262114, throughput 8.98646K wps
Begin Testing...
[Epoch 156] train avg loss 0.00257748, dev acc 0.8201, dev avg loss 0.383592, throughput 9.09354K wps
[Epoch 157 Batch 30/62] avg loss 0.00260217, throughput 8.93692K wps
[Epoch 157 Batch 60/62] avg loss 0.00267177, throughput 8.96052K wps
Begin Testing...
[Epoch 157] train avg loss 0.00268785, dev acc 0.8230, dev avg loss 0.364582, throughput 8.98091K wps
[Epoch 158 Batch 30/62] avg loss 0.0027143, throughput 9.24164K wps
[Epoch 158 Batch 60/62] avg loss 0.00260751, throughput 8.93926K wps
Begin Testing...
[Epoch 158] train avg loss 0.00268808, dev acc 0.8201, dev avg loss 0.375869, throughput 9.11668K wps
[Epoch 159 Batch 30/62] avg loss 0.00271539, throughput 9.28623K wps
[Epoch 159 Batch 60/62] avg loss 0.00256033, throughput 9.05698K wps
Begin Testing...
[Epoch 159] train avg loss 0.0027152, dev acc 0.8230, dev avg loss 0.372133, throughput 9.19621K wps
[Epoch 160 Batch 30/62] avg loss 0.00258642, throughput 8.92467K wps
[Epoch 160 Batch 60/62] avg loss 0.00246651, throughput 8.83676K wps
Begin Testing...
[Epoch 160] train avg loss 0.00255456, dev acc 0.8289, dev avg loss 0.3701, throughput 8.85728K wps
[Epoch 161 Batch 30/62] avg loss 0.00257011, throughput 8.8516K wps
[Epoch 161 Batch 60/62] avg loss 0.00246927, throughput 8.96968K wps
Begin Testing...
[Epoch 161] train avg loss 0.00256199, dev acc 0.8171, dev avg loss 0.379713, throughput 8.89533K wps
[Epoch 162 Batch 30/62] avg loss 0.00247265, throughput 8.97365K wps
[Epoch 162 Batch 60/62] avg loss 0.00242623, throughput 8.82394K wps
Begin Testing...
[Epoch 162] train avg loss 0.00248292, dev acc 0.8289, dev avg loss 0.362086, throughput 8.86405K wps
[Epoch 163 Batch 30/62] avg loss 0.0026122, throughput 9.21497K wps
[Epoch 163 Batch 60/62] avg loss 0.00247095, throughput 8.84166K wps
Begin Testing...
[Epoch 163] train avg loss 0.00256066, dev acc 0.8260, dev avg loss 0.372417, throughput 9.01214K wps
[Epoch 164 Batch 30/62] avg loss 0.00258735, throughput 8.88226K wps
[Epoch 164 Batch 60/62] avg loss 0.00237763, throughput 9.05667K wps
Begin Testing...
[Epoch 164] train avg loss 0.00249599, dev acc 0.8289, dev avg loss 0.367754, throughput 9.0036K wps
[Epoch 165 Batch 30/62] avg loss 0.00233552, throughput 8.99713K wps
[Epoch 165 Batch 60/62] avg loss 0.0024372, throughput 8.94938K wps
Begin Testing...
[Epoch 165] train avg loss 0.00241198, dev acc 0.8289, dev avg loss 0.366446, throughput 8.95493K wps
[Epoch 166 Batch 30/62] avg loss 0.00221844, throughput 9.29266K wps
[Epoch 166 Batch 60/62] avg loss 0.00238175, throughput 9.13705K wps
Begin Testing...
[Epoch 166] train avg loss 0.00232641, dev acc 0.8201, dev avg loss 0.375911, throughput 9.24261K wps
[Epoch 167 Batch 30/62] avg loss 0.00228816, throughput 9.13489K wps
[Epoch 167 Batch 60/62] avg loss 0.00242179, throughput 9.11058K wps
Begin Testing...
[Epoch 167] train avg loss 0.00235238, dev acc 0.8201, dev avg loss 0.377744, throughput 9.09773K wps
[Epoch 168 Batch 30/62] avg loss 0.00233672, throughput 9.0804K wps
[Epoch 168 Batch 60/62] avg loss 0.00230765, throughput 9.19844K wps
Begin Testing...
[Epoch 168] train avg loss 0.00236696, dev acc 0.8230, dev avg loss 0.372621, throughput 9.16993K wps
[Epoch 169 Batch 30/62] avg loss 0.00219508, throughput 8.83567K wps
[Epoch 169 Batch 60/62] avg loss 0.0022618, throughput 9.02218K wps
Begin Testing...
[Epoch 169] train avg loss 0.00224374, dev acc 0.8319, dev avg loss 0.361522, throughput 8.96764K wps
Observed Improvement.
Begin Testing...
[Epoch 170 Batch 30/62] avg loss 0.00241248, throughput 9.21907K wps
[Epoch 170 Batch 60/62] avg loss 0.00224604, throughput 8.88455K wps
Begin Testing...
[Epoch 170] train avg loss 0.00234388, dev acc 0.8260, dev avg loss 0.366376, throughput 9.07925K wps
[Epoch 171 Batch 30/62] avg loss 0.0024068, throughput 9.29599K wps
[Epoch 171 Batch 60/62] avg loss 0.00226881, throughput 8.5405K wps
Begin Testing...
[Epoch 171] train avg loss 0.00238044, dev acc 0.8260, dev avg loss 0.36058, throughput 8.97665K wps
[Epoch 172 Batch 30/62] avg loss 0.00233245, throughput 9.23084K wps
[Epoch 172 Batch 60/62] avg loss 0.0023038, throughput 9.11041K wps
Begin Testing...
[Epoch 172] train avg loss 0.00234889, dev acc 0.8289, dev avg loss 0.364069, throughput 9.19786K wps
[Epoch 173 Batch 30/62] avg loss 0.00242777, throughput 9.00336K wps
[Epoch 173 Batch 60/62] avg loss 0.00221077, throughput 9.16156K wps
Begin Testing...
[Epoch 173] train avg loss 0.00234616, dev acc 0.8319, dev avg loss 0.367697, throughput 9.11382K wps
Observed Improvement.
Begin Testing...
[Epoch 174 Batch 30/62] avg loss 0.00215384, throughput 9.08734K wps
[Epoch 174 Batch 60/62] avg loss 0.00228221, throughput 9.07696K wps
Begin Testing...
[Epoch 174] train avg loss 0.00222837, dev acc 0.8319, dev avg loss 0.367519, throughput 9.11407K wps
Observed Improvement.
Begin Testing...
[Epoch 175 Batch 30/62] avg loss 0.00209193, throughput 9.18588K wps
[Epoch 175 Batch 60/62] avg loss 0.00236402, throughput 8.95449K wps
Begin Testing...
[Epoch 175] train avg loss 0.00222732, dev acc 0.8201, dev avg loss 0.376969, throughput 9.1014K wps
[Epoch 176 Batch 30/62] avg loss 0.0021351, throughput 9.22815K wps
[Epoch 176 Batch 60/62] avg loss 0.00210464, throughput 8.99167K wps
Begin Testing...
[Epoch 176] train avg loss 0.00217834, dev acc 0.8289, dev avg loss 0.362656, throughput 9.13572K wps
[Epoch 177 Batch 30/62] avg loss 0.00220451, throughput 9.11076K wps
[Epoch 177 Batch 60/62] avg loss 0.00209315, throughput 8.89942K wps
Begin Testing...
[Epoch 177] train avg loss 0.00219853, dev acc 0.8260, dev avg loss 0.366141, throughput 9.03367K wps
[Epoch 178 Batch 30/62] avg loss 0.0023201, throughput 8.9351K wps
[Epoch 178 Batch 60/62] avg loss 0.00217775, throughput 8.96042K wps
Begin Testing...
[Epoch 178] train avg loss 0.00228659, dev acc 0.8201, dev avg loss 0.377412, throughput 8.98105K wps
[Epoch 179 Batch 30/62] avg loss 0.00215513, throughput 9.01165K wps
[Epoch 179 Batch 60/62] avg loss 0.00200724, throughput 8.97003K wps
Begin Testing...
[Epoch 179] train avg loss 0.00208789, dev acc 0.8201, dev avg loss 0.375241, throughput 8.99577K wps
[Epoch 180 Batch 30/62] avg loss 0.00201074, throughput 9.19577K wps
[Epoch 180 Batch 60/62] avg loss 0.0020598, throughput 8.88587K wps
Begin Testing...
[Epoch 180] train avg loss 0.00206402, dev acc 0.8289, dev avg loss 0.367871, throughput 9.06908K wps
[Epoch 181 Batch 30/62] avg loss 0.00204185, throughput 9.01923K wps
[Epoch 181 Batch 60/62] avg loss 0.00221237, throughput 8.92459K wps
Begin Testing...
[Epoch 181] train avg loss 0.00214301, dev acc 0.8201, dev avg loss 0.374778, throughput 9.00009K wps
[Epoch 182 Batch 30/62] avg loss 0.00207095, throughput 9.07073K wps
[Epoch 182 Batch 60/62] avg loss 0.00205967, throughput 9.02329K wps
Begin Testing...
[Epoch 182] train avg loss 0.00210586, dev acc 0.8319, dev avg loss 0.370566, throughput 9.00852K wps
Observed Improvement.
Begin Testing...
[Epoch 183 Batch 30/62] avg loss 0.0019446, throughput 9.29446K wps
[Epoch 183 Batch 60/62] avg loss 0.00211387, throughput 9.13146K wps
Begin Testing...
[Epoch 183] train avg loss 0.00204939, dev acc 0.8319, dev avg loss 0.370516, throughput 9.20347K wps
Observed Improvement.
Begin Testing...
[Epoch 184 Batch 30/62] avg loss 0.0020472, throughput 8.90062K wps
[Epoch 184 Batch 60/62] avg loss 0.00204484, throughput 9.00197K wps
Begin Testing...
[Epoch 184] train avg loss 0.00206411, dev acc 0.8260, dev avg loss 0.360993, throughput 8.98432K wps
[Epoch 185 Batch 30/62] avg loss 0.00195732, throughput 8.87671K wps
[Epoch 185 Batch 60/62] avg loss 0.0019922, throughput 9.30591K wps
Begin Testing...
[Epoch 185] train avg loss 0.00199912, dev acc 0.8260, dev avg loss 0.362735, throughput 9.05654K wps
[Epoch 186 Batch 30/62] avg loss 0.00204684, throughput 9.15328K wps
[Epoch 186 Batch 60/62] avg loss 0.00194095, throughput 8.81638K wps
Begin Testing...
[Epoch 186] train avg loss 0.00201811, dev acc 0.8289, dev avg loss 0.367685, throughput 9.05654K wps
[Epoch 187 Batch 30/62] avg loss 0.00185023, throughput 9.18143K wps
[Epoch 187 Batch 60/62] avg loss 0.00208515, throughput 8.8889K wps
Begin Testing...
[Epoch 187] train avg loss 0.00204026, dev acc 0.8319, dev avg loss 0.369013, throughput 9.03556K wps
Observed Improvement.
Begin Testing...
[Epoch 188 Batch 30/62] avg loss 0.00191317, throughput 9.02796K wps
[Epoch 188 Batch 60/62] avg loss 0.00185974, throughput 9.00821K wps
Begin Testing...
[Epoch 188] train avg loss 0.00189351, dev acc 0.8319, dev avg loss 0.370403, throughput 9.04772K wps
Observed Improvement.
Begin Testing...
[Epoch 189 Batch 30/62] avg loss 0.00183873, throughput 9.06861K wps
[Epoch 189 Batch 60/62] avg loss 0.00196432, throughput 9.1367K wps
Begin Testing...
[Epoch 189] train avg loss 0.00194188, dev acc 0.8319, dev avg loss 0.369992, throughput 9.13177K wps
Observed Improvement.
Begin Testing...
[Epoch 190 Batch 30/62] avg loss 0.00190162, throughput 9.04982K wps
[Epoch 190 Batch 60/62] avg loss 0.00215644, throughput 9.07111K wps
Begin Testing...
[Epoch 190] train avg loss 0.00205484, dev acc 0.8319, dev avg loss 0.368597, throughput 9.0922K wps
Observed Improvement.
Begin Testing...
[Epoch 191 Batch 30/62] avg loss 0.0019627, throughput 9.05523K wps
[Epoch 191 Batch 60/62] avg loss 0.00195397, throughput 8.69306K wps
Begin Testing...
[Epoch 191] train avg loss 0.00198332, dev acc 0.8319, dev avg loss 0.368816, throughput 8.86165K wps
Observed Improvement.
Begin Testing...
[Epoch 192 Batch 30/62] avg loss 0.00189148, throughput 9.22598K wps
[Epoch 192 Batch 60/62] avg loss 0.00193238, throughput 8.98139K wps
Begin Testing...
[Epoch 192] train avg loss 0.00195364, dev acc 0.8260, dev avg loss 0.363781, throughput 9.06374K wps
[Epoch 193 Batch 30/62] avg loss 0.00186572, throughput 9.1039K wps
[Epoch 193 Batch 60/62] avg loss 0.00206442, throughput 9.00616K wps
Begin Testing...
[Epoch 193] train avg loss 0.00200059, dev acc 0.8201, dev avg loss 0.359085, throughput 9.0339K wps
[Epoch 194 Batch 30/62] avg loss 0.00184336, throughput 9.0821K wps
[Epoch 194 Batch 60/62] avg loss 0.00173873, throughput 8.94766K wps
Begin Testing...
[Epoch 194] train avg loss 0.00180764, dev acc 0.8289, dev avg loss 0.374153, throughput 9.00264K wps
[Epoch 195 Batch 30/62] avg loss 0.00190232, throughput 8.93275K wps
[Epoch 195 Batch 60/62] avg loss 0.00183379, throughput 9.13045K wps
Begin Testing...
[Epoch 195] train avg loss 0.00188114, dev acc 0.8319, dev avg loss 0.373581, throughput 9.01766K wps
Observed Improvement.
Begin Testing...
[Epoch 196 Batch 30/62] avg loss 0.00188783, throughput 9.09751K wps
[Epoch 196 Batch 60/62] avg loss 0.00189779, throughput 9.13961K wps
Begin Testing...
[Epoch 196] train avg loss 0.00189686, dev acc 0.8260, dev avg loss 0.363918, throughput 9.10186K wps
[Epoch 197 Batch 30/62] avg loss 0.00187462, throughput 8.93746K wps
[Epoch 197 Batch 60/62] avg loss 0.00180364, throughput 8.99123K wps
Begin Testing...
[Epoch 197] train avg loss 0.00185597, dev acc 0.8319, dev avg loss 0.370552, throughput 8.99798K wps
Observed Improvement.
Begin Testing...
[Epoch 198 Batch 30/62] avg loss 0.0016773, throughput 9.15083K wps
[Epoch 198 Batch 60/62] avg loss 0.00181579, throughput 8.95327K wps
Begin Testing...
[Epoch 198] train avg loss 0.00176097, dev acc 0.8289, dev avg loss 0.364053, throughput 9.07724K wps
[Epoch 199 Batch 30/62] avg loss 0.00178434, throughput 9.30715K wps
[Epoch 199 Batch 60/62] avg loss 0.00172663, throughput 9.17561K wps
Begin Testing...
[Epoch 199] train avg loss 0.00178199, dev acc 0.8319, dev avg loss 0.368012, throughput 9.26569K wps
Observed Improvement.
Begin Testing...
Test loss 0.440642, test acc 0.8037
Total time cost 156.28s
[Epoch 0 Batch 30/62] avg loss 0.0136735, throughput 8.5088K wps
[Epoch 0 Batch 60/62] avg loss 0.0133743, throughput 9.07336K wps
Begin Testing...
[Epoch 0] train avg loss 0.013705, dev acc 0.6519, dev avg loss 0.649484, throughput 8.80617K wps
Observed Improvement.
Begin Testing...
[Epoch 1 Batch 30/62] avg loss 0.0132334, throughput 9.21918K wps
[Epoch 1 Batch 60/62] avg loss 0.0130802, throughput 8.81028K wps
Begin Testing...
[Epoch 1] train avg loss 0.0133697, dev acc 0.6519, dev avg loss 0.643262, throughput 9.07303K wps
Observed Improvement.
Begin Testing...
[Epoch 2 Batch 30/62] avg loss 0.0130496, throughput 9.25195K wps
[Epoch 2 Batch 60/62] avg loss 0.0129502, throughput 8.99181K wps
Begin Testing...
[Epoch 2] train avg loss 0.0131708, dev acc 0.6519, dev avg loss 0.638471, throughput 9.15291K wps
Observed Improvement.
Begin Testing...
[Epoch 3 Batch 30/62] avg loss 0.0131149, throughput 9.34642K wps
[Epoch 3 Batch 60/62] avg loss 0.0129585, throughput 9.14135K wps
Begin Testing...
[Epoch 3] train avg loss 0.0131682, dev acc 0.6519, dev avg loss 0.634457, throughput 9.27272K wps
Observed Improvement.
Begin Testing...
[Epoch 4 Batch 30/62] avg loss 0.0130751, throughput 9.10536K wps
[Epoch 4 Batch 60/62] avg loss 0.0128886, throughput 9.11903K wps
Begin Testing...
[Epoch 4] train avg loss 0.0132758, dev acc 0.6519, dev avg loss 0.63508, throughput 9.14102K wps
Observed Improvement.
Begin Testing...
[Epoch 5 Batch 30/62] avg loss 0.0127737, throughput 9.25834K wps
[Epoch 5 Batch 60/62] avg loss 0.012791, throughput 8.96849K wps
Begin Testing...
[Epoch 5] train avg loss 0.0129493, dev acc 0.6519, dev avg loss 0.628107, throughput 9.07744K wps
Observed Improvement.
Begin Testing...
[Epoch 6 Batch 30/62] avg loss 0.0127164, throughput 8.87665K wps
[Epoch 6 Batch 60/62] avg loss 0.0126775, throughput 9.12395K wps
Begin Testing...
[Epoch 6] train avg loss 0.0128798, dev acc 0.6519, dev avg loss 0.624274, throughput 9.02918K wps
Observed Improvement.
Begin Testing...
[Epoch 7 Batch 30/62] avg loss 0.0126823, throughput 9.12987K wps
[Epoch 7 Batch 60/62] avg loss 0.0125763, throughput 8.71796K wps
Begin Testing...
[Epoch 7] train avg loss 0.0127911, dev acc 0.6519, dev avg loss 0.62093, throughput 8.9495K wps
Observed Improvement.
Begin Testing...
[Epoch 8 Batch 30/62] avg loss 0.01256, throughput 8.92745K wps
[Epoch 8 Batch 60/62] avg loss 0.0123421, throughput 9.23324K wps
Begin Testing...
[Epoch 8] train avg loss 0.0125786, dev acc 0.6519, dev avg loss 0.615404, throughput 9.0447K wps
Observed Improvement.
Begin Testing...
[Epoch 9 Batch 30/62] avg loss 0.0124979, throughput 9.13985K wps
[Epoch 9 Batch 60/62] avg loss 0.012241, throughput 9.16797K wps
Begin Testing...
[Epoch 9] train avg loss 0.012553, dev acc 0.6519, dev avg loss 0.612497, throughput 9.17502K wps
Observed Improvement.
Begin Testing...
[Epoch 10 Batch 30/62] avg loss 0.0122089, throughput 9.09116K wps
[Epoch 10 Batch 60/62] avg loss 0.0126389, throughput 8.82301K wps
Begin Testing...
[Epoch 10] train avg loss 0.0125989, dev acc 0.6519, dev avg loss 0.607893, throughput 8.99263K wps
Observed Improvement.
Begin Testing...
[Epoch 11 Batch 30/62] avg loss 0.0123451, throughput 9.02491K wps
[Epoch 11 Batch 60/62] avg loss 0.0122247, throughput 8.56028K wps
Begin Testing...
[Epoch 11] train avg loss 0.0124442, dev acc 0.6519, dev avg loss 0.604185, throughput 8.82546K wps
Observed Improvement.
Begin Testing...
[Epoch 12 Batch 30/62] avg loss 0.0120451, throughput 9.06611K wps
[Epoch 12 Batch 60/62] avg loss 0.0120128, throughput 8.7583K wps
Begin Testing...
[Epoch 12] train avg loss 0.0122023, dev acc 0.6519, dev avg loss 0.599342, throughput 8.89495K wps
Observed Improvement.
Begin Testing...
[Epoch 13 Batch 30/62] avg loss 0.0121686, throughput 9.14298K wps
[Epoch 13 Batch 60/62] avg loss 0.0118697, throughput 9.16234K wps
Begin Testing...
[Epoch 13] train avg loss 0.0121728, dev acc 0.6519, dev avg loss 0.594933, throughput 9.13381K wps
Observed Improvement.
Begin Testing...
[Epoch 14 Batch 30/62] avg loss 0.011966, throughput 8.89337K wps
[Epoch 14 Batch 60/62] avg loss 0.0119914, throughput 8.87408K wps
Begin Testing...
[Epoch 14] train avg loss 0.0121364, dev acc 0.6519, dev avg loss 0.590957, throughput 8.87264K wps
Observed Improvement.
Begin Testing...
[Epoch 15 Batch 30/62] avg loss 0.0119509, throughput 9.41097K wps
[Epoch 15 Batch 60/62] avg loss 0.0117604, throughput 9.02702K wps
Begin Testing...
[Epoch 15] train avg loss 0.0120364, dev acc 0.6519, dev avg loss 0.586372, throughput 9.24353K wps
Observed Improvement.
Begin Testing...
[Epoch 16 Batch 30/62] avg loss 0.0117654, throughput 9.35884K wps
[Epoch 16 Batch 60/62] avg loss 0.0116716, throughput 8.67702K wps
Begin Testing...
[Epoch 16] train avg loss 0.0119306, dev acc 0.6814, dev avg loss 0.583885, throughput 8.98981K wps
Observed Improvement.
Begin Testing...
[Epoch 17 Batch 30/62] avg loss 0.0113799, throughput 8.71886K wps
[Epoch 17 Batch 60/62] avg loss 0.0117549, throughput 8.95661K wps
Begin Testing...
[Epoch 17] train avg loss 0.0117846, dev acc 0.6873, dev avg loss 0.579211, throughput 8.87477K wps
Observed Improvement.
Begin Testing...
[Epoch 18 Batch 30/62] avg loss 0.0117211, throughput 9.18288K wps
[Epoch 18 Batch 60/62] avg loss 0.0112493, throughput 8.94509K wps
Begin Testing...
[Epoch 18] train avg loss 0.0116574, dev acc 0.6696, dev avg loss 0.572076, throughput 9.12168K wps
[Epoch 19 Batch 30/62] avg loss 0.0112255, throughput 9.16011K wps
[Epoch 19 Batch 60/62] avg loss 0.0113619, throughput 9.17631K wps
Begin Testing...
[Epoch 19] train avg loss 0.0115007, dev acc 0.6873, dev avg loss 0.568632, throughput 9.15652K wps
Observed Improvement.
Begin Testing...
[Epoch 20 Batch 30/62] avg loss 0.0112302, throughput 8.74057K wps
[Epoch 20 Batch 60/62] avg loss 0.0112935, throughput 9.18255K wps
Begin Testing...
[Epoch 20] train avg loss 0.0113762, dev acc 0.6844, dev avg loss 0.56203, throughput 8.98654K wps
[Epoch 21 Batch 30/62] avg loss 0.0109779, throughput 9.24841K wps
[Epoch 21 Batch 60/62] avg loss 0.0112032, throughput 9.18521K wps
Begin Testing...
[Epoch 21] train avg loss 0.0112705, dev acc 0.6873, dev avg loss 0.556944, throughput 9.25163K wps
Observed Improvement.
Begin Testing...
[Epoch 22 Batch 30/62] avg loss 0.0108927, throughput 9.28507K wps
[Epoch 22 Batch 60/62] avg loss 0.0110648, throughput 9.03944K wps
Begin Testing...
[Epoch 22] train avg loss 0.0111096, dev acc 0.6962, dev avg loss 0.552591, throughput 9.12913K wps
Observed Improvement.
Begin Testing...
[Epoch 23 Batch 30/62] avg loss 0.0109607, throughput 9.1723K wps
[Epoch 23 Batch 60/62] avg loss 0.0107032, throughput 9.1067K wps
Begin Testing...
[Epoch 23] train avg loss 0.0110009, dev acc 0.7050, dev avg loss 0.547397, throughput 9.16944K wps
Observed Improvement.
Begin Testing...
[Epoch 24 Batch 30/62] avg loss 0.0105997, throughput 9.13265K wps
[Epoch 24 Batch 60/62] avg loss 0.0107085, throughput 9.06941K wps
Begin Testing...
[Epoch 24] train avg loss 0.0108175, dev acc 0.7404, dev avg loss 0.543352, throughput 9.15458K wps
Observed Improvement.
Begin Testing...
[Epoch 25 Batch 30/62] avg loss 0.010477, throughput 8.95139K wps
[Epoch 25 Batch 60/62] avg loss 0.0107305, throughput 9.06215K wps
Begin Testing...
[Epoch 25] train avg loss 0.0107226, dev acc 0.7227, dev avg loss 0.536737, throughput 9.03881K wps
[Epoch 26 Batch 30/62] avg loss 0.01045, throughput 8.82308K wps
[Epoch 26 Batch 60/62] avg loss 0.0105974, throughput 8.82749K wps
Begin Testing...
[Epoch 26] train avg loss 0.0106712, dev acc 0.7670, dev avg loss 0.535889, throughput 8.85485K wps
Observed Improvement.
Begin Testing...
[Epoch 27 Batch 30/62] avg loss 0.0102815, throughput 9.25545K wps
[Epoch 27 Batch 60/62] avg loss 0.0103387, throughput 9.12237K wps
Begin Testing...
[Epoch 27] train avg loss 0.0105049, dev acc 0.7729, dev avg loss 0.531714, throughput 9.21932K wps
Observed Improvement.
Begin Testing...
[Epoch 28 Batch 30/62] avg loss 0.010257, throughput 9.07191K wps
[Epoch 28 Batch 60/62] avg loss 0.0102839, throughput 8.94344K wps
Begin Testing...
[Epoch 28] train avg loss 0.0103602, dev acc 0.7316, dev avg loss 0.522013, throughput 9.03556K wps
[Epoch 29 Batch 30/62] avg loss 0.00992632, throughput 8.77293K wps
[Epoch 29 Batch 60/62] avg loss 0.010147, throughput 9.05201K wps
Begin Testing...
[Epoch 29] train avg loss 0.0101811, dev acc 0.7670, dev avg loss 0.518968, throughput 8.94251K wps
[Epoch 30 Batch 30/62] avg loss 0.00988422, throughput 8.99992K wps
[Epoch 30 Batch 60/62] avg loss 0.0100282, throughput 9.29291K wps
Begin Testing...
[Epoch 30] train avg loss 0.0100678, dev acc 0.7345, dev avg loss 0.512897, throughput 9.17145K wps
[Epoch 31 Batch 30/62] avg loss 0.00982638, throughput 9.3012K wps
[Epoch 31 Batch 60/62] avg loss 0.00987347, throughput 9.17409K wps
Begin Testing...
[Epoch 31] train avg loss 0.0100249, dev acc 0.7139, dev avg loss 0.510293, throughput 9.21833K wps
[Epoch 32 Batch 30/62] avg loss 0.00984488, throughput 9.33203K wps
[Epoch 32 Batch 60/62] avg loss 0.00958257, throughput 8.97553K wps
Begin Testing...
[Epoch 32] train avg loss 0.00982169, dev acc 0.7699, dev avg loss 0.5042, throughput 9.18241K wps
[Epoch 33 Batch 30/62] avg loss 0.00970908, throughput 9.18002K wps
[Epoch 33 Batch 60/62] avg loss 0.00946454, throughput 8.7835K wps
Begin Testing...
[Epoch 33] train avg loss 0.0097755, dev acc 0.7729, dev avg loss 0.500931, throughput 8.9505K wps
Observed Improvement.
Begin Testing...
[Epoch 34 Batch 30/62] avg loss 0.00942118, throughput 8.65123K wps
[Epoch 34 Batch 60/62] avg loss 0.00957058, throughput 9.16418K wps
Begin Testing...
[Epoch 34] train avg loss 0.00962616, dev acc 0.7758, dev avg loss 0.501352, throughput 8.94733K wps
Observed Improvement.
Begin Testing...
[Epoch 35 Batch 30/62] avg loss 0.00947682, throughput 9.0972K wps
[Epoch 35 Batch 60/62] avg loss 0.00945259, throughput 9.21268K wps
Begin Testing...
[Epoch 35] train avg loss 0.00963527, dev acc 0.7847, dev avg loss 0.494015, throughput 9.18501K wps
Observed Improvement.
Begin Testing...
[Epoch 36 Batch 30/62] avg loss 0.0092971, throughput 9.13687K wps
[Epoch 36 Batch 60/62] avg loss 0.00912643, throughput 9.14304K wps
Begin Testing...
[Epoch 36] train avg loss 0.00933659, dev acc 0.7876, dev avg loss 0.490099, throughput 9.1112K wps
Observed Improvement.
Begin Testing...
[Epoch 37 Batch 30/62] avg loss 0.0090512, throughput 8.94624K wps
[Epoch 37 Batch 60/62] avg loss 0.00908412, throughput 9.11696K wps
Begin Testing...
[Epoch 37] train avg loss 0.00917782, dev acc 0.7847, dev avg loss 0.485949, throughput 9.06395K wps
[Epoch 38 Batch 30/62] avg loss 0.00924059, throughput 8.97931K wps
[Epoch 38 Batch 60/62] avg loss 0.00877832, throughput 8.69427K wps
Begin Testing...
[Epoch 38] train avg loss 0.00915584, dev acc 0.7788, dev avg loss 0.482098, throughput 8.81469K wps
[Epoch 39 Batch 30/62] avg loss 0.00883193, throughput 9.33019K wps
[Epoch 39 Batch 60/62] avg loss 0.00899896, throughput 9.02916K wps
Begin Testing...
[Epoch 39] train avg loss 0.0090407, dev acc 0.7788, dev avg loss 0.480746, throughput 9.15372K wps
[Epoch 40 Batch 30/62] avg loss 0.00860699, throughput 9.26802K wps
[Epoch 40 Batch 60/62] avg loss 0.00890286, throughput 8.98507K wps
Begin Testing...
[Epoch 40] train avg loss 0.00882503, dev acc 0.7876, dev avg loss 0.475729, throughput 9.10372K wps
Observed Improvement.
Begin Testing...
[Epoch 41 Batch 30/62] avg loss 0.00873691, throughput 9.04085K wps
[Epoch 41 Batch 60/62] avg loss 0.00869466, throughput 8.94624K wps
Begin Testing...
[Epoch 41] train avg loss 0.00875242, dev acc 0.7817, dev avg loss 0.4728, throughput 8.97531K wps
[Epoch 42 Batch 30/62] avg loss 0.00867596, throughput 9.16251K wps
[Epoch 42 Batch 60/62] avg loss 0.00852464, throughput 8.95396K wps
Begin Testing...
[Epoch 42] train avg loss 0.00870574, dev acc 0.7847, dev avg loss 0.469665, throughput 9.1141K wps
[Epoch 43 Batch 30/62] avg loss 0.00817448, throughput 8.79558K wps
[Epoch 43 Batch 60/62] avg loss 0.00880054, throughput 9.2445K wps
Begin Testing...
[Epoch 43] train avg loss 0.00855571, dev acc 0.7817, dev avg loss 0.467903, throughput 9.02989K wps
[Epoch 44 Batch 30/62] avg loss 0.00856301, throughput 9.17287K wps
[Epoch 44 Batch 60/62] avg loss 0.00844181, throughput 9.26144K wps
Begin Testing...
[Epoch 44] train avg loss 0.00854047, dev acc 0.7817, dev avg loss 0.465349, throughput 9.24863K wps
[Epoch 45 Batch 30/62] avg loss 0.0083255, throughput 9.06796K wps
[Epoch 45 Batch 60/62] avg loss 0.00827958, throughput 8.91393K wps
Begin Testing...
[Epoch 45] train avg loss 0.00839087, dev acc 0.7847, dev avg loss 0.46272, throughput 9.02498K wps
[Epoch 46 Batch 30/62] avg loss 0.00834397, throughput 9.2078K wps
[Epoch 46 Batch 60/62] avg loss 0.0081898, throughput 9.0517K wps
Begin Testing...
[Epoch 46] train avg loss 0.00835399, dev acc 0.7817, dev avg loss 0.460362, throughput 9.1115K wps
[Epoch 47 Batch 30/62] avg loss 0.00827023, throughput 9.2007K wps
[Epoch 47 Batch 60/62] avg loss 0.00807837, throughput 9.07141K wps
Begin Testing...
[Epoch 47] train avg loss 0.0082136, dev acc 0.7847, dev avg loss 0.458277, throughput 9.1164K wps
[Epoch 48 Batch 30/62] avg loss 0.008118, throughput 8.97618K wps
[Epoch 48 Batch 60/62] avg loss 0.00805543, throughput 9.07212K wps
Begin Testing...
[Epoch 48] train avg loss 0.00818243, dev acc 0.7817, dev avg loss 0.456525, throughput 9.01207K wps
[Epoch 49 Batch 30/62] avg loss 0.00786864, throughput 9.23789K wps
[Epoch 49 Batch 60/62] avg loss 0.00817715, throughput 8.79468K wps
Begin Testing...
[Epoch 49] train avg loss 0.00808508, dev acc 0.7847, dev avg loss 0.4545, throughput 9.0433K wps
[Epoch 50 Batch 30/62] avg loss 0.00800716, throughput 8.91461K wps
[Epoch 50 Batch 60/62] avg loss 0.0077744, throughput 9.0397K wps
Begin Testing...
[Epoch 50] train avg loss 0.00796528, dev acc 0.7817, dev avg loss 0.452713, throughput 8.95715K wps
[Epoch 51 Batch 30/62] avg loss 0.00773203, throughput 9.16251K wps
[Epoch 51 Batch 60/62] avg loss 0.00781954, throughput 9.1407K wps
Begin Testing...
[Epoch 51] train avg loss 0.00784304, dev acc 0.7876, dev avg loss 0.450524, throughput 9.18168K wps
Observed Improvement.
Begin Testing...
[Epoch 52 Batch 30/62] avg loss 0.00782366, throughput 9.37992K wps
[Epoch 52 Batch 60/62] avg loss 0.00785369, throughput 9.08368K wps
Begin Testing...
[Epoch 52] train avg loss 0.00790278, dev acc 0.7817, dev avg loss 0.448916, throughput 9.25471K wps
[Epoch 53 Batch 30/62] avg loss 0.00723134, throughput 9.02988K wps
[Epoch 53 Batch 60/62] avg loss 0.00776292, throughput 9.00617K wps
Begin Testing...
[Epoch 53] train avg loss 0.00766068, dev acc 0.7817, dev avg loss 0.44994, throughput 8.98663K wps
[Epoch 54 Batch 30/62] avg loss 0.00753528, throughput 9.1218K wps
[Epoch 54 Batch 60/62] avg loss 0.00764345, throughput 8.99556K wps
Begin Testing...
[Epoch 54] train avg loss 0.00767094, dev acc 0.7847, dev avg loss 0.445341, throughput 9.09289K wps
[Epoch 55 Batch 30/62] avg loss 0.00749018, throughput 9.13237K wps
[Epoch 55 Batch 60/62] avg loss 0.00734499, throughput 9.14446K wps
Begin Testing...
[Epoch 55] train avg loss 0.00752729, dev acc 0.7670, dev avg loss 0.446041, throughput 9.16552K wps
[Epoch 56 Batch 30/62] avg loss 0.00742677, throughput 8.87576K wps
[Epoch 56 Batch 60/62] avg loss 0.00737714, throughput 9.14548K wps
Begin Testing...
[Epoch 56] train avg loss 0.00743917, dev acc 0.7847, dev avg loss 0.444156, throughput 9.04315K wps
[Epoch 57 Batch 30/62] avg loss 0.00714874, throughput 9.23972K wps
[Epoch 57 Batch 60/62] avg loss 0.00739906, throughput 9.16847K wps
Begin Testing...
[Epoch 57] train avg loss 0.00743655, dev acc 0.7847, dev avg loss 0.442174, throughput 9.23604K wps
[Epoch 58 Batch 30/62] avg loss 0.00735892, throughput 9.32833K wps
[Epoch 58 Batch 60/62] avg loss 0.00716323, throughput 9.03489K wps
Begin Testing...
[Epoch 58] train avg loss 0.00735371, dev acc 0.7699, dev avg loss 0.440163, throughput 9.21971K wps
[Epoch 59 Batch 30/62] avg loss 0.00706982, throughput 8.77624K wps
[Epoch 59 Batch 60/62] avg loss 0.0071672, throughput 8.93346K wps
Begin Testing...
[Epoch 59] train avg loss 0.00721231, dev acc 0.7788, dev avg loss 0.439619, throughput 8.8364K wps
[Epoch 60 Batch 30/62] avg loss 0.00673774, throughput 8.94345K wps
[Epoch 60 Batch 60/62] avg loss 0.00741586, throughput 9.04926K wps
Begin Testing...
[Epoch 60] train avg loss 0.00720322, dev acc 0.7876, dev avg loss 0.436643, throughput 9.02777K wps
Observed Improvement.
Begin Testing...
[Epoch 61 Batch 30/62] avg loss 0.00713628, throughput 9.14649K wps
[Epoch 61 Batch 60/62] avg loss 0.00679429, throughput 8.9418K wps
Begin Testing...
[Epoch 61] train avg loss 0.00710363, dev acc 0.7788, dev avg loss 0.436555, throughput 9.01291K wps
[Epoch 62 Batch 30/62] avg loss 0.00695912, throughput 9.37312K wps
[Epoch 62 Batch 60/62] avg loss 0.0071819, throughput 9.08412K wps
Begin Testing...
[Epoch 62] train avg loss 0.00711895, dev acc 0.7935, dev avg loss 0.435406, throughput 9.25713K wps
Observed Improvement.
Begin Testing...
[Epoch 63 Batch 30/62] avg loss 0.00673033, throughput 9.24118K wps
[Epoch 63 Batch 60/62] avg loss 0.00704963, throughput 9.08537K wps
Begin Testing...
[Epoch 63] train avg loss 0.00699514, dev acc 0.7847, dev avg loss 0.435699, throughput 9.1877K wps
[Epoch 64 Batch 30/62] avg loss 0.00719794, throughput 9.1467K wps
[Epoch 64 Batch 60/62] avg loss 0.0065706, throughput 9.2184K wps
Begin Testing...
[Epoch 64] train avg loss 0.0070052, dev acc 0.7581, dev avg loss 0.43661, throughput 9.21376K wps
[Epoch 65 Batch 30/62] avg loss 0.00682178, throughput 9.03244K wps
[Epoch 65 Batch 60/62] avg loss 0.00662091, throughput 9.21342K wps
Begin Testing...
[Epoch 65] train avg loss 0.00678731, dev acc 0.7847, dev avg loss 0.431502, throughput 9.15308K wps
[Epoch 66 Batch 30/62] avg loss 0.0066046, throughput 9.35234K wps
[Epoch 66 Batch 60/62] avg loss 0.00677196, throughput 8.73395K wps
Begin Testing...
[Epoch 66] train avg loss 0.00674288, dev acc 0.7640, dev avg loss 0.432236, throughput 9.01187K wps
[Epoch 67 Batch 30/62] avg loss 0.00652861, throughput 9.31164K wps
[Epoch 67 Batch 60/62] avg loss 0.00648954, throughput 9.0514K wps
Begin Testing...
[Epoch 67] train avg loss 0.00677366, dev acc 0.7640, dev avg loss 0.435018, throughput 9.20689K wps
[Epoch 68 Batch 30/62] avg loss 0.00652364, throughput 9.03793K wps
[Epoch 68 Batch 60/62] avg loss 0.00645848, throughput 9.15137K wps
Begin Testing...
[Epoch 68] train avg loss 0.00655119, dev acc 0.7965, dev avg loss 0.429986, throughput 9.12673K wps
Observed Improvement.
Begin Testing...
[Epoch 69 Batch 30/62] avg loss 0.00626517, throughput 8.90435K wps
[Epoch 69 Batch 60/62] avg loss 0.00638655, throughput 8.93543K wps
Begin Testing...
[Epoch 69] train avg loss 0.00650557, dev acc 0.7611, dev avg loss 0.429484, throughput 8.9004K wps
[Epoch 70 Batch 30/62] avg loss 0.00637911, throughput 8.7683K wps
[Epoch 70 Batch 60/62] avg loss 0.00658213, throughput 8.77788K wps
Begin Testing...
[Epoch 70] train avg loss 0.00656263, dev acc 0.7817, dev avg loss 0.427023, throughput 8.75866K wps
[Epoch 71 Batch 30/62] avg loss 0.00641529, throughput 8.73128K wps
[Epoch 71 Batch 60/62] avg loss 0.00601095, throughput 9.20233K wps
Begin Testing...
[Epoch 71] train avg loss 0.00625608, dev acc 0.7699, dev avg loss 0.426452, throughput 8.99339K wps
[Epoch 72 Batch 30/62] avg loss 0.00628287, throughput 9.26503K wps
[Epoch 72 Batch 60/62] avg loss 0.00600895, throughput 9.22536K wps
Begin Testing...
[Epoch 72] train avg loss 0.00617268, dev acc 0.7699, dev avg loss 0.4263, throughput 9.26709K wps
[Epoch 73 Batch 30/62] avg loss 0.00614835, throughput 9.22964K wps
[Epoch 73 Batch 60/62] avg loss 0.00620745, throughput 9.13367K wps
Begin Testing...
[Epoch 73] train avg loss 0.00625577, dev acc 0.7699, dev avg loss 0.425142, throughput 9.202K wps
[Epoch 74 Batch 30/62] avg loss 0.00617808, throughput 9.22734K wps
[Epoch 74 Batch 60/62] avg loss 0.00616068, throughput 9.06189K wps
Begin Testing...
[Epoch 74] train avg loss 0.00625847, dev acc 0.7729, dev avg loss 0.423664, throughput 9.17529K wps
[Epoch 75 Batch 30/62] avg loss 0.00612933, throughput 9.07114K wps
[Epoch 75 Batch 60/62] avg loss 0.00589442, throughput 9.12604K wps
Begin Testing...
[Epoch 75] train avg loss 0.00606722, dev acc 0.7729, dev avg loss 0.42381, throughput 9.12872K wps
[Epoch 76 Batch 30/62] avg loss 0.00609153, throughput 9.1723K wps
[Epoch 76 Batch 60/62] avg loss 0.00599178, throughput 9.14448K wps
Begin Testing...
[Epoch 76] train avg loss 0.00614517, dev acc 0.7876, dev avg loss 0.422698, throughput 9.18853K wps
[Epoch 77 Batch 30/62] avg loss 0.00580753, throughput 9.25481K wps
[Epoch 77 Batch 60/62] avg loss 0.00591835, throughput 9.12407K wps
Begin Testing...
[Epoch 77] train avg loss 0.00595603, dev acc 0.7876, dev avg loss 0.422082, throughput 9.15664K wps
[Epoch 78 Batch 30/62] avg loss 0.00569182, throughput 9.08014K wps
[Epoch 78 Batch 60/62] avg loss 0.00593642, throughput 9.11651K wps
Begin Testing...
[Epoch 78] train avg loss 0.00587629, dev acc 0.7729, dev avg loss 0.420544, throughput 9.12294K wps
[Epoch 79 Batch 30/62] avg loss 0.00570689, throughput 9.19926K wps
[Epoch 79 Batch 60/62] avg loss 0.00572771, throughput 9.1169K wps
Begin Testing...
[Epoch 79] train avg loss 0.00574491, dev acc 0.7788, dev avg loss 0.419778, throughput 9.18993K wps
[Epoch 80 Batch 30/62] avg loss 0.00563439, throughput 9.23004K wps
[Epoch 80 Batch 60/62] avg loss 0.00563741, throughput 9.16757K wps
Begin Testing...
[Epoch 80] train avg loss 0.00580444, dev acc 0.7817, dev avg loss 0.419162, throughput 9.23034K wps
[Epoch 81 Batch 30/62] avg loss 0.00591631, throughput 9.16239K wps
[Epoch 81 Batch 60/62] avg loss 0.00573714, throughput 9.06312K wps
Begin Testing...
[Epoch 81] train avg loss 0.00585996, dev acc 0.7758, dev avg loss 0.418808, throughput 9.13474K wps
[Epoch 82 Batch 30/62] avg loss 0.00565591, throughput 9.02279K wps
[Epoch 82 Batch 60/62] avg loss 0.00565537, throughput 8.94542K wps
Begin Testing...
[Epoch 82] train avg loss 0.00580164, dev acc 0.7876, dev avg loss 0.418285, throughput 9.02038K wps
[Epoch 83 Batch 30/62] avg loss 0.005607, throughput 9.13942K wps
[Epoch 83 Batch 60/62] avg loss 0.00566943, throughput 8.6422K wps
Begin Testing...
[Epoch 83] train avg loss 0.00571996, dev acc 0.7817, dev avg loss 0.417345, throughput 8.87056K wps
[Epoch 84 Batch 30/62] avg loss 0.00540814, throughput 9.29406K wps
[Epoch 84 Batch 60/62] avg loss 0.00563349, throughput 9.05673K wps
Begin Testing...
[Epoch 84] train avg loss 0.00563652, dev acc 0.7817, dev avg loss 0.417338, throughput 9.19799K wps
[Epoch 85 Batch 30/62] avg loss 0.00547924, throughput 9.29364K wps
[Epoch 85 Batch 60/62] avg loss 0.00519638, throughput 9.13566K wps
Begin Testing...
[Epoch 85] train avg loss 0.0054754, dev acc 0.7876, dev avg loss 0.416478, throughput 9.18375K wps
[Epoch 86 Batch 30/62] avg loss 0.00567316, throughput 9.33021K wps
[Epoch 86 Batch 60/62] avg loss 0.00546454, throughput 8.96587K wps
Begin Testing...
[Epoch 86] train avg loss 0.00567311, dev acc 0.7876, dev avg loss 0.416091, throughput 9.11809K wps
[Epoch 87 Batch 30/62] avg loss 0.00520427, throughput 8.92623K wps
[Epoch 87 Batch 60/62] avg loss 0.00552693, throughput 9.07902K wps
Begin Testing...
[Epoch 87] train avg loss 0.0054694, dev acc 0.7876, dev avg loss 0.415572, throughput 9.03471K wps
[Epoch 88 Batch 30/62] avg loss 0.00522333, throughput 9.2556K wps
[Epoch 88 Batch 60/62] avg loss 0.00542693, throughput 8.86319K wps
Begin Testing...
[Epoch 88] train avg loss 0.00537564, dev acc 0.7906, dev avg loss 0.415266, throughput 9.06809K wps
[Epoch 89 Batch 30/62] avg loss 0.00502489, throughput 8.90859K wps
[Epoch 89 Batch 60/62] avg loss 0.00549255, throughput 8.89324K wps
Begin Testing...
[Epoch 89] train avg loss 0.00535235, dev acc 0.7906, dev avg loss 0.414398, throughput 8.875K wps
[Epoch 90 Batch 30/62] avg loss 0.00514744, throughput 9.22755K wps
[Epoch 90 Batch 60/62] avg loss 0.00519155, throughput 9.06425K wps
Begin Testing...
[Epoch 90] train avg loss 0.00524983, dev acc 0.7935, dev avg loss 0.414195, throughput 9.17594K wps
[Epoch 91 Batch 30/62] avg loss 0.00523098, throughput 9.21904K wps
[Epoch 91 Batch 60/62] avg loss 0.00511139, throughput 9.10927K wps
Begin Testing...
[Epoch 91] train avg loss 0.00523208, dev acc 0.7788, dev avg loss 0.41969, throughput 9.19011K wps
[Epoch 92 Batch 30/62] avg loss 0.00497547, throughput 9.28902K wps
[Epoch 92 Batch 60/62] avg loss 0.00518129, throughput 9.05193K wps
Begin Testing...
[Epoch 92] train avg loss 0.00509946, dev acc 0.7935, dev avg loss 0.414542, throughput 9.20007K wps
[Epoch 93 Batch 30/62] avg loss 0.00504231, throughput 9.04615K wps
[Epoch 93 Batch 60/62] avg loss 0.00507276, throughput 9.02816K wps
Begin Testing...
[Epoch 93] train avg loss 0.00509572, dev acc 0.7906, dev avg loss 0.413722, throughput 9.06555K wps
[Epoch 94 Batch 30/62] avg loss 0.00501115, throughput 9.09547K wps
[Epoch 94 Batch 60/62] avg loss 0.00482743, throughput 8.93855K wps
Begin Testing...
[Epoch 94] train avg loss 0.00495261, dev acc 0.7965, dev avg loss 0.412959, throughput 9.04929K wps
Observed Improvement.
Begin Testing...
[Epoch 95 Batch 30/62] avg loss 0.00490113, throughput 9.05032K wps
[Epoch 95 Batch 60/62] avg loss 0.00495567, throughput 8.82415K wps
Begin Testing...
[Epoch 95] train avg loss 0.0050199, dev acc 0.7994, dev avg loss 0.411498, throughput 8.90829K wps
Observed Improvement.
Begin Testing...
[Epoch 96 Batch 30/62] avg loss 0.00481937, throughput 9.27647K wps
[Epoch 96 Batch 60/62] avg loss 0.00479416, throughput 8.98237K wps
Begin Testing...
[Epoch 96] train avg loss 0.00486002, dev acc 0.7788, dev avg loss 0.417033, throughput 9.14614K wps
[Epoch 97 Batch 30/62] avg loss 0.00484978, throughput 9.00812K wps
[Epoch 97 Batch 60/62] avg loss 0.00493234, throughput 9.29504K wps
Begin Testing...
[Epoch 97] train avg loss 0.00493989, dev acc 0.7906, dev avg loss 0.413127, throughput 9.17194K wps
[Epoch 98 Batch 30/62] avg loss 0.0046355, throughput 8.52625K wps
[Epoch 98 Batch 60/62] avg loss 0.00480378, throughput 9.12795K wps
Begin Testing...
[Epoch 98] train avg loss 0.00477948, dev acc 0.7965, dev avg loss 0.410463, throughput 8.85661K wps
[Epoch 99 Batch 30/62] avg loss 0.00462332, throughput 8.87267K wps
[Epoch 99 Batch 60/62] avg loss 0.00475702, throughput 9.20137K wps
Begin Testing...
[Epoch 99] train avg loss 0.00479256, dev acc 0.7965, dev avg loss 0.411209, throughput 9.06634K wps
[Epoch 100 Batch 30/62] avg loss 0.00501582, throughput 9.28005K wps
[Epoch 100 Batch 60/62] avg loss 0.00458511, throughput 8.77534K wps
Begin Testing...
[Epoch 100] train avg loss 0.00483541, dev acc 0.8024, dev avg loss 0.410093, throughput 8.9892K wps
Observed Improvement.
Begin Testing...
[Epoch 101 Batch 30/62] avg loss 0.00471022, throughput 9.21899K wps
[Epoch 101 Batch 60/62] avg loss 0.00448483, throughput 9.08567K wps
Begin Testing...
[Epoch 101] train avg loss 0.0046929, dev acc 0.7847, dev avg loss 0.412032, throughput 9.13498K wps
[Epoch 102 Batch 30/62] avg loss 0.00438917, throughput 9.25199K wps
[Epoch 102 Batch 60/62] avg loss 0.00460655, throughput 9.13038K wps
Begin Testing...
[Epoch 102] train avg loss 0.00458525, dev acc 0.7906, dev avg loss 0.410246, throughput 9.22304K wps
[Epoch 103 Batch 30/62] avg loss 0.00455452, throughput 9.30968K wps
[Epoch 103 Batch 60/62] avg loss 0.00464278, throughput 8.83198K wps
Begin Testing...
[Epoch 103] train avg loss 0.00461353, dev acc 0.8024, dev avg loss 0.408942, throughput 9.04749K wps
Observed Improvement.
Begin Testing...
[Epoch 104 Batch 30/62] avg loss 0.00463512, throughput 9.11625K wps
[Epoch 104 Batch 60/62] avg loss 0.0044474, throughput 9.24099K wps
Begin Testing...
[Epoch 104] train avg loss 0.00465965, dev acc 0.7994, dev avg loss 0.409622, throughput 9.20644K wps
[Epoch 105 Batch 30/62] avg loss 0.00429696, throughput 9.31448K wps
[Epoch 105 Batch 60/62] avg loss 0.00457739, throughput 9.19464K wps
Begin Testing...
[Epoch 105] train avg loss 0.00450046, dev acc 0.7817, dev avg loss 0.411754, throughput 9.28188K wps
[Epoch 106 Batch 30/62] avg loss 0.00428604, throughput 9.37524K wps
[Epoch 106 Batch 60/62] avg loss 0.00434667, throughput 8.83882K wps
Begin Testing...
[Epoch 106] train avg loss 0.00434205, dev acc 0.7994, dev avg loss 0.407638, throughput 9.08137K wps
[Epoch 107 Batch 30/62] avg loss 0.00436944, throughput 9.14432K wps
[Epoch 107 Batch 60/62] avg loss 0.00422331, throughput 8.92767K wps
Begin Testing...
[Epoch 107] train avg loss 0.00434777, dev acc 0.7994, dev avg loss 0.408518, throughput 9.06662K wps
[Epoch 108 Batch 30/62] avg loss 0.00433789, throughput 9.17339K wps
[Epoch 108 Batch 60/62] avg loss 0.00430978, throughput 9.04601K wps
Begin Testing...
[Epoch 108] train avg loss 0.00436146, dev acc 0.8024, dev avg loss 0.407566, throughput 9.14521K wps
Observed Improvement.
Begin Testing...
[Epoch 109 Batch 30/62] avg loss 0.00386889, throughput 9.10824K wps
[Epoch 109 Batch 60/62] avg loss 0.00441283, throughput 8.83086K wps
Begin Testing...
[Epoch 109] train avg loss 0.00424849, dev acc 0.8053, dev avg loss 0.406769, throughput 9.03605K wps
Observed Improvement.
Begin Testing...
[Epoch 110 Batch 30/62] avg loss 0.00428085, throughput 9.28969K wps
[Epoch 110 Batch 60/62] avg loss 0.00421337, throughput 9.13558K wps
Begin Testing...
[Epoch 110] train avg loss 0.0043512, dev acc 0.8024, dev avg loss 0.407051, throughput 9.16499K wps
[Epoch 111 Batch 30/62] avg loss 0.00414133, throughput 9.10423K wps
[Epoch 111 Batch 60/62] avg loss 0.00412698, throughput 8.8015K wps
Begin Testing...
[Epoch 111] train avg loss 0.00426625, dev acc 0.7994, dev avg loss 0.406416, throughput 8.98624K wps
[Epoch 112 Batch 30/62] avg loss 0.00420832, throughput 9.05889K wps
[Epoch 112 Batch 60/62] avg loss 0.00386987, throughput 8.92723K wps
Begin Testing...
[Epoch 112] train avg loss 0.00407866, dev acc 0.7965, dev avg loss 0.406277, throughput 8.95848K wps
[Epoch 113 Batch 30/62] avg loss 0.00434001, throughput 8.91328K wps
[Epoch 113 Batch 60/62] avg loss 0.00403235, throughput 8.98328K wps
Begin Testing...
[Epoch 113] train avg loss 0.00422936, dev acc 0.7994, dev avg loss 0.406436, throughput 8.96943K wps
[Epoch 114 Batch 30/62] avg loss 0.00403222, throughput 9.18166K wps
[Epoch 114 Batch 60/62] avg loss 0.00408218, throughput 8.97274K wps
Begin Testing...
[Epoch 114] train avg loss 0.00413922, dev acc 0.7906, dev avg loss 0.405962, throughput 9.0466K wps
[Epoch 115 Batch 30/62] avg loss 0.00389424, throughput 8.8591K wps
[Epoch 115 Batch 60/62] avg loss 0.00429971, throughput 9.22471K wps
Begin Testing...
[Epoch 115] train avg loss 0.00420223, dev acc 0.7994, dev avg loss 0.406254, throughput 9.06053K wps
[Epoch 116 Batch 30/62] avg loss 0.00390483, throughput 9.06066K wps
[Epoch 116 Batch 60/62] avg loss 0.00392769, throughput 9.15139K wps
Begin Testing...
[Epoch 116] train avg loss 0.00395837, dev acc 0.7935, dev avg loss 0.411229, throughput 9.06464K wps
[Epoch 117 Batch 30/62] avg loss 0.00398675, throughput 9.05667K wps
[Epoch 117 Batch 60/62] avg loss 0.00391813, throughput 8.9645K wps
Begin Testing...
[Epoch 117] train avg loss 0.00405142, dev acc 0.8024, dev avg loss 0.404986, throughput 9.04116K wps
[Epoch 118 Batch 30/62] avg loss 0.00387334, throughput 9.25066K wps
[Epoch 118 Batch 60/62] avg loss 0.00374557, throughput 8.87411K wps
Begin Testing...
[Epoch 118] train avg loss 0.00388018, dev acc 0.7906, dev avg loss 0.410561, throughput 9.04677K wps
[Epoch 119 Batch 30/62] avg loss 0.00388527, throughput 9.16891K wps
[Epoch 119 Batch 60/62] avg loss 0.0038817, throughput 9.19169K wps
Begin Testing...
[Epoch 119] train avg loss 0.00389617, dev acc 0.8024, dev avg loss 0.405414, throughput 9.21055K wps
[Epoch 120 Batch 30/62] avg loss 0.00371553, throughput 8.91798K wps
[Epoch 120 Batch 60/62] avg loss 0.00393157, throughput 9.06487K wps
Begin Testing...
[Epoch 120] train avg loss 0.00389704, dev acc 0.7994, dev avg loss 0.409202, throughput 9.02288K wps
[Epoch 121 Batch 30/62] avg loss 0.00389925, throughput 9.34299K wps
[Epoch 121 Batch 60/62] avg loss 0.0036304, throughput 9.09981K wps
Begin Testing...
[Epoch 121] train avg loss 0.00377047, dev acc 0.7935, dev avg loss 0.405424, throughput 9.238K wps
[Epoch 122 Batch 30/62] avg loss 0.00385626, throughput 9.13648K wps
[Epoch 122 Batch 60/62] avg loss 0.00365463, throughput 9.08643K wps
Begin Testing...
[Epoch 122] train avg loss 0.00378534, dev acc 0.8024, dev avg loss 0.405068, throughput 9.14061K wps
[Epoch 123 Batch 30/62] avg loss 0.00358061, throughput 8.98773K wps
[Epoch 123 Batch 60/62] avg loss 0.00376806, throughput 9.04421K wps
Begin Testing...
[Epoch 123] train avg loss 0.00367421, dev acc 0.7994, dev avg loss 0.404122, throughput 9.04709K wps
[Epoch 124 Batch 30/62] avg loss 0.00363, throughput 9.14065K wps
[Epoch 124 Batch 60/62] avg loss 0.00358537, throughput 8.99004K wps
Begin Testing...
[Epoch 124] train avg loss 0.00361369, dev acc 0.8024, dev avg loss 0.406228, throughput 9.04253K wps
[Epoch 125 Batch 30/62] avg loss 0.0037638, throughput 9.20197K wps
[Epoch 125 Batch 60/62] avg loss 0.00351408, throughput 8.96595K wps
Begin Testing...
[Epoch 125] train avg loss 0.00366038, dev acc 0.8024, dev avg loss 0.404546, throughput 9.11681K wps
[Epoch 126 Batch 30/62] avg loss 0.00363741, throughput 9.00698K wps
[Epoch 126 Batch 60/62] avg loss 0.00352593, throughput 9.28939K wps
Begin Testing...
[Epoch 126] train avg loss 0.00362283, dev acc 0.7994, dev avg loss 0.408741, throughput 9.17783K wps
[Epoch 127 Batch 30/62] avg loss 0.00360159, throughput 9.35206K wps
[Epoch 127 Batch 60/62] avg loss 0.00344621, throughput 9.26573K wps
Begin Testing...
[Epoch 127] train avg loss 0.00356936, dev acc 0.7965, dev avg loss 0.407436, throughput 9.33504K wps
[Epoch 128 Batch 30/62] avg loss 0.00348554, throughput 9.22648K wps
[Epoch 128 Batch 60/62] avg loss 0.00346394, throughput 9.15425K wps
Begin Testing...
[Epoch 128] train avg loss 0.00348792, dev acc 0.7935, dev avg loss 0.403706, throughput 9.21714K wps
[Epoch 129 Batch 30/62] avg loss 0.00330703, throughput 9.25178K wps
[Epoch 129 Batch 60/62] avg loss 0.00344829, throughput 8.88834K wps
Begin Testing...
[Epoch 129] train avg loss 0.00353125, dev acc 0.7935, dev avg loss 0.403293, throughput 9.1401K wps
[Epoch 130 Batch 30/62] avg loss 0.00348262, throughput 9.19616K wps
[Epoch 130 Batch 60/62] avg loss 0.00346469, throughput 9.03905K wps
Begin Testing...
[Epoch 130] train avg loss 0.00347538, dev acc 0.8024, dev avg loss 0.404964, throughput 9.11074K wps
[Epoch 131 Batch 30/62] avg loss 0.00349706, throughput 9.31028K wps
[Epoch 131 Batch 60/62] avg loss 0.00324411, throughput 8.5738K wps
Begin Testing...
[Epoch 131] train avg loss 0.00338778, dev acc 0.7935, dev avg loss 0.403524, throughput 8.90457K wps
[Epoch 132 Batch 30/62] avg loss 0.00348155, throughput 9.22278K wps
[Epoch 132 Batch 60/62] avg loss 0.00329461, throughput 8.96478K wps
Begin Testing...
[Epoch 132] train avg loss 0.00342854, dev acc 0.7994, dev avg loss 0.407225, throughput 9.07758K wps
[Epoch 133 Batch 30/62] avg loss 0.00332751, throughput 9.21769K wps
[Epoch 133 Batch 60/62] avg loss 0.00340393, throughput 9.14509K wps
Begin Testing...
[Epoch 133] train avg loss 0.00340151, dev acc 0.8024, dev avg loss 0.404534, throughput 9.21057K wps
[Epoch 134 Batch 30/62] avg loss 0.00358333, throughput 8.75677K wps
[Epoch 134 Batch 60/62] avg loss 0.00306386, throughput 9.09886K wps
Begin Testing...
[Epoch 134] train avg loss 0.00334702, dev acc 0.7935, dev avg loss 0.403183, throughput 8.89528K wps
[Epoch 135 Batch 30/62] avg loss 0.00322195, throughput 9.31139K wps
[Epoch 135 Batch 60/62] avg loss 0.00326797, throughput 8.7915K wps
Begin Testing...
[Epoch 135] train avg loss 0.00329902, dev acc 0.8024, dev avg loss 0.4044, throughput 9.02411K wps
[Epoch 136 Batch 30/62] avg loss 0.00308454, throughput 8.85795K wps
[Epoch 136 Batch 60/62] avg loss 0.00332253, throughput 9.19706K wps
Begin Testing...
[Epoch 136] train avg loss 0.0032731, dev acc 0.7935, dev avg loss 0.402764, throughput 9.06041K wps
[Epoch 137 Batch 30/62] avg loss 0.0033237, throughput 9.2623K wps
[Epoch 137 Batch 60/62] avg loss 0.00299517, throughput 9.0881K wps
Begin Testing...
[Epoch 137] train avg loss 0.00320707, dev acc 0.8053, dev avg loss 0.405513, throughput 9.20199K wps
Observed Improvement.
Begin Testing...
[Epoch 138 Batch 30/62] avg loss 0.00310758, throughput 9.17552K wps
[Epoch 138 Batch 60/62] avg loss 0.00326703, throughput 8.9978K wps
Begin Testing...
[Epoch 138] train avg loss 0.00323196, dev acc 0.7935, dev avg loss 0.402482, throughput 9.06964K wps
[Epoch 139 Batch 30/62] avg loss 0.00334286, throughput 9.27756K wps
[Epoch 139 Batch 60/62] avg loss 0.00312966, throughput 9.17485K wps
Begin Testing...
[Epoch 139] train avg loss 0.00328664, dev acc 0.7906, dev avg loss 0.402428, throughput 9.25342K wps
[Epoch 140 Batch 30/62] avg loss 0.003112, throughput 9.12341K wps
[Epoch 140 Batch 60/62] avg loss 0.00307956, throughput 9.12235K wps
Begin Testing...
[Epoch 140] train avg loss 0.00312634, dev acc 0.7965, dev avg loss 0.403223, throughput 9.15086K wps
[Epoch 141 Batch 30/62] avg loss 0.00299671, throughput 9.24948K wps
[Epoch 141 Batch 60/62] avg loss 0.00327556, throughput 9.17336K wps
Begin Testing...
[Epoch 141] train avg loss 0.00319004, dev acc 0.7965, dev avg loss 0.402661, throughput 9.23649K wps
[Epoch 142 Batch 30/62] avg loss 0.00314963, throughput 9.29661K wps
[Epoch 142 Batch 60/62] avg loss 0.00319143, throughput 9.1907K wps
Begin Testing...
[Epoch 142] train avg loss 0.00323178, dev acc 0.7965, dev avg loss 0.402566, throughput 9.27209K wps
[Epoch 143 Batch 30/62] avg loss 0.00305253, throughput 9.14322K wps
[Epoch 143 Batch 60/62] avg loss 0.00305787, throughput 8.83026K wps
Begin Testing...
[Epoch 143] train avg loss 0.0030657, dev acc 0.7935, dev avg loss 0.402249, throughput 9.01712K wps
[Epoch 144 Batch 30/62] avg loss 0.00292691, throughput 9.09614K wps
[Epoch 144 Batch 60/62] avg loss 0.00309591, throughput 9.16144K wps
Begin Testing...
[Epoch 144] train avg loss 0.00307179, dev acc 0.7994, dev avg loss 0.404127, throughput 9.16029K wps
[Epoch 145 Batch 30/62] avg loss 0.0030135, throughput 9.13588K wps
[Epoch 145 Batch 60/62] avg loss 0.00297697, throughput 9.06123K wps
Begin Testing...
[Epoch 145] train avg loss 0.0030448, dev acc 0.8024, dev avg loss 0.404329, throughput 9.12798K wps
[Epoch 146 Batch 30/62] avg loss 0.00315002, throughput 9.20365K wps
[Epoch 146 Batch 60/62] avg loss 0.00280309, throughput 9.13844K wps
Begin Testing...
[Epoch 146] train avg loss 0.00305274, dev acc 0.7994, dev avg loss 0.403919, throughput 9.199K wps
[Epoch 147 Batch 30/62] avg loss 0.00286611, throughput 9.37242K wps
[Epoch 147 Batch 60/62] avg loss 0.00295703, throughput 9.04205K wps
Begin Testing...
[Epoch 147] train avg loss 0.0029308, dev acc 0.8053, dev avg loss 0.405347, throughput 9.17509K wps
Observed Improvement.
Begin Testing...
[Epoch 148 Batch 30/62] avg loss 0.00287905, throughput 8.84336K wps
[Epoch 148 Batch 60/62] avg loss 0.00293518, throughput 8.98552K wps
Begin Testing...
[Epoch 148] train avg loss 0.00294647, dev acc 0.8024, dev avg loss 0.403116, throughput 8.89649K wps
[Epoch 149 Batch 30/62] avg loss 0.00278757, throughput 9.05017K wps
[Epoch 149 Batch 60/62] avg loss 0.00301061, throughput 9.04122K wps
Begin Testing...
[Epoch 149] train avg loss 0.00294097, dev acc 0.7965, dev avg loss 0.402447, throughput 9.08052K wps
[Epoch 150 Batch 30/62] avg loss 0.00267837, throughput 8.88612K wps
[Epoch 150 Batch 60/62] avg loss 0.00284822, throughput 9.07481K wps
Begin Testing...
[Epoch 150] train avg loss 0.00285137, dev acc 0.7965, dev avg loss 0.403133, throughput 9.01914K wps
[Epoch 151 Batch 30/62] avg loss 0.00282623, throughput 9.00208K wps
[Epoch 151 Batch 60/62] avg loss 0.0028799, throughput 8.60507K wps
Begin Testing...
[Epoch 151] train avg loss 0.00287878, dev acc 0.8053, dev avg loss 0.405273, throughput 8.83613K wps
Observed Improvement.
Begin Testing...
[Epoch 152 Batch 30/62] avg loss 0.00267751, throughput 9.41871K wps
[Epoch 152 Batch 60/62] avg loss 0.00299348, throughput 9.11076K wps
Begin Testing...
[Epoch 152] train avg loss 0.00285358, dev acc 0.7935, dev avg loss 0.402724, throughput 9.28962K wps
[Epoch 153 Batch 30/62] avg loss 0.0027807, throughput 9.09877K wps
[Epoch 153 Batch 60/62] avg loss 0.00270935, throughput 9.00418K wps
Begin Testing...
[Epoch 153] train avg loss 0.00279253, dev acc 0.8053, dev avg loss 0.406159, throughput 9.08555K wps
Observed Improvement.
Begin Testing...
[Epoch 154 Batch 30/62] avg loss 0.0026736, throughput 9.00136K wps
[Epoch 154 Batch 60/62] avg loss 0.00278377, throughput 9.11092K wps
Begin Testing...
[Epoch 154] train avg loss 0.00274251, dev acc 0.7994, dev avg loss 0.408219, throughput 9.08943K wps
[Epoch 155 Batch 30/62] avg loss 0.00272407, throughput 8.88595K wps
[Epoch 155 Batch 60/62] avg loss 0.00262389, throughput 8.78007K wps
Begin Testing...
[Epoch 155] train avg loss 0.00270583, dev acc 0.8024, dev avg loss 0.402217, throughput 8.90966K wps
[Epoch 156 Batch 30/62] avg loss 0.00252249, throughput 9.10984K wps
[Epoch 156 Batch 60/62] avg loss 0.00278126, throughput 9.02788K wps
Begin Testing...
[Epoch 156] train avg loss 0.00268365, dev acc 0.8024, dev avg loss 0.40182, throughput 9.09809K wps
[Epoch 157 Batch 30/62] avg loss 0.00278745, throughput 9.28166K wps
[Epoch 157 Batch 60/62] avg loss 0.00248833, throughput 9.10994K wps
Begin Testing...
[Epoch 157] train avg loss 0.0027124, dev acc 0.8024, dev avg loss 0.402513, throughput 9.22381K wps
[Epoch 158 Batch 30/62] avg loss 0.00273052, throughput 8.6621K wps
[Epoch 158 Batch 60/62] avg loss 0.00268286, throughput 8.98172K wps
Begin Testing...
[Epoch 158] train avg loss 0.0027253, dev acc 0.7994, dev avg loss 0.409808, throughput 8.86091K wps
[Epoch 159 Batch 30/62] avg loss 0.00265938, throughput 9.01127K wps
[Epoch 159 Batch 60/62] avg loss 0.00255662, throughput 8.85249K wps
Begin Testing...
[Epoch 159] train avg loss 0.00264051, dev acc 0.8053, dev avg loss 0.406933, throughput 8.92828K wps
Observed Improvement.
Begin Testing...
[Epoch 160 Batch 30/62] avg loss 0.00256, throughput 9.093K wps
[Epoch 160 Batch 60/62] avg loss 0.00253196, throughput 8.9485K wps
Begin Testing...
[Epoch 160] train avg loss 0.00256941, dev acc 0.8024, dev avg loss 0.404948, throughput 9.05355K wps
[Epoch 161 Batch 30/62] avg loss 0.00250299, throughput 8.83297K wps
[Epoch 161 Batch 60/62] avg loss 0.00242225, throughput 9.26448K wps
Begin Testing...
[Epoch 161] train avg loss 0.00250491, dev acc 0.7965, dev avg loss 0.403036, throughput 9.0326K wps
[Epoch 162 Batch 30/62] avg loss 0.00259734, throughput 8.77848K wps
[Epoch 162 Batch 60/62] avg loss 0.00247725, throughput 9.17423K wps
Begin Testing...
[Epoch 162] train avg loss 0.00263349, dev acc 0.7935, dev avg loss 0.404442, throughput 9.00939K wps
[Epoch 163 Batch 30/62] avg loss 0.00248415, throughput 9.23394K wps
[Epoch 163 Batch 60/62] avg loss 0.0026709, throughput 9.12519K wps
Begin Testing...
[Epoch 163] train avg loss 0.00260064, dev acc 0.8053, dev avg loss 0.40249, throughput 9.2082K wps
Observed Improvement.
Begin Testing...
[Epoch 164 Batch 30/62] avg loss 0.00253868, throughput 9.05702K wps
[Epoch 164 Batch 60/62] avg loss 0.00255688, throughput 9.10158K wps
Begin Testing...
[Epoch 164] train avg loss 0.00257129, dev acc 0.8024, dev avg loss 0.402699, throughput 9.05666K wps
[Epoch 165 Batch 30/62] avg loss 0.00252133, throughput 9.21465K wps
[Epoch 165 Batch 60/62] avg loss 0.00237868, throughput 9.18096K wps
Begin Testing...
[Epoch 165] train avg loss 0.00249049, dev acc 0.7994, dev avg loss 0.404281, throughput 9.22863K wps
[Epoch 166 Batch 30/62] avg loss 0.00239477, throughput 9.22258K wps
[Epoch 166 Batch 60/62] avg loss 0.00249894, throughput 8.91466K wps
Begin Testing...
[Epoch 166] train avg loss 0.00247081, dev acc 0.7994, dev avg loss 0.403092, throughput 9.11158K wps
[Epoch 167 Batch 30/62] avg loss 0.00242535, throughput 9.24446K wps
[Epoch 167 Batch 60/62] avg loss 0.00247725, throughput 8.99751K wps
Begin Testing...
[Epoch 167] train avg loss 0.0025001, dev acc 0.7994, dev avg loss 0.402741, throughput 9.08628K wps
[Epoch 168 Batch 30/62] avg loss 0.00245686, throughput 9.06571K wps
[Epoch 168 Batch 60/62] avg loss 0.00235031, throughput 9.22217K wps
Begin Testing...
[Epoch 168] train avg loss 0.00240882, dev acc 0.7994, dev avg loss 0.403918, throughput 9.1552K wps
[Epoch 169 Batch 30/62] avg loss 0.00236938, throughput 9.09943K wps
[Epoch 169 Batch 60/62] avg loss 0.00239482, throughput 9.01752K wps
Begin Testing...
[Epoch 169] train avg loss 0.0024424, dev acc 0.8053, dev avg loss 0.402226, throughput 9.08453K wps
Observed Improvement.
Begin Testing...
[Epoch 170 Batch 30/62] avg loss 0.00236052, throughput 9.2691K wps
[Epoch 170 Batch 60/62] avg loss 0.0023811, throughput 8.79254K wps
Begin Testing...
[Epoch 170] train avg loss 0.00248571, dev acc 0.7994, dev avg loss 0.402899, throughput 9.0632K wps
[Epoch 171 Batch 30/62] avg loss 0.00222575, throughput 9.1721K wps
[Epoch 171 Batch 60/62] avg loss 0.00239487, throughput 9.11163K wps
Begin Testing...
[Epoch 171] train avg loss 0.00233468, dev acc 0.8024, dev avg loss 0.403273, throughput 9.11569K wps
[Epoch 172 Batch 30/62] avg loss 0.00218511, throughput 9.15435K wps
[Epoch 172 Batch 60/62] avg loss 0.00231017, throughput 8.90808K wps
Begin Testing...
[Epoch 172] train avg loss 0.00226782, dev acc 0.8024, dev avg loss 0.404723, throughput 9.0374K wps
[Epoch 173 Batch 30/62] avg loss 0.00231832, throughput 9.17549K wps
[Epoch 173 Batch 60/62] avg loss 0.00229066, throughput 9.00459K wps
Begin Testing...
[Epoch 173] train avg loss 0.00237728, dev acc 0.7965, dev avg loss 0.411429, throughput 9.11538K wps
[Epoch 174 Batch 30/62] avg loss 0.00235518, throughput 9.16875K wps
[Epoch 174 Batch 60/62] avg loss 0.00231113, throughput 9.03908K wps
Begin Testing...
[Epoch 174] train avg loss 0.00236254, dev acc 0.8024, dev avg loss 0.403763, throughput 9.13603K wps
[Epoch 175 Batch 30/62] avg loss 0.00218344, throughput 9.29552K wps
[Epoch 175 Batch 60/62] avg loss 0.00223721, throughput 9.01326K wps
Begin Testing...
[Epoch 175] train avg loss 0.00226242, dev acc 0.8024, dev avg loss 0.402425, throughput 9.16666K wps
[Epoch 176 Batch 30/62] avg loss 0.00221078, throughput 9.23648K wps
[Epoch 176 Batch 60/62] avg loss 0.0024086, throughput 8.8099K wps
Begin Testing...
[Epoch 176] train avg loss 0.00232289, dev acc 0.7965, dev avg loss 0.404315, throughput 9.03146K wps
[Epoch 177 Batch 30/62] avg loss 0.00225175, throughput 8.98698K wps
[Epoch 177 Batch 60/62] avg loss 0.00215373, throughput 8.93072K wps
Begin Testing...
[Epoch 177] train avg loss 0.00221515, dev acc 0.8053, dev avg loss 0.402907, throughput 8.9965K wps
Observed Improvement.
Begin Testing...
[Epoch 178 Batch 30/62] avg loss 0.00229362, throughput 9.19557K wps
[Epoch 178 Batch 60/62] avg loss 0.00222753, throughput 9.03082K wps
Begin Testing...
[Epoch 178] train avg loss 0.00227795, dev acc 0.8083, dev avg loss 0.403354, throughput 9.07805K wps
Observed Improvement.
Begin Testing...
[Epoch 179 Batch 30/62] avg loss 0.00198409, throughput 9.00672K wps
[Epoch 179 Batch 60/62] avg loss 0.0023825, throughput 9.0209K wps
Begin Testing...
[Epoch 179] train avg loss 0.00220767, dev acc 0.7994, dev avg loss 0.402736, throughput 9.04437K wps
[Epoch 180 Batch 30/62] avg loss 0.00222009, throughput 9.23107K wps
[Epoch 180 Batch 60/62] avg loss 0.00221471, throughput 9.15392K wps
Begin Testing...
[Epoch 180] train avg loss 0.00222913, dev acc 0.7965, dev avg loss 0.403292, throughput 9.21927K wps
[Epoch 181 Batch 30/62] avg loss 0.00224394, throughput 9.06013K wps
[Epoch 181 Batch 60/62] avg loss 0.00213512, throughput 8.93134K wps
Begin Testing...
[Epoch 181] train avg loss 0.00219367, dev acc 0.7994, dev avg loss 0.404899, throughput 8.97148K wps
[Epoch 182 Batch 30/62] avg loss 0.00212466, throughput 9.25685K wps
[Epoch 182 Batch 60/62] avg loss 0.00226882, throughput 8.99823K wps
Begin Testing...
[Epoch 182] train avg loss 0.00218421, dev acc 0.8053, dev avg loss 0.404524, throughput 9.1048K wps
[Epoch 183 Batch 30/62] avg loss 0.00193218, throughput 9.3323K wps
[Epoch 183 Batch 60/62] avg loss 0.00226354, throughput 8.92405K wps
Begin Testing...
[Epoch 183] train avg loss 0.00214285, dev acc 0.8053, dev avg loss 0.40484, throughput 9.08771K wps
[Epoch 184 Batch 30/62] avg loss 0.00219428, throughput 9.29421K wps
[Epoch 184 Batch 60/62] avg loss 0.00209281, throughput 9.16977K wps
Begin Testing...
[Epoch 184] train avg loss 0.00214766, dev acc 0.8053, dev avg loss 0.403711, throughput 9.25966K wps
[Epoch 185 Batch 30/62] avg loss 0.0019846, throughput 9.26334K wps
[Epoch 185 Batch 60/62] avg loss 0.00221727, throughput 8.97392K wps
Begin Testing...
[Epoch 185] train avg loss 0.00210476, dev acc 0.8053, dev avg loss 0.404952, throughput 9.15084K wps
[Epoch 186 Batch 30/62] avg loss 0.00197149, throughput 9.10443K wps
[Epoch 186 Batch 60/62] avg loss 0.00213796, throughput 8.9358K wps
Begin Testing...
[Epoch 186] train avg loss 0.00207231, dev acc 0.8053, dev avg loss 0.405999, throughput 8.98485K wps
[Epoch 187 Batch 30/62] avg loss 0.00202307, throughput 9.00911K wps
[Epoch 187 Batch 60/62] avg loss 0.00220164, throughput 9.21673K wps
Begin Testing...
[Epoch 187] train avg loss 0.00214717, dev acc 0.8083, dev avg loss 0.405874, throughput 9.11137K wps
Observed Improvement.
Begin Testing...
[Epoch 188 Batch 30/62] avg loss 0.00208265, throughput 9.03167K wps
[Epoch 188 Batch 60/62] avg loss 0.0020518, throughput 8.95205K wps
Begin Testing...
[Epoch 188] train avg loss 0.00207313, dev acc 0.8053, dev avg loss 0.405714, throughput 9.05257K wps
[Epoch 189 Batch 30/62] avg loss 0.00194603, throughput 9.33749K wps
[Epoch 189 Batch 60/62] avg loss 0.00207768, throughput 8.97038K wps
Begin Testing...
[Epoch 189] train avg loss 0.00200373, dev acc 0.8024, dev avg loss 0.409832, throughput 9.18306K wps
[Epoch 190 Batch 30/62] avg loss 0.00216369, throughput 9.36363K wps
[Epoch 190 Batch 60/62] avg loss 0.00190957, throughput 8.82503K wps
Begin Testing...
[Epoch 190] train avg loss 0.00205027, dev acc 0.8083, dev avg loss 0.40513, throughput 9.11163K wps
Observed Improvement.
Begin Testing...
[Epoch 191 Batch 30/62] avg loss 0.00206331, throughput 9.25668K wps
[Epoch 191 Batch 60/62] avg loss 0.00194518, throughput 9.036K wps
Begin Testing...
[Epoch 191] train avg loss 0.00201644, dev acc 0.8083, dev avg loss 0.404854, throughput 9.16832K wps
Observed Improvement.
Begin Testing...
[Epoch 192 Batch 30/62] avg loss 0.00188301, throughput 8.98277K wps
[Epoch 192 Batch 60/62] avg loss 0.00184186, throughput 9.02879K wps
Begin Testing...
[Epoch 192] train avg loss 0.0019052, dev acc 0.7965, dev avg loss 0.404613, throughput 9.04149K wps
[Epoch 193 Batch 30/62] avg loss 0.00188656, throughput 8.79964K wps
[Epoch 193 Batch 60/62] avg loss 0.00186646, throughput 8.87258K wps
Begin Testing...
[Epoch 193] train avg loss 0.00188986, dev acc 0.7994, dev avg loss 0.407564, throughput 8.90022K wps
[Epoch 194 Batch 30/62] avg loss 0.00195463, throughput 9.21561K wps
[Epoch 194 Batch 60/62] avg loss 0.00196799, throughput 9.22951K wps
Begin Testing...
[Epoch 194] train avg loss 0.00199892, dev acc 0.8024, dev avg loss 0.409432, throughput 9.25579K wps
[Epoch 195 Batch 30/62] avg loss 0.00197916, throughput 9.07256K wps
[Epoch 195 Batch 60/62] avg loss 0.00182744, throughput 8.87352K wps
Begin Testing...
[Epoch 195] train avg loss 0.00196828, dev acc 0.8024, dev avg loss 0.40475, throughput 9.02268K wps
[Epoch 196 Batch 30/62] avg loss 0.00189288, throughput 9.02936K wps
[Epoch 196 Batch 60/62] avg loss 0.00186145, throughput 8.91271K wps
Begin Testing...
[Epoch 196] train avg loss 0.00190187, dev acc 0.8053, dev avg loss 0.409171, throughput 8.95253K wps
[Epoch 197 Batch 30/62] avg loss 0.0019679, throughput 9.07513K wps
[Epoch 197 Batch 60/62] avg loss 0.00172188, throughput 8.82146K wps
Begin Testing...
[Epoch 197] train avg loss 0.00185089, dev acc 0.8053, dev avg loss 0.406028, throughput 8.97536K wps
[Epoch 198 Batch 30/62] avg loss 0.00188469, throughput 8.83942K wps
[Epoch 198 Batch 60/62] avg loss 0.00187142, throughput 9.2198K wps
Begin Testing...
[Epoch 198] train avg loss 0.0019034, dev acc 0.8024, dev avg loss 0.405189, throughput 9.06072K wps
[Epoch 199 Batch 30/62] avg loss 0.00178458, throughput 9.24747K wps
[Epoch 199 Batch 60/62] avg loss 0.00189282, throughput 8.84085K wps
Begin Testing...
[Epoch 199] train avg loss 0.00185101, dev acc 0.8024, dev avg loss 0.410923, throughput 9.07533K wps
Test loss 0.381389, test acc 0.8302
Total time cost 154.20s
[Epoch 0 Batch 30/62] avg loss 0.0133692, throughput 8.51705K wps
[Epoch 0 Batch 60/62] avg loss 0.0130627, throughput 9.05936K wps
Begin Testing...
[Epoch 0] train avg loss 0.0134342, dev acc 0.6431, dev avg loss 0.652494, throughput 8.77074K wps
Observed Improvement.
Begin Testing...
[Epoch 1 Batch 30/62] avg loss 0.0132139, throughput 9.28835K wps
[Epoch 1 Batch 60/62] avg loss 0.0133472, throughput 8.93311K wps
Begin Testing...
[Epoch 1] train avg loss 0.0134653, dev acc 0.6431, dev avg loss 0.647679, throughput 9.16177K wps
Observed Improvement.
Begin Testing...
[Epoch 2 Batch 30/62] avg loss 0.0131403, throughput 9.26041K wps
[Epoch 2 Batch 60/62] avg loss 0.0130965, throughput 9.13864K wps
Begin Testing...
[Epoch 2] train avg loss 0.0132853, dev acc 0.6431, dev avg loss 0.642607, throughput 9.22703K wps
Observed Improvement.
Begin Testing...
[Epoch 3 Batch 30/62] avg loss 0.0130232, throughput 8.8754K wps
[Epoch 3 Batch 60/62] avg loss 0.0129201, throughput 9.07811K wps
Begin Testing...
[Epoch 3] train avg loss 0.0131398, dev acc 0.6431, dev avg loss 0.63725, throughput 9.00902K wps
Observed Improvement.
Begin Testing...
[Epoch 4 Batch 30/62] avg loss 0.0128201, throughput 9.16523K wps
[Epoch 4 Batch 60/62] avg loss 0.0128172, throughput 9.05749K wps
Begin Testing...
[Epoch 4] train avg loss 0.0130109, dev acc 0.6431, dev avg loss 0.636117, throughput 9.1379K wps
Observed Improvement.
Begin Testing...
[Epoch 5 Batch 30/62] avg loss 0.0128838, throughput 9.18084K wps
[Epoch 5 Batch 60/62] avg loss 0.0125892, throughput 8.94439K wps
Begin Testing...
[Epoch 5] train avg loss 0.0129129, dev acc 0.6431, dev avg loss 0.6284, throughput 9.08512K wps
Observed Improvement.
Begin Testing...
[Epoch 6 Batch 30/62] avg loss 0.0125492, throughput 9.22509K wps
[Epoch 6 Batch 60/62] avg loss 0.0127428, throughput 9.17113K wps
Begin Testing...
[Epoch 6] train avg loss 0.0128339, dev acc 0.6431, dev avg loss 0.624621, throughput 9.22658K wps
Observed Improvement.
Begin Testing...
[Epoch 7 Batch 30/62] avg loss 0.012582, throughput 9.05086K wps
[Epoch 7 Batch 60/62] avg loss 0.0125889, throughput 8.99914K wps
Begin Testing...
[Epoch 7] train avg loss 0.0127326, dev acc 0.6431, dev avg loss 0.619709, throughput 9.00263K wps
Observed Improvement.
Begin Testing...
[Epoch 8 Batch 30/62] avg loss 0.0126126, throughput 8.7909K wps
[Epoch 8 Batch 60/62] avg loss 0.0123883, throughput 9.07045K wps
Begin Testing...
[Epoch 8] train avg loss 0.0127262, dev acc 0.6431, dev avg loss 0.616195, throughput 8.96399K wps
Observed Improvement.
Begin Testing...
[Epoch 9 Batch 30/62] avg loss 0.0124909, throughput 9.21556K wps
[Epoch 9 Batch 60/62] avg loss 0.0122876, throughput 8.8531K wps
Begin Testing...
[Epoch 9] train avg loss 0.0125628, dev acc 0.6431, dev avg loss 0.611126, throughput 9.06453K wps
Observed Improvement.
Begin Testing...
[Epoch 10 Batch 30/62] avg loss 0.0123274, throughput 9.33459K wps
[Epoch 10 Batch 60/62] avg loss 0.0121599, throughput 9.0158K wps
Begin Testing...
[Epoch 10] train avg loss 0.0123786, dev acc 0.6431, dev avg loss 0.607106, throughput 9.19996K wps
Observed Improvement.
Begin Testing...
[Epoch 11 Batch 30/62] avg loss 0.0121623, throughput 9.06302K wps
[Epoch 11 Batch 60/62] avg loss 0.0120859, throughput 8.97315K wps
Begin Testing...
[Epoch 11] train avg loss 0.0122832, dev acc 0.6431, dev avg loss 0.60255, throughput 8.98967K wps
Observed Improvement.
Begin Testing...
[Epoch 12 Batch 30/62] avg loss 0.0122929, throughput 9.10416K wps
[Epoch 12 Batch 60/62] avg loss 0.0119561, throughput 9.11462K wps
Begin Testing...
[Epoch 12] train avg loss 0.012265, dev acc 0.6431, dev avg loss 0.598086, throughput 9.13748K wps
Observed Improvement.
Begin Testing...
[Epoch 13 Batch 30/62] avg loss 0.0121133, throughput 9.17255K wps
[Epoch 13 Batch 60/62] avg loss 0.0120651, throughput 9.09784K wps
Begin Testing...
[Epoch 13] train avg loss 0.0122434, dev acc 0.6460, dev avg loss 0.593798, throughput 9.16659K wps
Observed Improvement.
Begin Testing...
[Epoch 14 Batch 30/62] avg loss 0.0120604, throughput 9.25741K wps
[Epoch 14 Batch 60/62] avg loss 0.0118184, throughput 9.17667K wps
Begin Testing...
[Epoch 14] train avg loss 0.0121031, dev acc 0.6460, dev avg loss 0.588959, throughput 9.18739K wps
Observed Improvement.
Begin Testing...
[Epoch 15 Batch 30/62] avg loss 0.0117739, throughput 9.2038K wps
[Epoch 15 Batch 60/62] avg loss 0.0117936, throughput 8.98785K wps
Begin Testing...
[Epoch 15] train avg loss 0.0119021, dev acc 0.6460, dev avg loss 0.584484, throughput 9.128K wps
Observed Improvement.
Begin Testing...
[Epoch 16 Batch 30/62] avg loss 0.0117601, throughput 9.23974K wps
[Epoch 16 Batch 60/62] avg loss 0.0116784, throughput 9.11924K wps
Begin Testing...
[Epoch 16] train avg loss 0.0118473, dev acc 0.6460, dev avg loss 0.57992, throughput 9.20504K wps
Observed Improvement.
Begin Testing...
[Epoch 17 Batch 30/62] avg loss 0.0116011, throughput 9.09171K wps
[Epoch 17 Batch 60/62] avg loss 0.0116028, throughput 8.94031K wps
Begin Testing...
[Epoch 17] train avg loss 0.0117746, dev acc 0.6549, dev avg loss 0.575121, throughput 9.04897K wps
Observed Improvement.
Begin Testing...
[Epoch 18 Batch 30/62] avg loss 0.0114519, throughput 8.87506K wps
[Epoch 18 Batch 60/62] avg loss 0.0115696, throughput 9.21783K wps
Begin Testing...
[Epoch 18] train avg loss 0.0116649, dev acc 0.6932, dev avg loss 0.570591, throughput 9.06445K wps
Observed Improvement.
Begin Testing...
[Epoch 19 Batch 30/62] avg loss 0.0114257, throughput 9.121K wps
[Epoch 19 Batch 60/62] avg loss 0.0115638, throughput 9.20908K wps
Begin Testing...
[Epoch 19] train avg loss 0.0116238, dev acc 0.6549, dev avg loss 0.566762, throughput 9.19378K wps
[Epoch 20 Batch 30/62] avg loss 0.0113789, throughput 9.20283K wps
[Epoch 20 Batch 60/62] avg loss 0.0113121, throughput 9.02295K wps
Begin Testing...
[Epoch 20] train avg loss 0.0114201, dev acc 0.6696, dev avg loss 0.561106, throughput 9.11982K wps
[Epoch 21 Batch 30/62] avg loss 0.0111483, throughput 8.89786K wps
[Epoch 21 Batch 60/62] avg loss 0.0109461, throughput 9.0344K wps
Begin Testing...
[Epoch 21] train avg loss 0.0111972, dev acc 0.7139, dev avg loss 0.555431, throughput 8.99744K wps
Observed Improvement.
Begin Testing...
[Epoch 22 Batch 30/62] avg loss 0.0111828, throughput 9.05035K wps
[Epoch 22 Batch 60/62] avg loss 0.0110137, throughput 9.05829K wps
Begin Testing...
[Epoch 22] train avg loss 0.0112257, dev acc 0.6903, dev avg loss 0.550775, throughput 9.08781K wps
[Epoch 23 Batch 30/62] avg loss 0.0109222, throughput 9.09039K wps
[Epoch 23 Batch 60/62] avg loss 0.0107943, throughput 9.20183K wps
Begin Testing...
[Epoch 23] train avg loss 0.0110283, dev acc 0.7168, dev avg loss 0.545152, throughput 9.17821K wps
Observed Improvement.
Begin Testing...
[Epoch 24 Batch 30/62] avg loss 0.0107948, throughput 9.05438K wps
[Epoch 24 Batch 60/62] avg loss 0.0107139, throughput 8.9264K wps
Begin Testing...
[Epoch 24] train avg loss 0.010832, dev acc 0.7021, dev avg loss 0.541322, throughput 9.02771K wps
[Epoch 25 Batch 30/62] avg loss 0.0106465, throughput 9.25532K wps
[Epoch 25 Batch 60/62] avg loss 0.0108332, throughput 8.88266K wps
Begin Testing...
[Epoch 25] train avg loss 0.0108647, dev acc 0.7227, dev avg loss 0.535088, throughput 9.0423K wps
Observed Improvement.
Begin Testing...
[Epoch 26 Batch 30/62] avg loss 0.0104914, throughput 9.30758K wps
[Epoch 26 Batch 60/62] avg loss 0.0106482, throughput 9.23409K wps
Begin Testing...
[Epoch 26] train avg loss 0.0107198, dev acc 0.7552, dev avg loss 0.530431, throughput 9.29921K wps
Observed Improvement.
Begin Testing...
[Epoch 27 Batch 30/62] avg loss 0.0105019, throughput 8.80723K wps
[Epoch 27 Batch 60/62] avg loss 0.0101881, throughput 9.14343K wps
Begin Testing...
[Epoch 27] train avg loss 0.0105203, dev acc 0.7493, dev avg loss 0.524533, throughput 8.95743K wps
[Epoch 28 Batch 30/62] avg loss 0.0100428, throughput 8.96847K wps
[Epoch 28 Batch 60/62] avg loss 0.0104334, throughput 8.9501K wps
Begin Testing...
[Epoch 28] train avg loss 0.010399, dev acc 0.7198, dev avg loss 0.520052, throughput 9.04091K wps
[Epoch 29 Batch 30/62] avg loss 0.0102006, throughput 9.09795K wps
[Epoch 29 Batch 60/62] avg loss 0.0100044, throughput 9.20456K wps
Begin Testing...
[Epoch 29] train avg loss 0.010256, dev acc 0.7375, dev avg loss 0.51477, throughput 9.18123K wps
[Epoch 30 Batch 30/62] avg loss 0.010315, throughput 9.09581K wps
[Epoch 30 Batch 60/62] avg loss 0.00969731, throughput 9.2302K wps
Begin Testing...
[Epoch 30] train avg loss 0.0101164, dev acc 0.7463, dev avg loss 0.509695, throughput 9.19287K wps
[Epoch 31 Batch 30/62] avg loss 0.00992992, throughput 9.11156K wps
[Epoch 31 Batch 60/62] avg loss 0.00994839, throughput 8.94151K wps
Begin Testing...
[Epoch 31] train avg loss 0.0100237, dev acc 0.7493, dev avg loss 0.504942, throughput 9.05641K wps
[Epoch 32 Batch 30/62] avg loss 0.0100501, throughput 8.89146K wps
[Epoch 32 Batch 60/62] avg loss 0.00975167, throughput 8.90465K wps
Begin Testing...
[Epoch 32] train avg loss 0.00998267, dev acc 0.7404, dev avg loss 0.502082, throughput 8.93816K wps
[Epoch 33 Batch 30/62] avg loss 0.00983194, throughput 9.18154K wps
[Epoch 33 Batch 60/62] avg loss 0.00947454, throughput 9.20398K wps
Begin Testing...
[Epoch 33] train avg loss 0.0097594, dev acc 0.7493, dev avg loss 0.497233, throughput 9.19234K wps
[Epoch 34 Batch 30/62] avg loss 0.00948725, throughput 9.13971K wps
[Epoch 34 Batch 60/62] avg loss 0.00965045, throughput 9.02021K wps
Begin Testing...
[Epoch 34] train avg loss 0.00968821, dev acc 0.7463, dev avg loss 0.492637, throughput 9.1115K wps
[Epoch 35 Batch 30/62] avg loss 0.00968122, throughput 9.1355K wps
[Epoch 35 Batch 60/62] avg loss 0.00922367, throughput 9.1141K wps
Begin Testing...
[Epoch 35] train avg loss 0.00959303, dev acc 0.7876, dev avg loss 0.488193, throughput 9.15111K wps
Observed Improvement.
Begin Testing...
[Epoch 36 Batch 30/62] avg loss 0.0092777, throughput 8.99557K wps
[Epoch 36 Batch 60/62] avg loss 0.0092657, throughput 8.84006K wps
Begin Testing...
[Epoch 36] train avg loss 0.00939913, dev acc 0.7847, dev avg loss 0.48425, throughput 8.95501K wps
[Epoch 37 Batch 30/62] avg loss 0.00931648, throughput 9.08556K wps
[Epoch 37 Batch 60/62] avg loss 0.00910853, throughput 8.90131K wps
Begin Testing...
[Epoch 37] train avg loss 0.00940031, dev acc 0.7847, dev avg loss 0.480594, throughput 9.02354K wps
[Epoch 38 Batch 30/62] avg loss 0.00903153, throughput 9.0634K wps
[Epoch 38 Batch 60/62] avg loss 0.00891883, throughput 9.16774K wps
Begin Testing...
[Epoch 38] train avg loss 0.00912074, dev acc 0.7640, dev avg loss 0.478207, throughput 9.09269K wps
[Epoch 39 Batch 30/62] avg loss 0.00888643, throughput 9.08425K wps
[Epoch 39 Batch 60/62] avg loss 0.0089927, throughput 8.73184K wps
Begin Testing...
[Epoch 39] train avg loss 0.00902677, dev acc 0.7906, dev avg loss 0.47285, throughput 8.91046K wps
Observed Improvement.
Begin Testing...
[Epoch 40 Batch 30/62] avg loss 0.00881055, throughput 8.8917K wps
[Epoch 40 Batch 60/62] avg loss 0.00906997, throughput 9.08252K wps
Begin Testing...
[Epoch 40] train avg loss 0.00908206, dev acc 0.7935, dev avg loss 0.47013, throughput 9.02339K wps
Observed Improvement.
Begin Testing...
[Epoch 41 Batch 30/62] avg loss 0.0086877, throughput 9.06195K wps
[Epoch 41 Batch 60/62] avg loss 0.00902724, throughput 8.94625K wps
Begin Testing...
[Epoch 41] train avg loss 0.0089886, dev acc 0.8171, dev avg loss 0.472686, throughput 9.03913K wps
Observed Improvement.
Begin Testing...
[Epoch 42 Batch 30/62] avg loss 0.00867788, throughput 9.11388K wps
[Epoch 42 Batch 60/62] avg loss 0.00867469, throughput 8.84032K wps
Begin Testing...
[Epoch 42] train avg loss 0.00882664, dev acc 0.8024, dev avg loss 0.463949, throughput 8.95717K wps
[Epoch 43 Batch 30/62] avg loss 0.00872646, throughput 8.73143K wps
[Epoch 43 Batch 60/62] avg loss 0.00868879, throughput 8.89974K wps
Begin Testing...
[Epoch 43] train avg loss 0.00876669, dev acc 0.7994, dev avg loss 0.461134, throughput 8.85283K wps
[Epoch 44 Batch 30/62] avg loss 0.00848401, throughput 9.06694K wps
[Epoch 44 Batch 60/62] avg loss 0.00856237, throughput 9.09549K wps
Begin Testing...
[Epoch 44] train avg loss 0.00859036, dev acc 0.8083, dev avg loss 0.45813, throughput 9.11099K wps
[Epoch 45 Batch 30/62] avg loss 0.00864448, throughput 9.15948K wps
[Epoch 45 Batch 60/62] avg loss 0.00827113, throughput 8.82893K wps
Begin Testing...
[Epoch 45] train avg loss 0.00856434, dev acc 0.8142, dev avg loss 0.455258, throughput 8.96066K wps
[Epoch 46 Batch 30/62] avg loss 0.00818785, throughput 9.31685K wps
[Epoch 46 Batch 60/62] avg loss 0.00850369, throughput 9.03639K wps
Begin Testing...
[Epoch 46] train avg loss 0.00848326, dev acc 0.8083, dev avg loss 0.45319, throughput 9.13546K wps
[Epoch 47 Batch 30/62] avg loss 0.0084951, throughput 8.88675K wps
[Epoch 47 Batch 60/62] avg loss 0.00784164, throughput 9.31252K wps
Begin Testing...
[Epoch 47] train avg loss 0.0082948, dev acc 0.8083, dev avg loss 0.450461, throughput 9.12858K wps
[Epoch 48 Batch 30/62] avg loss 0.00808046, throughput 9.0692K wps
[Epoch 48 Batch 60/62] avg loss 0.00812958, throughput 8.79702K wps
Begin Testing...
[Epoch 48] train avg loss 0.00823495, dev acc 0.8083, dev avg loss 0.447978, throughput 8.90343K wps
[Epoch 49 Batch 30/62] avg loss 0.00813377, throughput 8.84177K wps
[Epoch 49 Batch 60/62] avg loss 0.00813199, throughput 9.23854K wps
Begin Testing...
[Epoch 49] train avg loss 0.0082293, dev acc 0.8142, dev avg loss 0.44615, throughput 9.06982K wps
[Epoch 50 Batch 30/62] avg loss 0.00814612, throughput 9.13767K wps
[Epoch 50 Batch 60/62] avg loss 0.00802216, throughput 8.8825K wps
Begin Testing...
[Epoch 50] train avg loss 0.00821026, dev acc 0.8142, dev avg loss 0.444108, throughput 9.04363K wps
[Epoch 51 Batch 30/62] avg loss 0.00790252, throughput 9.22973K wps
[Epoch 51 Batch 60/62] avg loss 0.00782465, throughput 8.83533K wps
Begin Testing...
[Epoch 51] train avg loss 0.00794941, dev acc 0.8024, dev avg loss 0.44321, throughput 9.017K wps
[Epoch 52 Batch 30/62] avg loss 0.00771205, throughput 9.05559K wps
[Epoch 52 Batch 60/62] avg loss 0.00766842, throughput 9.02014K wps
Begin Testing...
[Epoch 52] train avg loss 0.00786209, dev acc 0.8201, dev avg loss 0.44065, throughput 8.99951K wps
Observed Improvement.
Begin Testing...
[Epoch 53 Batch 30/62] avg loss 0.00780775, throughput 8.88451K wps
[Epoch 53 Batch 60/62] avg loss 0.00770714, throughput 9.19809K wps
Begin Testing...
[Epoch 53] train avg loss 0.0078333, dev acc 0.8024, dev avg loss 0.439255, throughput 9.06494K wps
[Epoch 54 Batch 30/62] avg loss 0.00751522, throughput 8.86789K wps
[Epoch 54 Batch 60/62] avg loss 0.00757858, throughput 9.15479K wps
Begin Testing...
[Epoch 54] train avg loss 0.00770304, dev acc 0.8112, dev avg loss 0.436673, throughput 9.04514K wps
[Epoch 55 Batch 30/62] avg loss 0.00767612, throughput 9.19641K wps
[Epoch 55 Batch 60/62] avg loss 0.00761133, throughput 8.96449K wps
Begin Testing...
[Epoch 55] train avg loss 0.00779253, dev acc 0.8171, dev avg loss 0.435651, throughput 9.1104K wps
[Epoch 56 Batch 30/62] avg loss 0.00736914, throughput 9.30562K wps
[Epoch 56 Batch 60/62] avg loss 0.00777252, throughput 8.83626K wps
Begin Testing...
[Epoch 56] train avg loss 0.00760447, dev acc 0.8230, dev avg loss 0.432427, throughput 9.09226K wps
Observed Improvement.
Begin Testing...
[Epoch 57 Batch 30/62] avg loss 0.00742516, throughput 9.00575K wps
[Epoch 57 Batch 60/62] avg loss 0.00750747, throughput 9.19999K wps
Begin Testing...
[Epoch 57] train avg loss 0.00757683, dev acc 0.8112, dev avg loss 0.432228, throughput 9.13671K wps
[Epoch 58 Batch 30/62] avg loss 0.0076245, throughput 9.18839K wps
[Epoch 58 Batch 60/62] avg loss 0.00722524, throughput 8.96609K wps
Begin Testing...
[Epoch 58] train avg loss 0.00751919, dev acc 0.8142, dev avg loss 0.429394, throughput 9.13112K wps
[Epoch 59 Batch 30/62] avg loss 0.00747883, throughput 9.33688K wps
[Epoch 59 Batch 60/62] avg loss 0.0071472, throughput 9.15073K wps
Begin Testing...
[Epoch 59] train avg loss 0.00741952, dev acc 0.8112, dev avg loss 0.428162, throughput 9.2211K wps
[Epoch 60 Batch 30/62] avg loss 0.00712345, throughput 9.17753K wps
[Epoch 60 Batch 60/62] avg loss 0.00718393, throughput 8.80179K wps
Begin Testing...
[Epoch 60] train avg loss 0.00724305, dev acc 0.8053, dev avg loss 0.428409, throughput 8.97134K wps
[Epoch 61 Batch 30/62] avg loss 0.00698084, throughput 9.06337K wps
[Epoch 61 Batch 60/62] avg loss 0.00752905, throughput 8.92163K wps
Begin Testing...
[Epoch 61] train avg loss 0.00732744, dev acc 0.8289, dev avg loss 0.424465, throughput 9.02712K wps
Observed Improvement.
Begin Testing...
[Epoch 62 Batch 30/62] avg loss 0.00697659, throughput 9.07751K wps
[Epoch 62 Batch 60/62] avg loss 0.00695409, throughput 9.15658K wps
Begin Testing...
[Epoch 62] train avg loss 0.00703244, dev acc 0.8289, dev avg loss 0.422927, throughput 9.09511K wps
Observed Improvement.
Begin Testing...
[Epoch 63 Batch 30/62] avg loss 0.0070244, throughput 9.14024K wps
[Epoch 63 Batch 60/62] avg loss 0.00698855, throughput 9.12898K wps
Begin Testing...
[Epoch 63] train avg loss 0.00710795, dev acc 0.8319, dev avg loss 0.421305, throughput 9.16448K wps
Observed Improvement.
Begin Testing...
[Epoch 64 Batch 30/62] avg loss 0.00683016, throughput 9.2235K wps
[Epoch 64 Batch 60/62] avg loss 0.00694797, throughput 9.01413K wps
Begin Testing...
[Epoch 64] train avg loss 0.00698981, dev acc 0.8083, dev avg loss 0.424608, throughput 9.17214K wps
[Epoch 65 Batch 30/62] avg loss 0.00703981, throughput 8.79359K wps
[Epoch 65 Batch 60/62] avg loss 0.00657672, throughput 9.31708K wps
Begin Testing...
[Epoch 65] train avg loss 0.00691242, dev acc 0.8112, dev avg loss 0.421123, throughput 9.02326K wps
[Epoch 66 Batch 30/62] avg loss 0.00677926, throughput 8.96646K wps
[Epoch 66 Batch 60/62] avg loss 0.00659813, throughput 9.15164K wps
Begin Testing...
[Epoch 66] train avg loss 0.00677936, dev acc 0.8378, dev avg loss 0.418315, throughput 9.09023K wps
Observed Improvement.
Begin Testing...
[Epoch 67 Batch 30/62] avg loss 0.00653981, throughput 9.27883K wps
[Epoch 67 Batch 60/62] avg loss 0.00687709, throughput 8.95854K wps
Begin Testing...
[Epoch 67] train avg loss 0.0067541, dev acc 0.8201, dev avg loss 0.417767, throughput 9.14681K wps
[Epoch 68 Batch 30/62] avg loss 0.00661595, throughput 8.93675K wps
[Epoch 68 Batch 60/62] avg loss 0.0065282, throughput 8.73923K wps
Begin Testing...
[Epoch 68] train avg loss 0.00677413, dev acc 0.8230, dev avg loss 0.41542, throughput 8.83005K wps
[Epoch 69 Batch 30/62] avg loss 0.00643802, throughput 9.14138K wps
[Epoch 69 Batch 60/62] avg loss 0.00660039, throughput 8.89526K wps
Begin Testing...
[Epoch 69] train avg loss 0.00658117, dev acc 0.8171, dev avg loss 0.416014, throughput 9.04757K wps
[Epoch 70 Batch 30/62] avg loss 0.00624652, throughput 9.14238K wps
[Epoch 70 Batch 60/62] avg loss 0.00650754, throughput 9.01381K wps
Begin Testing...
[Epoch 70] train avg loss 0.00649342, dev acc 0.8407, dev avg loss 0.413098, throughput 9.05972K wps
Observed Improvement.
Begin Testing...
[Epoch 71 Batch 30/62] avg loss 0.00638282, throughput 9.29321K wps
[Epoch 71 Batch 60/62] avg loss 0.00629728, throughput 9.06218K wps
Begin Testing...
[Epoch 71] train avg loss 0.00646409, dev acc 0.8378, dev avg loss 0.411437, throughput 9.20633K wps
[Epoch 72 Batch 30/62] avg loss 0.00651696, throughput 8.88519K wps
[Epoch 72 Batch 60/62] avg loss 0.00632186, throughput 9.22709K wps
Begin Testing...
[Epoch 72] train avg loss 0.0065025, dev acc 0.8466, dev avg loss 0.413192, throughput 9.08764K wps
Observed Improvement.
Begin Testing...
[Epoch 73 Batch 30/62] avg loss 0.00613451, throughput 9.14699K wps
[Epoch 73 Batch 60/62] avg loss 0.0063488, throughput 9.07665K wps
Begin Testing...
[Epoch 73] train avg loss 0.00628969, dev acc 0.8260, dev avg loss 0.409522, throughput 9.08229K wps
[Epoch 74 Batch 30/62] avg loss 0.00610864, throughput 8.83572K wps
[Epoch 74 Batch 60/62] avg loss 0.00625429, throughput 8.909K wps
Begin Testing...
[Epoch 74] train avg loss 0.00623154, dev acc 0.8466, dev avg loss 0.408762, throughput 8.86345K wps
Observed Improvement.
Begin Testing...
[Epoch 75 Batch 30/62] avg loss 0.00593419, throughput 9.11803K wps
[Epoch 75 Batch 60/62] avg loss 0.00645216, throughput 8.90396K wps
Begin Testing...
[Epoch 75] train avg loss 0.00619658, dev acc 0.8289, dev avg loss 0.40744, throughput 9.04391K wps
[Epoch 76 Batch 30/62] avg loss 0.00633796, throughput 9.22984K wps
[Epoch 76 Batch 60/62] avg loss 0.00586028, throughput 8.85243K wps
Begin Testing...
[Epoch 76] train avg loss 0.00621219, dev acc 0.8378, dev avg loss 0.405266, throughput 9.05356K wps
[Epoch 77 Batch 30/62] avg loss 0.00590113, throughput 9.16109K wps
[Epoch 77 Batch 60/62] avg loss 0.00605271, throughput 8.9156K wps
Begin Testing...
[Epoch 77] train avg loss 0.00604665, dev acc 0.8407, dev avg loss 0.404257, throughput 9.06848K wps
[Epoch 78 Batch 30/62] avg loss 0.00619556, throughput 8.9031K wps
[Epoch 78 Batch 60/62] avg loss 0.00592277, throughput 9.1826K wps
Begin Testing...
[Epoch 78] train avg loss 0.00608851, dev acc 0.8319, dev avg loss 0.403854, throughput 9.07137K wps
[Epoch 79 Batch 30/62] avg loss 0.00591667, throughput 9.11845K wps
[Epoch 79 Batch 60/62] avg loss 0.00589194, throughput 8.92353K wps
Begin Testing...
[Epoch 79] train avg loss 0.00611661, dev acc 0.8496, dev avg loss 0.404544, throughput 8.99658K wps
Observed Improvement.
Begin Testing...
[Epoch 80 Batch 30/62] avg loss 0.00596979, throughput 9.18103K wps
[Epoch 80 Batch 60/62] avg loss 0.00581664, throughput 8.75623K wps
Begin Testing...
[Epoch 80] train avg loss 0.00595671, dev acc 0.8437, dev avg loss 0.401404, throughput 8.953K wps
[Epoch 81 Batch 30/62] avg loss 0.00587434, throughput 9.06725K wps
[Epoch 81 Batch 60/62] avg loss 0.00565877, throughput 8.89209K wps
Begin Testing...
[Epoch 81] train avg loss 0.00584958, dev acc 0.8437, dev avg loss 0.400319, throughput 9.04391K wps
[Epoch 82 Batch 30/62] avg loss 0.00579188, throughput 9.06121K wps
[Epoch 82 Batch 60/62] avg loss 0.00551609, throughput 9.01699K wps
Begin Testing...
[Epoch 82] train avg loss 0.0057375, dev acc 0.8466, dev avg loss 0.399565, throughput 9.0555K wps
[Epoch 83 Batch 30/62] avg loss 0.00531903, throughput 8.97179K wps
[Epoch 83 Batch 60/62] avg loss 0.00572043, throughput 8.85396K wps
Begin Testing...
[Epoch 83] train avg loss 0.00558434, dev acc 0.8378, dev avg loss 0.398549, throughput 8.90431K wps
[Epoch 84 Batch 30/62] avg loss 0.00571107, throughput 8.71012K wps
[Epoch 84 Batch 60/62] avg loss 0.00560146, throughput 9.20311K wps
Begin Testing...
[Epoch 84] train avg loss 0.00571319, dev acc 0.8407, dev avg loss 0.398904, throughput 8.98456K wps
[Epoch 85 Batch 30/62] avg loss 0.00538199, throughput 9.25811K wps
[Epoch 85 Batch 60/62] avg loss 0.00548524, throughput 9.12514K wps
Begin Testing...
[Epoch 85] train avg loss 0.00553767, dev acc 0.8407, dev avg loss 0.398663, throughput 9.14552K wps
[Epoch 86 Batch 30/62] avg loss 0.00553014, throughput 8.94719K wps
[Epoch 86 Batch 60/62] avg loss 0.00546651, throughput 9.15743K wps
Begin Testing...
[Epoch 86] train avg loss 0.00553412, dev acc 0.8289, dev avg loss 0.401146, throughput 9.08498K wps
[Epoch 87 Batch 30/62] avg loss 0.00538909, throughput 9.32048K wps
[Epoch 87 Batch 60/62] avg loss 0.00525891, throughput 9.08825K wps
Begin Testing...
[Epoch 87] train avg loss 0.00536496, dev acc 0.8437, dev avg loss 0.395448, throughput 9.21611K wps
[Epoch 88 Batch 30/62] avg loss 0.00544288, throughput 8.99829K wps
[Epoch 88 Batch 60/62] avg loss 0.00529481, throughput 8.95583K wps
Begin Testing...
[Epoch 88] train avg loss 0.00549657, dev acc 0.8437, dev avg loss 0.39507, throughput 8.94651K wps
[Epoch 89 Batch 30/62] avg loss 0.00511932, throughput 8.95435K wps
[Epoch 89 Batch 60/62] avg loss 0.00549844, throughput 9.17621K wps
Begin Testing...
[Epoch 89] train avg loss 0.00537538, dev acc 0.8437, dev avg loss 0.394471, throughput 9.09586K wps
[Epoch 90 Batch 30/62] avg loss 0.00535396, throughput 9.20285K wps
[Epoch 90 Batch 60/62] avg loss 0.00516037, throughput 8.83989K wps
Begin Testing...
[Epoch 90] train avg loss 0.00532283, dev acc 0.8289, dev avg loss 0.404276, throughput 9.00402K wps
[Epoch 91 Batch 30/62] avg loss 0.00488004, throughput 9.02422K wps
[Epoch 91 Batch 60/62] avg loss 0.00543603, throughput 8.6599K wps
Begin Testing...
[Epoch 91] train avg loss 0.00523171, dev acc 0.8437, dev avg loss 0.393024, throughput 8.81805K wps
[Epoch 92 Batch 30/62] avg loss 0.00511606, throughput 9.1163K wps
[Epoch 92 Batch 60/62] avg loss 0.00512413, throughput 8.71994K wps
Begin Testing...
[Epoch 92] train avg loss 0.00517233, dev acc 0.8378, dev avg loss 0.394633, throughput 8.89331K wps
[Epoch 93 Batch 30/62] avg loss 0.00507311, throughput 9.19111K wps
[Epoch 93 Batch 60/62] avg loss 0.0052533, throughput 8.89215K wps
Begin Testing...
[Epoch 93] train avg loss 0.00522492, dev acc 0.8378, dev avg loss 0.394847, throughput 9.07234K wps
[Epoch 94 Batch 30/62] avg loss 0.00502767, throughput 8.98559K wps
[Epoch 94 Batch 60/62] avg loss 0.00501737, throughput 8.828K wps
Begin Testing...
[Epoch 94] train avg loss 0.00510952, dev acc 0.8466, dev avg loss 0.391423, throughput 8.93825K wps
[Epoch 95 Batch 30/62] avg loss 0.00490498, throughput 8.89676K wps
[Epoch 95 Batch 60/62] avg loss 0.00511375, throughput 9.21669K wps
Begin Testing...
[Epoch 95] train avg loss 0.00509229, dev acc 0.8407, dev avg loss 0.392222, throughput 9.08032K wps
[Epoch 96 Batch 30/62] avg loss 0.00512774, throughput 9.09869K wps
[Epoch 96 Batch 60/62] avg loss 0.00467836, throughput 9.1416K wps
Begin Testing...
[Epoch 96] train avg loss 0.00504949, dev acc 0.8437, dev avg loss 0.38916, throughput 9.15205K wps
[Epoch 97 Batch 30/62] avg loss 0.00493946, throughput 9.109K wps
[Epoch 97 Batch 60/62] avg loss 0.00470762, throughput 8.88487K wps
Begin Testing...
[Epoch 97] train avg loss 0.00490655, dev acc 0.8437, dev avg loss 0.388478, throughput 8.96528K wps
[Epoch 98 Batch 30/62] avg loss 0.00480465, throughput 9.16718K wps
[Epoch 98 Batch 60/62] avg loss 0.00472519, throughput 9.0952K wps
Begin Testing...
[Epoch 98] train avg loss 0.00476005, dev acc 0.8437, dev avg loss 0.388241, throughput 9.16268K wps
[Epoch 99 Batch 30/62] avg loss 0.00454144, throughput 9.2842K wps
[Epoch 99 Batch 60/62] avg loss 0.00472585, throughput 8.95028K wps
Begin Testing...
[Epoch 99] train avg loss 0.00467454, dev acc 0.8466, dev avg loss 0.387269, throughput 9.08619K wps
[Epoch 100 Batch 30/62] avg loss 0.00470277, throughput 9.08677K wps
[Epoch 100 Batch 60/62] avg loss 0.00463104, throughput 8.85388K wps
Begin Testing...
[Epoch 100] train avg loss 0.00470624, dev acc 0.8437, dev avg loss 0.386338, throughput 8.96248K wps
[Epoch 101 Batch 30/62] avg loss 0.00460347, throughput 8.88699K wps
[Epoch 101 Batch 60/62] avg loss 0.00487909, throughput 8.83184K wps
Begin Testing...
[Epoch 101] train avg loss 0.0048184, dev acc 0.8437, dev avg loss 0.386176, throughput 8.84806K wps
[Epoch 102 Batch 30/62] avg loss 0.00461779, throughput 8.73909K wps
[Epoch 102 Batch 60/62] avg loss 0.00467431, throughput 9.24943K wps
Begin Testing...
[Epoch 102] train avg loss 0.00465742, dev acc 0.8466, dev avg loss 0.385597, throughput 9.02122K wps
[Epoch 103 Batch 30/62] avg loss 0.004462, throughput 9.17835K wps
[Epoch 103 Batch 60/62] avg loss 0.00463056, throughput 8.74932K wps
Begin Testing...
[Epoch 103] train avg loss 0.0045647, dev acc 0.8525, dev avg loss 0.385134, throughput 8.93896K wps
Observed Improvement.
Begin Testing...
[Epoch 104 Batch 30/62] avg loss 0.00444096, throughput 9.30828K wps
[Epoch 104 Batch 60/62] avg loss 0.00472909, throughput 9.07028K wps
Begin Testing...
[Epoch 104] train avg loss 0.00456908, dev acc 0.8496, dev avg loss 0.384453, throughput 9.15029K wps
[Epoch 105 Batch 30/62] avg loss 0.00444462, throughput 9.09162K wps
[Epoch 105 Batch 60/62] avg loss 0.00445457, throughput 8.73113K wps
Begin Testing...
[Epoch 105] train avg loss 0.00447783, dev acc 0.8466, dev avg loss 0.38449, throughput 8.89746K wps
[Epoch 106 Batch 30/62] avg loss 0.00435622, throughput 9.28121K wps
[Epoch 106 Batch 60/62] avg loss 0.00460423, throughput 8.79581K wps
Begin Testing...
[Epoch 106] train avg loss 0.00446834, dev acc 0.8466, dev avg loss 0.384346, throughput 9.00491K wps
[Epoch 107 Batch 30/62] avg loss 0.00441809, throughput 9.20456K wps
[Epoch 107 Batch 60/62] avg loss 0.00437291, throughput 8.72338K wps
Begin Testing...
[Epoch 107] train avg loss 0.00440643, dev acc 0.8496, dev avg loss 0.383629, throughput 8.9915K wps
[Epoch 108 Batch 30/62] avg loss 0.00421323, throughput 9.30871K wps
[Epoch 108 Batch 60/62] avg loss 0.00442681, throughput 8.96316K wps
Begin Testing...
[Epoch 108] train avg loss 0.00437141, dev acc 0.8496, dev avg loss 0.383217, throughput 9.11047K wps
[Epoch 109 Batch 30/62] avg loss 0.00420049, throughput 9.11655K wps
[Epoch 109 Batch 60/62] avg loss 0.00436297, throughput 9.03093K wps
Begin Testing...
[Epoch 109] train avg loss 0.00429551, dev acc 0.8466, dev avg loss 0.383458, throughput 9.02854K wps
[Epoch 110 Batch 30/62] avg loss 0.00420366, throughput 8.95365K wps
[Epoch 110 Batch 60/62] avg loss 0.00435475, throughput 8.90582K wps
Begin Testing...
[Epoch 110] train avg loss 0.00444769, dev acc 0.8496, dev avg loss 0.386619, throughput 8.91338K wps
[Epoch 111 Batch 30/62] avg loss 0.00417568, throughput 9.21331K wps
[Epoch 111 Batch 60/62] avg loss 0.00421159, throughput 8.91362K wps
Begin Testing...
[Epoch 111] train avg loss 0.00422488, dev acc 0.8466, dev avg loss 0.380535, throughput 9.03631K wps
[Epoch 112 Batch 30/62] avg loss 0.00398449, throughput 9.3142K wps
[Epoch 112 Batch 60/62] avg loss 0.00441783, throughput 9.17499K wps
Begin Testing...
[Epoch 112] train avg loss 0.00425315, dev acc 0.8437, dev avg loss 0.380046, throughput 9.27444K wps
[Epoch 113 Batch 30/62] avg loss 0.00421633, throughput 9.29389K wps
[Epoch 113 Batch 60/62] avg loss 0.00411829, throughput 9.18624K wps
Begin Testing...
[Epoch 113] train avg loss 0.00420286, dev acc 0.8378, dev avg loss 0.38397, throughput 9.22046K wps
[Epoch 114 Batch 30/62] avg loss 0.00399788, throughput 8.92994K wps
[Epoch 114 Batch 60/62] avg loss 0.00418482, throughput 9.10087K wps
Begin Testing...
[Epoch 114] train avg loss 0.00416367, dev acc 0.8466, dev avg loss 0.379263, throughput 9.01185K wps
[Epoch 115 Batch 30/62] avg loss 0.00404446, throughput 9.12442K wps
[Epoch 115 Batch 60/62] avg loss 0.00394327, throughput 8.98237K wps
Begin Testing...
[Epoch 115] train avg loss 0.00402239, dev acc 0.8437, dev avg loss 0.378765, throughput 9.04984K wps
[Epoch 116 Batch 30/62] avg loss 0.00410847, throughput 9.01814K wps
[Epoch 116 Batch 60/62] avg loss 0.00391283, throughput 9.12803K wps
Begin Testing...
[Epoch 116] train avg loss 0.00404899, dev acc 0.8437, dev avg loss 0.378797, throughput 9.04754K wps
[Epoch 117 Batch 30/62] avg loss 0.00377385, throughput 9.13367K wps
[Epoch 117 Batch 60/62] avg loss 0.00400972, throughput 9.04647K wps
Begin Testing...
[Epoch 117] train avg loss 0.00392557, dev acc 0.8496, dev avg loss 0.378621, throughput 9.1218K wps
[Epoch 118 Batch 30/62] avg loss 0.00377389, throughput 9.10987K wps
[Epoch 118 Batch 60/62] avg loss 0.0038839, throughput 9.06653K wps
Begin Testing...
[Epoch 118] train avg loss 0.00385682, dev acc 0.8437, dev avg loss 0.378121, throughput 9.06282K wps
[Epoch 119 Batch 30/62] avg loss 0.00371838, throughput 8.98584K wps
[Epoch 119 Batch 60/62] avg loss 0.00402301, throughput 8.85336K wps
Begin Testing...
[Epoch 119] train avg loss 0.00396236, dev acc 0.8466, dev avg loss 0.382573, throughput 8.95506K wps
[Epoch 120 Batch 30/62] avg loss 0.00378705, throughput 9.29986K wps
[Epoch 120 Batch 60/62] avg loss 0.00384013, throughput 8.98676K wps
Begin Testing...
[Epoch 120] train avg loss 0.00382608, dev acc 0.8525, dev avg loss 0.376965, throughput 9.17025K wps
Observed Improvement.
Begin Testing...
[Epoch 121 Batch 30/62] avg loss 0.003867, throughput 9.16234K wps
[Epoch 121 Batch 60/62] avg loss 0.00376605, throughput 8.60398K wps
Begin Testing...
[Epoch 121] train avg loss 0.00386756, dev acc 0.8378, dev avg loss 0.379993, throughput 8.86031K wps
[Epoch 122 Batch 30/62] avg loss 0.00373276, throughput 9.02671K wps
[Epoch 122 Batch 60/62] avg loss 0.00353857, throughput 9.0871K wps
Begin Testing...
[Epoch 122] train avg loss 0.00368875, dev acc 0.8466, dev avg loss 0.376839, throughput 9.08962K wps
[Epoch 123 Batch 30/62] avg loss 0.00379935, throughput 9.23187K wps
[Epoch 123 Batch 60/62] avg loss 0.00377254, throughput 8.72048K wps
Begin Testing...
[Epoch 123] train avg loss 0.00383989, dev acc 0.8496, dev avg loss 0.377886, throughput 8.95372K wps
[Epoch 124 Batch 30/62] avg loss 0.00366673, throughput 9.16265K wps
[Epoch 124 Batch 60/62] avg loss 0.00394368, throughput 8.94616K wps
Begin Testing...
[Epoch 124] train avg loss 0.00384459, dev acc 0.8496, dev avg loss 0.377676, throughput 9.07762K wps
[Epoch 125 Batch 30/62] avg loss 0.00375716, throughput 9.31929K wps
[Epoch 125 Batch 60/62] avg loss 0.00346349, throughput 9.05893K wps
Begin Testing...
[Epoch 125] train avg loss 0.00366092, dev acc 0.8466, dev avg loss 0.375837, throughput 9.21411K wps
[Epoch 126 Batch 30/62] avg loss 0.0034689, throughput 9.17394K wps
[Epoch 126 Batch 60/62] avg loss 0.00381396, throughput 9.1559K wps
Begin Testing...
[Epoch 126] train avg loss 0.00369496, dev acc 0.8466, dev avg loss 0.375078, throughput 9.19393K wps
[Epoch 127 Batch 30/62] avg loss 0.00366905, throughput 9.3543K wps
[Epoch 127 Batch 60/62] avg loss 0.00341058, throughput 9.14387K wps
Begin Testing...
[Epoch 127] train avg loss 0.00361482, dev acc 0.8496, dev avg loss 0.374531, throughput 9.27755K wps
[Epoch 128 Batch 30/62] avg loss 0.00349048, throughput 9.15116K wps
[Epoch 128 Batch 60/62] avg loss 0.0034917, throughput 9.03131K wps
Begin Testing...
[Epoch 128] train avg loss 0.00352449, dev acc 0.8437, dev avg loss 0.375949, throughput 9.07043K wps
[Epoch 129 Batch 30/62] avg loss 0.00345096, throughput 9.25031K wps
[Epoch 129 Batch 60/62] avg loss 0.00344946, throughput 9.00555K wps
Begin Testing...
[Epoch 129] train avg loss 0.00345528, dev acc 0.8466, dev avg loss 0.374572, throughput 9.15585K wps
[Epoch 130 Batch 30/62] avg loss 0.00347655, throughput 9.03938K wps
[Epoch 130 Batch 60/62] avg loss 0.00331486, throughput 8.87813K wps
Begin Testing...
[Epoch 130] train avg loss 0.00346298, dev acc 0.8466, dev avg loss 0.37364, throughput 8.96843K wps
[Epoch 131 Batch 30/62] avg loss 0.00350805, throughput 9.14211K wps
[Epoch 131 Batch 60/62] avg loss 0.00342155, throughput 9.02154K wps
Begin Testing...
[Epoch 131] train avg loss 0.00347795, dev acc 0.8555, dev avg loss 0.375174, throughput 9.10498K wps
Observed Improvement.
Begin Testing...
[Epoch 132 Batch 30/62] avg loss 0.00343361, throughput 9.21552K wps
[Epoch 132 Batch 60/62] avg loss 0.00328056, throughput 9.00349K wps
Begin Testing...
[Epoch 132] train avg loss 0.00341522, dev acc 0.8437, dev avg loss 0.374549, throughput 9.12906K wps
[Epoch 133 Batch 30/62] avg loss 0.00338288, throughput 9.23048K wps
[Epoch 133 Batch 60/62] avg loss 0.00334808, throughput 9.20376K wps
Begin Testing...
[Epoch 133] train avg loss 0.00342084, dev acc 0.8496, dev avg loss 0.373286, throughput 9.24357K wps
[Epoch 134 Batch 30/62] avg loss 0.00336736, throughput 9.07267K wps
[Epoch 134 Batch 60/62] avg loss 0.00313115, throughput 9.16702K wps
Begin Testing...
[Epoch 134] train avg loss 0.00330699, dev acc 0.8555, dev avg loss 0.373007, throughput 9.14408K wps
Observed Improvement.
Begin Testing...
[Epoch 135 Batch 30/62] avg loss 0.00311647, throughput 9.22154K wps
[Epoch 135 Batch 60/62] avg loss 0.00326545, throughput 9.09558K wps
Begin Testing...
[Epoch 135] train avg loss 0.00322727, dev acc 0.8496, dev avg loss 0.372189, throughput 9.18928K wps
[Epoch 136 Batch 30/62] avg loss 0.00346469, throughput 9.25078K wps
[Epoch 136 Batch 60/62] avg loss 0.00307713, throughput 9.05136K wps
Begin Testing...
[Epoch 136] train avg loss 0.00329546, dev acc 0.8466, dev avg loss 0.371812, throughput 9.1794K wps
[Epoch 137 Batch 30/62] avg loss 0.00338793, throughput 9.07432K wps
[Epoch 137 Batch 60/62] avg loss 0.00315728, throughput 8.91833K wps
Begin Testing...
[Epoch 137] train avg loss 0.00331675, dev acc 0.8437, dev avg loss 0.372839, throughput 8.97133K wps
[Epoch 138 Batch 30/62] avg loss 0.00310288, throughput 9.21279K wps
[Epoch 138 Batch 60/62] avg loss 0.00308673, throughput 8.91513K wps
Begin Testing...
[Epoch 138] train avg loss 0.00314661, dev acc 0.8437, dev avg loss 0.374525, throughput 9.03983K wps
[Epoch 139 Batch 30/62] avg loss 0.0030942, throughput 8.99653K wps
[Epoch 139 Batch 60/62] avg loss 0.00311126, throughput 8.81133K wps
Begin Testing...
[Epoch 139] train avg loss 0.00318701, dev acc 0.8496, dev avg loss 0.373124, throughput 8.96692K wps
[Epoch 140 Batch 30/62] avg loss 0.0031108, throughput 9.01352K wps
[Epoch 140 Batch 60/62] avg loss 0.00308765, throughput 9.11941K wps
Begin Testing...
[Epoch 140] train avg loss 0.00317546, dev acc 0.8584, dev avg loss 0.373118, throughput 9.09874K wps
Observed Improvement.
Begin Testing...
[Epoch 141 Batch 30/62] avg loss 0.00308573, throughput 9.21013K wps
[Epoch 141 Batch 60/62] avg loss 0.00296887, throughput 9.14755K wps
Begin Testing...
[Epoch 141] train avg loss 0.0030655, dev acc 0.8289, dev avg loss 0.389253, throughput 9.20399K wps
[Epoch 142 Batch 30/62] avg loss 0.00313598, throughput 9.10304K wps
[Epoch 142 Batch 60/62] avg loss 0.00293391, throughput 8.83647K wps
Begin Testing...
[Epoch 142] train avg loss 0.00316307, dev acc 0.8525, dev avg loss 0.389536, throughput 9.0334K wps
[Epoch 143 Batch 30/62] avg loss 0.00298981, throughput 8.94249K wps
[Epoch 143 Batch 60/62] avg loss 0.00313209, throughput 8.96136K wps
Begin Testing...
[Epoch 143] train avg loss 0.00308771, dev acc 0.8437, dev avg loss 0.371081, throughput 8.97169K wps
[Epoch 144 Batch 30/62] avg loss 0.00305451, throughput 9.0351K wps
[Epoch 144 Batch 60/62] avg loss 0.00296827, throughput 9.11973K wps
Begin Testing...
[Epoch 144] train avg loss 0.00313764, dev acc 0.8525, dev avg loss 0.372189, throughput 9.10933K wps
[Epoch 145 Batch 30/62] avg loss 0.00305557, throughput 9.36914K wps
[Epoch 145 Batch 60/62] avg loss 0.00289781, throughput 9.1284K wps
Begin Testing...
[Epoch 145] train avg loss 0.00298996, dev acc 0.8437, dev avg loss 0.37316, throughput 9.26992K wps
[Epoch 146 Batch 30/62] avg loss 0.00292128, throughput 8.91794K wps
[Epoch 146 Batch 60/62] avg loss 0.00307695, throughput 9.16437K wps
Begin Testing...
[Epoch 146] train avg loss 0.00302475, dev acc 0.8584, dev avg loss 0.370289, throughput 9.0105K wps
Observed Improvement.
Begin Testing...
[Epoch 147 Batch 30/62] avg loss 0.00282074, throughput 9.00508K wps
[Epoch 147 Batch 60/62] avg loss 0.00301296, throughput 9.16017K wps
Begin Testing...
[Epoch 147] train avg loss 0.00293471, dev acc 0.8466, dev avg loss 0.373515, throughput 9.11405K wps
[Epoch 148 Batch 30/62] avg loss 0.00303282, throughput 8.89567K wps
[Epoch 148 Batch 60/62] avg loss 0.00281194, throughput 8.84125K wps
Begin Testing...
[Epoch 148] train avg loss 0.00295368, dev acc 0.8437, dev avg loss 0.371837, throughput 8.84709K wps
[Epoch 149 Batch 30/62] avg loss 0.0026997, throughput 8.99728K wps
[Epoch 149 Batch 60/62] avg loss 0.00286075, throughput 9.1015K wps
Begin Testing...
[Epoch 149] train avg loss 0.00283533, dev acc 0.8614, dev avg loss 0.36901, throughput 9.01152K wps
Observed Improvement.
Begin Testing...
[Epoch 150 Batch 30/62] avg loss 0.00271982, throughput 8.75726K wps
[Epoch 150 Batch 60/62] avg loss 0.00286025, throughput 9.10062K wps
Begin Testing...
[Epoch 150] train avg loss 0.00280876, dev acc 0.8525, dev avg loss 0.368249, throughput 8.96014K wps
[Epoch 151 Batch 30/62] avg loss 0.0028303, throughput 9.24898K wps
[Epoch 151 Batch 60/62] avg loss 0.00284236, throughput 9.09418K wps
Begin Testing...
[Epoch 151] train avg loss 0.00286027, dev acc 0.8525, dev avg loss 0.36902, throughput 9.20234K wps
[Epoch 152 Batch 30/62] avg loss 0.0027962, throughput 9.2802K wps
[Epoch 152 Batch 60/62] avg loss 0.00282856, throughput 9.22508K wps
Begin Testing...
[Epoch 152] train avg loss 0.00284928, dev acc 0.8437, dev avg loss 0.372878, throughput 9.28079K wps
[Epoch 153 Batch 30/62] avg loss 0.00277577, throughput 9.35499K wps
[Epoch 153 Batch 60/62] avg loss 0.00264347, throughput 8.93566K wps
Begin Testing...
[Epoch 153] train avg loss 0.00277369, dev acc 0.8466, dev avg loss 0.369181, throughput 9.1136K wps
[Epoch 154 Batch 30/62] avg loss 0.00258844, throughput 9.30422K wps
[Epoch 154 Batch 60/62] avg loss 0.00272622, throughput 9.12381K wps
Begin Testing...
[Epoch 154] train avg loss 0.00267247, dev acc 0.8437, dev avg loss 0.371795, throughput 9.1844K wps
[Epoch 155 Batch 30/62] avg loss 0.00267785, throughput 9.05522K wps
[Epoch 155 Batch 60/62] avg loss 0.00263876, throughput 9.02914K wps
Begin Testing...
[Epoch 155] train avg loss 0.0027003, dev acc 0.8643, dev avg loss 0.368869, throughput 9.07361K wps
Observed Improvement.
Begin Testing...
[Epoch 156 Batch 30/62] avg loss 0.00259168, throughput 9.11131K wps
[Epoch 156 Batch 60/62] avg loss 0.00265616, throughput 8.87775K wps
Begin Testing...
[Epoch 156] train avg loss 0.00266048, dev acc 0.8614, dev avg loss 0.368636, throughput 8.97117K wps
[Epoch 157 Batch 30/62] avg loss 0.00273146, throughput 9.12578K wps
[Epoch 157 Batch 60/62] avg loss 0.00251296, throughput 9.1683K wps
Begin Testing...
[Epoch 157] train avg loss 0.00262907, dev acc 0.8555, dev avg loss 0.368327, throughput 9.17789K wps
[Epoch 158 Batch 30/62] avg loss 0.00241168, throughput 9.28991K wps
[Epoch 158 Batch 60/62] avg loss 0.00259854, throughput 9.06951K wps
Begin Testing...
[Epoch 158] train avg loss 0.0025321, dev acc 0.8555, dev avg loss 0.36803, throughput 9.20581K wps
[Epoch 159 Batch 30/62] avg loss 0.00269852, throughput 9.23757K wps
[Epoch 159 Batch 60/62] avg loss 0.00245324, throughput 8.92491K wps
Begin Testing...
[Epoch 159] train avg loss 0.00261757, dev acc 0.8614, dev avg loss 0.368815, throughput 9.05032K wps
[Epoch 160 Batch 30/62] avg loss 0.00259102, throughput 8.95667K wps
[Epoch 160 Batch 60/62] avg loss 0.00248901, throughput 8.80465K wps
Begin Testing...
[Epoch 160] train avg loss 0.00262721, dev acc 0.8555, dev avg loss 0.380857, throughput 8.91604K wps
[Epoch 161 Batch 30/62] avg loss 0.00259682, throughput 8.99419K wps
[Epoch 161 Batch 60/62] avg loss 0.00254826, throughput 9.03022K wps
Begin Testing...
[Epoch 161] train avg loss 0.00258739, dev acc 0.8643, dev avg loss 0.368132, throughput 9.04732K wps
Observed Improvement.
Begin Testing...
[Epoch 162 Batch 30/62] avg loss 0.00241614, throughput 9.01165K wps
[Epoch 162 Batch 60/62] avg loss 0.00248068, throughput 9.10189K wps
Begin Testing...
[Epoch 162] train avg loss 0.00249811, dev acc 0.8496, dev avg loss 0.370329, throughput 9.04489K wps
[Epoch 163 Batch 30/62] avg loss 0.00247657, throughput 8.84047K wps
[Epoch 163 Batch 60/62] avg loss 0.00248009, throughput 9.24088K wps
Begin Testing...
[Epoch 163] train avg loss 0.00250905, dev acc 0.8466, dev avg loss 0.369763, throughput 9.06336K wps
[Epoch 164 Batch 30/62] avg loss 0.00244994, throughput 9.08604K wps
[Epoch 164 Batch 60/62] avg loss 0.00257095, throughput 9.08972K wps
Begin Testing...
[Epoch 164] train avg loss 0.00254177, dev acc 0.8584, dev avg loss 0.367835, throughput 9.11239K wps
[Epoch 165 Batch 30/62] avg loss 0.00252555, throughput 8.99326K wps
[Epoch 165 Batch 60/62] avg loss 0.00239202, throughput 9.10005K wps
Begin Testing...
[Epoch 165] train avg loss 0.00247385, dev acc 0.8555, dev avg loss 0.367943, throughput 9.0784K wps
[Epoch 166 Batch 30/62] avg loss 0.0025106, throughput 9.13205K wps
[Epoch 166 Batch 60/62] avg loss 0.00244329, throughput 9.06212K wps
Begin Testing...
[Epoch 166] train avg loss 0.00251483, dev acc 0.8584, dev avg loss 0.367983, throughput 9.1097K wps
[Epoch 167 Batch 30/62] avg loss 0.00229906, throughput 8.79639K wps
[Epoch 167 Batch 60/62] avg loss 0.00244361, throughput 9.08119K wps
Begin Testing...
[Epoch 167] train avg loss 0.00239583, dev acc 0.8614, dev avg loss 0.367716, throughput 8.97341K wps
[Epoch 168 Batch 30/62] avg loss 0.00236273, throughput 9.19061K wps
[Epoch 168 Batch 60/62] avg loss 0.00240126, throughput 8.762K wps
Begin Testing...
[Epoch 168] train avg loss 0.00245982, dev acc 0.8555, dev avg loss 0.367928, throughput 8.94659K wps
[Epoch 169 Batch 30/62] avg loss 0.00226439, throughput 8.97282K wps
[Epoch 169 Batch 60/62] avg loss 0.00231454, throughput 8.81341K wps
Begin Testing...
[Epoch 169] train avg loss 0.00229704, dev acc 0.8466, dev avg loss 0.369274, throughput 8.86498K wps
[Epoch 170 Batch 30/62] avg loss 0.00242607, throughput 9.31733K wps
[Epoch 170 Batch 60/62] avg loss 0.00226129, throughput 9.16627K wps
Begin Testing...
[Epoch 170] train avg loss 0.00234547, dev acc 0.8643, dev avg loss 0.368045, throughput 9.27502K wps
Observed Improvement.
Begin Testing...
[Epoch 171 Batch 30/62] avg loss 0.00240406, throughput 9.11997K wps
[Epoch 171 Batch 60/62] avg loss 0.00221354, throughput 8.97015K wps
Begin Testing...
[Epoch 171] train avg loss 0.00239392, dev acc 0.8525, dev avg loss 0.375823, throughput 9.07729K wps
[Epoch 172 Batch 30/62] avg loss 0.0022972, throughput 9.01948K wps
[Epoch 172 Batch 60/62] avg loss 0.00224233, throughput 9.05551K wps
Begin Testing...
[Epoch 172] train avg loss 0.00230148, dev acc 0.8466, dev avg loss 0.36862, throughput 9.0715K wps
[Epoch 173 Batch 30/62] avg loss 0.00224384, throughput 9.11189K wps
[Epoch 173 Batch 60/62] avg loss 0.00226071, throughput 9.11961K wps
Begin Testing...
[Epoch 173] train avg loss 0.00227896, dev acc 0.8525, dev avg loss 0.36797, throughput 9.14291K wps
[Epoch 174 Batch 30/62] avg loss 0.00228784, throughput 8.89294K wps
[Epoch 174 Batch 60/62] avg loss 0.00230251, throughput 9.06752K wps
Begin Testing...
[Epoch 174] train avg loss 0.00234051, dev acc 0.8643, dev avg loss 0.367391, throughput 9.01612K wps
Observed Improvement.
Begin Testing...
[Epoch 175 Batch 30/62] avg loss 0.00239448, throughput 8.74549K wps
[Epoch 175 Batch 60/62] avg loss 0.00221494, throughput 9.19332K wps
Begin Testing...
[Epoch 175] train avg loss 0.00231629, dev acc 0.8496, dev avg loss 0.371169, throughput 8.9933K wps
[Epoch 176 Batch 30/62] avg loss 0.00226598, throughput 9.09071K wps
[Epoch 176 Batch 60/62] avg loss 0.00225305, throughput 9.14985K wps
Begin Testing...
[Epoch 176] train avg loss 0.00227707, dev acc 0.8643, dev avg loss 0.368122, throughput 9.09808K wps
Observed Improvement.
Begin Testing...
[Epoch 177 Batch 30/62] avg loss 0.00198965, throughput 8.87414K wps
[Epoch 177 Batch 60/62] avg loss 0.00223095, throughput 9.0582K wps
Begin Testing...
[Epoch 177] train avg loss 0.00213217, dev acc 0.8466, dev avg loss 0.369896, throughput 8.94827K wps
[Epoch 178 Batch 30/62] avg loss 0.00218171, throughput 8.88849K wps
[Epoch 178 Batch 60/62] avg loss 0.00216187, throughput 8.92952K wps
Begin Testing...
[Epoch 178] train avg loss 0.00221811, dev acc 0.8584, dev avg loss 0.367383, throughput 8.94458K wps
[Epoch 179 Batch 30/62] avg loss 0.00221428, throughput 9.13811K wps
[Epoch 179 Batch 60/62] avg loss 0.00206183, throughput 8.87604K wps
Begin Testing...
[Epoch 179] train avg loss 0.00216375, dev acc 0.8584, dev avg loss 0.366873, throughput 8.98669K wps
[Epoch 180 Batch 30/62] avg loss 0.00214238, throughput 8.95292K wps
[Epoch 180 Batch 60/62] avg loss 0.00205495, throughput 8.94095K wps
Begin Testing...
[Epoch 180] train avg loss 0.00211734, dev acc 0.8643, dev avg loss 0.366693, throughput 8.92172K wps
Observed Improvement.
Begin Testing...
[Epoch 181 Batch 30/62] avg loss 0.00204801, throughput 9.17774K wps
[Epoch 181 Batch 60/62] avg loss 0.00226757, throughput 8.80209K wps
Begin Testing...
[Epoch 181] train avg loss 0.00217803, dev acc 0.8643, dev avg loss 0.366658, throughput 8.96079K wps
Observed Improvement.
Begin Testing...
[Epoch 182 Batch 30/62] avg loss 0.0021293, throughput 9.14627K wps
[Epoch 182 Batch 60/62] avg loss 0.00201978, throughput 9.12555K wps
Begin Testing...
[Epoch 182] train avg loss 0.00210726, dev acc 0.8555, dev avg loss 0.369691, throughput 9.16705K wps
[Epoch 183 Batch 30/62] avg loss 0.00197683, throughput 8.85705K wps
[Epoch 183 Batch 60/62] avg loss 0.00215521, throughput 9.23893K wps
Begin Testing...
[Epoch 183] train avg loss 0.00211503, dev acc 0.8555, dev avg loss 0.369776, throughput 9.01194K wps
[Epoch 184 Batch 30/62] avg loss 0.00202317, throughput 8.86485K wps
[Epoch 184 Batch 60/62] avg loss 0.00206213, throughput 8.94731K wps
Begin Testing...
[Epoch 184] train avg loss 0.00205762, dev acc 0.8614, dev avg loss 0.366362, throughput 8.91607K wps
[Epoch 185 Batch 30/62] avg loss 0.00195253, throughput 9.32901K wps
[Epoch 185 Batch 60/62] avg loss 0.00202342, throughput 9.05527K wps
Begin Testing...
[Epoch 185] train avg loss 0.00202075, dev acc 0.8614, dev avg loss 0.368168, throughput 9.21907K wps
[Epoch 186 Batch 30/62] avg loss 0.00197379, throughput 9.3906K wps
[Epoch 186 Batch 60/62] avg loss 0.00190049, throughput 9.07405K wps
Begin Testing...
[Epoch 186] train avg loss 0.0019814, dev acc 0.8555, dev avg loss 0.366843, throughput 9.25988K wps
[Epoch 187 Batch 30/62] avg loss 0.00200964, throughput 9.23554K wps
[Epoch 187 Batch 60/62] avg loss 0.00186902, throughput 9.16925K wps
Begin Testing...
[Epoch 187] train avg loss 0.00194629, dev acc 0.8614, dev avg loss 0.366546, throughput 9.2173K wps
[Epoch 188 Batch 30/62] avg loss 0.00184412, throughput 9.24697K wps
[Epoch 188 Batch 60/62] avg loss 0.00195958, throughput 8.93803K wps
Begin Testing...
[Epoch 188] train avg loss 0.00193598, dev acc 0.8496, dev avg loss 0.369712, throughput 9.1208K wps
[Epoch 189 Batch 30/62] avg loss 0.00197952, throughput 8.99889K wps
[Epoch 189 Batch 60/62] avg loss 0.00199081, throughput 9.10192K wps
Begin Testing...
[Epoch 189] train avg loss 0.00199081, dev acc 0.8496, dev avg loss 0.36822, throughput 9.01439K wps
[Epoch 190 Batch 30/62] avg loss 0.00206453, throughput 9.20168K wps
[Epoch 190 Batch 60/62] avg loss 0.00193347, throughput 8.92875K wps
Begin Testing...
[Epoch 190] train avg loss 0.0020223, dev acc 0.8466, dev avg loss 0.369702, throughput 9.02885K wps
[Epoch 191 Batch 30/62] avg loss 0.00197428, throughput 9.06255K wps
[Epoch 191 Batch 60/62] avg loss 0.00183999, throughput 8.96953K wps
Begin Testing...
[Epoch 191] train avg loss 0.0019039, dev acc 0.8673, dev avg loss 0.36684, throughput 8.99539K wps
Observed Improvement.
Begin Testing...
[Epoch 192 Batch 30/62] avg loss 0.00189931, throughput 9.09137K wps
[Epoch 192 Batch 60/62] avg loss 0.00188056, throughput 9.15148K wps
Begin Testing...
[Epoch 192] train avg loss 0.00193992, dev acc 0.8555, dev avg loss 0.367375, throughput 9.15261K wps
[Epoch 193 Batch 30/62] avg loss 0.00184736, throughput 8.98432K wps
[Epoch 193 Batch 60/62] avg loss 0.00193026, throughput 9.10279K wps
Begin Testing...
[Epoch 193] train avg loss 0.00194903, dev acc 0.8643, dev avg loss 0.367632, throughput 9.01788K wps
[Epoch 194 Batch 30/62] avg loss 0.0018606, throughput 9.14734K wps
[Epoch 194 Batch 60/62] avg loss 0.00191531, throughput 9.18125K wps
Begin Testing...
[Epoch 194] train avg loss 0.00190026, dev acc 0.8525, dev avg loss 0.367307, throughput 9.13805K wps
[Epoch 195 Batch 30/62] avg loss 0.00189967, throughput 8.80577K wps
[Epoch 195 Batch 60/62] avg loss 0.001818, throughput 9.00496K wps
Begin Testing...
[Epoch 195] train avg loss 0.00186944, dev acc 0.8673, dev avg loss 0.366858, throughput 8.93888K wps
Observed Improvement.
Begin Testing...
[Epoch 196 Batch 30/62] avg loss 0.00186507, throughput 8.93703K wps
[Epoch 196 Batch 60/62] avg loss 0.00191216, throughput 9.02484K wps
Begin Testing...
[Epoch 196] train avg loss 0.00192979, dev acc 0.8437, dev avg loss 0.369613, throughput 9.01451K wps
[Epoch 197 Batch 30/62] avg loss 0.00176978, throughput 9.33337K wps
[Epoch 197 Batch 60/62] avg loss 0.00192355, throughput 9.03243K wps
Begin Testing...
[Epoch 197] train avg loss 0.00184033, dev acc 0.8584, dev avg loss 0.367245, throughput 9.14429K wps
[Epoch 198 Batch 30/62] avg loss 0.00185714, throughput 9.2458K wps
[Epoch 198 Batch 60/62] avg loss 0.00177926, throughput 9.09651K wps
Begin Testing...
[Epoch 198] train avg loss 0.00184661, dev acc 0.8555, dev avg loss 0.367925, throughput 9.19462K wps
[Epoch 199 Batch 30/62] avg loss 0.00187763, throughput 9.03549K wps
[Epoch 199 Batch 60/62] avg loss 0.00178823, throughput 8.8582K wps
Begin Testing...
[Epoch 199] train avg loss 0.00187208, dev acc 0.8702, dev avg loss 0.366813, throughput 8.9728K wps
Observed Improvement.
Begin Testing...
Test loss 0.354645, test acc 0.8355
Total time cost 154.62s
[Epoch 0 Batch 30/62] avg loss 0.0137167, throughput 8.45262K wps
[Epoch 0 Batch 60/62] avg loss 0.013141, throughput 9.08692K wps
Begin Testing...
[Epoch 0] train avg loss 0.0135857, dev acc 0.6077, dev avg loss 0.67283, throughput 8.79799K wps
Observed Improvement.
Begin Testing...
[Epoch 1 Batch 30/62] avg loss 0.0130475, throughput 8.97344K wps
[Epoch 1 Batch 60/62] avg loss 0.0131314, throughput 9.04989K wps
Begin Testing...
[Epoch 1] train avg loss 0.0132488, dev acc 0.6077, dev avg loss 0.666867, throughput 8.99868K wps
Observed Improvement.
Begin Testing...
[Epoch 2 Batch 30/62] avg loss 0.0130429, throughput 9.20246K wps
[Epoch 2 Batch 60/62] avg loss 0.0129764, throughput 9.16258K wps
Begin Testing...
[Epoch 2] train avg loss 0.0131853, dev acc 0.6077, dev avg loss 0.664578, throughput 9.21519K wps
Observed Improvement.
Begin Testing...
[Epoch 3 Batch 30/62] avg loss 0.012968, throughput 9.19523K wps
[Epoch 3 Batch 60/62] avg loss 0.0128568, throughput 9.09268K wps
Begin Testing...
[Epoch 3] train avg loss 0.0130985, dev acc 0.6077, dev avg loss 0.661912, throughput 9.12588K wps
Observed Improvement.
Begin Testing...
[Epoch 4 Batch 30/62] avg loss 0.0128416, throughput 9.01091K wps
[Epoch 4 Batch 60/62] avg loss 0.0128522, throughput 9.20768K wps
Begin Testing...
[Epoch 4] train avg loss 0.0130672, dev acc 0.6077, dev avg loss 0.657554, throughput 9.13642K wps
Observed Improvement.
Begin Testing...
[Epoch 5 Batch 30/62] avg loss 0.0126517, throughput 9.16264K wps
[Epoch 5 Batch 60/62] avg loss 0.0128207, throughput 9.13898K wps
Begin Testing...
[Epoch 5] train avg loss 0.012867, dev acc 0.6077, dev avg loss 0.655958, throughput 9.18316K wps
Observed Improvement.
Begin Testing...
[Epoch 6 Batch 30/62] avg loss 0.0127851, throughput 8.83893K wps
[Epoch 6 Batch 60/62] avg loss 0.012551, throughput 9.03455K wps
Begin Testing...
[Epoch 6] train avg loss 0.0127928, dev acc 0.6077, dev avg loss 0.656132, throughput 8.92391K wps
Observed Improvement.
Begin Testing...
[Epoch 7 Batch 30/62] avg loss 0.0124705, throughput 9.18015K wps
[Epoch 7 Batch 60/62] avg loss 0.0126544, throughput 9.12687K wps
Begin Testing...
[Epoch 7] train avg loss 0.0127335, dev acc 0.6077, dev avg loss 0.648159, throughput 9.18463K wps
Observed Improvement.
Begin Testing...
[Epoch 8 Batch 30/62] avg loss 0.0125874, throughput 8.97489K wps
[Epoch 8 Batch 60/62] avg loss 0.0123831, throughput 8.9158K wps
Begin Testing...
[Epoch 8] train avg loss 0.0126766, dev acc 0.6077, dev avg loss 0.645433, throughput 8.98023K wps
Observed Improvement.
Begin Testing...
[Epoch 9 Batch 30/62] avg loss 0.0122857, throughput 9.33002K wps
[Epoch 9 Batch 60/62] avg loss 0.0124559, throughput 9.08262K wps
Begin Testing...
[Epoch 9] train avg loss 0.0125253, dev acc 0.6077, dev avg loss 0.642205, throughput 9.23344K wps
Observed Improvement.
Begin Testing...
[Epoch 10 Batch 30/62] avg loss 0.0123882, throughput 8.91986K wps
[Epoch 10 Batch 60/62] avg loss 0.0122185, throughput 9.18728K wps
Begin Testing...
[Epoch 10] train avg loss 0.0124712, dev acc 0.6077, dev avg loss 0.641129, throughput 9.08509K wps
Observed Improvement.
Begin Testing...
[Epoch 11 Batch 30/62] avg loss 0.0122314, throughput 9.04855K wps
[Epoch 11 Batch 60/62] avg loss 0.012228, throughput 8.71634K wps
Begin Testing...
[Epoch 11] train avg loss 0.0123749, dev acc 0.6077, dev avg loss 0.636041, throughput 8.95747K wps
Observed Improvement.
Begin Testing...
[Epoch 12 Batch 30/62] avg loss 0.0120857, throughput 9.15732K wps
[Epoch 12 Batch 60/62] avg loss 0.0121113, throughput 9.1028K wps
Begin Testing...
[Epoch 12] train avg loss 0.0122886, dev acc 0.6077, dev avg loss 0.631686, throughput 9.16264K wps
Observed Improvement.
Begin Testing...
[Epoch 13 Batch 30/62] avg loss 0.0119786, throughput 9.13595K wps
[Epoch 13 Batch 60/62] avg loss 0.0119649, throughput 9.05583K wps
Begin Testing...
[Epoch 13] train avg loss 0.0121734, dev acc 0.6165, dev avg loss 0.627082, throughput 9.06344K wps
Observed Improvement.
Begin Testing...
[Epoch 14 Batch 30/62] avg loss 0.011869, throughput 9.16563K wps
[Epoch 14 Batch 60/62] avg loss 0.0119409, throughput 9.07559K wps
Begin Testing...
[Epoch 14] train avg loss 0.0120168, dev acc 0.6077, dev avg loss 0.628753, throughput 9.15042K wps
[Epoch 15 Batch 30/62] avg loss 0.0118205, throughput 9.26845K wps
[Epoch 15 Batch 60/62] avg loss 0.011901, throughput 9.12407K wps
Begin Testing...
[Epoch 15] train avg loss 0.0119738, dev acc 0.6077, dev avg loss 0.620774, throughput 9.16813K wps
[Epoch 16 Batch 30/62] avg loss 0.0116193, throughput 8.94449K wps
[Epoch 16 Batch 60/62] avg loss 0.0117254, throughput 8.94589K wps
Begin Testing...
[Epoch 16] train avg loss 0.0118209, dev acc 0.6106, dev avg loss 0.617452, throughput 8.91552K wps
[Epoch 17 Batch 30/62] avg loss 0.0116414, throughput 9.17758K wps
[Epoch 17 Batch 60/62] avg loss 0.0116261, throughput 8.97972K wps
Begin Testing...
[Epoch 17] train avg loss 0.0117952, dev acc 0.6283, dev avg loss 0.613164, throughput 9.11398K wps
Observed Improvement.
Begin Testing...
[Epoch 18 Batch 30/62] avg loss 0.0116881, throughput 8.77207K wps
[Epoch 18 Batch 60/62] avg loss 0.0112082, throughput 9.10427K wps
Begin Testing...
[Epoch 18] train avg loss 0.0116096, dev acc 0.6401, dev avg loss 0.606894, throughput 8.91458K wps
Observed Improvement.
Begin Testing...
[Epoch 19 Batch 30/62] avg loss 0.0114594, throughput 8.99747K wps
[Epoch 19 Batch 60/62] avg loss 0.0111318, throughput 9.11192K wps
Begin Testing...
[Epoch 19] train avg loss 0.0114499, dev acc 0.6372, dev avg loss 0.603378, throughput 9.08826K wps
[Epoch 20 Batch 30/62] avg loss 0.0112569, throughput 8.73315K wps
[Epoch 20 Batch 60/62] avg loss 0.0111196, throughput 9.26686K wps
Begin Testing...
[Epoch 20] train avg loss 0.0113437, dev acc 0.6342, dev avg loss 0.601258, throughput 8.98618K wps
[Epoch 21 Batch 30/62] avg loss 0.0111563, throughput 8.99121K wps
[Epoch 21 Batch 60/62] avg loss 0.0110155, throughput 9.02361K wps
Begin Testing...
[Epoch 21] train avg loss 0.0112182, dev acc 0.6372, dev avg loss 0.596695, throughput 9.03869K wps
[Epoch 22 Batch 30/62] avg loss 0.0110845, throughput 9.21403K wps
[Epoch 22 Batch 60/62] avg loss 0.0108678, throughput 9.20794K wps
Begin Testing...
[Epoch 22] train avg loss 0.0111388, dev acc 0.6578, dev avg loss 0.588769, throughput 9.23419K wps
Observed Improvement.
Begin Testing...
[Epoch 23 Batch 30/62] avg loss 0.0109559, throughput 9.07493K wps
[Epoch 23 Batch 60/62] avg loss 0.0107527, throughput 8.9245K wps
Begin Testing...
[Epoch 23] train avg loss 0.0110139, dev acc 0.6549, dev avg loss 0.583598, throughput 9.03284K wps
[Epoch 24 Batch 30/62] avg loss 0.0106081, throughput 8.92749K wps
[Epoch 24 Batch 60/62] avg loss 0.0108478, throughput 9.09535K wps
Begin Testing...
[Epoch 24] train avg loss 0.0108672, dev acc 0.6667, dev avg loss 0.578476, throughput 9.00212K wps
Observed Improvement.
Begin Testing...
[Epoch 25 Batch 30/62] avg loss 0.0107711, throughput 9.14669K wps
[Epoch 25 Batch 60/62] avg loss 0.010357, throughput 8.97017K wps
Begin Testing...
[Epoch 25] train avg loss 0.0107085, dev acc 0.6637, dev avg loss 0.574506, throughput 9.04447K wps
[Epoch 26 Batch 30/62] avg loss 0.0104671, throughput 9.23713K wps
[Epoch 26 Batch 60/62] avg loss 0.0105975, throughput 8.9339K wps
Begin Testing...
[Epoch 26] train avg loss 0.0106827, dev acc 0.6578, dev avg loss 0.573617, throughput 9.11445K wps
[Epoch 27 Batch 30/62] avg loss 0.0105209, throughput 9.20565K wps
[Epoch 27 Batch 60/62] avg loss 0.0102265, throughput 8.96795K wps
Begin Testing...
[Epoch 27] train avg loss 0.0105303, dev acc 0.6785, dev avg loss 0.565379, throughput 9.114K wps
Observed Improvement.
Begin Testing...
[Epoch 28 Batch 30/62] avg loss 0.0104803, throughput 8.92407K wps
[Epoch 28 Batch 60/62] avg loss 0.0102334, throughput 9.11859K wps
Begin Testing...
[Epoch 28] train avg loss 0.0104812, dev acc 0.6667, dev avg loss 0.562891, throughput 9.05616K wps
[Epoch 29 Batch 30/62] avg loss 0.010203, throughput 9.12109K wps
[Epoch 29 Batch 60/62] avg loss 0.00978981, throughput 9.08123K wps
Begin Testing...
[Epoch 29] train avg loss 0.0100746, dev acc 0.6873, dev avg loss 0.556387, throughput 9.13316K wps
Observed Improvement.
Begin Testing...
[Epoch 30 Batch 30/62] avg loss 0.00984352, throughput 8.92003K wps
[Epoch 30 Batch 60/62] avg loss 0.0101046, throughput 9.00676K wps
Begin Testing...
[Epoch 30] train avg loss 0.010098, dev acc 0.7021, dev avg loss 0.551916, throughput 8.99165K wps
Observed Improvement.
Begin Testing...
[Epoch 31 Batch 30/62] avg loss 0.00959132, throughput 8.94392K wps
[Epoch 31 Batch 60/62] avg loss 0.00980896, throughput 8.90985K wps
Begin Testing...
[Epoch 31] train avg loss 0.00990401, dev acc 0.7345, dev avg loss 0.546483, throughput 8.96075K wps
Observed Improvement.
Begin Testing...
[Epoch 32 Batch 30/62] avg loss 0.00981201, throughput 9.31139K wps
[Epoch 32 Batch 60/62] avg loss 0.00961894, throughput 9.07502K wps
Begin Testing...
[Epoch 32] train avg loss 0.00982616, dev acc 0.7227, dev avg loss 0.543674, throughput 9.15889K wps
[Epoch 33 Batch 30/62] avg loss 0.0098781, throughput 8.73755K wps
[Epoch 33 Batch 60/62] avg loss 0.00937265, throughput 9.12768K wps
Begin Testing...
[Epoch 33] train avg loss 0.00981157, dev acc 0.6903, dev avg loss 0.54269, throughput 8.96498K wps
[Epoch 34 Batch 30/62] avg loss 0.00944379, throughput 9.13712K wps
[Epoch 34 Batch 60/62] avg loss 0.0094887, throughput 9.18599K wps
Begin Testing...
[Epoch 34] train avg loss 0.00959558, dev acc 0.7375, dev avg loss 0.533814, throughput 9.18824K wps
Observed Improvement.
Begin Testing...
[Epoch 35 Batch 30/62] avg loss 0.00937492, throughput 9.11424K wps
[Epoch 35 Batch 60/62] avg loss 0.00936672, throughput 8.83131K wps
Begin Testing...
[Epoch 35] train avg loss 0.0094422, dev acc 0.7345, dev avg loss 0.53159, throughput 8.94658K wps
[Epoch 36 Batch 30/62] avg loss 0.00934053, throughput 9.07952K wps
[Epoch 36 Batch 60/62] avg loss 0.0092499, throughput 8.89952K wps
Begin Testing...
[Epoch 36] train avg loss 0.00942833, dev acc 0.7316, dev avg loss 0.528652, throughput 8.97646K wps
[Epoch 37 Batch 30/62] avg loss 0.00907941, throughput 9.32598K wps
[Epoch 37 Batch 60/62] avg loss 0.00918525, throughput 8.85066K wps
Begin Testing...
[Epoch 37] train avg loss 0.00925164, dev acc 0.7434, dev avg loss 0.525156, throughput 9.11209K wps
Observed Improvement.
Begin Testing...
[Epoch 38 Batch 30/62] avg loss 0.00909234, throughput 9.09186K wps
[Epoch 38 Batch 60/62] avg loss 0.00882693, throughput 8.98289K wps
Begin Testing...
[Epoch 38] train avg loss 0.00909657, dev acc 0.7404, dev avg loss 0.519721, throughput 9.00095K wps
[Epoch 39 Batch 30/62] avg loss 0.00898947, throughput 9.00899K wps
[Epoch 39 Batch 60/62] avg loss 0.00886822, throughput 8.89939K wps
Begin Testing...
[Epoch 39] train avg loss 0.00905619, dev acc 0.7611, dev avg loss 0.51789, throughput 8.9903K wps
Observed Improvement.
Begin Testing...
[Epoch 40 Batch 30/62] avg loss 0.00889444, throughput 9.14349K wps
[Epoch 40 Batch 60/62] avg loss 0.00862413, throughput 9.03944K wps
Begin Testing...
[Epoch 40] train avg loss 0.00886783, dev acc 0.7493, dev avg loss 0.513866, throughput 9.07269K wps
[Epoch 41 Batch 30/62] avg loss 0.0087574, throughput 9.24203K wps
[Epoch 41 Batch 60/62] avg loss 0.00864226, throughput 9.00942K wps
Begin Testing...
[Epoch 41] train avg loss 0.00886807, dev acc 0.7552, dev avg loss 0.513372, throughput 9.14158K wps
[Epoch 42 Batch 30/62] avg loss 0.00861042, throughput 8.98476K wps
[Epoch 42 Batch 60/62] avg loss 0.00869364, throughput 9.03193K wps
Begin Testing...
[Epoch 42] train avg loss 0.00884123, dev acc 0.7522, dev avg loss 0.508223, throughput 9.03639K wps
[Epoch 43 Batch 30/62] avg loss 0.00844982, throughput 9.23211K wps
[Epoch 43 Batch 60/62] avg loss 0.00865429, throughput 8.91102K wps
Begin Testing...
[Epoch 43] train avg loss 0.00865637, dev acc 0.7581, dev avg loss 0.505888, throughput 9.04155K wps
[Epoch 44 Batch 30/62] avg loss 0.00853028, throughput 9.03592K wps
[Epoch 44 Batch 60/62] avg loss 0.00827774, throughput 8.99092K wps
Begin Testing...
[Epoch 44] train avg loss 0.00848818, dev acc 0.7493, dev avg loss 0.507966, throughput 9.02941K wps
[Epoch 45 Batch 30/62] avg loss 0.0084942, throughput 8.8754K wps
[Epoch 45 Batch 60/62] avg loss 0.00807399, throughput 9.25538K wps
Begin Testing...
[Epoch 45] train avg loss 0.00842266, dev acc 0.7670, dev avg loss 0.500354, throughput 9.09568K wps
Observed Improvement.
Begin Testing...
[Epoch 46 Batch 30/62] avg loss 0.00832656, throughput 9.12879K wps
[Epoch 46 Batch 60/62] avg loss 0.00800343, throughput 9.22677K wps
Begin Testing...
[Epoch 46] train avg loss 0.00833616, dev acc 0.7729, dev avg loss 0.4977, throughput 9.20938K wps
Observed Improvement.
Begin Testing...
[Epoch 47 Batch 30/62] avg loss 0.0080179, throughput 8.86467K wps
[Epoch 47 Batch 60/62] avg loss 0.00819337, throughput 9.17653K wps
Begin Testing...
[Epoch 47] train avg loss 0.00818735, dev acc 0.7640, dev avg loss 0.495366, throughput 9.054K wps
[Epoch 48 Batch 30/62] avg loss 0.00806399, throughput 9.10857K wps
[Epoch 48 Batch 60/62] avg loss 0.00791454, throughput 8.99952K wps
Begin Testing...
[Epoch 48] train avg loss 0.00804538, dev acc 0.7670, dev avg loss 0.494541, throughput 9.07714K wps
[Epoch 49 Batch 30/62] avg loss 0.00784867, throughput 8.80373K wps
[Epoch 49 Batch 60/62] avg loss 0.0078903, throughput 9.10715K wps
Begin Testing...
[Epoch 49] train avg loss 0.00802621, dev acc 0.7640, dev avg loss 0.494948, throughput 8.97958K wps
[Epoch 50 Batch 30/62] avg loss 0.00764311, throughput 9.32614K wps
[Epoch 50 Batch 60/62] avg loss 0.00800769, throughput 9.10998K wps
Begin Testing...
[Epoch 50] train avg loss 0.00788342, dev acc 0.7729, dev avg loss 0.492763, throughput 9.24432K wps
Observed Improvement.
Begin Testing...
[Epoch 51 Batch 30/62] avg loss 0.00761323, throughput 9.21714K wps
[Epoch 51 Batch 60/62] avg loss 0.00774296, throughput 8.92096K wps
Begin Testing...
[Epoch 51] train avg loss 0.00777732, dev acc 0.7729, dev avg loss 0.488877, throughput 9.04248K wps
Observed Improvement.
Begin Testing...
[Epoch 52 Batch 30/62] avg loss 0.00771728, throughput 9.33415K wps
[Epoch 52 Batch 60/62] avg loss 0.00774598, throughput 9.15068K wps
Begin Testing...
[Epoch 52] train avg loss 0.00782135, dev acc 0.7729, dev avg loss 0.487811, throughput 9.25964K wps
Observed Improvement.
Begin Testing...
[Epoch 53 Batch 30/62] avg loss 0.00776203, throughput 8.94543K wps
[Epoch 53 Batch 60/62] avg loss 0.00765854, throughput 8.71304K wps
Begin Testing...
[Epoch 53] train avg loss 0.00779881, dev acc 0.7670, dev avg loss 0.485923, throughput 8.89512K wps
[Epoch 54 Batch 30/62] avg loss 0.00753979, throughput 8.99177K wps
[Epoch 54 Batch 60/62] avg loss 0.0074396, throughput 9.0025K wps
Begin Testing...
[Epoch 54] train avg loss 0.00755232, dev acc 0.7729, dev avg loss 0.483014, throughput 9.03267K wps
Observed Improvement.
Begin Testing...
[Epoch 55 Batch 30/62] avg loss 0.00778298, throughput 8.99158K wps
[Epoch 55 Batch 60/62] avg loss 0.00720214, throughput 8.63556K wps
Begin Testing...
[Epoch 55] train avg loss 0.00761537, dev acc 0.7463, dev avg loss 0.495014, throughput 8.79626K wps
[Epoch 56 Batch 30/62] avg loss 0.00745093, throughput 9.18185K wps
[Epoch 56 Batch 60/62] avg loss 0.0072586, throughput 8.92336K wps
Begin Testing...
[Epoch 56] train avg loss 0.00752051, dev acc 0.7729, dev avg loss 0.479984, throughput 9.02822K wps
Observed Improvement.
Begin Testing...
[Epoch 57 Batch 30/62] avg loss 0.0071737, throughput 9.31322K wps
[Epoch 57 Batch 60/62] avg loss 0.00739662, throughput 8.88156K wps
Begin Testing...
[Epoch 57] train avg loss 0.00746044, dev acc 0.7729, dev avg loss 0.481903, throughput 9.12211K wps
Observed Improvement.
Begin Testing...
[Epoch 58 Batch 30/62] avg loss 0.00742405, throughput 9.22656K wps
[Epoch 58 Batch 60/62] avg loss 0.00699748, throughput 9.03542K wps
Begin Testing...
[Epoch 58] train avg loss 0.00724398, dev acc 0.7788, dev avg loss 0.476494, throughput 9.15575K wps
Observed Improvement.
Begin Testing...
[Epoch 59 Batch 30/62] avg loss 0.00752045, throughput 9.09536K wps
[Epoch 59 Batch 60/62] avg loss 0.00688169, throughput 9.10535K wps
Begin Testing...
[Epoch 59] train avg loss 0.00733676, dev acc 0.7758, dev avg loss 0.474598, throughput 9.12807K wps
[Epoch 60 Batch 30/62] avg loss 0.00701438, throughput 8.81665K wps
[Epoch 60 Batch 60/62] avg loss 0.00720518, throughput 9.10054K wps
Begin Testing...
[Epoch 60] train avg loss 0.00722627, dev acc 0.7758, dev avg loss 0.480135, throughput 8.94891K wps
[Epoch 61 Batch 30/62] avg loss 0.00682872, throughput 9.19789K wps
[Epoch 61 Batch 60/62] avg loss 0.00717864, throughput 8.80854K wps
Begin Testing...
[Epoch 61] train avg loss 0.00707775, dev acc 0.7847, dev avg loss 0.471246, throughput 9.02049K wps
Observed Improvement.
Begin Testing...
[Epoch 62 Batch 30/62] avg loss 0.00693704, throughput 8.89468K wps
[Epoch 62 Batch 60/62] avg loss 0.00671801, throughput 8.89259K wps
Begin Testing...
[Epoch 62] train avg loss 0.00696699, dev acc 0.7817, dev avg loss 0.471244, throughput 8.9178K wps
[Epoch 63 Batch 30/62] avg loss 0.00699093, throughput 8.96001K wps
[Epoch 63 Batch 60/62] avg loss 0.00679095, throughput 8.75265K wps
Begin Testing...
[Epoch 63] train avg loss 0.0070611, dev acc 0.7758, dev avg loss 0.475129, throughput 8.87779K wps
[Epoch 64 Batch 30/62] avg loss 0.00704811, throughput 8.46242K wps
[Epoch 64 Batch 60/62] avg loss 0.00656295, throughput 8.65642K wps
Begin Testing...
[Epoch 64] train avg loss 0.0068788, dev acc 0.7876, dev avg loss 0.467644, throughput 8.54408K wps
Observed Improvement.
Begin Testing...
[Epoch 65 Batch 30/62] avg loss 0.00680307, throughput 8.92993K wps
[Epoch 65 Batch 60/62] avg loss 0.00664584, throughput 8.93687K wps
Begin Testing...
[Epoch 65] train avg loss 0.00683254, dev acc 0.7758, dev avg loss 0.473245, throughput 8.96369K wps
[Epoch 66 Batch 30/62] avg loss 0.00659425, throughput 8.72718K wps
[Epoch 66 Batch 60/62] avg loss 0.00683141, throughput 9.05757K wps
Begin Testing...
[Epoch 66] train avg loss 0.00675079, dev acc 0.7699, dev avg loss 0.468694, throughput 8.92371K wps
[Epoch 67 Batch 30/62] avg loss 0.00660108, throughput 8.95452K wps
[Epoch 67 Batch 60/62] avg loss 0.00676818, throughput 9.13265K wps
Begin Testing...
[Epoch 67] train avg loss 0.00677848, dev acc 0.7906, dev avg loss 0.462198, throughput 9.07225K wps
Observed Improvement.
Begin Testing...
[Epoch 68 Batch 30/62] avg loss 0.00652191, throughput 8.99239K wps
[Epoch 68 Batch 60/62] avg loss 0.00656397, throughput 9.04826K wps
Begin Testing...
[Epoch 68] train avg loss 0.00669191, dev acc 0.7758, dev avg loss 0.464794, throughput 9.0464K wps
[Epoch 69 Batch 30/62] avg loss 0.0064228, throughput 9.05578K wps
[Epoch 69 Batch 60/62] avg loss 0.00639395, throughput 9.11433K wps
Begin Testing...
[Epoch 69] train avg loss 0.00654157, dev acc 0.7788, dev avg loss 0.46442, throughput 9.11733K wps
[Epoch 70 Batch 30/62] avg loss 0.00642363, throughput 9.15763K wps
[Epoch 70 Batch 60/62] avg loss 0.006212, throughput 9.01942K wps
Begin Testing...
[Epoch 70] train avg loss 0.00638869, dev acc 0.7788, dev avg loss 0.463355, throughput 9.0565K wps
[Epoch 71 Batch 30/62] avg loss 0.00636567, throughput 8.95736K wps
[Epoch 71 Batch 60/62] avg loss 0.00610733, throughput 8.90019K wps
Begin Testing...
[Epoch 71] train avg loss 0.00631113, dev acc 0.7847, dev avg loss 0.45872, throughput 8.91817K wps
[Epoch 72 Batch 30/62] avg loss 0.00619137, throughput 9.0208K wps
[Epoch 72 Batch 60/62] avg loss 0.00621324, throughput 9.0806K wps
Begin Testing...
[Epoch 72] train avg loss 0.00629297, dev acc 0.7847, dev avg loss 0.457545, throughput 9.08136K wps
[Epoch 73 Batch 30/62] avg loss 0.00625986, throughput 8.83515K wps
[Epoch 73 Batch 60/62] avg loss 0.00602631, throughput 9.09152K wps
Begin Testing...
[Epoch 73] train avg loss 0.00620673, dev acc 0.7758, dev avg loss 0.465866, throughput 8.91348K wps
[Epoch 74 Batch 30/62] avg loss 0.0061594, throughput 8.98586K wps
[Epoch 74 Batch 60/62] avg loss 0.00602534, throughput 8.99333K wps
Begin Testing...
[Epoch 74] train avg loss 0.00616543, dev acc 0.7817, dev avg loss 0.456466, throughput 9.01868K wps
[Epoch 75 Batch 30/62] avg loss 0.00601253, throughput 8.77854K wps
[Epoch 75 Batch 60/62] avg loss 0.0061194, throughput 8.92995K wps
Begin Testing...
[Epoch 75] train avg loss 0.00611996, dev acc 0.7788, dev avg loss 0.460741, throughput 8.88815K wps
[Epoch 76 Batch 30/62] avg loss 0.00566219, throughput 8.68553K wps
[Epoch 76 Batch 60/62] avg loss 0.00615334, throughput 8.89313K wps
Begin Testing...
[Epoch 76] train avg loss 0.00595998, dev acc 0.7876, dev avg loss 0.452102, throughput 8.8195K wps
[Epoch 77 Batch 30/62] avg loss 0.00597586, throughput 9.17356K wps
[Epoch 77 Batch 60/62] avg loss 0.00578983, throughput 8.40316K wps
Begin Testing...
[Epoch 77] train avg loss 0.00598881, dev acc 0.7817, dev avg loss 0.45438, throughput 8.7659K wps
[Epoch 78 Batch 30/62] avg loss 0.005895, throughput 9.21518K wps
[Epoch 78 Batch 60/62] avg loss 0.00582205, throughput 8.96036K wps
Begin Testing...
[Epoch 78] train avg loss 0.00590154, dev acc 0.7817, dev avg loss 0.455776, throughput 9.11351K wps
[Epoch 79 Batch 30/62] avg loss 0.00597893, throughput 8.81259K wps
[Epoch 79 Batch 60/62] avg loss 0.00577306, throughput 8.98585K wps
Begin Testing...
[Epoch 79] train avg loss 0.00589875, dev acc 0.7788, dev avg loss 0.452244, throughput 8.87135K wps
[Epoch 80 Batch 30/62] avg loss 0.00575562, throughput 9.13291K wps
[Epoch 80 Batch 60/62] avg loss 0.00574279, throughput 8.73198K wps
Begin Testing...
[Epoch 80] train avg loss 0.00580804, dev acc 0.7817, dev avg loss 0.453265, throughput 8.96062K wps
[Epoch 81 Batch 30/62] avg loss 0.00571146, throughput 8.76983K wps
[Epoch 81 Batch 60/62] avg loss 0.00559772, throughput 8.70598K wps
Begin Testing...
[Epoch 81] train avg loss 0.00569216, dev acc 0.7876, dev avg loss 0.448995, throughput 8.7109K wps
[Epoch 82 Batch 30/62] avg loss 0.00567706, throughput 9.02381K wps
[Epoch 82 Batch 60/62] avg loss 0.00548539, throughput 8.93447K wps
Begin Testing...
[Epoch 82] train avg loss 0.00564213, dev acc 0.7876, dev avg loss 0.450133, throughput 9.00678K wps
[Epoch 83 Batch 30/62] avg loss 0.00567459, throughput 9.00337K wps
[Epoch 83 Batch 60/62] avg loss 0.00538481, throughput 8.66747K wps
Begin Testing...
[Epoch 83] train avg loss 0.00562537, dev acc 0.7758, dev avg loss 0.453521, throughput 8.84251K wps
[Epoch 84 Batch 30/62] avg loss 0.00569759, throughput 8.88623K wps
[Epoch 84 Batch 60/62] avg loss 0.00528104, throughput 8.83173K wps
Begin Testing...
[Epoch 84] train avg loss 0.00555625, dev acc 0.7876, dev avg loss 0.444788, throughput 8.84228K wps
[Epoch 85 Batch 30/62] avg loss 0.00515436, throughput 8.87437K wps
[Epoch 85 Batch 60/62] avg loss 0.00554666, throughput 8.99713K wps
Begin Testing...
[Epoch 85] train avg loss 0.00548172, dev acc 0.7935, dev avg loss 0.443977, throughput 8.9654K wps
Observed Improvement.
Begin Testing...
[Epoch 86 Batch 30/62] avg loss 0.00524848, throughput 8.88328K wps
[Epoch 86 Batch 60/62] avg loss 0.00559302, throughput 8.8264K wps
Begin Testing...
[Epoch 86] train avg loss 0.00549906, dev acc 0.7817, dev avg loss 0.445682, throughput 8.88342K wps
[Epoch 87 Batch 30/62] avg loss 0.00526673, throughput 8.95709K wps
[Epoch 87 Batch 60/62] avg loss 0.00523108, throughput 8.89573K wps
Begin Testing...
[Epoch 87] train avg loss 0.00528269, dev acc 0.7876, dev avg loss 0.442884, throughput 8.88764K wps
[Epoch 88 Batch 30/62] avg loss 0.00509179, throughput 8.83063K wps
[Epoch 88 Batch 60/62] avg loss 0.00539497, throughput 8.49043K wps
Begin Testing...
[Epoch 88] train avg loss 0.00527388, dev acc 0.7906, dev avg loss 0.44222, throughput 8.62717K wps
[Epoch 89 Batch 30/62] avg loss 0.00532976, throughput 9.0127K wps
[Epoch 89 Batch 60/62] avg loss 0.00505858, throughput 8.90808K wps
Begin Testing...
[Epoch 89] train avg loss 0.00528566, dev acc 0.7670, dev avg loss 0.455692, throughput 8.92426K wps
[Epoch 90 Batch 30/62] avg loss 0.00526403, throughput 8.73905K wps
[Epoch 90 Batch 60/62] avg loss 0.00515262, throughput 9.01323K wps
Begin Testing...
[Epoch 90] train avg loss 0.0052396, dev acc 0.7817, dev avg loss 0.443327, throughput 8.90519K wps
[Epoch 91 Batch 30/62] avg loss 0.0049485, throughput 8.89316K wps
[Epoch 91 Batch 60/62] avg loss 0.00518584, throughput 8.59382K wps
Begin Testing...
[Epoch 91] train avg loss 0.00513391, dev acc 0.7699, dev avg loss 0.454707, throughput 8.71585K wps
[Epoch 92 Batch 30/62] avg loss 0.00518388, throughput 8.93076K wps
[Epoch 92 Batch 60/62] avg loss 0.00484586, throughput 8.52689K wps
Begin Testing...
[Epoch 92] train avg loss 0.00510732, dev acc 0.7876, dev avg loss 0.444384, throughput 8.70537K wps
[Epoch 93 Batch 30/62] avg loss 0.00496852, throughput 9.00092K wps
[Epoch 93 Batch 60/62] avg loss 0.00514557, throughput 8.56566K wps
Begin Testing...
[Epoch 93] train avg loss 0.00511639, dev acc 0.7876, dev avg loss 0.440444, throughput 8.82821K wps
[Epoch 94 Batch 30/62] avg loss 0.00501611, throughput 9.02629K wps
[Epoch 94 Batch 60/62] avg loss 0.00495601, throughput 8.82032K wps
Begin Testing...
[Epoch 94] train avg loss 0.00501032, dev acc 0.7876, dev avg loss 0.440246, throughput 8.87277K wps
[Epoch 95 Batch 30/62] avg loss 0.00471975, throughput 8.7545K wps
[Epoch 95 Batch 60/62] avg loss 0.00495823, throughput 8.72458K wps
Begin Testing...
[Epoch 95] train avg loss 0.00502675, dev acc 0.7876, dev avg loss 0.437209, throughput 8.71705K wps
[Epoch 96 Batch 30/62] avg loss 0.00475317, throughput 8.74127K wps
[Epoch 96 Batch 60/62] avg loss 0.00475224, throughput 8.81704K wps
Begin Testing...
[Epoch 96] train avg loss 0.00478011, dev acc 0.7817, dev avg loss 0.443143, throughput 8.80933K wps
[Epoch 97 Batch 30/62] avg loss 0.00458587, throughput 8.34236K wps
[Epoch 97 Batch 60/62] avg loss 0.0049438, throughput 8.77717K wps
Begin Testing...
[Epoch 97] train avg loss 0.00485449, dev acc 0.7788, dev avg loss 0.442065, throughput 8.55523K wps
[Epoch 98 Batch 30/62] avg loss 0.00470112, throughput 9.10528K wps
[Epoch 98 Batch 60/62] avg loss 0.00450495, throughput 9.0693K wps
Begin Testing...
[Epoch 98] train avg loss 0.00467306, dev acc 0.7817, dev avg loss 0.443036, throughput 9.10962K wps
[Epoch 99 Batch 30/62] avg loss 0.00447774, throughput 9.20825K wps
[Epoch 99 Batch 60/62] avg loss 0.00478863, throughput 9.03031K wps
Begin Testing...
[Epoch 99] train avg loss 0.00475853, dev acc 0.7876, dev avg loss 0.435061, throughput 9.07852K wps
[Epoch 100 Batch 30/62] avg loss 0.00481002, throughput 9.04145K wps
[Epoch 100 Batch 60/62] avg loss 0.00463857, throughput 9.0129K wps
Begin Testing...
[Epoch 100] train avg loss 0.00478835, dev acc 0.7847, dev avg loss 0.435403, throughput 9.05612K wps
[Epoch 101 Batch 30/62] avg loss 0.00443752, throughput 8.7493K wps
[Epoch 101 Batch 60/62] avg loss 0.00467746, throughput 9.07874K wps
Begin Testing...
[Epoch 101] train avg loss 0.00462717, dev acc 0.7817, dev avg loss 0.436055, throughput 8.88966K wps
[Epoch 102 Batch 30/62] avg loss 0.00437963, throughput 9.20635K wps
[Epoch 102 Batch 60/62] avg loss 0.00467054, throughput 8.98489K wps
Begin Testing...
[Epoch 102] train avg loss 0.00462818, dev acc 0.7935, dev avg loss 0.433208, throughput 9.11759K wps
Observed Improvement.
Begin Testing...
[Epoch 103 Batch 30/62] avg loss 0.00455103, throughput 9.0492K wps
[Epoch 103 Batch 60/62] avg loss 0.00435781, throughput 8.7001K wps
Begin Testing...
[Epoch 103] train avg loss 0.00451763, dev acc 0.7817, dev avg loss 0.438947, throughput 8.92708K wps
[Epoch 104 Batch 30/62] avg loss 0.0044202, throughput 9.01905K wps
[Epoch 104 Batch 60/62] avg loss 0.00442528, throughput 9.09457K wps
Begin Testing...
[Epoch 104] train avg loss 0.0044969, dev acc 0.7876, dev avg loss 0.436838, throughput 9.08211K wps
[Epoch 105 Batch 30/62] avg loss 0.00431336, throughput 8.97666K wps
[Epoch 105 Batch 60/62] avg loss 0.00437597, throughput 8.8602K wps
Begin Testing...
[Epoch 105] train avg loss 0.00436084, dev acc 0.7847, dev avg loss 0.43352, throughput 8.94311K wps
[Epoch 106 Batch 30/62] avg loss 0.00472398, throughput 9.02345K wps
[Epoch 106 Batch 60/62] avg loss 0.00424126, throughput 8.90258K wps
Begin Testing...
[Epoch 106] train avg loss 0.00455259, dev acc 0.7876, dev avg loss 0.437098, throughput 8.9318K wps
[Epoch 107 Batch 30/62] avg loss 0.00444354, throughput 9.17728K wps
[Epoch 107 Batch 60/62] avg loss 0.00424965, throughput 8.95486K wps
Begin Testing...
[Epoch 107] train avg loss 0.00449395, dev acc 0.7817, dev avg loss 0.433911, throughput 9.09577K wps
[Epoch 108 Batch 30/62] avg loss 0.00413166, throughput 8.81819K wps
[Epoch 108 Batch 60/62] avg loss 0.00442797, throughput 8.96875K wps
Begin Testing...
[Epoch 108] train avg loss 0.00429746, dev acc 0.7847, dev avg loss 0.434412, throughput 8.91924K wps
[Epoch 109 Batch 30/62] avg loss 0.00414655, throughput 8.7826K wps
[Epoch 109 Batch 60/62] avg loss 0.00433922, throughput 8.96465K wps
Begin Testing...
[Epoch 109] train avg loss 0.00427627, dev acc 0.7876, dev avg loss 0.441341, throughput 8.85502K wps
[Epoch 110 Batch 30/62] avg loss 0.00412201, throughput 8.63604K wps
[Epoch 110 Batch 60/62] avg loss 0.0041733, throughput 8.69707K wps
Begin Testing...
[Epoch 110] train avg loss 0.00418801, dev acc 0.7847, dev avg loss 0.441406, throughput 8.69832K wps
[Epoch 111 Batch 30/62] avg loss 0.00397071, throughput 9.0524K wps
[Epoch 111 Batch 60/62] avg loss 0.00425161, throughput 8.99821K wps
Begin Testing...
[Epoch 111] train avg loss 0.00418499, dev acc 0.7935, dev avg loss 0.42971, throughput 9.05873K wps
Observed Improvement.
Begin Testing...
[Epoch 112 Batch 30/62] avg loss 0.00397489, throughput 8.99585K wps
[Epoch 112 Batch 60/62] avg loss 0.00420692, throughput 8.83154K wps
Begin Testing...
[Epoch 112] train avg loss 0.00412709, dev acc 0.7876, dev avg loss 0.429524, throughput 8.89328K wps
[Epoch 113 Batch 30/62] avg loss 0.00400658, throughput 8.9699K wps
[Epoch 113 Batch 60/62] avg loss 0.00399291, throughput 9.16064K wps
Begin Testing...
[Epoch 113] train avg loss 0.00408331, dev acc 0.7729, dev avg loss 0.445225, throughput 9.09193K wps
[Epoch 114 Batch 30/62] avg loss 0.00373011, throughput 8.86884K wps
[Epoch 114 Batch 60/62] avg loss 0.0040903, throughput 8.83637K wps
Begin Testing...
[Epoch 114] train avg loss 0.00405171, dev acc 0.7935, dev avg loss 0.428247, throughput 8.91223K wps
Observed Improvement.
Begin Testing...
[Epoch 115 Batch 30/62] avg loss 0.00389797, throughput 9.2024K wps
[Epoch 115 Batch 60/62] avg loss 0.00405846, throughput 8.99611K wps
Begin Testing...
[Epoch 115] train avg loss 0.00399328, dev acc 0.7906, dev avg loss 0.428355, throughput 9.12254K wps
[Epoch 116 Batch 30/62] avg loss 0.00376238, throughput 8.98345K wps
[Epoch 116 Batch 60/62] avg loss 0.00413256, throughput 9.09177K wps
Begin Testing...
[Epoch 116] train avg loss 0.00398744, dev acc 0.7876, dev avg loss 0.436119, throughput 9.06962K wps
[Epoch 117 Batch 30/62] avg loss 0.00402337, throughput 9.15273K wps
[Epoch 117 Batch 60/62] avg loss 0.00388802, throughput 8.91771K wps
Begin Testing...
[Epoch 117] train avg loss 0.0040033, dev acc 0.7876, dev avg loss 0.427686, throughput 9.03582K wps
[Epoch 118 Batch 30/62] avg loss 0.00415925, throughput 9.05247K wps
[Epoch 118 Batch 60/62] avg loss 0.00367228, throughput 8.79827K wps
Begin Testing...
[Epoch 118] train avg loss 0.00397251, dev acc 0.7876, dev avg loss 0.436784, throughput 8.90599K wps
[Epoch 119 Batch 30/62] avg loss 0.00402795, throughput 8.94619K wps
[Epoch 119 Batch 60/62] avg loss 0.00362171, throughput 9.06396K wps
Begin Testing...
[Epoch 119] train avg loss 0.0038823, dev acc 0.7847, dev avg loss 0.431128, throughput 9.03573K wps
[Epoch 120 Batch 30/62] avg loss 0.0035915, throughput 9.05031K wps
[Epoch 120 Batch 60/62] avg loss 0.00381277, throughput 8.5207K wps
Begin Testing...
[Epoch 120] train avg loss 0.00374182, dev acc 0.7847, dev avg loss 0.433344, throughput 8.74614K wps
[Epoch 121 Batch 30/62] avg loss 0.00380038, throughput 9.18514K wps
[Epoch 121 Batch 60/62] avg loss 0.00355295, throughput 8.66696K wps
Begin Testing...
[Epoch 121] train avg loss 0.00369276, dev acc 0.7906, dev avg loss 0.4268, throughput 8.89409K wps
[Epoch 122 Batch 30/62] avg loss 0.00371088, throughput 9.18776K wps
[Epoch 122 Batch 60/62] avg loss 0.00355469, throughput 8.74498K wps
Begin Testing...
[Epoch 122] train avg loss 0.00369293, dev acc 0.7817, dev avg loss 0.433443, throughput 8.99594K wps
[Epoch 123 Batch 30/62] avg loss 0.00374689, throughput 8.86686K wps
[Epoch 123 Batch 60/62] avg loss 0.00377639, throughput 8.77988K wps
Begin Testing...
[Epoch 123] train avg loss 0.00377589, dev acc 0.7906, dev avg loss 0.431589, throughput 8.85444K wps
[Epoch 124 Batch 30/62] avg loss 0.00363167, throughput 9.10361K wps
[Epoch 124 Batch 60/62] avg loss 0.00371361, throughput 8.632K wps
Begin Testing...
[Epoch 124] train avg loss 0.00375113, dev acc 0.7935, dev avg loss 0.425694, throughput 8.85589K wps
Observed Improvement.
Begin Testing...
[Epoch 125 Batch 30/62] avg loss 0.00345923, throughput 8.95732K wps
[Epoch 125 Batch 60/62] avg loss 0.00382107, throughput 8.92339K wps
Begin Testing...
[Epoch 125] train avg loss 0.00368457, dev acc 0.7906, dev avg loss 0.426227, throughput 8.94214K wps
[Epoch 126 Batch 30/62] avg loss 0.00353847, throughput 8.83257K wps
[Epoch 126 Batch 60/62] avg loss 0.00346493, throughput 8.9962K wps
Begin Testing...
[Epoch 126] train avg loss 0.00353031, dev acc 0.7935, dev avg loss 0.425531, throughput 8.93575K wps
Observed Improvement.
Begin Testing...
[Epoch 127 Batch 30/62] avg loss 0.00374466, throughput 8.88012K wps
[Epoch 127 Batch 60/62] avg loss 0.00351878, throughput 8.77669K wps
Begin Testing...
[Epoch 127] train avg loss 0.00373304, dev acc 0.7906, dev avg loss 0.424181, throughput 8.86231K wps
[Epoch 128 Batch 30/62] avg loss 0.00353346, throughput 9.13516K wps
[Epoch 128 Batch 60/62] avg loss 0.00352166, throughput 8.46959K wps
Begin Testing...
[Epoch 128] train avg loss 0.00359156, dev acc 0.7906, dev avg loss 0.4235, throughput 8.75207K wps
[Epoch 129 Batch 30/62] avg loss 0.00323864, throughput 8.8086K wps
[Epoch 129 Batch 60/62] avg loss 0.00348807, throughput 9.20791K wps
Begin Testing...
[Epoch 129] train avg loss 0.00343006, dev acc 0.7935, dev avg loss 0.423347, throughput 9.02515K wps
Observed Improvement.
Begin Testing...
[Epoch 130 Batch 30/62] avg loss 0.00332438, throughput 8.80359K wps
[Epoch 130 Batch 60/62] avg loss 0.00337833, throughput 8.69895K wps
Begin Testing...
[Epoch 130] train avg loss 0.00338749, dev acc 0.7876, dev avg loss 0.422227, throughput 8.73962K wps
[Epoch 131 Batch 30/62] avg loss 0.00344843, throughput 8.92503K wps
[Epoch 131 Batch 60/62] avg loss 0.00343683, throughput 9.17352K wps
Begin Testing...
[Epoch 131] train avg loss 0.00348063, dev acc 0.7906, dev avg loss 0.427039, throughput 9.02474K wps
[Epoch 132 Batch 30/62] avg loss 0.00352456, throughput 8.60485K wps
[Epoch 132 Batch 60/62] avg loss 0.00322633, throughput 8.78316K wps
Begin Testing...
[Epoch 132] train avg loss 0.00341311, dev acc 0.7935, dev avg loss 0.424526, throughput 8.72753K wps
Observed Improvement.
Begin Testing...
[Epoch 133 Batch 30/62] avg loss 0.0032559, throughput 8.91631K wps
[Epoch 133 Batch 60/62] avg loss 0.00324954, throughput 8.76707K wps
Begin Testing...
[Epoch 133] train avg loss 0.00327696, dev acc 0.7994, dev avg loss 0.426107, throughput 8.79881K wps
Observed Improvement.
Begin Testing...
[Epoch 134 Batch 30/62] avg loss 0.00337657, throughput 9.00816K wps
[Epoch 134 Batch 60/62] avg loss 0.00336556, throughput 8.81471K wps
Begin Testing...
[Epoch 134] train avg loss 0.00342672, dev acc 0.7876, dev avg loss 0.430255, throughput 8.97045K wps
[Epoch 135 Batch 30/62] avg loss 0.00315107, throughput 8.91183K wps
[Epoch 135 Batch 60/62] avg loss 0.00328617, throughput 8.98897K wps
Begin Testing...
[Epoch 135] train avg loss 0.00330324, dev acc 0.7876, dev avg loss 0.430737, throughput 8.98019K wps
[Epoch 136 Batch 30/62] avg loss 0.00325106, throughput 8.78542K wps
[Epoch 136 Batch 60/62] avg loss 0.00317614, throughput 8.79441K wps
Begin Testing...
[Epoch 136] train avg loss 0.0032311, dev acc 0.7965, dev avg loss 0.42177, throughput 8.81563K wps
[Epoch 137 Batch 30/62] avg loss 0.00315872, throughput 9.14448K wps
[Epoch 137 Batch 60/62] avg loss 0.00316207, throughput 8.52512K wps
Begin Testing...
[Epoch 137] train avg loss 0.00325802, dev acc 0.7876, dev avg loss 0.429659, throughput 8.86216K wps
[Epoch 138 Batch 30/62] avg loss 0.00309776, throughput 8.66242K wps
[Epoch 138 Batch 60/62] avg loss 0.00312549, throughput 8.95285K wps
Begin Testing...
[Epoch 138] train avg loss 0.00314712, dev acc 0.7876, dev avg loss 0.430381, throughput 8.83523K wps
[Epoch 139 Batch 30/62] avg loss 0.00309827, throughput 8.77334K wps
[Epoch 139 Batch 60/62] avg loss 0.00308211, throughput 8.52991K wps
Begin Testing...
[Epoch 139] train avg loss 0.00311917, dev acc 0.7876, dev avg loss 0.431305, throughput 8.64014K wps
[Epoch 140 Batch 30/62] avg loss 0.00308837, throughput 8.69313K wps
[Epoch 140 Batch 60/62] avg loss 0.00313937, throughput 8.7247K wps
Begin Testing...
[Epoch 140] train avg loss 0.00315158, dev acc 0.7935, dev avg loss 0.426414, throughput 8.73579K wps
[Epoch 141 Batch 30/62] avg loss 0.00298033, throughput 9.01737K wps
[Epoch 141 Batch 60/62] avg loss 0.00316809, throughput 8.65074K wps
Begin Testing...
[Epoch 141] train avg loss 0.00308817, dev acc 0.7965, dev avg loss 0.422893, throughput 8.79903K wps
[Epoch 142 Batch 30/62] avg loss 0.0028198, throughput 8.83591K wps
[Epoch 142 Batch 60/62] avg loss 0.0029546, throughput 9.07774K wps
Begin Testing...
[Epoch 142] train avg loss 0.00296375, dev acc 0.7965, dev avg loss 0.422574, throughput 8.98892K wps
[Epoch 143 Batch 30/62] avg loss 0.0029654, throughput 9.03153K wps
[Epoch 143 Batch 60/62] avg loss 0.00295557, throughput 9.05476K wps
Begin Testing...
[Epoch 143] train avg loss 0.00298041, dev acc 0.7994, dev avg loss 0.424636, throughput 9.069K wps
Observed Improvement.
Begin Testing...
[Epoch 144 Batch 30/62] avg loss 0.00269349, throughput 8.98713K wps
[Epoch 144 Batch 60/62] avg loss 0.00296555, throughput 9.05758K wps
Begin Testing...
[Epoch 144] train avg loss 0.00286205, dev acc 0.8024, dev avg loss 0.423919, throughput 9.04534K wps
Observed Improvement.
Begin Testing...
[Epoch 145 Batch 30/62] avg loss 0.00272508, throughput 9.14563K wps
[Epoch 145 Batch 60/62] avg loss 0.00311811, throughput 8.99539K wps
Begin Testing...
[Epoch 145] train avg loss 0.00297296, dev acc 0.7729, dev avg loss 0.440072, throughput 9.10363K wps
[Epoch 146 Batch 30/62] avg loss 0.002841, throughput 8.99385K wps
[Epoch 146 Batch 60/62] avg loss 0.00300878, throughput 8.99118K wps
Begin Testing...
[Epoch 146] train avg loss 0.0029541, dev acc 0.8024, dev avg loss 0.423064, throughput 9.02517K wps
Observed Improvement.
Begin Testing...
[Epoch 147 Batch 30/62] avg loss 0.00289548, throughput 9.0247K wps
[Epoch 147 Batch 60/62] avg loss 0.00287539, throughput 9.11117K wps
Begin Testing...
[Epoch 147] train avg loss 0.00293228, dev acc 0.7906, dev avg loss 0.426781, throughput 9.10287K wps
[Epoch 148 Batch 30/62] avg loss 0.0028055, throughput 9.29699K wps
[Epoch 148 Batch 60/62] avg loss 0.00296215, throughput 8.66304K wps
Begin Testing...
[Epoch 148] train avg loss 0.00289325, dev acc 0.7965, dev avg loss 0.424403, throughput 8.95255K wps
[Epoch 149 Batch 30/62] avg loss 0.00284643, throughput 8.65416K wps
[Epoch 149 Batch 60/62] avg loss 0.00291922, throughput 8.96915K wps
Begin Testing...
[Epoch 149] train avg loss 0.00292253, dev acc 0.8053, dev avg loss 0.421102, throughput 8.80407K wps
Observed Improvement.
Begin Testing...
[Epoch 150 Batch 30/62] avg loss 0.00280223, throughput 8.98051K wps
[Epoch 150 Batch 60/62] avg loss 0.00285907, throughput 8.67637K wps
Begin Testing...
[Epoch 150] train avg loss 0.0028856, dev acc 0.8024, dev avg loss 0.421889, throughput 8.7944K wps
[Epoch 151 Batch 30/62] avg loss 0.00278926, throughput 8.90994K wps
[Epoch 151 Batch 60/62] avg loss 0.00267572, throughput 8.975K wps
Begin Testing...
[Epoch 151] train avg loss 0.00276386, dev acc 0.7935, dev avg loss 0.426802, throughput 8.91804K wps
[Epoch 152 Batch 30/62] avg loss 0.00278897, throughput 9.00757K wps
[Epoch 152 Batch 60/62] avg loss 0.00266726, throughput 8.87521K wps
Begin Testing...
[Epoch 152] train avg loss 0.00276118, dev acc 0.8024, dev avg loss 0.422224, throughput 8.89362K wps
[Epoch 153 Batch 30/62] avg loss 0.00268328, throughput 8.90177K wps
[Epoch 153 Batch 60/62] avg loss 0.00289155, throughput 8.84277K wps
Begin Testing...
[Epoch 153] train avg loss 0.00282022, dev acc 0.7994, dev avg loss 0.424429, throughput 8.88884K wps
[Epoch 154 Batch 30/62] avg loss 0.00259558, throughput 9.15225K wps
[Epoch 154 Batch 60/62] avg loss 0.00276598, throughput 8.7128K wps
Begin Testing...
[Epoch 154] train avg loss 0.00271109, dev acc 0.8024, dev avg loss 0.422797, throughput 8.98619K wps
[Epoch 155 Batch 30/62] avg loss 0.00272868, throughput 8.90245K wps
[Epoch 155 Batch 60/62] avg loss 0.00263382, throughput 8.82067K wps
Begin Testing...
[Epoch 155] train avg loss 0.00275815, dev acc 0.8024, dev avg loss 0.418826, throughput 8.88358K wps
[Epoch 156 Batch 30/62] avg loss 0.00263676, throughput 9.02987K wps
[Epoch 156 Batch 60/62] avg loss 0.00262429, throughput 8.64649K wps
Begin Testing...
[Epoch 156] train avg loss 0.00264028, dev acc 0.8024, dev avg loss 0.421757, throughput 8.86783K wps
[Epoch 157 Batch 30/62] avg loss 0.00251256, throughput 8.84484K wps
[Epoch 157 Batch 60/62] avg loss 0.00246124, throughput 8.58513K wps
Begin Testing...
[Epoch 157] train avg loss 0.00255421, dev acc 0.8083, dev avg loss 0.42092, throughput 8.76366K wps
Observed Improvement.
Begin Testing...
[Epoch 158 Batch 30/62] avg loss 0.00271286, throughput 9.2018K wps
[Epoch 158 Batch 60/62] avg loss 0.00256727, throughput 8.90255K wps
Begin Testing...
[Epoch 158] train avg loss 0.00269087, dev acc 0.7935, dev avg loss 0.424436, throughput 9.0201K wps
[Epoch 159 Batch 30/62] avg loss 0.00250403, throughput 8.84108K wps
[Epoch 159 Batch 60/62] avg loss 0.00251985, throughput 8.99861K wps
Begin Testing...
[Epoch 159] train avg loss 0.00257394, dev acc 0.8112, dev avg loss 0.420093, throughput 8.95191K wps
Observed Improvement.
Begin Testing...
[Epoch 160 Batch 30/62] avg loss 0.00248013, throughput 8.75886K wps
[Epoch 160 Batch 60/62] avg loss 0.00255827, throughput 8.84307K wps
Begin Testing...
[Epoch 160] train avg loss 0.00256202, dev acc 0.8083, dev avg loss 0.420762, throughput 8.83338K wps
[Epoch 161 Batch 30/62] avg loss 0.00234594, throughput 9.14287K wps
[Epoch 161 Batch 60/62] avg loss 0.00255657, throughput 8.79413K wps
Begin Testing...
[Epoch 161] train avg loss 0.00247138, dev acc 0.7994, dev avg loss 0.419362, throughput 8.93424K wps
[Epoch 162 Batch 30/62] avg loss 0.00248662, throughput 8.71503K wps
[Epoch 162 Batch 60/62] avg loss 0.0025293, throughput 8.62252K wps
Begin Testing...
[Epoch 162] train avg loss 0.00252822, dev acc 0.7965, dev avg loss 0.423547, throughput 8.65341K wps
[Epoch 163 Batch 30/62] avg loss 0.00232153, throughput 8.94626K wps
[Epoch 163 Batch 60/62] avg loss 0.00257234, throughput 8.9088K wps
Begin Testing...
[Epoch 163] train avg loss 0.00245258, dev acc 0.7935, dev avg loss 0.426671, throughput 8.88798K wps
[Epoch 164 Batch 30/62] avg loss 0.00233585, throughput 8.80473K wps
[Epoch 164 Batch 60/62] avg loss 0.00258645, throughput 8.84569K wps
Begin Testing...
[Epoch 164] train avg loss 0.00251408, dev acc 0.7847, dev avg loss 0.428911, throughput 8.85692K wps
[Epoch 165 Batch 30/62] avg loss 0.00233556, throughput 9.00209K wps
[Epoch 165 Batch 60/62] avg loss 0.00233781, throughput 9.04429K wps
Begin Testing...
[Epoch 165] train avg loss 0.00238464, dev acc 0.8083, dev avg loss 0.420979, throughput 9.03055K wps
[Epoch 166 Batch 30/62] avg loss 0.00246748, throughput 9.11257K wps
[Epoch 166 Batch 60/62] avg loss 0.00240498, throughput 9.07708K wps
Begin Testing...
[Epoch 166] train avg loss 0.00248059, dev acc 0.7994, dev avg loss 0.419322, throughput 9.12235K wps
[Epoch 167 Batch 30/62] avg loss 0.00236326, throughput 9.17847K wps
[Epoch 167 Batch 60/62] avg loss 0.00225813, throughput 8.60468K wps
Begin Testing...
[Epoch 167] train avg loss 0.00231335, dev acc 0.7935, dev avg loss 0.426265, throughput 8.91132K wps
[Epoch 168 Batch 30/62] avg loss 0.00224474, throughput 9.20878K wps
[Epoch 168 Batch 60/62] avg loss 0.00238311, throughput 8.79704K wps
Begin Testing...
[Epoch 168] train avg loss 0.00233024, dev acc 0.8083, dev avg loss 0.421015, throughput 8.97001K wps
[Epoch 169 Batch 30/62] avg loss 0.00224667, throughput 9.19664K wps
[Epoch 169 Batch 60/62] avg loss 0.00250763, throughput 9.17966K wps
Begin Testing...
[Epoch 169] train avg loss 0.00237936, dev acc 0.8053, dev avg loss 0.421906, throughput 9.16836K wps
[Epoch 170 Batch 30/62] avg loss 0.00240181, throughput 8.8366K wps
[Epoch 170 Batch 60/62] avg loss 0.00227408, throughput 8.56269K wps
Begin Testing...
[Epoch 170] train avg loss 0.00234212, dev acc 0.7994, dev avg loss 0.423233, throughput 8.68891K wps
[Epoch 171 Batch 30/62] avg loss 0.00221878, throughput 8.76344K wps
[Epoch 171 Batch 60/62] avg loss 0.00231237, throughput 8.99405K wps
Begin Testing...
[Epoch 171] train avg loss 0.00228603, dev acc 0.8053, dev avg loss 0.422252, throughput 8.86197K wps
[Epoch 172 Batch 30/62] avg loss 0.00233992, throughput 9.04601K wps
[Epoch 172 Batch 60/62] avg loss 0.00230002, throughput 8.84382K wps
Begin Testing...
[Epoch 172] train avg loss 0.00234986, dev acc 0.8053, dev avg loss 0.421809, throughput 8.97657K wps
[Epoch 173 Batch 30/62] avg loss 0.00224268, throughput 9.10769K wps
[Epoch 173 Batch 60/62] avg loss 0.00218743, throughput 8.77585K wps
Begin Testing...
[Epoch 173] train avg loss 0.00225614, dev acc 0.7994, dev avg loss 0.424812, throughput 8.9244K wps
[Epoch 174 Batch 30/62] avg loss 0.00228851, throughput 8.85942K wps
[Epoch 174 Batch 60/62] avg loss 0.00239809, throughput 8.99987K wps
Begin Testing...
[Epoch 174] train avg loss 0.00237221, dev acc 0.8053, dev avg loss 0.422308, throughput 8.96015K wps
[Epoch 175 Batch 30/62] avg loss 0.00222719, throughput 8.60518K wps
[Epoch 175 Batch 60/62] avg loss 0.00222286, throughput 8.84573K wps
Begin Testing...
[Epoch 175] train avg loss 0.00224355, dev acc 0.7994, dev avg loss 0.425289, throughput 8.76373K wps
[Epoch 176 Batch 30/62] avg loss 0.00223715, throughput 8.84845K wps
[Epoch 176 Batch 60/62] avg loss 0.00232483, throughput 8.50401K wps
Begin Testing...
[Epoch 176] train avg loss 0.00233145, dev acc 0.8053, dev avg loss 0.421856, throughput 8.6601K wps
[Epoch 177 Batch 30/62] avg loss 0.00221748, throughput 8.96643K wps
[Epoch 177 Batch 60/62] avg loss 0.00218907, throughput 8.79059K wps
Begin Testing...
[Epoch 177] train avg loss 0.0022142, dev acc 0.8053, dev avg loss 0.422961, throughput 8.94889K wps
[Epoch 178 Batch 30/62] avg loss 0.00217437, throughput 8.53569K wps
[Epoch 178 Batch 60/62] avg loss 0.00209815, throughput 8.91026K wps
Begin Testing...
[Epoch 178] train avg loss 0.00214789, dev acc 0.7876, dev avg loss 0.430803, throughput 8.75917K wps
[Epoch 179 Batch 30/62] avg loss 0.00207293, throughput 9.07973K wps
[Epoch 179 Batch 60/62] avg loss 0.00225089, throughput 8.90946K wps
Begin Testing...
[Epoch 179] train avg loss 0.00218351, dev acc 0.8024, dev avg loss 0.426405, throughput 9.02379K wps
[Epoch 180 Batch 30/62] avg loss 0.00209003, throughput 9.02995K wps
[Epoch 180 Batch 60/62] avg loss 0.00215249, throughput 8.72966K wps
Begin Testing...
[Epoch 180] train avg loss 0.00218033, dev acc 0.8083, dev avg loss 0.420349, throughput 8.86033K wps
[Epoch 181 Batch 30/62] avg loss 0.00212849, throughput 8.75704K wps
[Epoch 181 Batch 60/62] avg loss 0.00208273, throughput 8.7304K wps
Begin Testing...
[Epoch 181] train avg loss 0.00211398, dev acc 0.8024, dev avg loss 0.424808, throughput 8.77337K wps
[Epoch 182 Batch 30/62] avg loss 0.00205069, throughput 8.65534K wps
[Epoch 182 Batch 60/62] avg loss 0.00203389, throughput 8.54765K wps
Begin Testing...
[Epoch 182] train avg loss 0.00206023, dev acc 0.8024, dev avg loss 0.42606, throughput 8.64073K wps
[Epoch 183 Batch 30/62] avg loss 0.00191706, throughput 8.94069K wps
[Epoch 183 Batch 60/62] avg loss 0.00219421, throughput 9.14803K wps
Begin Testing...
[Epoch 183] train avg loss 0.00209439, dev acc 0.8053, dev avg loss 0.420766, throughput 9.07177K wps
[Epoch 184 Batch 30/62] avg loss 0.00207782, throughput 8.95148K wps
[Epoch 184 Batch 60/62] avg loss 0.00209149, throughput 9.02419K wps
Begin Testing...
[Epoch 184] train avg loss 0.00211654, dev acc 0.8053, dev avg loss 0.423249, throughput 9.01563K wps
[Epoch 185 Batch 30/62] avg loss 0.00208776, throughput 9.03587K wps
[Epoch 185 Batch 60/62] avg loss 0.00196702, throughput 8.31143K wps
Begin Testing...
[Epoch 185] train avg loss 0.00208014, dev acc 0.7758, dev avg loss 0.442834, throughput 8.68089K wps
[Epoch 186 Batch 30/62] avg loss 0.00194659, throughput 9.1396K wps
[Epoch 186 Batch 60/62] avg loss 0.00202733, throughput 8.92562K wps
Begin Testing...
[Epoch 186] train avg loss 0.00200453, dev acc 0.8024, dev avg loss 0.420835, throughput 9.05703K wps
[Epoch 187 Batch 30/62] avg loss 0.00204315, throughput 9.01891K wps
[Epoch 187 Batch 60/62] avg loss 0.00193868, throughput 8.97482K wps
Begin Testing...
[Epoch 187] train avg loss 0.00204603, dev acc 0.8053, dev avg loss 0.42163, throughput 9.02907K wps
[Epoch 188 Batch 30/62] avg loss 0.00196163, throughput 8.80446K wps
[Epoch 188 Batch 60/62] avg loss 0.00185505, throughput 8.91304K wps
Begin Testing...
[Epoch 188] train avg loss 0.00193467, dev acc 0.7876, dev avg loss 0.430401, throughput 8.88439K wps
[Epoch 189 Batch 30/62] avg loss 0.00192069, throughput 9.10427K wps
[Epoch 189 Batch 60/62] avg loss 0.00198972, throughput 8.98141K wps
Begin Testing...
[Epoch 189] train avg loss 0.00198315, dev acc 0.7906, dev avg loss 0.427137, throughput 9.02672K wps
[Epoch 190 Batch 30/62] avg loss 0.00205078, throughput 9.25492K wps
[Epoch 190 Batch 60/62] avg loss 0.00186315, throughput 9.06478K wps
Begin Testing...
[Epoch 190] train avg loss 0.00200289, dev acc 0.8083, dev avg loss 0.420237, throughput 9.19083K wps
[Epoch 191 Batch 30/62] avg loss 0.00196015, throughput 8.79516K wps
[Epoch 191 Batch 60/62] avg loss 0.00196923, throughput 8.9206K wps
Begin Testing...
[Epoch 191] train avg loss 0.00197638, dev acc 0.8024, dev avg loss 0.424178, throughput 8.8631K wps
[Epoch 192 Batch 30/62] avg loss 0.00198265, throughput 8.92821K wps
[Epoch 192 Batch 60/62] avg loss 0.00204472, throughput 8.85283K wps
Begin Testing...
[Epoch 192] train avg loss 0.00202505, dev acc 0.8024, dev avg loss 0.420891, throughput 8.86983K wps
[Epoch 193 Batch 30/62] avg loss 0.00189804, throughput 8.82657K wps
[Epoch 193 Batch 60/62] avg loss 0.001898, throughput 8.77824K wps
Begin Testing...
[Epoch 193] train avg loss 0.00190229, dev acc 0.8053, dev avg loss 0.424604, throughput 8.8437K wps
[Epoch 194 Batch 30/62] avg loss 0.00191501, throughput 8.80399K wps
[Epoch 194 Batch 60/62] avg loss 0.00188742, throughput 9.04787K wps
Begin Testing...
[Epoch 194] train avg loss 0.00190791, dev acc 0.7876, dev avg loss 0.432369, throughput 8.95325K wps
[Epoch 195 Batch 30/62] avg loss 0.00189829, throughput 8.99569K wps
[Epoch 195 Batch 60/62] avg loss 0.001775, throughput 9.1751K wps
Begin Testing...
[Epoch 195] train avg loss 0.00185047, dev acc 0.8024, dev avg loss 0.42665, throughput 9.10792K wps
[Epoch 196 Batch 30/62] avg loss 0.00189281, throughput 8.91507K wps
[Epoch 196 Batch 60/62] avg loss 0.00184811, throughput 8.90303K wps
Begin Testing...
[Epoch 196] train avg loss 0.00189829, dev acc 0.7788, dev avg loss 0.43831, throughput 8.93746K wps
[Epoch 197 Batch 30/62] avg loss 0.00185356, throughput 8.40859K wps
[Epoch 197 Batch 60/62] avg loss 0.00186289, throughput 8.83525K wps
Begin Testing...
[Epoch 197] train avg loss 0.00186604, dev acc 0.7965, dev avg loss 0.429281, throughput 8.65692K wps
[Epoch 198 Batch 30/62] avg loss 0.00173432, throughput 9.15649K wps
[Epoch 198 Batch 60/62] avg loss 0.00194553, throughput 8.95986K wps
Begin Testing...
[Epoch 198] train avg loss 0.00188474, dev acc 0.8053, dev avg loss 0.423658, throughput 9.03767K wps
[Epoch 199 Batch 30/62] avg loss 0.00178902, throughput 9.07478K wps
[Epoch 199 Batch 60/62] avg loss 0.00166157, throughput 9.05084K wps
Begin Testing...
[Epoch 199] train avg loss 0.00174182, dev acc 0.8053, dev avg loss 0.427425, throughput 9.09219K wps
Test loss 0.365047, test acc 0.8515
Total time cost 156.38s
[Epoch 0 Batch 30/62] avg loss 0.0134084, throughput 8.12252K wps
[Epoch 0 Batch 60/62] avg loss 0.0132416, throughput 8.9896K wps
Begin Testing...
[Epoch 0] train avg loss 0.0136013, dev acc 0.6519, dev avg loss 0.646378, throughput 8.51597K wps
Observed Improvement.
Begin Testing...
[Epoch 1 Batch 30/62] avg loss 0.0132499, throughput 9.0766K wps
[Epoch 1 Batch 60/62] avg loss 0.0130461, throughput 9.03345K wps
Begin Testing...
[Epoch 1] train avg loss 0.0133793, dev acc 0.6519, dev avg loss 0.641433, throughput 9.08754K wps
Observed Improvement.
Begin Testing...
[Epoch 2 Batch 30/62] avg loss 0.0131817, throughput 8.92212K wps
[Epoch 2 Batch 60/62] avg loss 0.0130766, throughput 8.792K wps
Begin Testing...
[Epoch 2] train avg loss 0.0133301, dev acc 0.6519, dev avg loss 0.637697, throughput 8.89284K wps
Observed Improvement.
Begin Testing...
[Epoch 3 Batch 30/62] avg loss 0.0128734, throughput 8.96514K wps
[Epoch 3 Batch 60/62] avg loss 0.0131646, throughput 8.85065K wps
Begin Testing...
[Epoch 3] train avg loss 0.0131625, dev acc 0.6519, dev avg loss 0.631204, throughput 8.91998K wps
Observed Improvement.
Begin Testing...
[Epoch 4 Batch 30/62] avg loss 0.0130971, throughput 8.77427K wps
[Epoch 4 Batch 60/62] avg loss 0.0127191, throughput 8.79167K wps
Begin Testing...
[Epoch 4] train avg loss 0.0130925, dev acc 0.6519, dev avg loss 0.626926, throughput 8.80821K wps
Observed Improvement.
Begin Testing...
[Epoch 5 Batch 30/62] avg loss 0.0127939, throughput 9.00991K wps
[Epoch 5 Batch 60/62] avg loss 0.0128705, throughput 8.97303K wps
Begin Testing...
[Epoch 5] train avg loss 0.0129955, dev acc 0.6519, dev avg loss 0.62167, throughput 8.97856K wps
Observed Improvement.
Begin Testing...
[Epoch 6 Batch 30/62] avg loss 0.0126694, throughput 8.77721K wps
[Epoch 6 Batch 60/62] avg loss 0.0126298, throughput 8.9749K wps
Begin Testing...
[Epoch 6] train avg loss 0.0128014, dev acc 0.6519, dev avg loss 0.617476, throughput 8.90085K wps
Observed Improvement.
Begin Testing...
[Epoch 7 Batch 30/62] avg loss 0.0123978, throughput 9.08319K wps
[Epoch 7 Batch 60/62] avg loss 0.012572, throughput 9.03295K wps
Begin Testing...
[Epoch 7] train avg loss 0.012626, dev acc 0.6519, dev avg loss 0.613016, throughput 9.07633K wps
Observed Improvement.
Begin Testing...
[Epoch 8 Batch 30/62] avg loss 0.0125463, throughput 8.78036K wps
[Epoch 8 Batch 60/62] avg loss 0.0124839, throughput 8.97733K wps
Begin Testing...
[Epoch 8] train avg loss 0.0127086, dev acc 0.6519, dev avg loss 0.609171, throughput 8.8986K wps
Observed Improvement.
Begin Testing...
[Epoch 9 Batch 30/62] avg loss 0.0124301, throughput 8.95201K wps
[Epoch 9 Batch 60/62] avg loss 0.0125049, throughput 8.96542K wps
Begin Testing...
[Epoch 9] train avg loss 0.0125977, dev acc 0.6519, dev avg loss 0.604324, throughput 8.98988K wps
Observed Improvement.
Begin Testing...
[Epoch 10 Batch 30/62] avg loss 0.0123616, throughput 9.0773K wps
[Epoch 10 Batch 60/62] avg loss 0.0122457, throughput 8.96375K wps
Begin Testing...
[Epoch 10] train avg loss 0.0124719, dev acc 0.6519, dev avg loss 0.60072, throughput 9.0451K wps
Observed Improvement.
Begin Testing...
[Epoch 11 Batch 30/62] avg loss 0.0121717, throughput 8.6229K wps
[Epoch 11 Batch 60/62] avg loss 0.0122025, throughput 8.82162K wps
Begin Testing...
[Epoch 11] train avg loss 0.0123273, dev acc 0.6519, dev avg loss 0.595392, throughput 8.73205K wps
Observed Improvement.
Begin Testing...
[Epoch 12 Batch 30/62] avg loss 0.0121036, throughput 8.95581K wps
[Epoch 12 Batch 60/62] avg loss 0.0120947, throughput 8.95668K wps
Begin Testing...
[Epoch 12] train avg loss 0.0122269, dev acc 0.6519, dev avg loss 0.590735, throughput 8.98676K wps
Observed Improvement.
Begin Testing...
[Epoch 13 Batch 30/62] avg loss 0.0121972, throughput 8.46755K wps
[Epoch 13 Batch 60/62] avg loss 0.0118225, throughput 8.7255K wps
Begin Testing...
[Epoch 13] train avg loss 0.0121688, dev acc 0.6578, dev avg loss 0.586446, throughput 8.63069K wps
Observed Improvement.
Begin Testing...
[Epoch 14 Batch 30/62] avg loss 0.0118923, throughput 8.4764K wps
[Epoch 14 Batch 60/62] avg loss 0.011918, throughput 8.7925K wps
Begin Testing...
[Epoch 14] train avg loss 0.0120473, dev acc 0.6578, dev avg loss 0.581515, throughput 8.60963K wps
Observed Improvement.
Begin Testing...
[Epoch 15 Batch 30/62] avg loss 0.011708, throughput 8.89652K wps
[Epoch 15 Batch 60/62] avg loss 0.011695, throughput 8.75959K wps
Begin Testing...
[Epoch 15] train avg loss 0.0118705, dev acc 0.6578, dev avg loss 0.576763, throughput 8.86557K wps
Observed Improvement.
Begin Testing...
[Epoch 16 Batch 30/62] avg loss 0.0116895, throughput 9.19537K wps
[Epoch 16 Batch 60/62] avg loss 0.0118167, throughput 8.98251K wps
Begin Testing...
[Epoch 16] train avg loss 0.0118401, dev acc 0.6578, dev avg loss 0.57204, throughput 9.11294K wps
Observed Improvement.
Begin Testing...
[Epoch 17 Batch 30/62] avg loss 0.0116192, throughput 9.00798K wps
[Epoch 17 Batch 60/62] avg loss 0.0115293, throughput 9.14563K wps
Begin Testing...
[Epoch 17] train avg loss 0.0118029, dev acc 0.6844, dev avg loss 0.568623, throughput 9.10102K wps
Observed Improvement.
Begin Testing...
[Epoch 18 Batch 30/62] avg loss 0.0114998, throughput 9.23671K wps
[Epoch 18 Batch 60/62] avg loss 0.0113144, throughput 8.62249K wps
Begin Testing...
[Epoch 18] train avg loss 0.0116007, dev acc 0.6696, dev avg loss 0.562428, throughput 8.91152K wps
[Epoch 19 Batch 30/62] avg loss 0.0114908, throughput 9.00945K wps
[Epoch 19 Batch 60/62] avg loss 0.0111587, throughput 8.53928K wps
Begin Testing...
[Epoch 19] train avg loss 0.0114765, dev acc 0.6785, dev avg loss 0.557292, throughput 8.80263K wps
[Epoch 20 Batch 30/62] avg loss 0.0110809, throughput 9.19975K wps
[Epoch 20 Batch 60/62] avg loss 0.01144, throughput 8.83786K wps
Begin Testing...
[Epoch 20] train avg loss 0.0114317, dev acc 0.6844, dev avg loss 0.552318, throughput 9.04733K wps
Observed Improvement.
Begin Testing...
[Epoch 21 Batch 30/62] avg loss 0.0111855, throughput 8.8768K wps
[Epoch 21 Batch 60/62] avg loss 0.0108549, throughput 9.04789K wps
Begin Testing...
[Epoch 21] train avg loss 0.01115, dev acc 0.6932, dev avg loss 0.547381, throughput 8.99394K wps
Observed Improvement.
Begin Testing...
[Epoch 22 Batch 30/62] avg loss 0.0110483, throughput 8.98065K wps
[Epoch 22 Batch 60/62] avg loss 0.0109578, throughput 8.95396K wps
Begin Testing...
[Epoch 22] train avg loss 0.0111906, dev acc 0.7168, dev avg loss 0.542607, throughput 8.9929K wps
Observed Improvement.
Begin Testing...
[Epoch 23 Batch 30/62] avg loss 0.0109579, throughput 8.95179K wps
[Epoch 23 Batch 60/62] avg loss 0.0108204, throughput 8.99271K wps
Begin Testing...
[Epoch 23] train avg loss 0.0110444, dev acc 0.6962, dev avg loss 0.536984, throughput 8.99915K wps
[Epoch 24 Batch 30/62] avg loss 0.0110109, throughput 9.07924K wps
[Epoch 24 Batch 60/62] avg loss 0.0107516, throughput 8.67329K wps
Begin Testing...
[Epoch 24] train avg loss 0.0109591, dev acc 0.6873, dev avg loss 0.533993, throughput 8.83807K wps
[Epoch 25 Batch 30/62] avg loss 0.0106354, throughput 8.9419K wps
[Epoch 25 Batch 60/62] avg loss 0.0105184, throughput 8.98798K wps
Begin Testing...
[Epoch 25] train avg loss 0.0106892, dev acc 0.6903, dev avg loss 0.527583, throughput 8.99139K wps
[Epoch 26 Batch 30/62] avg loss 0.010787, throughput 8.64675K wps
[Epoch 26 Batch 60/62] avg loss 0.0103925, throughput 9.13513K wps
Begin Testing...
[Epoch 26] train avg loss 0.0107071, dev acc 0.7198, dev avg loss 0.521603, throughput 8.9104K wps
Observed Improvement.
Begin Testing...
[Epoch 27 Batch 30/62] avg loss 0.0103462, throughput 8.34666K wps
[Epoch 27 Batch 60/62] avg loss 0.0104715, throughput 8.89691K wps
Begin Testing...
[Epoch 27] train avg loss 0.0105473, dev acc 0.7906, dev avg loss 0.518699, throughput 8.67399K wps
Observed Improvement.
Begin Testing...
[Epoch 28 Batch 30/62] avg loss 0.0103908, throughput 8.95955K wps
[Epoch 28 Batch 60/62] avg loss 0.0103552, throughput 9.04524K wps
Begin Testing...
[Epoch 28] train avg loss 0.010506, dev acc 0.7935, dev avg loss 0.512949, throughput 8.97846K wps
Observed Improvement.
Begin Testing...
[Epoch 29 Batch 30/62] avg loss 0.0100524, throughput 8.96164K wps
[Epoch 29 Batch 60/62] avg loss 0.0103543, throughput 8.88112K wps
Begin Testing...
[Epoch 29] train avg loss 0.0103612, dev acc 0.7906, dev avg loss 0.508783, throughput 8.94864K wps
[Epoch 30 Batch 30/62] avg loss 0.0101002, throughput 8.64004K wps
[Epoch 30 Batch 60/62] avg loss 0.00997862, throughput 8.88905K wps
Begin Testing...
[Epoch 30] train avg loss 0.0101803, dev acc 0.7522, dev avg loss 0.502635, throughput 8.79825K wps
[Epoch 31 Batch 30/62] avg loss 0.00991801, throughput 9.13332K wps
[Epoch 31 Batch 60/62] avg loss 0.0100154, throughput 8.73216K wps
Begin Testing...
[Epoch 31] train avg loss 0.0101106, dev acc 0.8083, dev avg loss 0.497985, throughput 9.00538K wps
Observed Improvement.
Begin Testing...
[Epoch 32 Batch 30/62] avg loss 0.00958606, throughput 8.72932K wps
[Epoch 32 Batch 60/62] avg loss 0.00983834, throughput 9.00842K wps
Begin Testing...
[Epoch 32] train avg loss 0.00992195, dev acc 0.7906, dev avg loss 0.500965, throughput 8.8924K wps
[Epoch 33 Batch 30/62] avg loss 0.00958483, throughput 8.93758K wps
[Epoch 33 Batch 60/62] avg loss 0.00972935, throughput 9.14124K wps
Begin Testing...
[Epoch 33] train avg loss 0.00977138, dev acc 0.8142, dev avg loss 0.48885, throughput 9.0142K wps
Observed Improvement.
Begin Testing...
[Epoch 34 Batch 30/62] avg loss 0.00949895, throughput 9.13687K wps
[Epoch 34 Batch 60/62] avg loss 0.00974282, throughput 8.96922K wps
Begin Testing...
[Epoch 34] train avg loss 0.00970761, dev acc 0.7935, dev avg loss 0.485517, throughput 9.03142K wps
[Epoch 35 Batch 30/62] avg loss 0.00949559, throughput 8.64836K wps
[Epoch 35 Batch 60/62] avg loss 0.00923331, throughput 8.76747K wps
Begin Testing...
[Epoch 35] train avg loss 0.00949978, dev acc 0.7935, dev avg loss 0.48104, throughput 8.74645K wps
[Epoch 36 Batch 30/62] avg loss 0.00922025, throughput 8.94978K wps
[Epoch 36 Batch 60/62] avg loss 0.00953672, throughput 9.04623K wps
Begin Testing...
[Epoch 36] train avg loss 0.00952645, dev acc 0.7847, dev avg loss 0.479037, throughput 8.96576K wps
[Epoch 37 Batch 30/62] avg loss 0.00933602, throughput 8.96717K wps
[Epoch 37 Batch 60/62] avg loss 0.00919996, throughput 9.1166K wps
Begin Testing...
[Epoch 37] train avg loss 0.00934359, dev acc 0.7994, dev avg loss 0.473164, throughput 9.06882K wps
[Epoch 38 Batch 30/62] avg loss 0.00919923, throughput 9.16271K wps
[Epoch 38 Batch 60/62] avg loss 0.00907483, throughput 8.72633K wps
Begin Testing...
[Epoch 38] train avg loss 0.00923613, dev acc 0.7876, dev avg loss 0.470864, throughput 9.01444K wps
[Epoch 39 Batch 30/62] avg loss 0.00890261, throughput 9.25207K wps
[Epoch 39 Batch 60/62] avg loss 0.00903689, throughput 8.81036K wps
Begin Testing...
[Epoch 39] train avg loss 0.00904802, dev acc 0.8024, dev avg loss 0.46572, throughput 9.05246K wps
[Epoch 40 Batch 30/62] avg loss 0.00903063, throughput 8.66224K wps
[Epoch 40 Batch 60/62] avg loss 0.00862254, throughput 8.77115K wps
Begin Testing...
[Epoch 40] train avg loss 0.00902659, dev acc 0.8024, dev avg loss 0.462435, throughput 8.78006K wps
[Epoch 41 Batch 30/62] avg loss 0.00860335, throughput 9.09162K wps
[Epoch 41 Batch 60/62] avg loss 0.00887006, throughput 8.9868K wps
Begin Testing...
[Epoch 41] train avg loss 0.00884379, dev acc 0.7758, dev avg loss 0.465088, throughput 9.06697K wps
[Epoch 42 Batch 30/62] avg loss 0.00880283, throughput 8.88396K wps
[Epoch 42 Batch 60/62] avg loss 0.00855287, throughput 8.79448K wps
Begin Testing...
[Epoch 42] train avg loss 0.00873973, dev acc 0.7935, dev avg loss 0.455754, throughput 8.86928K wps
[Epoch 43 Batch 30/62] avg loss 0.00845829, throughput 8.76063K wps
[Epoch 43 Batch 60/62] avg loss 0.00854343, throughput 8.58251K wps
Begin Testing...
[Epoch 43] train avg loss 0.00861885, dev acc 0.7935, dev avg loss 0.453767, throughput 8.64427K wps
[Epoch 44 Batch 30/62] avg loss 0.00857975, throughput 8.64639K wps
[Epoch 44 Batch 60/62] avg loss 0.00844045, throughput 8.98408K wps
Begin Testing...
[Epoch 44] train avg loss 0.00860079, dev acc 0.7994, dev avg loss 0.449373, throughput 8.79938K wps
[Epoch 45 Batch 30/62] avg loss 0.00825844, throughput 8.94712K wps
[Epoch 45 Batch 60/62] avg loss 0.00855509, throughput 8.91368K wps
Begin Testing...
[Epoch 45] train avg loss 0.00853207, dev acc 0.7935, dev avg loss 0.447333, throughput 8.89244K wps
[Epoch 46 Batch 30/62] avg loss 0.00818482, throughput 8.96079K wps
[Epoch 46 Batch 60/62] avg loss 0.00841137, throughput 8.94946K wps
Begin Testing...
[Epoch 46] train avg loss 0.00836291, dev acc 0.8083, dev avg loss 0.443702, throughput 8.98503K wps
[Epoch 47 Batch 30/62] avg loss 0.0083225, throughput 9.20976K wps
[Epoch 47 Batch 60/62] avg loss 0.00827202, throughput 8.9245K wps
Begin Testing...
[Epoch 47] train avg loss 0.0083418, dev acc 0.8024, dev avg loss 0.44129, throughput 9.09828K wps
[Epoch 48 Batch 30/62] avg loss 0.00824674, throughput 8.97363K wps
[Epoch 48 Batch 60/62] avg loss 0.00807345, throughput 9.08134K wps
Begin Testing...
[Epoch 48] train avg loss 0.00822595, dev acc 0.8053, dev avg loss 0.438852, throughput 9.05911K wps
[Epoch 49 Batch 30/62] avg loss 0.00828721, throughput 9.2021K wps
[Epoch 49 Batch 60/62] avg loss 0.00798585, throughput 9.0041K wps
Begin Testing...
[Epoch 49] train avg loss 0.00822864, dev acc 0.8083, dev avg loss 0.436528, throughput 9.13079K wps
[Epoch 50 Batch 30/62] avg loss 0.00783588, throughput 9.26415K wps
[Epoch 50 Batch 60/62] avg loss 0.00802702, throughput 8.99288K wps
Begin Testing...
[Epoch 50] train avg loss 0.00802471, dev acc 0.7994, dev avg loss 0.434627, throughput 9.1546K wps
[Epoch 51 Batch 30/62] avg loss 0.00814266, throughput 9.15864K wps
[Epoch 51 Batch 60/62] avg loss 0.00786801, throughput 8.9489K wps
Begin Testing...
[Epoch 51] train avg loss 0.00816771, dev acc 0.8024, dev avg loss 0.432175, throughput 9.08065K wps
[Epoch 52 Batch 30/62] avg loss 0.00781236, throughput 8.82708K wps
[Epoch 52 Batch 60/62] avg loss 0.00801769, throughput 8.91279K wps
Begin Testing...
[Epoch 52] train avg loss 0.00799482, dev acc 0.8024, dev avg loss 0.43088, throughput 8.9046K wps
[Epoch 53 Batch 30/62] avg loss 0.00786893, throughput 9.16346K wps
[Epoch 53 Batch 60/62] avg loss 0.00763546, throughput 8.99971K wps
Begin Testing...
[Epoch 53] train avg loss 0.00783383, dev acc 0.8053, dev avg loss 0.427834, throughput 9.11172K wps
[Epoch 54 Batch 30/62] avg loss 0.0076814, throughput 9.1446K wps
[Epoch 54 Batch 60/62] avg loss 0.00762022, throughput 8.8391K wps
Begin Testing...
[Epoch 54] train avg loss 0.00776416, dev acc 0.8112, dev avg loss 0.426239, throughput 8.96278K wps
[Epoch 55 Batch 30/62] avg loss 0.00753038, throughput 9.00282K wps
[Epoch 55 Batch 60/62] avg loss 0.00752012, throughput 8.86439K wps
Begin Testing...
[Epoch 55] train avg loss 0.00763277, dev acc 0.7994, dev avg loss 0.423617, throughput 8.96044K wps
[Epoch 56 Batch 30/62] avg loss 0.00745052, throughput 9.05509K wps
[Epoch 56 Batch 60/62] avg loss 0.00759976, throughput 8.80384K wps
Begin Testing...
[Epoch 56] train avg loss 0.00759608, dev acc 0.7994, dev avg loss 0.423364, throughput 8.90895K wps
[Epoch 57 Batch 30/62] avg loss 0.00745173, throughput 8.35383K wps
[Epoch 57 Batch 60/62] avg loss 0.00733214, throughput 8.69756K wps
Begin Testing...
[Epoch 57] train avg loss 0.00749626, dev acc 0.8053, dev avg loss 0.421579, throughput 8.49142K wps
[Epoch 58 Batch 30/62] avg loss 0.00726503, throughput 8.74695K wps
[Epoch 58 Batch 60/62] avg loss 0.00738788, throughput 8.94221K wps
Begin Testing...
[Epoch 58] train avg loss 0.00747321, dev acc 0.8053, dev avg loss 0.418092, throughput 8.87605K wps
[Epoch 59 Batch 30/62] avg loss 0.00724476, throughput 8.8944K wps
[Epoch 59 Batch 60/62] avg loss 0.00723422, throughput 8.74483K wps
Begin Testing...
[Epoch 59] train avg loss 0.00729783, dev acc 0.8083, dev avg loss 0.416894, throughput 8.89609K wps
[Epoch 60 Batch 30/62] avg loss 0.00705901, throughput 9.03577K wps
[Epoch 60 Batch 60/62] avg loss 0.0071684, throughput 8.7221K wps
Begin Testing...
[Epoch 60] train avg loss 0.00720466, dev acc 0.8112, dev avg loss 0.416064, throughput 8.8403K wps
[Epoch 61 Batch 30/62] avg loss 0.00699805, throughput 8.67589K wps
[Epoch 61 Batch 60/62] avg loss 0.00709678, throughput 8.86036K wps
Begin Testing...
[Epoch 61] train avg loss 0.00721158, dev acc 0.8112, dev avg loss 0.412831, throughput 8.77414K wps
[Epoch 62 Batch 30/62] avg loss 0.00688297, throughput 9.04483K wps
[Epoch 62 Batch 60/62] avg loss 0.00723851, throughput 8.93694K wps
Begin Testing...
[Epoch 62] train avg loss 0.00710671, dev acc 0.8142, dev avg loss 0.412366, throughput 9.02128K wps
Observed Improvement.
Begin Testing...
[Epoch 63 Batch 30/62] avg loss 0.00698979, throughput 8.81227K wps
[Epoch 63 Batch 60/62] avg loss 0.00723285, throughput 8.95999K wps
Begin Testing...
[Epoch 63] train avg loss 0.00717437, dev acc 0.8171, dev avg loss 0.411185, throughput 8.91281K wps
Observed Improvement.
Begin Testing...
[Epoch 64 Batch 30/62] avg loss 0.00667062, throughput 8.78742K wps
[Epoch 64 Batch 60/62] avg loss 0.00706726, throughput 8.81465K wps
Begin Testing...
[Epoch 64] train avg loss 0.00700101, dev acc 0.8024, dev avg loss 0.408153, throughput 8.79522K wps
[Epoch 65 Batch 30/62] avg loss 0.00695034, throughput 8.78447K wps
[Epoch 65 Batch 60/62] avg loss 0.00675874, throughput 9.10892K wps
Begin Testing...
[Epoch 65] train avg loss 0.00694057, dev acc 0.8053, dev avg loss 0.406791, throughput 8.97716K wps
[Epoch 66 Batch 30/62] avg loss 0.00681896, throughput 9.03827K wps
[Epoch 66 Batch 60/62] avg loss 0.00689112, throughput 9.19416K wps
Begin Testing...
[Epoch 66] train avg loss 0.00687946, dev acc 0.8053, dev avg loss 0.405294, throughput 9.14209K wps
[Epoch 67 Batch 30/62] avg loss 0.00658985, throughput 8.9388K wps
[Epoch 67 Batch 60/62] avg loss 0.00661052, throughput 9.01636K wps
Begin Testing...
[Epoch 67] train avg loss 0.00668659, dev acc 0.8083, dev avg loss 0.403403, throughput 9.00876K wps
[Epoch 68 Batch 30/62] avg loss 0.0064438, throughput 9.09566K wps
[Epoch 68 Batch 60/62] avg loss 0.00672757, throughput 8.59152K wps
Begin Testing...
[Epoch 68] train avg loss 0.00673257, dev acc 0.8201, dev avg loss 0.402806, throughput 8.87865K wps
Observed Improvement.
Begin Testing...
[Epoch 69 Batch 30/62] avg loss 0.00656633, throughput 8.77959K wps
[Epoch 69 Batch 60/62] avg loss 0.00662063, throughput 8.49915K wps
Begin Testing...
[Epoch 69] train avg loss 0.00669502, dev acc 0.8053, dev avg loss 0.401608, throughput 8.72325K wps
[Epoch 70 Batch 30/62] avg loss 0.0064877, throughput 9.08301K wps
[Epoch 70 Batch 60/62] avg loss 0.00643677, throughput 8.9462K wps
Begin Testing...
[Epoch 70] train avg loss 0.00659439, dev acc 0.8024, dev avg loss 0.400096, throughput 9.04274K wps
[Epoch 71 Batch 30/62] avg loss 0.00649569, throughput 8.77194K wps
[Epoch 71 Batch 60/62] avg loss 0.00615129, throughput 9.01649K wps
Begin Testing...
[Epoch 71] train avg loss 0.00640091, dev acc 0.8024, dev avg loss 0.398448, throughput 8.90101K wps
[Epoch 72 Batch 30/62] avg loss 0.00647519, throughput 9.0429K wps
[Epoch 72 Batch 60/62] avg loss 0.00630147, throughput 8.66876K wps
Begin Testing...
[Epoch 72] train avg loss 0.0064379, dev acc 0.8142, dev avg loss 0.397138, throughput 8.81379K wps
[Epoch 73 Batch 30/62] avg loss 0.00617746, throughput 8.95563K wps
[Epoch 73 Batch 60/62] avg loss 0.00645345, throughput 8.72324K wps
Begin Testing...
[Epoch 73] train avg loss 0.00643029, dev acc 0.8319, dev avg loss 0.398112, throughput 8.85425K wps
Observed Improvement.
Begin Testing...
[Epoch 74 Batch 30/62] avg loss 0.00633115, throughput 9.1344K wps
[Epoch 74 Batch 60/62] avg loss 0.00614279, throughput 9.03427K wps
Begin Testing...
[Epoch 74] train avg loss 0.00634233, dev acc 0.8053, dev avg loss 0.394872, throughput 9.04684K wps
[Epoch 75 Batch 30/62] avg loss 0.00615655, throughput 8.51133K wps
[Epoch 75 Batch 60/62] avg loss 0.00624068, throughput 9.03263K wps
Begin Testing...
[Epoch 75] train avg loss 0.00627063, dev acc 0.8112, dev avg loss 0.393876, throughput 8.79912K wps
[Epoch 76 Batch 30/62] avg loss 0.00616923, throughput 9.12833K wps
[Epoch 76 Batch 60/62] avg loss 0.00630463, throughput 8.91788K wps
Begin Testing...
[Epoch 76] train avg loss 0.00642952, dev acc 0.8260, dev avg loss 0.394492, throughput 9.04987K wps
[Epoch 77 Batch 30/62] avg loss 0.00609709, throughput 8.9871K wps
[Epoch 77 Batch 60/62] avg loss 0.0061343, throughput 8.98989K wps
Begin Testing...
[Epoch 77] train avg loss 0.00617012, dev acc 0.8083, dev avg loss 0.391272, throughput 9.0157K wps
[Epoch 78 Batch 30/62] avg loss 0.00585943, throughput 8.84896K wps
[Epoch 78 Batch 60/62] avg loss 0.0061058, throughput 8.98483K wps
Begin Testing...
[Epoch 78] train avg loss 0.00604667, dev acc 0.8142, dev avg loss 0.39088, throughput 8.94244K wps
[Epoch 79 Batch 30/62] avg loss 0.00609336, throughput 9.03128K wps
[Epoch 79 Batch 60/62] avg loss 0.00594161, throughput 9.02381K wps
Begin Testing...
[Epoch 79] train avg loss 0.00605712, dev acc 0.8289, dev avg loss 0.389923, throughput 9.05504K wps
[Epoch 80 Batch 30/62] avg loss 0.00610527, throughput 8.73326K wps
[Epoch 80 Batch 60/62] avg loss 0.00580589, throughput 8.9935K wps
Begin Testing...
[Epoch 80] train avg loss 0.0060827, dev acc 0.8230, dev avg loss 0.388471, throughput 8.89326K wps
[Epoch 81 Batch 30/62] avg loss 0.00590257, throughput 9.17482K wps
[Epoch 81 Batch 60/62] avg loss 0.00582838, throughput 8.89652K wps
Begin Testing...
[Epoch 81] train avg loss 0.00592395, dev acc 0.8201, dev avg loss 0.387245, throughput 9.00635K wps
[Epoch 82 Batch 30/62] avg loss 0.00584111, throughput 8.87299K wps
[Epoch 82 Batch 60/62] avg loss 0.00591008, throughput 9.05989K wps
Begin Testing...
[Epoch 82] train avg loss 0.00595345, dev acc 0.8201, dev avg loss 0.386185, throughput 8.99557K wps
[Epoch 83 Batch 30/62] avg loss 0.00578903, throughput 8.87541K wps
[Epoch 83 Batch 60/62] avg loss 0.00560388, throughput 8.99954K wps
Begin Testing...
[Epoch 83] train avg loss 0.0058538, dev acc 0.8289, dev avg loss 0.391478, throughput 8.97021K wps
[Epoch 84 Batch 30/62] avg loss 0.00560233, throughput 8.73898K wps
[Epoch 84 Batch 60/62] avg loss 0.00584963, throughput 8.83251K wps
Begin Testing...
[Epoch 84] train avg loss 0.00575041, dev acc 0.8289, dev avg loss 0.38499, throughput 8.7527K wps
[Epoch 85 Batch 30/62] avg loss 0.00569179, throughput 8.94115K wps
[Epoch 85 Batch 60/62] avg loss 0.00553769, throughput 8.48233K wps
Begin Testing...
[Epoch 85] train avg loss 0.0057312, dev acc 0.8289, dev avg loss 0.384265, throughput 8.66235K wps
[Epoch 86 Batch 30/62] avg loss 0.00556845, throughput 9.04805K wps
[Epoch 86 Batch 60/62] avg loss 0.00549014, throughput 9.02512K wps
Begin Testing...
[Epoch 86] train avg loss 0.00570218, dev acc 0.8260, dev avg loss 0.382763, throughput 9.06175K wps
[Epoch 87 Batch 30/62] avg loss 0.00539825, throughput 8.91812K wps
[Epoch 87 Batch 60/62] avg loss 0.0054014, throughput 8.98919K wps
Begin Testing...
[Epoch 87] train avg loss 0.00543947, dev acc 0.8289, dev avg loss 0.382134, throughput 8.9798K wps
[Epoch 88 Batch 30/62] avg loss 0.00530334, throughput 9.04922K wps
[Epoch 88 Batch 60/62] avg loss 0.00545753, throughput 8.71608K wps
Begin Testing...
[Epoch 88] train avg loss 0.00536623, dev acc 0.8260, dev avg loss 0.38029, throughput 8.85688K wps
[Epoch 89 Batch 30/62] avg loss 0.00541168, throughput 8.96738K wps
[Epoch 89 Batch 60/62] avg loss 0.00547457, throughput 9.02393K wps
Begin Testing...
[Epoch 89] train avg loss 0.00556402, dev acc 0.8171, dev avg loss 0.380386, throughput 9.02511K wps
[Epoch 90 Batch 30/62] avg loss 0.00535897, throughput 8.84371K wps
[Epoch 90 Batch 60/62] avg loss 0.0052926, throughput 9.13484K wps
Begin Testing...
[Epoch 90] train avg loss 0.0054511, dev acc 0.8201, dev avg loss 0.379605, throughput 9.01897K wps
[Epoch 91 Batch 30/62] avg loss 0.00532996, throughput 8.89891K wps
[Epoch 91 Batch 60/62] avg loss 0.00513736, throughput 8.83143K wps
Begin Testing...
[Epoch 91] train avg loss 0.00533826, dev acc 0.8289, dev avg loss 0.378986, throughput 8.89679K wps
[Epoch 92 Batch 30/62] avg loss 0.00509795, throughput 8.36211K wps
[Epoch 92 Batch 60/62] avg loss 0.00523223, throughput 8.95131K wps
Begin Testing...
[Epoch 92] train avg loss 0.00522577, dev acc 0.8289, dev avg loss 0.376946, throughput 8.67597K wps
[Epoch 93 Batch 30/62] avg loss 0.00515891, throughput 9.13936K wps
[Epoch 93 Batch 60/62] avg loss 0.00513727, throughput 9.02721K wps
Begin Testing...
[Epoch 93] train avg loss 0.0052339, dev acc 0.8260, dev avg loss 0.37756, throughput 9.01803K wps
[Epoch 94 Batch 30/62] avg loss 0.00512703, throughput 8.96245K wps
[Epoch 94 Batch 60/62] avg loss 0.0051012, throughput 8.80935K wps
Begin Testing...
[Epoch 94] train avg loss 0.00521512, dev acc 0.8289, dev avg loss 0.375334, throughput 8.86358K wps
[Epoch 95 Batch 30/62] avg loss 0.00486939, throughput 8.99445K wps
[Epoch 95 Batch 60/62] avg loss 0.00511639, throughput 8.84218K wps
Begin Testing...
[Epoch 95] train avg loss 0.00506742, dev acc 0.8260, dev avg loss 0.374561, throughput 8.86474K wps
[Epoch 96 Batch 30/62] avg loss 0.00501174, throughput 8.96493K wps
[Epoch 96 Batch 60/62] avg loss 0.00499259, throughput 8.45688K wps
Begin Testing...
[Epoch 96] train avg loss 0.0050767, dev acc 0.8171, dev avg loss 0.374835, throughput 8.73546K wps
[Epoch 97 Batch 30/62] avg loss 0.00513502, throughput 8.7215K wps
[Epoch 97 Batch 60/62] avg loss 0.00484148, throughput 8.92315K wps
Begin Testing...
[Epoch 97] train avg loss 0.00506055, dev acc 0.8289, dev avg loss 0.372932, throughput 8.84828K wps
[Epoch 98 Batch 30/62] avg loss 0.00475521, throughput 8.95119K wps
[Epoch 98 Batch 60/62] avg loss 0.00492097, throughput 8.96351K wps
Begin Testing...
[Epoch 98] train avg loss 0.00491314, dev acc 0.8260, dev avg loss 0.37282, throughput 8.97681K wps
[Epoch 99 Batch 30/62] avg loss 0.00485485, throughput 8.66631K wps
[Epoch 99 Batch 60/62] avg loss 0.00461857, throughput 9.15687K wps
Begin Testing...
[Epoch 99] train avg loss 0.00487979, dev acc 0.8142, dev avg loss 0.373252, throughput 8.92K wps
[Epoch 100 Batch 30/62] avg loss 0.00495737, throughput 8.42174K wps
[Epoch 100 Batch 60/62] avg loss 0.00486123, throughput 9.04005K wps
Begin Testing...
[Epoch 100] train avg loss 0.00505882, dev acc 0.8112, dev avg loss 0.377044, throughput 8.75478K wps
[Epoch 101 Batch 30/62] avg loss 0.00492143, throughput 8.7498K wps
[Epoch 101 Batch 60/62] avg loss 0.00459509, throughput 8.59003K wps
Begin Testing...
[Epoch 101] train avg loss 0.00481563, dev acc 0.8142, dev avg loss 0.371119, throughput 8.70623K wps
[Epoch 102 Batch 30/62] avg loss 0.00464637, throughput 9.11218K wps
[Epoch 102 Batch 60/62] avg loss 0.00487924, throughput 8.99905K wps
Begin Testing...
[Epoch 102] train avg loss 0.00487809, dev acc 0.8289, dev avg loss 0.370847, throughput 9.07628K wps
[Epoch 103 Batch 30/62] avg loss 0.00485722, throughput 8.87028K wps
[Epoch 103 Batch 60/62] avg loss 0.00452955, throughput 8.89341K wps
Begin Testing...
[Epoch 103] train avg loss 0.00474473, dev acc 0.8289, dev avg loss 0.370329, throughput 8.91425K wps
[Epoch 104 Batch 30/62] avg loss 0.00474621, throughput 8.99498K wps
[Epoch 104 Batch 60/62] avg loss 0.00456025, throughput 9.03295K wps
Begin Testing...
[Epoch 104] train avg loss 0.00468956, dev acc 0.8348, dev avg loss 0.368768, throughput 9.03693K wps
Observed Improvement.
Begin Testing...
[Epoch 105 Batch 30/62] avg loss 0.00462427, throughput 9.09017K wps
[Epoch 105 Batch 60/62] avg loss 0.00429304, throughput 8.95373K wps
Begin Testing...
[Epoch 105] train avg loss 0.00450205, dev acc 0.8319, dev avg loss 0.367925, throughput 9.04987K wps
[Epoch 106 Batch 30/62] avg loss 0.00440501, throughput 9.17327K wps
[Epoch 106 Batch 60/62] avg loss 0.00449882, throughput 8.69522K wps
Begin Testing...
[Epoch 106] train avg loss 0.00451906, dev acc 0.8112, dev avg loss 0.370069, throughput 8.9563K wps
[Epoch 107 Batch 30/62] avg loss 0.00447763, throughput 8.72112K wps
[Epoch 107 Batch 60/62] avg loss 0.00452552, throughput 9.01558K wps
Begin Testing...
[Epoch 107] train avg loss 0.00458383, dev acc 0.8230, dev avg loss 0.366462, throughput 8.89875K wps
[Epoch 108 Batch 30/62] avg loss 0.00440155, throughput 9.1623K wps
[Epoch 108 Batch 60/62] avg loss 0.00442389, throughput 8.81664K wps
Begin Testing...
[Epoch 108] train avg loss 0.00448666, dev acc 0.8348, dev avg loss 0.365384, throughput 9.0048K wps
Observed Improvement.
Begin Testing...
[Epoch 109 Batch 30/62] avg loss 0.00432682, throughput 9.0485K wps
[Epoch 109 Batch 60/62] avg loss 0.00424253, throughput 8.65315K wps
Begin Testing...
[Epoch 109] train avg loss 0.00437354, dev acc 0.8201, dev avg loss 0.366693, throughput 8.91166K wps
[Epoch 110 Batch 30/62] avg loss 0.0040846, throughput 9.16467K wps
[Epoch 110 Batch 60/62] avg loss 0.00428735, throughput 8.82741K wps
Begin Testing...
[Epoch 110] train avg loss 0.00424685, dev acc 0.8201, dev avg loss 0.364891, throughput 9.02989K wps
[Epoch 111 Batch 30/62] avg loss 0.00427764, throughput 8.57744K wps
[Epoch 111 Batch 60/62] avg loss 0.00440712, throughput 9.03447K wps
Begin Testing...
[Epoch 111] train avg loss 0.00437921, dev acc 0.8289, dev avg loss 0.36418, throughput 8.83305K wps
[Epoch 112 Batch 30/62] avg loss 0.00438554, throughput 9.07842K wps
[Epoch 112 Batch 60/62] avg loss 0.00419915, throughput 8.8595K wps
Begin Testing...
[Epoch 112] train avg loss 0.00436656, dev acc 0.8260, dev avg loss 0.363745, throughput 9.02556K wps
[Epoch 113 Batch 30/62] avg loss 0.00418354, throughput 9.15852K wps
[Epoch 113 Batch 60/62] avg loss 0.0040455, throughput 8.90627K wps
Begin Testing...
[Epoch 113] train avg loss 0.00424743, dev acc 0.8348, dev avg loss 0.363467, throughput 9.06224K wps
Observed Improvement.
Begin Testing...
[Epoch 114 Batch 30/62] avg loss 0.00421059, throughput 9.16586K wps
[Epoch 114 Batch 60/62] avg loss 0.0041826, throughput 9.13464K wps
Begin Testing...
[Epoch 114] train avg loss 0.00421215, dev acc 0.8378, dev avg loss 0.365863, throughput 9.17773K wps
Observed Improvement.
Begin Testing...
[Epoch 115 Batch 30/62] avg loss 0.00428931, throughput 9.20974K wps
[Epoch 115 Batch 60/62] avg loss 0.00416636, throughput 8.90966K wps
Begin Testing...
[Epoch 115] train avg loss 0.004265, dev acc 0.8378, dev avg loss 0.361937, throughput 9.10607K wps
Observed Improvement.
Begin Testing...
[Epoch 116 Batch 30/62] avg loss 0.00398601, throughput 9.26583K wps
[Epoch 116 Batch 60/62] avg loss 0.0041831, throughput 8.78098K wps
Begin Testing...
[Epoch 116] train avg loss 0.00410374, dev acc 0.8348, dev avg loss 0.361504, throughput 9.04651K wps
[Epoch 117 Batch 30/62] avg loss 0.00413127, throughput 9.06345K wps
[Epoch 117 Batch 60/62] avg loss 0.00402451, throughput 9.01475K wps
Begin Testing...
[Epoch 117] train avg loss 0.00410167, dev acc 0.8348, dev avg loss 0.360812, throughput 9.06506K wps
[Epoch 118 Batch 30/62] avg loss 0.00395719, throughput 8.88948K wps
[Epoch 118 Batch 60/62] avg loss 0.00392965, throughput 8.92949K wps
Begin Testing...
[Epoch 118] train avg loss 0.00401244, dev acc 0.8407, dev avg loss 0.360238, throughput 8.94576K wps
Observed Improvement.
Begin Testing...
[Epoch 119 Batch 30/62] avg loss 0.0040128, throughput 8.85031K wps
[Epoch 119 Batch 60/62] avg loss 0.00398634, throughput 8.75025K wps
Begin Testing...
[Epoch 119] train avg loss 0.00404322, dev acc 0.8378, dev avg loss 0.361124, throughput 8.77155K wps
[Epoch 120 Batch 30/62] avg loss 0.00381328, throughput 9.01513K wps
[Epoch 120 Batch 60/62] avg loss 0.00399467, throughput 8.81384K wps
Begin Testing...
[Epoch 120] train avg loss 0.00394368, dev acc 0.8407, dev avg loss 0.360322, throughput 8.94188K wps
Observed Improvement.
Begin Testing...
[Epoch 121 Batch 30/62] avg loss 0.00388249, throughput 8.78424K wps
[Epoch 121 Batch 60/62] avg loss 0.00376202, throughput 8.94763K wps
Begin Testing...
[Epoch 121] train avg loss 0.00389282, dev acc 0.8319, dev avg loss 0.360248, throughput 8.89819K wps
[Epoch 122 Batch 30/62] avg loss 0.00398839, throughput 8.86549K wps
[Epoch 122 Batch 60/62] avg loss 0.00363546, throughput 8.5213K wps
Begin Testing...
[Epoch 122] train avg loss 0.0038539, dev acc 0.8378, dev avg loss 0.359484, throughput 8.74703K wps
[Epoch 123 Batch 30/62] avg loss 0.00386761, throughput 8.72993K wps
[Epoch 123 Batch 60/62] avg loss 0.00368851, throughput 8.98583K wps
Begin Testing...
[Epoch 123] train avg loss 0.00382494, dev acc 0.8171, dev avg loss 0.360127, throughput 8.86844K wps
[Epoch 124 Batch 30/62] avg loss 0.00370832, throughput 8.86514K wps
[Epoch 124 Batch 60/62] avg loss 0.00385895, throughput 9.04635K wps
Begin Testing...
[Epoch 124] train avg loss 0.00384251, dev acc 0.8348, dev avg loss 0.358338, throughput 8.98393K wps
[Epoch 125 Batch 30/62] avg loss 0.00378863, throughput 8.90321K wps
[Epoch 125 Batch 60/62] avg loss 0.00362484, throughput 8.8716K wps
Begin Testing...
[Epoch 125] train avg loss 0.00376319, dev acc 0.8348, dev avg loss 0.358389, throughput 8.87576K wps
[Epoch 126 Batch 30/62] avg loss 0.00370584, throughput 8.86267K wps
[Epoch 126 Batch 60/62] avg loss 0.00368286, throughput 8.92157K wps
Begin Testing...
[Epoch 126] train avg loss 0.00371394, dev acc 0.8348, dev avg loss 0.358409, throughput 8.87896K wps
[Epoch 127 Batch 30/62] avg loss 0.0035356, throughput 9.21063K wps
[Epoch 127 Batch 60/62] avg loss 0.00367036, throughput 8.7743K wps
Begin Testing...
[Epoch 127] train avg loss 0.00361097, dev acc 0.8289, dev avg loss 0.357754, throughput 9.02412K wps
[Epoch 128 Batch 30/62] avg loss 0.00370031, throughput 9.14981K wps
[Epoch 128 Batch 60/62] avg loss 0.00371599, throughput 9.05517K wps
Begin Testing...
[Epoch 128] train avg loss 0.00375992, dev acc 0.8407, dev avg loss 0.356697, throughput 9.13221K wps
Observed Improvement.
Begin Testing...
[Epoch 129 Batch 30/62] avg loss 0.0034238, throughput 8.77909K wps
[Epoch 129 Batch 60/62] avg loss 0.00359856, throughput 8.6112K wps
Begin Testing...
[Epoch 129] train avg loss 0.00357335, dev acc 0.8201, dev avg loss 0.359243, throughput 8.74572K wps
[Epoch 130 Batch 30/62] avg loss 0.00322876, throughput 9.09021K wps
[Epoch 130 Batch 60/62] avg loss 0.00372762, throughput 8.58665K wps
Begin Testing...
[Epoch 130] train avg loss 0.00356658, dev acc 0.8407, dev avg loss 0.360442, throughput 8.82073K wps
Observed Improvement.
Begin Testing...
[Epoch 131 Batch 30/62] avg loss 0.00360057, throughput 8.90363K wps
[Epoch 131 Batch 60/62] avg loss 0.00354821, throughput 8.74689K wps
Begin Testing...
[Epoch 131] train avg loss 0.00360513, dev acc 0.8378, dev avg loss 0.355323, throughput 8.79452K wps
[Epoch 132 Batch 30/62] avg loss 0.00363873, throughput 8.74396K wps
[Epoch 132 Batch 60/62] avg loss 0.00329928, throughput 8.99148K wps
Begin Testing...
[Epoch 132] train avg loss 0.00347284, dev acc 0.8348, dev avg loss 0.35493, throughput 8.90015K wps
[Epoch 133 Batch 30/62] avg loss 0.00344793, throughput 9.0564K wps
[Epoch 133 Batch 60/62] avg loss 0.00355203, throughput 9.06312K wps
Begin Testing...
[Epoch 133] train avg loss 0.00353284, dev acc 0.8378, dev avg loss 0.354902, throughput 9.02368K wps
[Epoch 134 Batch 30/62] avg loss 0.00354596, throughput 8.81924K wps
[Epoch 134 Batch 60/62] avg loss 0.00304416, throughput 8.92605K wps
Begin Testing...
[Epoch 134] train avg loss 0.00338611, dev acc 0.8171, dev avg loss 0.35885, throughput 8.91039K wps
[Epoch 135 Batch 30/62] avg loss 0.00329336, throughput 8.97718K wps
[Epoch 135 Batch 60/62] avg loss 0.00323073, throughput 8.7382K wps
Begin Testing...
[Epoch 135] train avg loss 0.00334045, dev acc 0.8437, dev avg loss 0.358392, throughput 8.84056K wps
Observed Improvement.
Begin Testing...
[Epoch 136 Batch 30/62] avg loss 0.00358365, throughput 9.02837K wps
[Epoch 136 Batch 60/62] avg loss 0.00323712, throughput 8.95222K wps
Begin Testing...
[Epoch 136] train avg loss 0.00343063, dev acc 0.8348, dev avg loss 0.353486, throughput 8.97653K wps
[Epoch 137 Batch 30/62] avg loss 0.00325386, throughput 8.78973K wps
[Epoch 137 Batch 60/62] avg loss 0.00322269, throughput 9.08275K wps
Begin Testing...
[Epoch 137] train avg loss 0.00326065, dev acc 0.8230, dev avg loss 0.354541, throughput 8.90778K wps
[Epoch 138 Batch 30/62] avg loss 0.00320836, throughput 9.11273K wps
[Epoch 138 Batch 60/62] avg loss 0.00331383, throughput 9.05098K wps
Begin Testing...
[Epoch 138] train avg loss 0.0032718, dev acc 0.8230, dev avg loss 0.354755, throughput 9.11094K wps
[Epoch 139 Batch 30/62] avg loss 0.00328569, throughput 8.8818K wps
[Epoch 139 Batch 60/62] avg loss 0.00323848, throughput 8.90975K wps
Begin Testing...
[Epoch 139] train avg loss 0.0033063, dev acc 0.8319, dev avg loss 0.354329, throughput 8.92977K wps
[Epoch 140 Batch 30/62] avg loss 0.00308523, throughput 9.17595K wps
[Epoch 140 Batch 60/62] avg loss 0.0032345, throughput 8.9274K wps
Begin Testing...
[Epoch 140] train avg loss 0.00322061, dev acc 0.8378, dev avg loss 0.351997, throughput 9.00757K wps
[Epoch 141 Batch 30/62] avg loss 0.00304514, throughput 8.90948K wps
[Epoch 141 Batch 60/62] avg loss 0.00336048, throughput 8.94911K wps
Begin Testing...
[Epoch 141] train avg loss 0.00320816, dev acc 0.8289, dev avg loss 0.352326, throughput 8.96252K wps
[Epoch 142 Batch 30/62] avg loss 0.00316995, throughput 8.77687K wps
[Epoch 142 Batch 60/62] avg loss 0.00320084, throughput 8.9844K wps
Begin Testing...
[Epoch 142] train avg loss 0.00321972, dev acc 0.8407, dev avg loss 0.350665, throughput 8.84483K wps
[Epoch 143 Batch 30/62] avg loss 0.00307656, throughput 9.19675K wps
[Epoch 143 Batch 60/62] avg loss 0.00314866, throughput 9.04523K wps
Begin Testing...
[Epoch 143] train avg loss 0.00314175, dev acc 0.8319, dev avg loss 0.351159, throughput 9.14777K wps
[Epoch 144 Batch 30/62] avg loss 0.00318791, throughput 9.03962K wps
[Epoch 144 Batch 60/62] avg loss 0.00291204, throughput 8.83007K wps
Begin Testing...
[Epoch 144] train avg loss 0.00304527, dev acc 0.8348, dev avg loss 0.350585, throughput 8.89088K wps
[Epoch 145 Batch 30/62] avg loss 0.00288406, throughput 8.84309K wps
[Epoch 145 Batch 60/62] avg loss 0.00325193, throughput 7.69168K wps
Begin Testing...
[Epoch 145] train avg loss 0.00309219, dev acc 0.8378, dev avg loss 0.350712, throughput 8.2286K wps
[Epoch 146 Batch 30/62] avg loss 0.00305122, throughput 8.8055K wps
[Epoch 146 Batch 60/62] avg loss 0.00301864, throughput 8.515K wps
Begin Testing...
[Epoch 146] train avg loss 0.00314634, dev acc 0.8348, dev avg loss 0.350115, throughput 8.6379K wps
[Epoch 147 Batch 30/62] avg loss 0.00301272, throughput 8.6902K wps
[Epoch 147 Batch 60/62] avg loss 0.00299792, throughput 8.53498K wps
Begin Testing...
[Epoch 147] train avg loss 0.00301528, dev acc 0.8260, dev avg loss 0.351302, throughput 8.5994K wps
[Epoch 148 Batch 30/62] avg loss 0.00303739, throughput 8.8896K wps
[Epoch 148 Batch 60/62] avg loss 0.00308771, throughput 8.85428K wps
Begin Testing...
[Epoch 148] train avg loss 0.00310521, dev acc 0.8083, dev avg loss 0.359634, throughput 8.83516K wps
[Epoch 149 Batch 30/62] avg loss 0.00304666, throughput 8.69369K wps
[Epoch 149 Batch 60/62] avg loss 0.00279754, throughput 8.7329K wps
Begin Testing...
[Epoch 149] train avg loss 0.00301475, dev acc 0.8319, dev avg loss 0.34933, throughput 8.67906K wps
[Epoch 150 Batch 30/62] avg loss 0.00270276, throughput 8.38175K wps
[Epoch 150 Batch 60/62] avg loss 0.00288859, throughput 9.03747K wps
Begin Testing...
[Epoch 150] train avg loss 0.00283868, dev acc 0.8289, dev avg loss 0.348965, throughput 8.73796K wps
[Epoch 151 Batch 30/62] avg loss 0.00298448, throughput 8.93007K wps
[Epoch 151 Batch 60/62] avg loss 0.00300027, throughput 8.98435K wps
Begin Testing...
[Epoch 151] train avg loss 0.00304046, dev acc 0.8437, dev avg loss 0.347992, throughput 8.97878K wps
Observed Improvement.
Begin Testing...
[Epoch 152 Batch 30/62] avg loss 0.00314805, throughput 8.88093K wps
[Epoch 152 Batch 60/62] avg loss 0.00265822, throughput 8.65025K wps
Begin Testing...
[Epoch 152] train avg loss 0.00291947, dev acc 0.8407, dev avg loss 0.348243, throughput 8.73504K wps
[Epoch 153 Batch 30/62] avg loss 0.00291662, throughput 9.01351K wps
[Epoch 153 Batch 60/62] avg loss 0.00282704, throughput 9.01718K wps
Begin Testing...
[Epoch 153] train avg loss 0.00290116, dev acc 0.8289, dev avg loss 0.34835, throughput 9.04283K wps
[Epoch 154 Batch 30/62] avg loss 0.00278045, throughput 8.92718K wps
[Epoch 154 Batch 60/62] avg loss 0.00276979, throughput 8.70128K wps
Begin Testing...
[Epoch 154] train avg loss 0.00284616, dev acc 0.8230, dev avg loss 0.354642, throughput 8.83468K wps
[Epoch 155 Batch 30/62] avg loss 0.00281385, throughput 9.05839K wps
[Epoch 155 Batch 60/62] avg loss 0.00284468, throughput 9.09786K wps
Begin Testing...
[Epoch 155] train avg loss 0.00285087, dev acc 0.8407, dev avg loss 0.34779, throughput 9.05328K wps
[Epoch 156 Batch 30/62] avg loss 0.00269895, throughput 8.96726K wps
[Epoch 156 Batch 60/62] avg loss 0.00281051, throughput 8.98344K wps
Begin Testing...
[Epoch 156] train avg loss 0.00278803, dev acc 0.8319, dev avg loss 0.348609, throughput 9.00631K wps
[Epoch 157 Batch 30/62] avg loss 0.00276305, throughput 8.88185K wps
[Epoch 157 Batch 60/62] avg loss 0.00268525, throughput 8.89152K wps
Begin Testing...
[Epoch 157] train avg loss 0.0027489, dev acc 0.8407, dev avg loss 0.346918, throughput 8.92196K wps
[Epoch 158 Batch 30/62] avg loss 0.00289623, throughput 9.06762K wps
[Epoch 158 Batch 60/62] avg loss 0.00256016, throughput 8.92846K wps
Begin Testing...
[Epoch 158] train avg loss 0.00274133, dev acc 0.8378, dev avg loss 0.346937, throughput 8.9797K wps
[Epoch 159 Batch 30/62] avg loss 0.00265097, throughput 9.0062K wps
[Epoch 159 Batch 60/62] avg loss 0.00256024, throughput 9.05201K wps
Begin Testing...
[Epoch 159] train avg loss 0.00267548, dev acc 0.8407, dev avg loss 0.346899, throughput 9.04728K wps
[Epoch 160 Batch 30/62] avg loss 0.00254505, throughput 8.86802K wps
[Epoch 160 Batch 60/62] avg loss 0.00275312, throughput 8.82634K wps
Begin Testing...
[Epoch 160] train avg loss 0.00267624, dev acc 0.8348, dev avg loss 0.347235, throughput 8.84625K wps
[Epoch 161 Batch 30/62] avg loss 0.00274382, throughput 9.00627K wps
[Epoch 161 Batch 60/62] avg loss 0.00257915, throughput 8.98004K wps
Begin Testing...
[Epoch 161] train avg loss 0.00270942, dev acc 0.8407, dev avg loss 0.345758, throughput 9.02752K wps
[Epoch 162 Batch 30/62] avg loss 0.00259132, throughput 9.07888K wps
[Epoch 162 Batch 60/62] avg loss 0.00248099, throughput 8.80668K wps
Begin Testing...
[Epoch 162] train avg loss 0.00258915, dev acc 0.8378, dev avg loss 0.347041, throughput 8.91157K wps
[Epoch 163 Batch 30/62] avg loss 0.00252797, throughput 8.91157K wps
[Epoch 163 Batch 60/62] avg loss 0.00255326, throughput 9.03978K wps
Begin Testing...
[Epoch 163] train avg loss 0.00254035, dev acc 0.8319, dev avg loss 0.346726, throughput 9.00308K wps
[Epoch 164 Batch 30/62] avg loss 0.0027474, throughput 8.95514K wps
[Epoch 164 Batch 60/62] avg loss 0.00246463, throughput 9.00651K wps
Begin Testing...
[Epoch 164] train avg loss 0.00263339, dev acc 0.8289, dev avg loss 0.346391, throughput 9.00947K wps
[Epoch 165 Batch 30/62] avg loss 0.00257088, throughput 8.90267K wps
[Epoch 165 Batch 60/62] avg loss 0.00249734, throughput 9.08297K wps
Begin Testing...
[Epoch 165] train avg loss 0.00253145, dev acc 0.8378, dev avg loss 0.345843, throughput 9.02453K wps
[Epoch 166 Batch 30/62] avg loss 0.00256303, throughput 8.99008K wps
[Epoch 166 Batch 60/62] avg loss 0.00258854, throughput 8.67577K wps
Begin Testing...
[Epoch 166] train avg loss 0.00258856, dev acc 0.8437, dev avg loss 0.344963, throughput 8.84191K wps
Observed Improvement.
Begin Testing...
[Epoch 167 Batch 30/62] avg loss 0.00252236, throughput 9.16689K wps
[Epoch 167 Batch 60/62] avg loss 0.00252736, throughput 8.941K wps
Begin Testing...
[Epoch 167] train avg loss 0.0025476, dev acc 0.8319, dev avg loss 0.345587, throughput 9.059K wps
[Epoch 168 Batch 30/62] avg loss 0.00243453, throughput 8.88827K wps
[Epoch 168 Batch 60/62] avg loss 0.00238132, throughput 9.12657K wps
Begin Testing...
[Epoch 168] train avg loss 0.00244409, dev acc 0.8348, dev avg loss 0.345297, throughput 9.02922K wps
[Epoch 169 Batch 30/62] avg loss 0.00253229, throughput 9.03305K wps
[Epoch 169 Batch 60/62] avg loss 0.00243181, throughput 8.83871K wps
Begin Testing...
[Epoch 169] train avg loss 0.00254629, dev acc 0.8319, dev avg loss 0.346794, throughput 8.89505K wps
[Epoch 170 Batch 30/62] avg loss 0.00238651, throughput 8.9994K wps
[Epoch 170 Batch 60/62] avg loss 0.0025088, throughput 8.60363K wps
Begin Testing...
[Epoch 170] train avg loss 0.00246419, dev acc 0.8407, dev avg loss 0.345031, throughput 8.83523K wps
[Epoch 171 Batch 30/62] avg loss 0.00258986, throughput 8.92772K wps
[Epoch 171 Batch 60/62] avg loss 0.0022948, throughput 8.64547K wps
Begin Testing...
[Epoch 171] train avg loss 0.00247051, dev acc 0.8348, dev avg loss 0.345002, throughput 8.7562K wps
[Epoch 172 Batch 30/62] avg loss 0.00234758, throughput 8.85835K wps
[Epoch 172 Batch 60/62] avg loss 0.00244151, throughput 8.87636K wps
Begin Testing...
[Epoch 172] train avg loss 0.0024127, dev acc 0.8348, dev avg loss 0.344065, throughput 8.90085K wps
[Epoch 173 Batch 30/62] avg loss 0.00231911, throughput 8.99879K wps
[Epoch 173 Batch 60/62] avg loss 0.00244008, throughput 8.89601K wps
Begin Testing...
[Epoch 173] train avg loss 0.00243026, dev acc 0.8407, dev avg loss 0.343857, throughput 8.98641K wps
[Epoch 174 Batch 30/62] avg loss 0.0023095, throughput 8.70452K wps
[Epoch 174 Batch 60/62] avg loss 0.00240842, throughput 9.03575K wps
Begin Testing...
[Epoch 174] train avg loss 0.00238966, dev acc 0.8378, dev avg loss 0.343701, throughput 8.83917K wps
[Epoch 175 Batch 30/62] avg loss 0.00228502, throughput 8.94777K wps
[Epoch 175 Batch 60/62] avg loss 0.00239811, throughput 8.72252K wps
Begin Testing...
[Epoch 175] train avg loss 0.00239586, dev acc 0.8230, dev avg loss 0.351026, throughput 8.89185K wps
[Epoch 176 Batch 30/62] avg loss 0.00208028, throughput 8.99683K wps
[Epoch 176 Batch 60/62] avg loss 0.00243833, throughput 8.27643K wps
Begin Testing...
[Epoch 176] train avg loss 0.00227074, dev acc 0.8289, dev avg loss 0.343618, throughput 8.60972K wps
[Epoch 177 Batch 30/62] avg loss 0.00224476, throughput 9.10577K wps
[Epoch 177 Batch 60/62] avg loss 0.0024042, throughput 8.84336K wps
Begin Testing...
[Epoch 177] train avg loss 0.0023806, dev acc 0.8407, dev avg loss 0.34787, throughput 8.94675K wps
[Epoch 178 Batch 30/62] avg loss 0.00248192, throughput 8.69143K wps
[Epoch 178 Batch 60/62] avg loss 0.00224001, throughput 8.84887K wps
Begin Testing...
[Epoch 178] train avg loss 0.00236301, dev acc 0.8378, dev avg loss 0.342894, throughput 8.76098K wps
[Epoch 179 Batch 30/62] avg loss 0.0022703, throughput 8.46056K wps
[Epoch 179 Batch 60/62] avg loss 0.00225956, throughput 8.95171K wps
Begin Testing...
[Epoch 179] train avg loss 0.00226734, dev acc 0.8437, dev avg loss 0.342395, throughput 8.76857K wps
Observed Improvement.
Begin Testing...
[Epoch 180 Batch 30/62] avg loss 0.00220603, throughput 8.91299K wps
[Epoch 180 Batch 60/62] avg loss 0.00214595, throughput 8.9595K wps
Begin Testing...
[Epoch 180] train avg loss 0.00222942, dev acc 0.8437, dev avg loss 0.34888, throughput 8.928K wps
Observed Improvement.
Begin Testing...
[Epoch 181 Batch 30/62] avg loss 0.00220186, throughput 9.07456K wps
[Epoch 181 Batch 60/62] avg loss 0.00212865, throughput 8.981K wps
Begin Testing...
[Epoch 181] train avg loss 0.00217688, dev acc 0.8378, dev avg loss 0.342262, throughput 9.05741K wps
[Epoch 182 Batch 30/62] avg loss 0.0020772, throughput 8.848K wps
[Epoch 182 Batch 60/62] avg loss 0.00217824, throughput 8.84792K wps
Begin Testing...
[Epoch 182] train avg loss 0.00215295, dev acc 0.8289, dev avg loss 0.346451, throughput 8.89884K wps
[Epoch 183 Batch 30/62] avg loss 0.00219487, throughput 9.09909K wps
[Epoch 183 Batch 60/62] avg loss 0.00215766, throughput 8.78082K wps
Begin Testing...
[Epoch 183] train avg loss 0.00220134, dev acc 0.8319, dev avg loss 0.344304, throughput 8.97176K wps
[Epoch 184 Batch 30/62] avg loss 0.00199379, throughput 9.29419K wps
[Epoch 184 Batch 60/62] avg loss 0.00226205, throughput 8.72664K wps
Begin Testing...
[Epoch 184] train avg loss 0.00217242, dev acc 0.8348, dev avg loss 0.343651, throughput 8.96503K wps
[Epoch 185 Batch 30/62] avg loss 0.0021701, throughput 8.73686K wps
[Epoch 185 Batch 60/62] avg loss 0.0020232, throughput 8.9366K wps
Begin Testing...
[Epoch 185] train avg loss 0.00211417, dev acc 0.8407, dev avg loss 0.344077, throughput 8.81866K wps
[Epoch 186 Batch 30/62] avg loss 0.00203386, throughput 8.83703K wps
[Epoch 186 Batch 60/62] avg loss 0.00202929, throughput 8.95085K wps
Begin Testing...
[Epoch 186] train avg loss 0.00210944, dev acc 0.8289, dev avg loss 0.348397, throughput 8.92871K wps
[Epoch 187 Batch 30/62] avg loss 0.0018955, throughput 9.14415K wps
[Epoch 187 Batch 60/62] avg loss 0.00209266, throughput 8.79957K wps
Begin Testing...
[Epoch 187] train avg loss 0.00202238, dev acc 0.8407, dev avg loss 0.34236, throughput 8.96181K wps
[Epoch 188 Batch 30/62] avg loss 0.00196864, throughput 9.16141K wps
[Epoch 188 Batch 60/62] avg loss 0.00200097, throughput 8.99955K wps
Begin Testing...
[Epoch 188] train avg loss 0.00205343, dev acc 0.8407, dev avg loss 0.349466, throughput 9.03181K wps
[Epoch 189 Batch 30/62] avg loss 0.00208564, throughput 9.11552K wps
[Epoch 189 Batch 60/62] avg loss 0.00195728, throughput 8.93542K wps
Begin Testing...
[Epoch 189] train avg loss 0.00204775, dev acc 0.8319, dev avg loss 0.346802, throughput 9.05488K wps
[Epoch 190 Batch 30/62] avg loss 0.00195055, throughput 8.93928K wps
[Epoch 190 Batch 60/62] avg loss 0.0020916, throughput 8.71788K wps
Begin Testing...
[Epoch 190] train avg loss 0.00203297, dev acc 0.8466, dev avg loss 0.34205, throughput 8.79784K wps
Observed Improvement.
Begin Testing...
[Epoch 191 Batch 30/62] avg loss 0.00213805, throughput 9.01435K wps
[Epoch 191 Batch 60/62] avg loss 0.00189269, throughput 9.0038K wps
Begin Testing...
[Epoch 191] train avg loss 0.00205321, dev acc 0.8348, dev avg loss 0.34159, throughput 9.03661K wps
[Epoch 192 Batch 30/62] avg loss 0.00212041, throughput 8.43284K wps
[Epoch 192 Batch 60/62] avg loss 0.00205997, throughput 8.85083K wps
Begin Testing...
[Epoch 192] train avg loss 0.00212758, dev acc 0.8407, dev avg loss 0.341388, throughput 8.67546K wps
[Epoch 193 Batch 30/62] avg loss 0.00198382, throughput 8.64205K wps
[Epoch 193 Batch 60/62] avg loss 0.00203741, throughput 8.64175K wps
Begin Testing...
[Epoch 193] train avg loss 0.00202522, dev acc 0.8378, dev avg loss 0.341998, throughput 8.6797K wps
[Epoch 194 Batch 30/62] avg loss 0.00205067, throughput 9.07557K wps
[Epoch 194 Batch 60/62] avg loss 0.00194058, throughput 8.67191K wps
Begin Testing...
[Epoch 194] train avg loss 0.00206718, dev acc 0.8437, dev avg loss 0.345112, throughput 8.86322K wps
[Epoch 195 Batch 30/62] avg loss 0.00195653, throughput 8.7529K wps
[Epoch 195 Batch 60/62] avg loss 0.00197395, throughput 8.92254K wps
Begin Testing...
[Epoch 195] train avg loss 0.00198425, dev acc 0.8319, dev avg loss 0.343118, throughput 8.8668K wps
[Epoch 196 Batch 30/62] avg loss 0.00191445, throughput 8.98513K wps
[Epoch 196 Batch 60/62] avg loss 0.0020659, throughput 8.83084K wps
Begin Testing...
[Epoch 196] train avg loss 0.00199437, dev acc 0.8437, dev avg loss 0.341809, throughput 8.92958K wps
[Epoch 197 Batch 30/62] avg loss 0.0020337, throughput 8.68398K wps
[Epoch 197 Batch 60/62] avg loss 0.00173688, throughput 8.60893K wps
Begin Testing...
[Epoch 197] train avg loss 0.00191347, dev acc 0.8319, dev avg loss 0.344596, throughput 8.67978K wps
[Epoch 198 Batch 30/62] avg loss 0.00183614, throughput 8.89909K wps
[Epoch 198 Batch 60/62] avg loss 0.00184525, throughput 8.87292K wps
Begin Testing...
[Epoch 198] train avg loss 0.00191797, dev acc 0.8437, dev avg loss 0.347748, throughput 8.88008K wps
[Epoch 199 Batch 30/62] avg loss 0.00192195, throughput 9.06669K wps
[Epoch 199 Batch 60/62] avg loss 0.00189224, throughput 8.7836K wps
Begin Testing...
[Epoch 199] train avg loss 0.00193377, dev acc 0.8437, dev avg loss 0.342089, throughput 8.94467K wps
Test loss 0.400817, test acc 0.8249
Total time cost 156.91s
K-fold cross valid avg acc 0.8307692307692307