SST-2_rand.log

Namespace(batch_size=50, data_name='SST-2', dropout=0.5, epochs=200, gpu=0, log_interval=30, model_mode='rand')
Use gpu0
Downloading data/sst-2/train-61f1f238.zip from https://apache-mxnet.s3-accelerate.dualstack.amazonaws.com/gluon/dataset/sst-2/train-61f1f238.zip...
Downloading data/sst-2/test-a39c1db6.zip from https://apache-mxnet.s3-accelerate.dualstack.amazonaws.com/gluon/dataset/sst-2/test-a39c1db6.zip...
Downloading data/sst-2/dev-65511587.zip from https://apache-mxnet.s3-accelerate.dualstack.amazonaws.com/gluon/dataset/sst-2/dev-65511587.zip...
maximum length (in tokens):  53
Done! Tokenizing Time=0.83s, #Sentences=76961
Done! Tokenizing Time=0.03s, #Sentences=1821
Done! Tokenizing Time=0.01s, #Sentences=872
SentimentNet(
  (embedding): Embedding(17244 -> 300, float32)
  (encoder): ConvolutionalEncoder(
    (_convs): HybridConcurrent(
      (0): HybridSequential(
        (0): Conv1D(300 -> 100, kernel_size=(3,), stride=(1,))
        (1): HybridLambda(<lambda>)
        (2): Activation(relu)
      )
      (1): HybridSequential(
        (0): Conv1D(300 -> 100, kernel_size=(4,), stride=(1,))
        (1): HybridLambda(<lambda>)
        (2): Activation(relu)
      )
      (2): HybridSequential(
        (0): Conv1D(300 -> 100, kernel_size=(5,), stride=(1,))
        (1): HybridLambda(<lambda>)
        (2): Activation(relu)
      )
    )
  )
  (output): HybridSequential(
    (0): Dropout(p = 0.5, axes=())
    (1): Dense(None -> 2, linear)
  )
)
[Epoch 0 Batch 30/1540] avg loss 0.0138004, throughput 0.748774K wps
[Epoch 0 Batch 60/1540] avg loss 0.0138109, throughput 2.84564K wps
[Epoch 0 Batch 90/1540] avg loss 0.0137973, throughput 2.86792K wps
[Epoch 0 Batch 120/1540] avg loss 0.0138202, throughput 2.84788K wps
[Epoch 0 Batch 150/1540] avg loss 0.013823, throughput 2.84192K wps
[Epoch 0 Batch 180/1540] avg loss 0.0137685, throughput 2.87025K wps
[Epoch 0 Batch 210/1540] avg loss 0.0137934, throughput 2.85502K wps
[Epoch 0 Batch 240/1540] avg loss 0.0138037, throughput 2.86384K wps
[Epoch 0 Batch 270/1540] avg loss 0.0137626, throughput 2.83265K wps
[Epoch 0 Batch 300/1540] avg loss 0.0137211, throughput 2.85611K wps
[Epoch 0 Batch 330/1540] avg loss 0.0138154, throughput 2.84877K wps
[Epoch 0 Batch 360/1540] avg loss 0.0137426, throughput 2.80955K wps
[Epoch 0 Batch 390/1540] avg loss 0.0138279, throughput 2.85582K wps
[Epoch 0 Batch 420/1540] avg loss 0.0136362, throughput 2.82855K wps
[Epoch 0 Batch 450/1540] avg loss 0.0136607, throughput 2.84329K wps
[Epoch 0 Batch 480/1540] avg loss 0.0138069, throughput 2.812K wps
[Epoch 0 Batch 510/1540] avg loss 0.0137447, throughput 2.83391K wps
[Epoch 0 Batch 540/1540] avg loss 0.0136492, throughput 2.8742K wps
[Epoch 0 Batch 570/1540] avg loss 0.0137062, throughput 2.87247K wps
[Epoch 0 Batch 600/1540] avg loss 0.0135451, throughput 2.878K wps
[Epoch 0 Batch 630/1540] avg loss 0.0136163, throughput 2.85093K wps
[Epoch 0 Batch 660/1540] avg loss 0.0137568, throughput 2.86394K wps
[Epoch 0 Batch 690/1540] avg loss 0.0137163, throughput 2.84508K wps
[Epoch 0 Batch 720/1540] avg loss 0.013598, throughput 2.79075K wps
[Epoch 0 Batch 750/1540] avg loss 0.0137718, throughput 2.78031K wps
[Epoch 0 Batch 780/1540] avg loss 0.0137142, throughput 2.86873K wps
[Epoch 0 Batch 810/1540] avg loss 0.0135996, throughput 2.86383K wps
[Epoch 0 Batch 840/1540] avg loss 0.013755, throughput 2.77059K wps
[Epoch 0 Batch 870/1540] avg loss 0.0137318, throughput 2.8167K wps
[Epoch 0 Batch 900/1540] avg loss 0.0136668, throughput 2.84457K wps
[Epoch 0 Batch 930/1540] avg loss 0.0137071, throughput 2.80267K wps
[Epoch 0 Batch 960/1540] avg loss 0.0137056, throughput 2.87838K wps
[Epoch 0 Batch 990/1540] avg loss 0.0137057, throughput 2.84067K wps
[Epoch 0 Batch 1020/1540] avg loss 0.0136072, throughput 2.82948K wps
[Epoch 0 Batch 1050/1540] avg loss 0.0136353, throughput 2.87821K wps
[Epoch 0 Batch 1080/1540] avg loss 0.013673, throughput 2.8781K wps
[Epoch 0 Batch 1110/1540] avg loss 0.0136834, throughput 2.87317K wps
[Epoch 0 Batch 1140/1540] avg loss 0.0136265, throughput 2.83966K wps
[Epoch 0 Batch 1170/1540] avg loss 0.0137202, throughput 2.83108K wps
[Epoch 0 Batch 1200/1540] avg loss 0.0136948, throughput 2.85214K wps
[Epoch 0 Batch 1230/1540] avg loss 0.0137064, throughput 2.8669K wps
[Epoch 0 Batch 1260/1540] avg loss 0.0137498, throughput 2.80595K wps
[Epoch 0 Batch 1290/1540] avg loss 0.0137196, throughput 2.77533K wps
[Epoch 0 Batch 1320/1540] avg loss 0.0136522, throughput 2.8534K wps
[Epoch 0 Batch 1350/1540] avg loss 0.013645, throughput 2.865K wps
[Epoch 0 Batch 1380/1540] avg loss 0.0136207, throughput 2.85378K wps
[Epoch 0 Batch 1410/1540] avg loss 0.0136265, throughput 2.84326K wps
[Epoch 0 Batch 1440/1540] avg loss 0.0136989, throughput 2.79218K wps
[Epoch 0 Batch 1470/1540] avg loss 0.013661, throughput 2.8306K wps
[Epoch 0 Batch 1500/1540] avg loss 0.013638, throughput 2.87707K wps
[Epoch 0 Batch 1530/1540] avg loss 0.0136524, throughput 2.87419K wps
Begin Testing...
[Epoch 0] train avg loss 0.013714, dev acc 0.5596, dev avg loss 0.687023, throughput 2.60711K wps
Observed Improvement.
Begin Testing...
[Batch 30/37] elapsed 0.12 s
[Epoch 1 Batch 30/1540] avg loss 0.0135832, throughput 2.86227K wps
[Epoch 1 Batch 60/1540] avg loss 0.0135932, throughput 2.82791K wps
[Epoch 1 Batch 90/1540] avg loss 0.0136373, throughput 2.87172K wps
[Epoch 1 Batch 120/1540] avg loss 0.0134875, throughput 2.86972K wps
[Epoch 1 Batch 150/1540] avg loss 0.0136505, throughput 2.85811K wps
[Epoch 1 Batch 180/1540] avg loss 0.0136201, throughput 2.82788K wps
[Epoch 1 Batch 210/1540] avg loss 0.013589, throughput 2.85694K wps
[Epoch 1 Batch 240/1540] avg loss 0.0135679, throughput 2.87736K wps
[Epoch 1 Batch 270/1540] avg loss 0.0135552, throughput 2.87208K wps
[Epoch 1 Batch 300/1540] avg loss 0.0136459, throughput 2.84159K wps
[Epoch 1 Batch 330/1540] avg loss 0.0136596, throughput 2.78248K wps
[Epoch 1 Batch 360/1540] avg loss 0.0135834, throughput 2.85935K wps
[Epoch 1 Batch 390/1540] avg loss 0.0136186, throughput 2.84167K wps
[Epoch 1 Batch 420/1540] avg loss 0.0136105, throughput 2.80499K wps
[Epoch 1 Batch 450/1540] avg loss 0.0137079, throughput 2.8343K wps
[Epoch 1 Batch 480/1540] avg loss 0.0134815, throughput 2.80809K wps
[Epoch 1 Batch 510/1540] avg loss 0.0136119, throughput 2.88064K wps
[Epoch 1 Batch 540/1540] avg loss 0.0134643, throughput 2.87233K wps
[Epoch 1 Batch 570/1540] avg loss 0.0136057, throughput 2.80412K wps
[Epoch 1 Batch 600/1540] avg loss 0.0135286, throughput 2.8745K wps
[Epoch 1 Batch 630/1540] avg loss 0.0134499, throughput 2.83625K wps
[Epoch 1 Batch 660/1540] avg loss 0.0135644, throughput 2.83596K wps
[Epoch 1 Batch 690/1540] avg loss 0.0135062, throughput 2.86191K wps
[Epoch 1 Batch 720/1540] avg loss 0.0135646, throughput 2.87746K wps
[Epoch 1 Batch 750/1540] avg loss 0.0136507, throughput 2.87634K wps
[Epoch 1 Batch 780/1540] avg loss 0.0135311, throughput 2.82194K wps
[Epoch 1 Batch 810/1540] avg loss 0.0136298, throughput 2.84957K wps
[Epoch 1 Batch 840/1540] avg loss 0.0135529, throughput 2.832K wps
[Epoch 1 Batch 870/1540] avg loss 0.0135618, throughput 2.87618K wps
[Epoch 1 Batch 900/1540] avg loss 0.013478, throughput 2.87753K wps
[Epoch 1 Batch 930/1540] avg loss 0.0136277, throughput 2.83478K wps
[Epoch 1 Batch 960/1540] avg loss 0.0134312, throughput 2.84745K wps
[Epoch 1 Batch 990/1540] avg loss 0.0135353, throughput 2.86332K wps
[Epoch 1 Batch 1020/1540] avg loss 0.0134932, throughput 2.82394K wps
[Epoch 1 Batch 1050/1540] avg loss 0.0134916, throughput 2.86456K wps
[Epoch 1 Batch 1080/1540] avg loss 0.0135267, throughput 2.88255K wps
[Epoch 1 Batch 1110/1540] avg loss 0.0135142, throughput 2.84973K wps
[Epoch 1 Batch 1140/1540] avg loss 0.0134453, throughput 2.78757K wps
[Epoch 1 Batch 1170/1540] avg loss 0.0134157, throughput 2.7842K wps
[Epoch 1 Batch 1200/1540] avg loss 0.0134685, throughput 2.83834K wps
[Epoch 1 Batch 1230/1540] avg loss 0.0136388, throughput 2.8008K wps
[Epoch 1 Batch 1260/1540] avg loss 0.0134214, throughput 2.85152K wps
[Epoch 1 Batch 1290/1540] avg loss 0.0133604, throughput 2.86685K wps
[Epoch 1 Batch 1320/1540] avg loss 0.0134374, throughput 2.86778K wps
[Epoch 1 Batch 1350/1540] avg loss 0.0135148, throughput 2.86068K wps
[Epoch 1 Batch 1380/1540] avg loss 0.0134876, throughput 2.86039K wps
[Epoch 1 Batch 1410/1540] avg loss 0.0134357, throughput 2.86624K wps
[Epoch 1 Batch 1440/1540] avg loss 0.013369, throughput 2.85966K wps
[Epoch 1 Batch 1470/1540] avg loss 0.0134107, throughput 2.85568K wps
[Epoch 1 Batch 1500/1540] avg loss 0.0134085, throughput 2.84484K wps
[Epoch 1 Batch 1530/1540] avg loss 0.0134981, throughput 2.87142K wps
Begin Testing...
[Epoch 1] train avg loss 0.0135392, dev acc 0.6307, dev avg loss 0.672574, throughput 2.8479K wps
Observed Improvement.
Begin Testing...
[Batch 30/37] elapsed 0.12 s
[Epoch 2 Batch 30/1540] avg loss 0.0133759, throughput 2.87948K wps
[Epoch 2 Batch 60/1540] avg loss 0.0132897, throughput 2.87358K wps
[Epoch 2 Batch 90/1540] avg loss 0.0134477, throughput 2.87964K wps
[Epoch 2 Batch 120/1540] avg loss 0.0133849, throughput 2.88407K wps
[Epoch 2 Batch 150/1540] avg loss 0.0134694, throughput 2.85355K wps
[Epoch 2 Batch 180/1540] avg loss 0.0134142, throughput 2.87801K wps
[Epoch 2 Batch 210/1540] avg loss 0.0133096, throughput 2.88083K wps
[Epoch 2 Batch 240/1540] avg loss 0.0134146, throughput 2.85674K wps
[Epoch 2 Batch 270/1540] avg loss 0.0134303, throughput 2.82348K wps
[Epoch 2 Batch 300/1540] avg loss 0.0133716, throughput 2.84946K wps
[Epoch 2 Batch 330/1540] avg loss 0.0133088, throughput 2.85484K wps
[Epoch 2 Batch 360/1540] avg loss 0.0133007, throughput 2.8751K wps
[Epoch 2 Batch 390/1540] avg loss 0.0133131, throughput 2.87699K wps
[Epoch 2 Batch 420/1540] avg loss 0.0133858, throughput 2.87544K wps
[Epoch 2 Batch 450/1540] avg loss 0.0133583, throughput 2.83946K wps
[Epoch 2 Batch 480/1540] avg loss 0.0132419, throughput 2.84357K wps
[Epoch 2 Batch 510/1540] avg loss 0.0133307, throughput 2.87255K wps
[Epoch 2 Batch 540/1540] avg loss 0.0131001, throughput 2.86574K wps
[Epoch 2 Batch 570/1540] avg loss 0.0133911, throughput 2.86791K wps
[Epoch 2 Batch 600/1540] avg loss 0.0133887, throughput 2.8555K wps
[Epoch 2 Batch 630/1540] avg loss 0.0133636, throughput 2.85588K wps
[Epoch 2 Batch 660/1540] avg loss 0.0133111, throughput 2.86026K wps
[Epoch 2 Batch 690/1540] avg loss 0.0132738, throughput 2.86662K wps
[Epoch 2 Batch 720/1540] avg loss 0.0131999, throughput 2.85669K wps
[Epoch 2 Batch 750/1540] avg loss 0.0132786, throughput 2.85791K wps
[Epoch 2 Batch 780/1540] avg loss 0.0132843, throughput 2.83769K wps
[Epoch 2 Batch 810/1540] avg loss 0.0133804, throughput 2.84937K wps
[Epoch 2 Batch 840/1540] avg loss 0.013238, throughput 2.83274K wps
[Epoch 2 Batch 870/1540] avg loss 0.0134047, throughput 2.83185K wps
[Epoch 2 Batch 900/1540] avg loss 0.0132575, throughput 2.86519K wps
[Epoch 2 Batch 930/1540] avg loss 0.0131964, throughput 2.81784K wps
[Epoch 2 Batch 960/1540] avg loss 0.0132731, throughput 2.85009K wps
[Epoch 2 Batch 990/1540] avg loss 0.0132442, throughput 2.84527K wps
[Epoch 2 Batch 1020/1540] avg loss 0.0132967, throughput 2.87948K wps
[Epoch 2 Batch 1050/1540] avg loss 0.0132044, throughput 2.85214K wps
[Epoch 2 Batch 1080/1540] avg loss 0.0131556, throughput 2.87514K wps
[Epoch 2 Batch 1110/1540] avg loss 0.0131895, throughput 2.86857K wps
[Epoch 2 Batch 1140/1540] avg loss 0.0132053, throughput 2.86702K wps
[Epoch 2 Batch 1170/1540] avg loss 0.0130771, throughput 2.85977K wps
[Epoch 2 Batch 1200/1540] avg loss 0.0131146, throughput 2.83268K wps
[Epoch 2 Batch 1230/1540] avg loss 0.0132125, throughput 2.87218K wps
[Epoch 2 Batch 1260/1540] avg loss 0.0130669, throughput 2.87333K wps
[Epoch 2 Batch 1290/1540] avg loss 0.013026, throughput 2.87589K wps
[Epoch 2 Batch 1320/1540] avg loss 0.012992, throughput 2.87523K wps
[Epoch 2 Batch 1350/1540] avg loss 0.0130996, throughput 2.87466K wps
[Epoch 2 Batch 1380/1540] avg loss 0.0131247, throughput 2.82573K wps
[Epoch 2 Batch 1410/1540] avg loss 0.0128969, throughput 2.85584K wps
[Epoch 2 Batch 1440/1540] avg loss 0.0130748, throughput 2.86088K wps
[Epoch 2 Batch 1470/1540] avg loss 0.0130485, throughput 2.87395K wps
[Epoch 2 Batch 1500/1540] avg loss 0.013037, throughput 2.86989K wps
[Epoch 2 Batch 1530/1540] avg loss 0.0130386, throughput 2.85385K wps
Begin Testing...
[Epoch 2] train avg loss 0.0132523, dev acc 0.6800, dev avg loss 0.645965, throughput 2.85944K wps
Observed Improvement.
Begin Testing...
[Batch 30/37] elapsed 0.12 s
[Epoch 3 Batch 30/1540] avg loss 0.0129923, throughput 2.92239K wps
[Epoch 3 Batch 60/1540] avg loss 0.0130136, throughput 2.8446K wps
[Epoch 3 Batch 90/1540] avg loss 0.0130823, throughput 2.87191K wps
[Epoch 3 Batch 120/1540] avg loss 0.0131139, throughput 2.84983K wps
[Epoch 3 Batch 150/1540] avg loss 0.0128815, throughput 2.86898K wps
[Epoch 3 Batch 180/1540] avg loss 0.0129892, throughput 2.87856K wps
[Epoch 3 Batch 210/1540] avg loss 0.0129723, throughput 2.84054K wps
[Epoch 3 Batch 240/1540] avg loss 0.0130261, throughput 2.87275K wps
[Epoch 3 Batch 270/1540] avg loss 0.0130874, throughput 2.87694K wps
[Epoch 3 Batch 300/1540] avg loss 0.0129992, throughput 2.84739K wps
[Epoch 3 Batch 330/1540] avg loss 0.0127983, throughput 2.82931K wps
[Epoch 3 Batch 360/1540] avg loss 0.0128736, throughput 2.81006K wps
[Epoch 3 Batch 390/1540] avg loss 0.0126295, throughput 2.84396K wps
[Epoch 3 Batch 420/1540] avg loss 0.0129446, throughput 2.86718K wps
[Epoch 3 Batch 450/1540] avg loss 0.0129793, throughput 2.85866K wps
[Epoch 3 Batch 480/1540] avg loss 0.0128536, throughput 2.86042K wps
[Epoch 3 Batch 510/1540] avg loss 0.0128249, throughput 2.84524K wps
[Epoch 3 Batch 540/1540] avg loss 0.0128234, throughput 2.87389K wps
[Epoch 3 Batch 570/1540] avg loss 0.0125954, throughput 2.86267K wps
[Epoch 3 Batch 600/1540] avg loss 0.0128308, throughput 2.83533K wps
[Epoch 3 Batch 630/1540] avg loss 0.0129443, throughput 2.88006K wps
[Epoch 3 Batch 660/1540] avg loss 0.0127793, throughput 2.87001K wps
[Epoch 3 Batch 690/1540] avg loss 0.012889, throughput 2.87715K wps
[Epoch 3 Batch 720/1540] avg loss 0.0126644, throughput 2.85958K wps
[Epoch 3 Batch 750/1540] avg loss 0.0127483, throughput 2.84097K wps
[Epoch 3 Batch 780/1540] avg loss 0.0126084, throughput 2.83583K wps
[Epoch 3 Batch 810/1540] avg loss 0.0126001, throughput 2.86778K wps
[Epoch 3 Batch 840/1540] avg loss 0.0126695, throughput 2.85772K wps
[Epoch 3 Batch 870/1540] avg loss 0.0125709, throughput 2.87201K wps
[Epoch 3 Batch 900/1540] avg loss 0.0126231, throughput 2.82978K wps
[Epoch 3 Batch 930/1540] avg loss 0.0126425, throughput 2.85174K wps
[Epoch 3 Batch 960/1540] avg loss 0.0126107, throughput 2.80688K wps
[Epoch 3 Batch 990/1540] avg loss 0.0125201, throughput 2.85561K wps
[Epoch 3 Batch 1020/1540] avg loss 0.0127235, throughput 2.86877K wps
[Epoch 3 Batch 1050/1540] avg loss 0.0125715, throughput 2.84838K wps
[Epoch 3 Batch 1080/1540] avg loss 0.0124887, throughput 2.86394K wps
[Epoch 3 Batch 1110/1540] avg loss 0.0127491, throughput 2.83163K wps
[Epoch 3 Batch 1140/1540] avg loss 0.0124604, throughput 2.8722K wps
[Epoch 3 Batch 1170/1540] avg loss 0.0124426, throughput 2.83278K wps
[Epoch 3 Batch 1200/1540] avg loss 0.0125199, throughput 2.78996K wps
[Epoch 3 Batch 1230/1540] avg loss 0.0125532, throughput 2.84109K wps
[Epoch 3 Batch 1260/1540] avg loss 0.0124685, throughput 2.83328K wps
[Epoch 3 Batch 1290/1540] avg loss 0.0124559, throughput 2.86705K wps
[Epoch 3 Batch 1320/1540] avg loss 0.0125179, throughput 2.8554K wps
[Epoch 3 Batch 1350/1540] avg loss 0.0122735, throughput 2.87615K wps
[Epoch 3 Batch 1380/1540] avg loss 0.0125621, throughput 2.87624K wps
[Epoch 3 Batch 1410/1540] avg loss 0.0127375, throughput 2.87155K wps
[Epoch 3 Batch 1440/1540] avg loss 0.0122948, throughput 2.86514K wps
[Epoch 3 Batch 1470/1540] avg loss 0.0125175, throughput 2.83488K wps
[Epoch 3 Batch 1500/1540] avg loss 0.0123382, throughput 2.86703K wps
[Epoch 3 Batch 1530/1540] avg loss 0.012455, throughput 2.86083K wps
Begin Testing...
[Epoch 3] train avg loss 0.012718, dev acc 0.6755, dev avg loss 0.60974, throughput 2.85526K wps
[Epoch 4 Batch 30/1540] avg loss 0.0125572, throughput 2.92357K wps
[Epoch 4 Batch 60/1540] avg loss 0.0122396, throughput 2.86992K wps
[Epoch 4 Batch 90/1540] avg loss 0.0123901, throughput 2.85577K wps
[Epoch 4 Batch 120/1540] avg loss 0.012153, throughput 2.87528K wps
[Epoch 4 Batch 150/1540] avg loss 0.0123142, throughput 2.86424K wps
[Epoch 4 Batch 180/1540] avg loss 0.0122087, throughput 2.83155K wps
[Epoch 4 Batch 210/1540] avg loss 0.0120872, throughput 2.87105K wps
[Epoch 4 Batch 240/1540] avg loss 0.0121988, throughput 2.87384K wps
[Epoch 4 Batch 270/1540] avg loss 0.0121247, throughput 2.83189K wps
[Epoch 4 Batch 300/1540] avg loss 0.012065, throughput 2.8535K wps
[Epoch 4 Batch 330/1540] avg loss 0.0120954, throughput 2.82428K wps
[Epoch 4 Batch 360/1540] avg loss 0.0123357, throughput 2.84309K wps
[Epoch 4 Batch 390/1540] avg loss 0.0121202, throughput 2.84239K wps
[Epoch 4 Batch 420/1540] avg loss 0.0122495, throughput 2.87225K wps
[Epoch 4 Batch 450/1540] avg loss 0.0121583, throughput 2.85514K wps
[Epoch 4 Batch 480/1540] avg loss 0.0119734, throughput 2.85955K wps
[Epoch 4 Batch 510/1540] avg loss 0.0120053, throughput 2.86879K wps
[Epoch 4 Batch 540/1540] avg loss 0.0120942, throughput 2.85683K wps
[Epoch 4 Batch 570/1540] avg loss 0.0122327, throughput 2.85976K wps
[Epoch 4 Batch 600/1540] avg loss 0.0118178, throughput 2.84185K wps
[Epoch 4 Batch 630/1540] avg loss 0.0119157, throughput 2.79804K wps
[Epoch 4 Batch 660/1540] avg loss 0.0118483, throughput 2.85401K wps
[Epoch 4 Batch 690/1540] avg loss 0.0117789, throughput 2.86022K wps
[Epoch 4 Batch 720/1540] avg loss 0.011994, throughput 2.84566K wps
[Epoch 4 Batch 750/1540] avg loss 0.0117548, throughput 2.77875K wps
[Epoch 4 Batch 780/1540] avg loss 0.0116677, throughput 2.84742K wps
[Epoch 4 Batch 810/1540] avg loss 0.0116204, throughput 2.87215K wps
[Epoch 4 Batch 840/1540] avg loss 0.0119183, throughput 2.88186K wps
[Epoch 4 Batch 870/1540] avg loss 0.0118464, throughput 2.87139K wps
[Epoch 4 Batch 900/1540] avg loss 0.0118322, throughput 2.81555K wps
[Epoch 4 Batch 930/1540] avg loss 0.011724, throughput 2.86834K wps
[Epoch 4 Batch 960/1540] avg loss 0.0121262, throughput 2.87378K wps
[Epoch 4 Batch 990/1540] avg loss 0.0119363, throughput 2.86169K wps
[Epoch 4 Batch 1020/1540] avg loss 0.0118567, throughput 2.87693K wps
[Epoch 4 Batch 1050/1540] avg loss 0.0117349, throughput 2.80259K wps
[Epoch 4 Batch 1080/1540] avg loss 0.0113797, throughput 2.85144K wps
[Epoch 4 Batch 1110/1540] avg loss 0.011804, throughput 2.8186K wps
[Epoch 4 Batch 1140/1540] avg loss 0.0115873, throughput 2.86864K wps
[Epoch 4 Batch 1170/1540] avg loss 0.0117139, throughput 2.85465K wps
[Epoch 4 Batch 1200/1540] avg loss 0.0116297, throughput 2.86959K wps
[Epoch 4 Batch 1230/1540] avg loss 0.0116782, throughput 2.85461K wps
[Epoch 4 Batch 1260/1540] avg loss 0.0113475, throughput 2.846K wps
[Epoch 4 Batch 1290/1540] avg loss 0.0114436, throughput 2.864K wps
[Epoch 4 Batch 1320/1540] avg loss 0.011606, throughput 2.87069K wps
[Epoch 4 Batch 1350/1540] avg loss 0.0113964, throughput 2.85623K wps
[Epoch 4 Batch 1380/1540] avg loss 0.0113831, throughput 2.84508K wps
[Epoch 4 Batch 1410/1540] avg loss 0.0115043, throughput 2.87117K wps
[Epoch 4 Batch 1440/1540] avg loss 0.0114194, throughput 2.86567K wps
[Epoch 4 Batch 1470/1540] avg loss 0.0115309, throughput 2.82584K wps
[Epoch 4 Batch 1500/1540] avg loss 0.011224, throughput 2.78014K wps
[Epoch 4 Batch 1530/1540] avg loss 0.0115118, throughput 2.81791K wps
Begin Testing...
[Epoch 4] train avg loss 0.0118697, dev acc 0.7328, dev avg loss 0.563926, throughput 2.85161K wps
Observed Improvement.
Begin Testing...
[Batch 30/37] elapsed 0.12 s
[Epoch 5 Batch 30/1540] avg loss 0.0112126, throughput 2.89362K wps
[Epoch 5 Batch 60/1540] avg loss 0.0112174, throughput 2.84711K wps
[Epoch 5 Batch 90/1540] avg loss 0.0111179, throughput 2.77902K wps
[Epoch 5 Batch 120/1540] avg loss 0.0111249, throughput 2.81623K wps
[Epoch 5 Batch 150/1540] avg loss 0.010953, throughput 2.86461K wps
[Epoch 5 Batch 180/1540] avg loss 0.0110536, throughput 2.83347K wps
[Epoch 5 Batch 210/1540] avg loss 0.0108626, throughput 2.85891K wps
[Epoch 5 Batch 240/1540] avg loss 0.0108945, throughput 2.82328K wps
[Epoch 5 Batch 270/1540] avg loss 0.0109154, throughput 2.83112K wps
[Epoch 5 Batch 300/1540] avg loss 0.0109706, throughput 2.81987K wps
[Epoch 5 Batch 330/1540] avg loss 0.0110977, throughput 2.87863K wps
[Epoch 5 Batch 360/1540] avg loss 0.0109776, throughput 2.87388K wps
[Epoch 5 Batch 390/1540] avg loss 0.0111206, throughput 2.86252K wps
[Epoch 5 Batch 420/1540] avg loss 0.0108639, throughput 2.80473K wps
[Epoch 5 Batch 450/1540] avg loss 0.0111617, throughput 2.83524K wps
[Epoch 5 Batch 480/1540] avg loss 0.0108822, throughput 2.87329K wps
[Epoch 5 Batch 510/1540] avg loss 0.0109191, throughput 2.86906K wps
[Epoch 5 Batch 540/1540] avg loss 0.0107287, throughput 2.86481K wps
[Epoch 5 Batch 570/1540] avg loss 0.0106061, throughput 2.8623K wps
[Epoch 5 Batch 600/1540] avg loss 0.0109577, throughput 2.85949K wps
[Epoch 5 Batch 630/1540] avg loss 0.0108638, throughput 2.86017K wps
[Epoch 5 Batch 660/1540] avg loss 0.0108706, throughput 2.87993K wps
[Epoch 5 Batch 690/1540] avg loss 0.0108266, throughput 2.80922K wps
[Epoch 5 Batch 720/1540] avg loss 0.0107844, throughput 2.87708K wps
[Epoch 5 Batch 750/1540] avg loss 0.010623, throughput 2.88049K wps
[Epoch 5 Batch 780/1540] avg loss 0.010808, throughput 2.87552K wps
[Epoch 5 Batch 810/1540] avg loss 0.0105911, throughput 2.87466K wps
[Epoch 5 Batch 840/1540] avg loss 0.0104744, throughput 2.8703K wps
[Epoch 5 Batch 870/1540] avg loss 0.0105409, throughput 2.87683K wps
[Epoch 5 Batch 900/1540] avg loss 0.0104029, throughput 2.82022K wps
[Epoch 5 Batch 930/1540] avg loss 0.0107438, throughput 2.87093K wps
[Epoch 5 Batch 960/1540] avg loss 0.0104448, throughput 2.85399K wps
[Epoch 5 Batch 990/1540] avg loss 0.0106657, throughput 2.80573K wps
[Epoch 5 Batch 1020/1540] avg loss 0.0101842, throughput 2.81487K wps
[Epoch 5 Batch 1050/1540] avg loss 0.0105361, throughput 2.83669K wps
[Epoch 5 Batch 1080/1540] avg loss 0.0102072, throughput 2.85008K wps
[Epoch 5 Batch 1110/1540] avg loss 0.010488, throughput 2.8502K wps
[Epoch 5 Batch 1140/1540] avg loss 0.0103501, throughput 2.79995K wps
[Epoch 5 Batch 1170/1540] avg loss 0.0101048, throughput 2.79695K wps
[Epoch 5 Batch 1200/1540] avg loss 0.0100308, throughput 2.80336K wps
[Epoch 5 Batch 1230/1540] avg loss 0.0103184, throughput 2.83569K wps
[Epoch 5 Batch 1260/1540] avg loss 0.0103771, throughput 2.85997K wps
[Epoch 5 Batch 1290/1540] avg loss 0.0105557, throughput 2.84893K wps
[Epoch 5 Batch 1320/1540] avg loss 0.0102983, throughput 2.83776K wps
[Epoch 5 Batch 1350/1540] avg loss 0.0100994, throughput 2.85406K wps
[Epoch 5 Batch 1380/1540] avg loss 0.0100077, throughput 2.86905K wps
[Epoch 5 Batch 1410/1540] avg loss 0.00984836, throughput 2.8778K wps
[Epoch 5 Batch 1440/1540] avg loss 0.0102557, throughput 2.84244K wps
[Epoch 5 Batch 1470/1540] avg loss 0.00991223, throughput 2.79344K wps
[Epoch 5 Batch 1500/1540] avg loss 0.00954781, throughput 2.77435K wps
[Epoch 5 Batch 1530/1540] avg loss 0.0100746, throughput 2.86985K wps
Begin Testing...
[Epoch 5] train avg loss 0.0106185, dev acc 0.7787, dev avg loss 0.519779, throughput 2.84537K wps
Observed Improvement.
Begin Testing...
[Batch 30/37] elapsed 0.12 s
[Epoch 6 Batch 30/1540] avg loss 0.0098245, throughput 2.88896K wps
[Epoch 6 Batch 60/1540] avg loss 0.00962132, throughput 2.84569K wps
[Epoch 6 Batch 90/1540] avg loss 0.0100202, throughput 2.84797K wps
[Epoch 6 Batch 120/1540] avg loss 0.00959598, throughput 2.85914K wps
[Epoch 6 Batch 150/1540] avg loss 0.00988194, throughput 2.88108K wps
[Epoch 6 Batch 180/1540] avg loss 0.0096392, throughput 2.85567K wps
[Epoch 6 Batch 210/1540] avg loss 0.00951429, throughput 2.81937K wps
[Epoch 6 Batch 240/1540] avg loss 0.00972758, throughput 2.84235K wps
[Epoch 6 Batch 270/1540] avg loss 0.00959005, throughput 2.81022K wps
[Epoch 6 Batch 300/1540] avg loss 0.00984259, throughput 2.85913K wps
[Epoch 6 Batch 330/1540] avg loss 0.0094906, throughput 2.87195K wps
[Epoch 6 Batch 360/1540] avg loss 0.00961345, throughput 2.83716K wps
[Epoch 6 Batch 390/1540] avg loss 0.0096149, throughput 2.84824K wps
[Epoch 6 Batch 420/1540] avg loss 0.00944561, throughput 2.80174K wps
[Epoch 6 Batch 450/1540] avg loss 0.00941356, throughput 2.78631K wps
[Epoch 6 Batch 480/1540] avg loss 0.00941492, throughput 2.79546K wps
[Epoch 6 Batch 510/1540] avg loss 0.00898626, throughput 2.81181K wps
[Epoch 6 Batch 540/1540] avg loss 0.00908801, throughput 2.86957K wps
[Epoch 6 Batch 570/1540] avg loss 0.00921519, throughput 2.85765K wps
[Epoch 6 Batch 600/1540] avg loss 0.00905014, throughput 2.85542K wps
[Epoch 6 Batch 630/1540] avg loss 0.00946734, throughput 2.86637K wps
[Epoch 6 Batch 660/1540] avg loss 0.00939207, throughput 2.8701K wps
[Epoch 6 Batch 690/1540] avg loss 0.00924371, throughput 2.84635K wps
[Epoch 6 Batch 720/1540] avg loss 0.00938426, throughput 2.86549K wps
[Epoch 6 Batch 750/1540] avg loss 0.00933438, throughput 2.87202K wps
[Epoch 6 Batch 780/1540] avg loss 0.00915644, throughput 2.84552K wps
[Epoch 6 Batch 810/1540] avg loss 0.00931434, throughput 2.87413K wps
[Epoch 6 Batch 840/1540] avg loss 0.00927732, throughput 2.87069K wps
[Epoch 6 Batch 870/1540] avg loss 0.00948765, throughput 2.83603K wps
[Epoch 6 Batch 900/1540] avg loss 0.00919847, throughput 2.81271K wps
[Epoch 6 Batch 930/1540] avg loss 0.00885069, throughput 2.78791K wps
[Epoch 6 Batch 960/1540] avg loss 0.00918094, throughput 2.78323K wps
[Epoch 6 Batch 990/1540] avg loss 0.00878389, throughput 2.76527K wps
[Epoch 6 Batch 1020/1540] avg loss 0.00903069, throughput 2.79435K wps
[Epoch 6 Batch 1050/1540] avg loss 0.00894816, throughput 2.81653K wps
[Epoch 6 Batch 1080/1540] avg loss 0.00915588, throughput 2.76909K wps
[Epoch 6 Batch 1110/1540] avg loss 0.0089336, throughput 2.80962K wps
[Epoch 6 Batch 1140/1540] avg loss 0.00915533, throughput 2.8671K wps
[Epoch 6 Batch 1170/1540] avg loss 0.00866029, throughput 2.85805K wps
[Epoch 6 Batch 1200/1540] avg loss 0.00894738, throughput 2.85913K wps
[Epoch 6 Batch 1230/1540] avg loss 0.00877337, throughput 2.86589K wps
[Epoch 6 Batch 1260/1540] avg loss 0.00891224, throughput 2.80636K wps
[Epoch 6 Batch 1290/1540] avg loss 0.00906667, throughput 2.83283K wps
[Epoch 6 Batch 1320/1540] avg loss 0.00862772, throughput 2.85331K wps
[Epoch 6 Batch 1350/1540] avg loss 0.00891718, throughput 2.81811K wps
[Epoch 6 Batch 1380/1540] avg loss 0.00897235, throughput 2.86313K wps
[Epoch 6 Batch 1410/1540] avg loss 0.00842482, throughput 2.86556K wps
[Epoch 6 Batch 1440/1540] avg loss 0.0087864, throughput 2.86064K wps
[Epoch 6 Batch 1470/1540] avg loss 0.00869268, throughput 2.86509K wps
[Epoch 6 Batch 1500/1540] avg loss 0.00844809, throughput 2.83551K wps
[Epoch 6 Batch 1530/1540] avg loss 0.00866327, throughput 2.80195K wps
Begin Testing...
[Epoch 6] train avg loss 0.00920906, dev acc 0.7970, dev avg loss 0.460756, throughput 2.83874K wps
Observed Improvement.
Begin Testing...
[Batch 30/37] elapsed 0.12 s
[Epoch 7 Batch 30/1540] avg loss 0.00825991, throughput 2.89203K wps
[Epoch 7 Batch 60/1540] avg loss 0.00881551, throughput 2.825K wps
[Epoch 7 Batch 90/1540] avg loss 0.00833516, throughput 2.85913K wps
[Epoch 7 Batch 120/1540] avg loss 0.00806622, throughput 2.85202K wps
[Epoch 7 Batch 150/1540] avg loss 0.00843859, throughput 2.83694K wps
[Epoch 7 Batch 180/1540] avg loss 0.00834409, throughput 2.84418K wps
[Epoch 7 Batch 210/1540] avg loss 0.00839169, throughput 2.86917K wps
[Epoch 7 Batch 240/1540] avg loss 0.00828628, throughput 2.85639K wps
[Epoch 7 Batch 270/1540] avg loss 0.00829326, throughput 2.84642K wps
[Epoch 7 Batch 300/1540] avg loss 0.00826126, throughput 2.86427K wps
[Epoch 7 Batch 330/1540] avg loss 0.00788044, throughput 2.85554K wps
[Epoch 7 Batch 360/1540] avg loss 0.00816125, throughput 2.8748K wps
[Epoch 7 Batch 390/1540] avg loss 0.00798977, throughput 2.87324K wps
[Epoch 7 Batch 420/1540] avg loss 0.00834245, throughput 2.8599K wps
[Epoch 7 Batch 450/1540] avg loss 0.0081372, throughput 2.87742K wps
[Epoch 7 Batch 480/1540] avg loss 0.00785917, throughput 2.87735K wps
[Epoch 7 Batch 510/1540] avg loss 0.00822373, throughput 2.87238K wps
[Epoch 7 Batch 540/1540] avg loss 0.00817121, throughput 2.80606K wps
[Epoch 7 Batch 570/1540] avg loss 0.00813353, throughput 2.84701K wps
[Epoch 7 Batch 600/1540] avg loss 0.00797193, throughput 2.87978K wps
[Epoch 7 Batch 630/1540] avg loss 0.00791665, throughput 2.87629K wps
[Epoch 7 Batch 660/1540] avg loss 0.0081805, throughput 2.83898K wps
[Epoch 7 Batch 690/1540] avg loss 0.00804365, throughput 2.80083K wps
[Epoch 7 Batch 720/1540] avg loss 0.00820712, throughput 2.78857K wps
[Epoch 7 Batch 750/1540] avg loss 0.00820856, throughput 2.8715K wps
[Epoch 7 Batch 780/1540] avg loss 0.00800739, throughput 2.87654K wps
[Epoch 7 Batch 810/1540] avg loss 0.00797157, throughput 2.87081K wps
[Epoch 7 Batch 840/1540] avg loss 0.0077511, throughput 2.87122K wps
[Epoch 7 Batch 870/1540] avg loss 0.00811865, throughput 2.87788K wps
[Epoch 7 Batch 900/1540] avg loss 0.00765177, throughput 2.84477K wps
[Epoch 7 Batch 930/1540] avg loss 0.00757489, throughput 2.80149K wps
[Epoch 7 Batch 960/1540] avg loss 0.00796375, throughput 2.83747K wps
[Epoch 7 Batch 990/1540] avg loss 0.00761744, throughput 2.86349K wps
[Epoch 7 Batch 1020/1540] avg loss 0.00782431, throughput 2.87655K wps
[Epoch 7 Batch 1050/1540] avg loss 0.00752091, throughput 2.8687K wps
[Epoch 7 Batch 1080/1540] avg loss 0.00769699, throughput 2.85456K wps
[Epoch 7 Batch 1110/1540] avg loss 0.00732822, throughput 2.87136K wps
[Epoch 7 Batch 1140/1540] avg loss 0.00779556, throughput 2.84986K wps
[Epoch 7 Batch 1170/1540] avg loss 0.00795337, throughput 2.84892K wps
[Epoch 7 Batch 1200/1540] avg loss 0.00762326, throughput 2.87471K wps
[Epoch 7 Batch 1230/1540] avg loss 0.00788853, throughput 2.85078K wps
[Epoch 7 Batch 1260/1540] avg loss 0.0078197, throughput 2.83619K wps
[Epoch 7 Batch 1290/1540] avg loss 0.00777646, throughput 2.78379K wps
[Epoch 7 Batch 1320/1540] avg loss 0.00789422, throughput 2.84311K wps
[Epoch 7 Batch 1350/1540] avg loss 0.00731866, throughput 2.86707K wps
[Epoch 7 Batch 1380/1540] avg loss 0.00752436, throughput 2.87333K wps
[Epoch 7 Batch 1410/1540] avg loss 0.00738245, throughput 2.87458K wps
[Epoch 7 Batch 1440/1540] avg loss 0.00764089, throughput 2.84285K wps
[Epoch 7 Batch 1470/1540] avg loss 0.00760671, throughput 2.86642K wps
[Epoch 7 Batch 1500/1540] avg loss 0.00744158, throughput 2.86612K wps
[Epoch 7 Batch 1530/1540] avg loss 0.00759741, throughput 2.87982K wps
Begin Testing...
[Epoch 7] train avg loss 0.00794728, dev acc 0.8005, dev avg loss 0.437719, throughput 2.85496K wps
Observed Improvement.
Begin Testing...
[Batch 30/37] elapsed 0.12 s
[Epoch 8 Batch 30/1540] avg loss 0.00700426, throughput 2.89692K wps
[Epoch 8 Batch 60/1540] avg loss 0.0071169, throughput 2.87137K wps
[Epoch 8 Batch 90/1540] avg loss 0.00701109, throughput 2.85659K wps
[Epoch 8 Batch 120/1540] avg loss 0.00726235, throughput 2.86725K wps
[Epoch 8 Batch 150/1540] avg loss 0.00723402, throughput 2.83711K wps
[Epoch 8 Batch 180/1540] avg loss 0.00723113, throughput 2.87776K wps
[Epoch 8 Batch 210/1540] avg loss 0.00725831, throughput 2.87068K wps
[Epoch 8 Batch 240/1540] avg loss 0.00715983, throughput 2.86004K wps
[Epoch 8 Batch 270/1540] avg loss 0.00693161, throughput 2.86467K wps
[Epoch 8 Batch 300/1540] avg loss 0.00693836, throughput 2.87248K wps
[Epoch 8 Batch 330/1540] avg loss 0.0071374, throughput 2.86431K wps
[Epoch 8 Batch 360/1540] avg loss 0.0073231, throughput 2.84465K wps
[Epoch 8 Batch 390/1540] avg loss 0.00678718, throughput 2.87325K wps
[Epoch 8 Batch 420/1540] avg loss 0.0070796, throughput 2.8738K wps
[Epoch 8 Batch 450/1540] avg loss 0.00725956, throughput 2.84717K wps
[Epoch 8 Batch 480/1540] avg loss 0.00720291, throughput 2.86924K wps
[Epoch 8 Batch 510/1540] avg loss 0.00717188, throughput 2.87498K wps
[Epoch 8 Batch 540/1540] avg loss 0.00691361, throughput 2.85918K wps
[Epoch 8 Batch 570/1540] avg loss 0.00734546, throughput 2.79205K wps
[Epoch 8 Batch 600/1540] avg loss 0.00704686, throughput 2.78737K wps
[Epoch 8 Batch 630/1540] avg loss 0.0071282, throughput 2.84455K wps
[Epoch 8 Batch 660/1540] avg loss 0.00688982, throughput 2.84754K wps
[Epoch 8 Batch 690/1540] avg loss 0.00730296, throughput 2.87633K wps
[Epoch 8 Batch 720/1540] avg loss 0.00687909, throughput 2.83198K wps
[Epoch 8 Batch 750/1540] avg loss 0.00730986, throughput 2.78896K wps
[Epoch 8 Batch 780/1540] avg loss 0.0070227, throughput 2.81495K wps
[Epoch 8 Batch 810/1540] avg loss 0.00707117, throughput 2.85642K wps
[Epoch 8 Batch 840/1540] avg loss 0.00674418, throughput 2.87021K wps
[Epoch 8 Batch 870/1540] avg loss 0.00707607, throughput 2.87595K wps
[Epoch 8 Batch 900/1540] avg loss 0.00675896, throughput 2.86891K wps
[Epoch 8 Batch 930/1540] avg loss 0.00669084, throughput 2.87824K wps
[Epoch 8 Batch 960/1540] avg loss 0.00637316, throughput 2.86867K wps
[Epoch 8 Batch 990/1540] avg loss 0.00726551, throughput 2.86205K wps
[Epoch 8 Batch 1020/1540] avg loss 0.00734874, throughput 2.78227K wps
[Epoch 8 Batch 1050/1540] avg loss 0.00646123, throughput 2.85748K wps
[Epoch 8 Batch 1080/1540] avg loss 0.0065004, throughput 2.87453K wps
[Epoch 8 Batch 1110/1540] avg loss 0.00704716, throughput 2.87549K wps
[Epoch 8 Batch 1140/1540] avg loss 0.00704922, throughput 2.87203K wps
[Epoch 8 Batch 1170/1540] avg loss 0.00695946, throughput 2.86819K wps
[Epoch 8 Batch 1200/1540] avg loss 0.00747787, throughput 2.85317K wps
[Epoch 8 Batch 1230/1540] avg loss 0.00705022, throughput 2.78019K wps
[Epoch 8 Batch 1260/1540] avg loss 0.00652246, throughput 2.81089K wps
[Epoch 8 Batch 1290/1540] avg loss 0.00654109, throughput 2.80301K wps
[Epoch 8 Batch 1320/1540] avg loss 0.00685872, throughput 2.88059K wps
[Epoch 8 Batch 1350/1540] avg loss 0.0066386, throughput 2.85119K wps
[Epoch 8 Batch 1380/1540] avg loss 0.00672991, throughput 2.87041K wps
[Epoch 8 Batch 1410/1540] avg loss 0.00642001, throughput 2.85193K wps
[Epoch 8 Batch 1440/1540] avg loss 0.00635343, throughput 2.8692K wps
[Epoch 8 Batch 1470/1540] avg loss 0.00715519, throughput 2.87862K wps
[Epoch 8 Batch 1500/1540] avg loss 0.00679608, throughput 2.86928K wps
[Epoch 8 Batch 1530/1540] avg loss 0.00666721, throughput 2.85659K wps
Begin Testing...
[Epoch 8] train avg loss 0.0069764, dev acc 0.8154, dev avg loss 0.419131, throughput 2.85368K wps
Observed Improvement.
Begin Testing...
[Batch 30/37] elapsed 0.12 s
[Epoch 9 Batch 30/1540] avg loss 0.00619578, throughput 2.88586K wps
[Epoch 9 Batch 60/1540] avg loss 0.00605075, throughput 2.86157K wps
[Epoch 9 Batch 90/1540] avg loss 0.00617871, throughput 2.86141K wps
[Epoch 9 Batch 120/1540] avg loss 0.00646453, throughput 2.8703K wps
[Epoch 9 Batch 150/1540] avg loss 0.00673407, throughput 2.87575K wps
[Epoch 9 Batch 180/1540] avg loss 0.00656423, throughput 2.83105K wps
[Epoch 9 Batch 210/1540] avg loss 0.00645156, throughput 2.87681K wps
[Epoch 9 Batch 240/1540] avg loss 0.00635163, throughput 2.85517K wps
[Epoch 9 Batch 270/1540] avg loss 0.00630716, throughput 2.84929K wps
[Epoch 9 Batch 300/1540] avg loss 0.00643651, throughput 2.84773K wps
[Epoch 9 Batch 330/1540] avg loss 0.00613593, throughput 2.86889K wps
[Epoch 9 Batch 360/1540] avg loss 0.00643492, throughput 2.87121K wps
[Epoch 9 Batch 390/1540] avg loss 0.00636353, throughput 2.80756K wps
[Epoch 9 Batch 420/1540] avg loss 0.0062237, throughput 2.84315K wps
[Epoch 9 Batch 450/1540] avg loss 0.00640715, throughput 2.873K wps
[Epoch 9 Batch 480/1540] avg loss 0.00652341, throughput 2.84392K wps
[Epoch 9 Batch 510/1540] avg loss 0.00642114, throughput 2.86765K wps
[Epoch 9 Batch 540/1540] avg loss 0.00618197, throughput 2.86862K wps
[Epoch 9 Batch 570/1540] avg loss 0.00655068, throughput 2.85865K wps
[Epoch 9 Batch 600/1540] avg loss 0.00626943, throughput 2.84815K wps
[Epoch 9 Batch 630/1540] avg loss 0.00605462, throughput 2.86374K wps
[Epoch 9 Batch 660/1540] avg loss 0.00659492, throughput 2.86841K wps
[Epoch 9 Batch 690/1540] avg loss 0.00614132, throughput 2.85061K wps
[Epoch 9 Batch 720/1540] avg loss 0.00642699, throughput 2.87782K wps
[Epoch 9 Batch 750/1540] avg loss 0.00595195, throughput 2.86046K wps
[Epoch 9 Batch 780/1540] avg loss 0.00627769, throughput 2.82313K wps
[Epoch 9 Batch 810/1540] avg loss 0.00628799, throughput 2.87666K wps
[Epoch 9 Batch 840/1540] avg loss 0.00583507, throughput 2.85026K wps
[Epoch 9 Batch 870/1540] avg loss 0.00636069, throughput 2.8064K wps
[Epoch 9 Batch 900/1540] avg loss 0.00613266, throughput 2.8593K wps
[Epoch 9 Batch 930/1540] avg loss 0.0065748, throughput 2.83976K wps
[Epoch 9 Batch 960/1540] avg loss 0.00600959, throughput 2.86833K wps
[Epoch 9 Batch 990/1540] avg loss 0.00654631, throughput 2.86886K wps
[Epoch 9 Batch 1020/1540] avg loss 0.00608594, throughput 2.85835K wps
[Epoch 9 Batch 1050/1540] avg loss 0.00638485, throughput 2.82088K wps
[Epoch 9 Batch 1080/1540] avg loss 0.00587679, throughput 2.84836K wps
[Epoch 9 Batch 1110/1540] avg loss 0.00592697, throughput 2.84355K wps
[Epoch 9 Batch 1140/1540] avg loss 0.00603676, throughput 2.861K wps
[Epoch 9 Batch 1170/1540] avg loss 0.00620328, throughput 2.80242K wps
[Epoch 9 Batch 1200/1540] avg loss 0.00596717, throughput 2.84354K wps
[Epoch 9 Batch 1230/1540] avg loss 0.00649963, throughput 2.85948K wps
[Epoch 9 Batch 1260/1540] avg loss 0.00661678, throughput 2.85709K wps
[Epoch 9 Batch 1290/1540] avg loss 0.00619676, throughput 2.85552K wps
[Epoch 9 Batch 1320/1540] avg loss 0.00608795, throughput 2.8648K wps
[Epoch 9 Batch 1350/1540] avg loss 0.00603408, throughput 2.86484K wps
[Epoch 9 Batch 1380/1540] avg loss 0.00601827, throughput 2.86878K wps
[Epoch 9 Batch 1410/1540] avg loss 0.00602206, throughput 2.87319K wps
[Epoch 9 Batch 1440/1540] avg loss 0.00625086, throughput 2.87469K wps
[Epoch 9 Batch 1470/1540] avg loss 0.00580507, throughput 2.85548K wps
[Epoch 9 Batch 1500/1540] avg loss 0.00612506, throughput 2.87051K wps
[Epoch 9 Batch 1530/1540] avg loss 0.00595437, throughput 2.82238K wps
Begin Testing...
[Epoch 9] train avg loss 0.00625529, dev acc 0.8085, dev avg loss 0.417866, throughput 2.8552K wps
[Epoch 10 Batch 30/1540] avg loss 0.00560278, throughput 2.86309K wps
[Epoch 10 Batch 60/1540] avg loss 0.00576539, throughput 2.7933K wps
[Epoch 10 Batch 90/1540] avg loss 0.00591446, throughput 2.80802K wps
[Epoch 10 Batch 120/1540] avg loss 0.00560873, throughput 2.81841K wps
[Epoch 10 Batch 150/1540] avg loss 0.00552855, throughput 2.83278K wps
[Epoch 10 Batch 180/1540] avg loss 0.00532143, throughput 2.85648K wps
[Epoch 10 Batch 210/1540] avg loss 0.00561921, throughput 2.85415K wps
[Epoch 10 Batch 240/1540] avg loss 0.00606827, throughput 2.87784K wps
[Epoch 10 Batch 270/1540] avg loss 0.00598494, throughput 2.824K wps
[Epoch 10 Batch 300/1540] avg loss 0.00540564, throughput 2.83927K wps
[Epoch 10 Batch 330/1540] avg loss 0.00539115, throughput 2.8692K wps
[Epoch 10 Batch 360/1540] avg loss 0.00580298, throughput 2.88198K wps
[Epoch 10 Batch 390/1540] avg loss 0.00586173, throughput 2.83944K wps
[Epoch 10 Batch 420/1540] avg loss 0.00576411, throughput 2.85458K wps
[Epoch 10 Batch 450/1540] avg loss 0.00568409, throughput 2.81329K wps
[Epoch 10 Batch 480/1540] avg loss 0.0059675, throughput 2.86029K wps
[Epoch 10 Batch 510/1540] avg loss 0.00548594, throughput 2.86642K wps
[Epoch 10 Batch 540/1540] avg loss 0.00594244, throughput 2.79066K wps
[Epoch 10 Batch 570/1540] avg loss 0.00568997, throughput 2.80611K wps
[Epoch 10 Batch 600/1540] avg loss 0.00594787, throughput 2.85608K wps
[Epoch 10 Batch 630/1540] avg loss 0.00653243, throughput 2.86725K wps
[Epoch 10 Batch 660/1540] avg loss 0.00568763, throughput 2.86858K wps
[Epoch 10 Batch 690/1540] avg loss 0.00546361, throughput 2.87145K wps
[Epoch 10 Batch 720/1540] avg loss 0.0057613, throughput 2.8699K wps
[Epoch 10 Batch 750/1540] avg loss 0.0055321, throughput 2.86078K wps
[Epoch 10 Batch 780/1540] avg loss 0.00585637, throughput 2.84849K wps
[Epoch 10 Batch 810/1540] avg loss 0.00540297, throughput 2.87501K wps
[Epoch 10 Batch 840/1540] avg loss 0.00549143, throughput 2.87859K wps
[Epoch 10 Batch 870/1540] avg loss 0.00587356, throughput 2.85276K wps
[Epoch 10 Batch 900/1540] avg loss 0.00607192, throughput 2.83686K wps
[Epoch 10 Batch 930/1540] avg loss 0.00589352, throughput 2.86395K wps
[Epoch 10 Batch 960/1540] avg loss 0.00573896, throughput 2.87819K wps
[Epoch 10 Batch 990/1540] avg loss 0.0059876, throughput 2.87876K wps
[Epoch 10 Batch 1020/1540] avg loss 0.00566614, throughput 2.8719K wps
[Epoch 10 Batch 1050/1540] avg loss 0.00580399, throughput 2.85761K wps
[Epoch 10 Batch 1080/1540] avg loss 0.00627715, throughput 2.85497K wps
[Epoch 10 Batch 1110/1540] avg loss 0.00526307, throughput 2.8603K wps
[Epoch 10 Batch 1140/1540] avg loss 0.00545778, throughput 2.8599K wps
[Epoch 10 Batch 1170/1540] avg loss 0.00545641, throughput 2.87173K wps
[Epoch 10 Batch 1200/1540] avg loss 0.00546712, throughput 2.87661K wps
[Epoch 10 Batch 1230/1540] avg loss 0.00576475, throughput 2.84398K wps
[Epoch 10 Batch 1260/1540] avg loss 0.00554865, throughput 2.84947K wps
[Epoch 10 Batch 1290/1540] avg loss 0.00613281, throughput 2.86158K wps
[Epoch 10 Batch 1320/1540] avg loss 0.00559378, throughput 2.85915K wps
[Epoch 10 Batch 1350/1540] avg loss 0.00519544, throughput 2.8594K wps
[Epoch 10 Batch 1380/1540] avg loss 0.00518721, throughput 2.85886K wps
[Epoch 10 Batch 1410/1540] avg loss 0.00532817, throughput 2.86864K wps
[Epoch 10 Batch 1440/1540] avg loss 0.00539702, throughput 2.87141K wps
[Epoch 10 Batch 1470/1540] avg loss 0.00548314, throughput 2.86375K wps
[Epoch 10 Batch 1500/1540] avg loss 0.00576672, throughput 2.85622K wps
[Epoch 10 Batch 1530/1540] avg loss 0.00564908, throughput 2.85837K wps
Begin Testing...
[Epoch 10] train avg loss 0.00568935, dev acc 0.8268, dev avg loss 0.417476, throughput 2.85396K wps
Observed Improvement.
Begin Testing...
[Batch 30/37] elapsed 0.12 s
[Epoch 11 Batch 30/1540] avg loss 0.00529954, throughput 2.92189K wps
[Epoch 11 Batch 60/1540] avg loss 0.00544322, throughput 2.86505K wps
[Epoch 11 Batch 90/1540] avg loss 0.00502778, throughput 2.8135K wps
[Epoch 11 Batch 120/1540] avg loss 0.0053774, throughput 2.86688K wps
[Epoch 11 Batch 150/1540] avg loss 0.0054993, throughput 2.85092K wps
[Epoch 11 Batch 180/1540] avg loss 0.00511095, throughput 2.87244K wps
[Epoch 11 Batch 210/1540] avg loss 0.00577389, throughput 2.82656K wps
[Epoch 11 Batch 240/1540] avg loss 0.00503056, throughput 2.87752K wps
[Epoch 11 Batch 270/1540] avg loss 0.00527163, throughput 2.87603K wps
[Epoch 11 Batch 300/1540] avg loss 0.00486225, throughput 2.86389K wps
[Epoch 11 Batch 330/1540] avg loss 0.0053856, throughput 2.83982K wps
[Epoch 11 Batch 360/1540] avg loss 0.00505071, throughput 2.87728K wps
[Epoch 11 Batch 390/1540] avg loss 0.00544922, throughput 2.87923K wps
[Epoch 11 Batch 420/1540] avg loss 0.00586109, throughput 2.85331K wps
[Epoch 11 Batch 450/1540] avg loss 0.00548735, throughput 2.84435K wps
[Epoch 11 Batch 480/1540] avg loss 0.00539436, throughput 2.81618K wps
[Epoch 11 Batch 510/1540] avg loss 0.00549712, throughput 2.80748K wps
[Epoch 11 Batch 540/1540] avg loss 0.00525779, throughput 2.82319K wps
[Epoch 11 Batch 570/1540] avg loss 0.0049041, throughput 2.80543K wps
[Epoch 11 Batch 600/1540] avg loss 0.00467523, throughput 2.8282K wps
[Epoch 11 Batch 630/1540] avg loss 0.00520027, throughput 2.86484K wps
[Epoch 11 Batch 660/1540] avg loss 0.00535244, throughput 2.87777K wps
[Epoch 11 Batch 690/1540] avg loss 0.0050197, throughput 2.84967K wps
[Epoch 11 Batch 720/1540] avg loss 0.00491594, throughput 2.87223K wps
[Epoch 11 Batch 750/1540] avg loss 0.00531045, throughput 2.82622K wps
[Epoch 11 Batch 780/1540] avg loss 0.00504664, throughput 2.8625K wps
[Epoch 11 Batch 810/1540] avg loss 0.00499072, throughput 2.84293K wps
[Epoch 11 Batch 840/1540] avg loss 0.00484892, throughput 2.84938K wps
[Epoch 11 Batch 870/1540] avg loss 0.00493278, throughput 2.86382K wps
[Epoch 11 Batch 900/1540] avg loss 0.00548666, throughput 2.86781K wps
[Epoch 11 Batch 930/1540] avg loss 0.0053415, throughput 2.86029K wps
[Epoch 11 Batch 960/1540] avg loss 0.00524888, throughput 2.81201K wps
[Epoch 11 Batch 990/1540] avg loss 0.00536742, throughput 2.85772K wps
[Epoch 11 Batch 1020/1540] avg loss 0.00525738, throughput 2.82844K wps
[Epoch 11 Batch 1050/1540] avg loss 0.00481887, throughput 2.87807K wps
[Epoch 11 Batch 1080/1540] avg loss 0.00501868, throughput 2.80777K wps
[Epoch 11 Batch 1110/1540] avg loss 0.00503706, throughput 2.85932K wps
[Epoch 11 Batch 1140/1540] avg loss 0.00531201, throughput 2.86339K wps
[Epoch 11 Batch 1170/1540] avg loss 0.00537489, throughput 2.83131K wps
[Epoch 11 Batch 1200/1540] avg loss 0.00524029, throughput 2.788K wps
[Epoch 11 Batch 1230/1540] avg loss 0.00489996, throughput 2.82875K wps
[Epoch 11 Batch 1260/1540] avg loss 0.00506119, throughput 2.80727K wps
[Epoch 11 Batch 1290/1540] avg loss 0.00501068, throughput 2.80065K wps
[Epoch 11 Batch 1320/1540] avg loss 0.00530482, throughput 2.87433K wps
[Epoch 11 Batch 1350/1540] avg loss 0.00560463, throughput 2.85454K wps
[Epoch 11 Batch 1380/1540] avg loss 0.0053076, throughput 2.85734K wps
[Epoch 11 Batch 1410/1540] avg loss 0.00528334, throughput 2.86835K wps
[Epoch 11 Batch 1440/1540] avg loss 0.00551849, throughput 2.87039K wps
[Epoch 11 Batch 1470/1540] avg loss 0.0052075, throughput 2.86872K wps
[Epoch 11 Batch 1500/1540] avg loss 0.00519176, throughput 2.86183K wps
[Epoch 11 Batch 1530/1540] avg loss 0.00525325, throughput 2.86227K wps
Begin Testing...
[Epoch 11] train avg loss 0.00522733, dev acc 0.8154, dev avg loss 0.41487, throughput 2.84941K wps
[Epoch 12 Batch 30/1540] avg loss 0.00459408, throughput 2.85194K wps
[Epoch 12 Batch 60/1540] avg loss 0.00491037, throughput 2.86956K wps
[Epoch 12 Batch 90/1540] avg loss 0.00524657, throughput 2.8686K wps
[Epoch 12 Batch 120/1540] avg loss 0.00539493, throughput 2.85217K wps
[Epoch 12 Batch 150/1540] avg loss 0.00507731, throughput 2.8672K wps
[Epoch 12 Batch 180/1540] avg loss 0.00448498, throughput 2.86041K wps
[Epoch 12 Batch 210/1540] avg loss 0.00459914, throughput 2.85766K wps
[Epoch 12 Batch 240/1540] avg loss 0.00471152, throughput 2.7843K wps
[Epoch 12 Batch 270/1540] avg loss 0.00501468, throughput 2.79973K wps
[Epoch 12 Batch 300/1540] avg loss 0.00484297, throughput 2.87177K wps
[Epoch 12 Batch 330/1540] avg loss 0.00501018, throughput 2.79047K wps
[Epoch 12 Batch 360/1540] avg loss 0.00471138, throughput 2.87457K wps
[Epoch 12 Batch 390/1540] avg loss 0.0049432, throughput 2.87765K wps
[Epoch 12 Batch 420/1540] avg loss 0.00490452, throughput 2.87606K wps
[Epoch 12 Batch 450/1540] avg loss 0.00516997, throughput 2.84712K wps
[Epoch 12 Batch 480/1540] avg loss 0.00509852, throughput 2.84603K wps
[Epoch 12 Batch 510/1540] avg loss 0.00436913, throughput 2.82328K wps
[Epoch 12 Batch 540/1540] avg loss 0.00468779, throughput 2.8765K wps
[Epoch 12 Batch 570/1540] avg loss 0.00502387, throughput 2.83461K wps
[Epoch 12 Batch 600/1540] avg loss 0.0047895, throughput 2.79215K wps
[Epoch 12 Batch 630/1540] avg loss 0.00513222, throughput 2.85132K wps
[Epoch 12 Batch 660/1540] avg loss 0.00509643, throughput 2.84477K wps
[Epoch 12 Batch 690/1540] avg loss 0.00473696, throughput 2.8722K wps
[Epoch 12 Batch 720/1540] avg loss 0.00505605, throughput 2.81686K wps
[Epoch 12 Batch 750/1540] avg loss 0.00457419, throughput 2.87451K wps
[Epoch 12 Batch 780/1540] avg loss 0.0046172, throughput 2.85142K wps
[Epoch 12 Batch 810/1540] avg loss 0.00483807, throughput 2.8754K wps
[Epoch 12 Batch 840/1540] avg loss 0.00514774, throughput 2.82651K wps
[Epoch 12 Batch 870/1540] avg loss 0.00531144, throughput 2.85358K wps
[Epoch 12 Batch 900/1540] avg loss 0.00478178, throughput 2.83389K wps
[Epoch 12 Batch 930/1540] avg loss 0.00471039, throughput 2.87719K wps
[Epoch 12 Batch 960/1540] avg loss 0.00496347, throughput 2.83385K wps
[Epoch 12 Batch 990/1540] avg loss 0.0050525, throughput 2.79573K wps
[Epoch 12 Batch 1020/1540] avg loss 0.00468869, throughput 2.82976K wps
[Epoch 12 Batch 1050/1540] avg loss 0.00454686, throughput 2.87201K wps
[Epoch 12 Batch 1080/1540] avg loss 0.00469205, throughput 2.87248K wps
[Epoch 12 Batch 1110/1540] avg loss 0.00497689, throughput 2.87541K wps
[Epoch 12 Batch 1140/1540] avg loss 0.00445265, throughput 2.86966K wps
[Epoch 12 Batch 1170/1540] avg loss 0.00505778, throughput 2.8492K wps
[Epoch 12 Batch 1200/1540] avg loss 0.00482485, throughput 2.87481K wps
[Epoch 12 Batch 1230/1540] avg loss 0.00504717, throughput 2.81775K wps
[Epoch 12 Batch 1260/1540] avg loss 0.00473321, throughput 2.82531K wps
[Epoch 12 Batch 1290/1540] avg loss 0.00507508, throughput 2.87582K wps
[Epoch 12 Batch 1320/1540] avg loss 0.00442842, throughput 2.87338K wps
[Epoch 12 Batch 1350/1540] avg loss 0.00489596, throughput 2.86631K wps
[Epoch 12 Batch 1380/1540] avg loss 0.0044795, throughput 2.88059K wps
[Epoch 12 Batch 1410/1540] avg loss 0.00467905, throughput 2.85294K wps
[Epoch 12 Batch 1440/1540] avg loss 0.00440097, throughput 2.7771K wps
[Epoch 12 Batch 1470/1540] avg loss 0.00455162, throughput 2.81136K wps
[Epoch 12 Batch 1500/1540] avg loss 0.00475475, throughput 2.78996K wps
[Epoch 12 Batch 1530/1540] avg loss 0.00497422, throughput 2.84052K wps
Begin Testing...
[Epoch 12] train avg loss 0.00483987, dev acc 0.8200, dev avg loss 0.43082, throughput 2.84601K wps
[Epoch 13 Batch 30/1540] avg loss 0.00446236, throughput 2.83165K wps
[Epoch 13 Batch 60/1540] avg loss 0.00474609, throughput 2.7882K wps
[Epoch 13 Batch 90/1540] avg loss 0.00481771, throughput 2.78453K wps
[Epoch 13 Batch 120/1540] avg loss 0.00455366, throughput 2.82144K wps
[Epoch 13 Batch 150/1540] avg loss 0.00468424, throughput 2.82126K wps
[Epoch 13 Batch 180/1540] avg loss 0.00467242, throughput 2.82396K wps
[Epoch 13 Batch 210/1540] avg loss 0.00463527, throughput 2.81668K wps
[Epoch 13 Batch 240/1540] avg loss 0.00451349, throughput 2.8703K wps
[Epoch 13 Batch 270/1540] avg loss 0.00432513, throughput 2.82377K wps
[Epoch 13 Batch 300/1540] avg loss 0.00436745, throughput 2.84135K wps
[Epoch 13 Batch 330/1540] avg loss 0.00443646, throughput 2.86605K wps
[Epoch 13 Batch 360/1540] avg loss 0.0045516, throughput 2.87585K wps
[Epoch 13 Batch 390/1540] avg loss 0.00417121, throughput 2.83353K wps
[Epoch 13 Batch 420/1540] avg loss 0.00457967, throughput 2.83476K wps
[Epoch 13 Batch 450/1540] avg loss 0.00449326, throughput 2.86706K wps
[Epoch 13 Batch 480/1540] avg loss 0.00426371, throughput 2.86733K wps
[Epoch 13 Batch 510/1540] avg loss 0.00439008, throughput 2.88155K wps
[Epoch 13 Batch 540/1540] avg loss 0.00452512, throughput 2.82744K wps
[Epoch 13 Batch 570/1540] avg loss 0.00425974, throughput 2.87104K wps
[Epoch 13 Batch 600/1540] avg loss 0.00416599, throughput 2.87146K wps
[Epoch 13 Batch 630/1540] avg loss 0.00469689, throughput 2.87303K wps
[Epoch 13 Batch 660/1540] avg loss 0.00448656, throughput 2.87424K wps
[Epoch 13 Batch 690/1540] avg loss 0.00439577, throughput 2.8576K wps
[Epoch 13 Batch 720/1540] avg loss 0.00462097, throughput 2.8352K wps
[Epoch 13 Batch 750/1540] avg loss 0.00449958, throughput 2.86557K wps
[Epoch 13 Batch 780/1540] avg loss 0.00453113, throughput 2.79336K wps
[Epoch 13 Batch 810/1540] avg loss 0.00434875, throughput 2.84386K wps
[Epoch 13 Batch 840/1540] avg loss 0.00457832, throughput 2.87667K wps
[Epoch 13 Batch 870/1540] avg loss 0.00500019, throughput 2.85573K wps
[Epoch 13 Batch 900/1540] avg loss 0.00473433, throughput 2.85732K wps
[Epoch 13 Batch 930/1540] avg loss 0.00463568, throughput 2.87828K wps
[Epoch 13 Batch 960/1540] avg loss 0.00428502, throughput 2.85308K wps
[Epoch 13 Batch 990/1540] avg loss 0.0043615, throughput 2.82854K wps
[Epoch 13 Batch 1020/1540] avg loss 0.00450924, throughput 2.87002K wps
[Epoch 13 Batch 1050/1540] avg loss 0.00436647, throughput 2.8819K wps
[Epoch 13 Batch 1080/1540] avg loss 0.00451411, throughput 2.87603K wps
[Epoch 13 Batch 1110/1540] avg loss 0.00448811, throughput 2.84644K wps
[Epoch 13 Batch 1140/1540] avg loss 0.00484055, throughput 2.87198K wps
[Epoch 13 Batch 1170/1540] avg loss 0.0047167, throughput 2.87767K wps
[Epoch 13 Batch 1200/1540] avg loss 0.00501602, throughput 2.88106K wps
[Epoch 13 Batch 1230/1540] avg loss 0.00452643, throughput 2.87166K wps
[Epoch 13 Batch 1260/1540] avg loss 0.00454048, throughput 2.87546K wps
[Epoch 13 Batch 1290/1540] avg loss 0.00456253, throughput 2.88161K wps
[Epoch 13 Batch 1320/1540] avg loss 0.00476569, throughput 2.8565K wps
[Epoch 13 Batch 1350/1540] avg loss 0.00418505, throughput 2.85399K wps
[Epoch 13 Batch 1380/1540] avg loss 0.00445918, throughput 2.87694K wps
[Epoch 13 Batch 1410/1540] avg loss 0.00435116, throughput 2.87921K wps
[Epoch 13 Batch 1440/1540] avg loss 0.00479225, throughput 2.86933K wps
[Epoch 13 Batch 1470/1540] avg loss 0.00425588, throughput 2.8674K wps
[Epoch 13 Batch 1500/1540] avg loss 0.00433084, throughput 2.87503K wps
[Epoch 13 Batch 1530/1540] avg loss 0.00457583, throughput 2.87123K wps
Begin Testing...
[Epoch 13] train avg loss 0.00452305, dev acc 0.8131, dev avg loss 0.419574, throughput 2.85466K wps
[Epoch 14 Batch 30/1540] avg loss 0.00461691, throughput 2.90346K wps
[Epoch 14 Batch 60/1540] avg loss 0.00409082, throughput 2.86606K wps
[Epoch 14 Batch 90/1540] avg loss 0.00411367, throughput 2.87014K wps
[Epoch 14 Batch 120/1540] avg loss 0.00441572, throughput 2.84007K wps
[Epoch 14 Batch 150/1540] avg loss 0.00415351, throughput 2.85366K wps
[Epoch 14 Batch 180/1540] avg loss 0.004476, throughput 2.84757K wps
[Epoch 14 Batch 210/1540] avg loss 0.00440516, throughput 2.87513K wps
[Epoch 14 Batch 240/1540] avg loss 0.00403609, throughput 2.85843K wps
[Epoch 14 Batch 270/1540] avg loss 0.00436929, throughput 2.84186K wps
[Epoch 14 Batch 300/1540] avg loss 0.00429113, throughput 2.87756K wps
[Epoch 14 Batch 330/1540] avg loss 0.00443148, throughput 2.85188K wps
[Epoch 14 Batch 360/1540] avg loss 0.0043789, throughput 2.8415K wps
[Epoch 14 Batch 390/1540] avg loss 0.00430021, throughput 2.8736K wps
[Epoch 14 Batch 420/1540] avg loss 0.00399232, throughput 2.87152K wps
[Epoch 14 Batch 450/1540] avg loss 0.00451988, throughput 2.82441K wps
[Epoch 14 Batch 480/1540] avg loss 0.00399028, throughput 2.82411K wps
[Epoch 14 Batch 510/1540] avg loss 0.00442665, throughput 2.86096K wps
[Epoch 14 Batch 540/1540] avg loss 0.00434507, throughput 2.87596K wps
[Epoch 14 Batch 570/1540] avg loss 0.00463962, throughput 2.87929K wps
[Epoch 14 Batch 600/1540] avg loss 0.00411575, throughput 2.88231K wps
[Epoch 14 Batch 630/1540] avg loss 0.00417867, throughput 2.87889K wps
[Epoch 14 Batch 660/1540] avg loss 0.0045338, throughput 2.8693K wps
[Epoch 14 Batch 690/1540] avg loss 0.00399325, throughput 2.86181K wps
[Epoch 14 Batch 720/1540] avg loss 0.00423137, throughput 2.87301K wps
[Epoch 14 Batch 750/1540] avg loss 0.00413027, throughput 2.86344K wps
[Epoch 14 Batch 780/1540] avg loss 0.00404059, throughput 2.87574K wps
[Epoch 14 Batch 810/1540] avg loss 0.00409784, throughput 2.87673K wps
[Epoch 14 Batch 840/1540] avg loss 0.00402593, throughput 2.87102K wps
[Epoch 14 Batch 870/1540] avg loss 0.00402846, throughput 2.87835K wps
[Epoch 14 Batch 900/1540] avg loss 0.00413051, throughput 2.86132K wps
[Epoch 14 Batch 930/1540] avg loss 0.00425607, throughput 2.8608K wps
[Epoch 14 Batch 960/1540] avg loss 0.00422695, throughput 2.84248K wps
[Epoch 14 Batch 990/1540] avg loss 0.00441385, throughput 2.84117K wps
[Epoch 14 Batch 1020/1540] avg loss 0.00415427, throughput 2.87268K wps
[Epoch 14 Batch 1050/1540] avg loss 0.00376706, throughput 2.82777K wps
[Epoch 14 Batch 1080/1540] avg loss 0.00476164, throughput 2.87051K wps
[Epoch 14 Batch 1110/1540] avg loss 0.00441269, throughput 2.8621K wps
[Epoch 14 Batch 1140/1540] avg loss 0.00449428, throughput 2.80276K wps
[Epoch 14 Batch 1170/1540] avg loss 0.00418358, throughput 2.84116K wps
[Epoch 14 Batch 1200/1540] avg loss 0.00422666, throughput 2.87902K wps
[Epoch 14 Batch 1230/1540] avg loss 0.0043409, throughput 2.86527K wps
[Epoch 14 Batch 1260/1540] avg loss 0.00404391, throughput 2.82409K wps
[Epoch 14 Batch 1290/1540] avg loss 0.00451377, throughput 2.86621K wps
[Epoch 14 Batch 1320/1540] avg loss 0.0042835, throughput 2.83833K wps
[Epoch 14 Batch 1350/1540] avg loss 0.00434493, throughput 2.80139K wps
[Epoch 14 Batch 1380/1540] avg loss 0.00438983, throughput 2.8662K wps
[Epoch 14 Batch 1410/1540] avg loss 0.00423225, throughput 2.85795K wps
[Epoch 14 Batch 1440/1540] avg loss 0.00471089, throughput 2.81824K wps
[Epoch 14 Batch 1470/1540] avg loss 0.0042575, throughput 2.84146K wps
[Epoch 14 Batch 1500/1540] avg loss 0.00381145, throughput 2.87356K wps
[Epoch 14 Batch 1530/1540] avg loss 0.00411584, throughput 2.85227K wps
Begin Testing...
[Epoch 14] train avg loss 0.00426876, dev acc 0.8119, dev avg loss 0.431456, throughput 2.85742K wps
[Epoch 15 Batch 30/1540] avg loss 0.00407376, throughput 2.91374K wps
[Epoch 15 Batch 60/1540] avg loss 0.00401679, throughput 2.86123K wps
[Epoch 15 Batch 90/1540] avg loss 0.00392947, throughput 2.83942K wps
[Epoch 15 Batch 120/1540] avg loss 0.00422627, throughput 2.81369K wps
[Epoch 15 Batch 150/1540] avg loss 0.00453781, throughput 2.79111K wps
[Epoch 15 Batch 180/1540] avg loss 0.00383111, throughput 2.79639K wps
[Epoch 15 Batch 210/1540] avg loss 0.00426815, throughput 2.81802K wps
[Epoch 15 Batch 240/1540] avg loss 0.00367191, throughput 2.86546K wps
[Epoch 15 Batch 270/1540] avg loss 0.00390078, throughput 2.87507K wps
[Epoch 15 Batch 300/1540] avg loss 0.00391309, throughput 2.83758K wps
[Epoch 15 Batch 330/1540] avg loss 0.00372025, throughput 2.85992K wps
[Epoch 15 Batch 360/1540] avg loss 0.00388494, throughput 2.78417K wps
[Epoch 15 Batch 390/1540] avg loss 0.00373275, throughput 2.81732K wps
[Epoch 15 Batch 420/1540] avg loss 0.00396817, throughput 2.82379K wps
[Epoch 15 Batch 450/1540] avg loss 0.00436736, throughput 2.84744K wps
[Epoch 15 Batch 480/1540] avg loss 0.00373357, throughput 2.86786K wps
[Epoch 15 Batch 510/1540] avg loss 0.00368596, throughput 2.85527K wps
[Epoch 15 Batch 540/1540] avg loss 0.00371191, throughput 2.87065K wps
[Epoch 15 Batch 570/1540] avg loss 0.00422839, throughput 2.86757K wps
[Epoch 15 Batch 600/1540] avg loss 0.00409697, throughput 2.86764K wps
[Epoch 15 Batch 630/1540] avg loss 0.00381312, throughput 2.82558K wps
[Epoch 15 Batch 660/1540] avg loss 0.00431842, throughput 2.86827K wps
[Epoch 15 Batch 690/1540] avg loss 0.0037886, throughput 2.84364K wps
[Epoch 15 Batch 720/1540] avg loss 0.00409405, throughput 2.7893K wps
[Epoch 15 Batch 750/1540] avg loss 0.00368649, throughput 2.84533K wps
[Epoch 15 Batch 780/1540] avg loss 0.00435725, throughput 2.88253K wps
[Epoch 15 Batch 810/1540] avg loss 0.0039976, throughput 2.86638K wps
[Epoch 15 Batch 840/1540] avg loss 0.00391333, throughput 2.83815K wps
[Epoch 15 Batch 870/1540] avg loss 0.00444651, throughput 2.87223K wps
[Epoch 15 Batch 900/1540] avg loss 0.00426778, throughput 2.87275K wps
[Epoch 15 Batch 930/1540] avg loss 0.00473772, throughput 2.87182K wps
[Epoch 15 Batch 960/1540] avg loss 0.00413148, throughput 2.86173K wps
[Epoch 15 Batch 990/1540] avg loss 0.00388711, throughput 2.87103K wps
[Epoch 15 Batch 1020/1540] avg loss 0.00363337, throughput 2.8719K wps
[Epoch 15 Batch 1050/1540] avg loss 0.00394424, throughput 2.86909K wps
[Epoch 15 Batch 1080/1540] avg loss 0.00408659, throughput 2.86277K wps
[Epoch 15 Batch 1110/1540] avg loss 0.0036926, throughput 2.86438K wps
[Epoch 15 Batch 1140/1540] avg loss 0.00416388, throughput 2.85054K wps
[Epoch 15 Batch 1170/1540] avg loss 0.00405194, throughput 2.85722K wps
[Epoch 15 Batch 1200/1540] avg loss 0.00350064, throughput 2.87805K wps
[Epoch 15 Batch 1230/1540] avg loss 0.00421358, throughput 2.86051K wps
[Epoch 15 Batch 1260/1540] avg loss 0.00361744, throughput 2.87947K wps
[Epoch 15 Batch 1290/1540] avg loss 0.00420992, throughput 2.88045K wps
[Epoch 15 Batch 1320/1540] avg loss 0.00381196, throughput 2.85958K wps
[Epoch 15 Batch 1350/1540] avg loss 0.00409585, throughput 2.8782K wps
[Epoch 15 Batch 1380/1540] avg loss 0.00405585, throughput 2.87984K wps
[Epoch 15 Batch 1410/1540] avg loss 0.00439197, throughput 2.82591K wps
[Epoch 15 Batch 1440/1540] avg loss 0.00391647, throughput 2.82319K wps
[Epoch 15 Batch 1470/1540] avg loss 0.00429827, throughput 2.87291K wps
[Epoch 15 Batch 1500/1540] avg loss 0.00439724, throughput 2.88058K wps
[Epoch 15 Batch 1530/1540] avg loss 0.00413388, throughput 2.86962K wps
Begin Testing...
[Epoch 15] train avg loss 0.00402739, dev acc 0.8177, dev avg loss 0.427729, throughput 2.85364K wps
[Epoch 16 Batch 30/1540] avg loss 0.00364828, throughput 2.91324K wps
[Epoch 16 Batch 60/1540] avg loss 0.00346847, throughput 2.85303K wps
[Epoch 16 Batch 90/1540] avg loss 0.00373049, throughput 2.87388K wps
[Epoch 16 Batch 120/1540] avg loss 0.00393828, throughput 2.87238K wps
[Epoch 16 Batch 150/1540] avg loss 0.0035373, throughput 2.87733K wps
[Epoch 16 Batch 180/1540] avg loss 0.00401865, throughput 2.83449K wps
[Epoch 16 Batch 210/1540] avg loss 0.00394978, throughput 2.78224K wps
[Epoch 16 Batch 240/1540] avg loss 0.00388588, throughput 2.85971K wps
[Epoch 16 Batch 270/1540] avg loss 0.00357529, throughput 2.85854K wps
[Epoch 16 Batch 300/1540] avg loss 0.00413567, throughput 2.87997K wps
[Epoch 16 Batch 330/1540] avg loss 0.00358932, throughput 2.86505K wps
[Epoch 16 Batch 360/1540] avg loss 0.00350209, throughput 2.83764K wps
[Epoch 16 Batch 390/1540] avg loss 0.00366215, throughput 2.87282K wps
[Epoch 16 Batch 420/1540] avg loss 0.00393011, throughput 2.8481K wps
[Epoch 16 Batch 450/1540] avg loss 0.00378705, throughput 2.87037K wps
[Epoch 16 Batch 480/1540] avg loss 0.00404772, throughput 2.86988K wps
[Epoch 16 Batch 510/1540] avg loss 0.00393417, throughput 2.87401K wps
[Epoch 16 Batch 540/1540] avg loss 0.00400132, throughput 2.82079K wps
[Epoch 16 Batch 570/1540] avg loss 0.00382737, throughput 2.84271K wps
[Epoch 16 Batch 600/1540] avg loss 0.00365693, throughput 2.86856K wps
[Epoch 16 Batch 630/1540] avg loss 0.00367696, throughput 2.87466K wps
[Epoch 16 Batch 660/1540] avg loss 0.00396527, throughput 2.85173K wps
[Epoch 16 Batch 690/1540] avg loss 0.00398598, throughput 2.83263K wps
[Epoch 16 Batch 720/1540] avg loss 0.00357823, throughput 2.8294K wps
[Epoch 16 Batch 750/1540] avg loss 0.00361394, throughput 2.86624K wps
[Epoch 16 Batch 780/1540] avg loss 0.00360104, throughput 2.8646K wps
[Epoch 16 Batch 810/1540] avg loss 0.00364887, throughput 2.83687K wps
[Epoch 16 Batch 840/1540] avg loss 0.00380038, throughput 2.83233K wps
[Epoch 16 Batch 870/1540] avg loss 0.00367782, throughput 2.83244K wps
[Epoch 16 Batch 900/1540] avg loss 0.00383111, throughput 2.85035K wps
[Epoch 16 Batch 930/1540] avg loss 0.00394563, throughput 2.87646K wps
[Epoch 16 Batch 960/1540] avg loss 0.00400893, throughput 2.83558K wps
[Epoch 16 Batch 990/1540] avg loss 0.00376215, throughput 2.79682K wps
[Epoch 16 Batch 1020/1540] avg loss 0.00371723, throughput 2.79242K wps
[Epoch 16 Batch 1050/1540] avg loss 0.00377845, throughput 2.87491K wps
[Epoch 16 Batch 1080/1540] avg loss 0.0040392, throughput 2.84615K wps
[Epoch 16 Batch 1110/1540] avg loss 0.00410519, throughput 2.79365K wps
[Epoch 16 Batch 1140/1540] avg loss 0.00410984, throughput 2.84937K wps
[Epoch 16 Batch 1170/1540] avg loss 0.00360057, throughput 2.88165K wps
[Epoch 16 Batch 1200/1540] avg loss 0.00419759, throughput 2.87876K wps
[Epoch 16 Batch 1230/1540] avg loss 0.0038205, throughput 2.85643K wps
[Epoch 16 Batch 1260/1540] avg loss 0.00364247, throughput 2.87129K wps
[Epoch 16 Batch 1290/1540] avg loss 0.00401488, throughput 2.87944K wps
[Epoch 16 Batch 1320/1540] avg loss 0.00436021, throughput 2.84787K wps
[Epoch 16 Batch 1350/1540] avg loss 0.00362354, throughput 2.87069K wps
[Epoch 16 Batch 1380/1540] avg loss 0.0036643, throughput 2.86974K wps
[Epoch 16 Batch 1410/1540] avg loss 0.00433668, throughput 2.87245K wps
[Epoch 16 Batch 1440/1540] avg loss 0.00382339, throughput 2.87811K wps
[Epoch 16 Batch 1470/1540] avg loss 0.0038438, throughput 2.86514K wps
[Epoch 16 Batch 1500/1540] avg loss 0.0040651, throughput 2.8789K wps
[Epoch 16 Batch 1530/1540] avg loss 0.00382273, throughput 2.86611K wps
Begin Testing...
[Epoch 16] train avg loss 0.00383502, dev acc 0.8234, dev avg loss 0.435514, throughput 2.85508K wps
[Epoch 17 Batch 30/1540] avg loss 0.00319087, throughput 2.92501K wps
[Epoch 17 Batch 60/1540] avg loss 0.00332997, throughput 2.79723K wps
[Epoch 17 Batch 90/1540] avg loss 0.00377095, throughput 2.86783K wps
[Epoch 17 Batch 120/1540] avg loss 0.00342876, throughput 2.87935K wps
[Epoch 17 Batch 150/1540] avg loss 0.00361603, throughput 2.86129K wps
[Epoch 17 Batch 180/1540] avg loss 0.00398759, throughput 2.81541K wps
[Epoch 17 Batch 210/1540] avg loss 0.00365921, throughput 2.86253K wps
[Epoch 17 Batch 240/1540] avg loss 0.00333436, throughput 2.8684K wps
[Epoch 17 Batch 270/1540] avg loss 0.00319246, throughput 2.85613K wps
[Epoch 17 Batch 300/1540] avg loss 0.00355645, throughput 2.86481K wps
[Epoch 17 Batch 330/1540] avg loss 0.00378092, throughput 2.8106K wps
[Epoch 17 Batch 360/1540] avg loss 0.00339321, throughput 2.86744K wps
[Epoch 17 Batch 390/1540] avg loss 0.00355143, throughput 2.87489K wps
[Epoch 17 Batch 420/1540] avg loss 0.00338337, throughput 2.84091K wps
[Epoch 17 Batch 450/1540] avg loss 0.0034537, throughput 2.87476K wps
[Epoch 17 Batch 480/1540] avg loss 0.00350938, throughput 2.87454K wps
[Epoch 17 Batch 510/1540] avg loss 0.00372047, throughput 2.87112K wps
[Epoch 17 Batch 540/1540] avg loss 0.00341108, throughput 2.8482K wps
[Epoch 17 Batch 570/1540] avg loss 0.0034723, throughput 2.8272K wps
[Epoch 17 Batch 600/1540] avg loss 0.00364292, throughput 2.82127K wps
[Epoch 17 Batch 630/1540] avg loss 0.00350363, throughput 2.86217K wps
[Epoch 17 Batch 660/1540] avg loss 0.00402372, throughput 2.84594K wps
[Epoch 17 Batch 690/1540] avg loss 0.00364954, throughput 2.83362K wps
[Epoch 17 Batch 720/1540] avg loss 0.00374546, throughput 2.79015K wps
[Epoch 17 Batch 750/1540] avg loss 0.00352202, throughput 2.83113K wps
[Epoch 17 Batch 780/1540] avg loss 0.00363937, throughput 2.8698K wps
[Epoch 17 Batch 810/1540] avg loss 0.00400565, throughput 2.87314K wps
[Epoch 17 Batch 840/1540] avg loss 0.00355017, throughput 2.87075K wps
[Epoch 17 Batch 870/1540] avg loss 0.00372163, throughput 2.82721K wps
[Epoch 17 Batch 900/1540] avg loss 0.00393952, throughput 2.79891K wps
[Epoch 17 Batch 930/1540] avg loss 0.00345285, throughput 2.87991K wps
[Epoch 17 Batch 960/1540] avg loss 0.00373159, throughput 2.8686K wps
[Epoch 17 Batch 990/1540] avg loss 0.00373004, throughput 2.86531K wps
[Epoch 17 Batch 1020/1540] avg loss 0.00389974, throughput 2.84328K wps
[Epoch 17 Batch 1050/1540] avg loss 0.00369152, throughput 2.84203K wps
[Epoch 17 Batch 1080/1540] avg loss 0.00339621, throughput 2.86918K wps
[Epoch 17 Batch 1110/1540] avg loss 0.00371069, throughput 2.83962K wps
[Epoch 17 Batch 1140/1540] avg loss 0.00360007, throughput 2.83966K wps
[Epoch 17 Batch 1170/1540] avg loss 0.00341526, throughput 2.86066K wps
[Epoch 17 Batch 1200/1540] avg loss 0.00430276, throughput 2.84973K wps
[Epoch 17 Batch 1230/1540] avg loss 0.00392419, throughput 2.84217K wps
[Epoch 17 Batch 1260/1540] avg loss 0.00415668, throughput 2.8437K wps
[Epoch 17 Batch 1290/1540] avg loss 0.00331118, throughput 2.86902K wps
[Epoch 17 Batch 1320/1540] avg loss 0.00361056, throughput 2.84208K wps
[Epoch 17 Batch 1350/1540] avg loss 0.00372032, throughput 2.85573K wps
[Epoch 17 Batch 1380/1540] avg loss 0.00364981, throughput 2.85255K wps
[Epoch 17 Batch 1410/1540] avg loss 0.00370076, throughput 2.85557K wps
[Epoch 17 Batch 1440/1540] avg loss 0.00401664, throughput 2.87357K wps
[Epoch 17 Batch 1470/1540] avg loss 0.00412138, throughput 2.87957K wps
[Epoch 17 Batch 1500/1540] avg loss 0.00385896, throughput 2.85209K wps
[Epoch 17 Batch 1530/1540] avg loss 0.00437636, throughput 2.82669K wps
Begin Testing...
[Epoch 17] train avg loss 0.00367402, dev acc 0.8165, dev avg loss 0.43482, throughput 2.85161K wps
[Epoch 18 Batch 30/1540] avg loss 0.00357906, throughput 2.93864K wps
[Epoch 18 Batch 60/1540] avg loss 0.00337154, throughput 2.85325K wps
[Epoch 18 Batch 90/1540] avg loss 0.00297107, throughput 2.87903K wps
[Epoch 18 Batch 120/1540] avg loss 0.00333438, throughput 2.87263K wps
[Epoch 18 Batch 150/1540] avg loss 0.00338964, throughput 2.85472K wps
[Epoch 18 Batch 180/1540] avg loss 0.0030976, throughput 2.87709K wps
[Epoch 18 Batch 210/1540] avg loss 0.00295231, throughput 2.87133K wps
[Epoch 18 Batch 240/1540] avg loss 0.00355337, throughput 2.86864K wps
[Epoch 18 Batch 270/1540] avg loss 0.003575, throughput 2.87699K wps
[Epoch 18 Batch 300/1540] avg loss 0.00324794, throughput 2.8589K wps
[Epoch 18 Batch 330/1540] avg loss 0.00356497, throughput 2.84314K wps
[Epoch 18 Batch 360/1540] avg loss 0.00356339, throughput 2.87465K wps
[Epoch 18 Batch 390/1540] avg loss 0.00375464, throughput 2.86385K wps
[Epoch 18 Batch 420/1540] avg loss 0.00346486, throughput 2.86775K wps
[Epoch 18 Batch 450/1540] avg loss 0.00338985, throughput 2.87758K wps
[Epoch 18 Batch 480/1540] avg loss 0.00340048, throughput 2.85165K wps
[Epoch 18 Batch 510/1540] avg loss 0.00334323, throughput 2.82923K wps
[Epoch 18 Batch 540/1540] avg loss 0.00368448, throughput 2.86647K wps
[Epoch 18 Batch 570/1540] avg loss 0.00321845, throughput 2.85408K wps
[Epoch 18 Batch 600/1540] avg loss 0.00348318, throughput 2.86232K wps
[Epoch 18 Batch 630/1540] avg loss 0.00324679, throughput 2.87064K wps
[Epoch 18 Batch 660/1540] avg loss 0.00364707, throughput 2.86977K wps
[Epoch 18 Batch 690/1540] avg loss 0.00367947, throughput 2.87485K wps
[Epoch 18 Batch 720/1540] avg loss 0.00323967, throughput 2.81789K wps
[Epoch 18 Batch 750/1540] avg loss 0.00300659, throughput 2.86046K wps
[Epoch 18 Batch 780/1540] avg loss 0.00320991, throughput 2.81983K wps
[Epoch 18 Batch 810/1540] avg loss 0.00350821, throughput 2.88281K wps
[Epoch 18 Batch 840/1540] avg loss 0.00367232, throughput 2.85983K wps
[Epoch 18 Batch 870/1540] avg loss 0.00358799, throughput 2.85452K wps
[Epoch 18 Batch 900/1540] avg loss 0.00377593, throughput 2.87457K wps
[Epoch 18 Batch 930/1540] avg loss 0.00355176, throughput 2.8255K wps
[Epoch 18 Batch 960/1540] avg loss 0.00354487, throughput 2.7912K wps
[Epoch 18 Batch 990/1540] avg loss 0.00406148, throughput 2.81019K wps
[Epoch 18 Batch 1020/1540] avg loss 0.00371452, throughput 2.8685K wps
[Epoch 18 Batch 1050/1540] avg loss 0.00362137, throughput 2.80297K wps
[Epoch 18 Batch 1080/1540] avg loss 0.00383899, throughput 2.79751K wps
[Epoch 18 Batch 1110/1540] avg loss 0.00376215, throughput 2.85163K wps
[Epoch 18 Batch 1140/1540] avg loss 0.00357949, throughput 2.82323K wps
[Epoch 18 Batch 1170/1540] avg loss 0.00304835, throughput 2.871K wps
[Epoch 18 Batch 1200/1540] avg loss 0.00402783, throughput 2.87504K wps
[Epoch 18 Batch 1230/1540] avg loss 0.00391006, throughput 2.8776K wps
[Epoch 18 Batch 1260/1540] avg loss 0.00325532, throughput 2.85809K wps
[Epoch 18 Batch 1290/1540] avg loss 0.003581, throughput 2.86853K wps
[Epoch 18 Batch 1320/1540] avg loss 0.00310963, throughput 2.85105K wps
[Epoch 18 Batch 1350/1540] avg loss 0.00383194, throughput 2.85997K wps
[Epoch 18 Batch 1380/1540] avg loss 0.00394252, throughput 2.84992K wps
[Epoch 18 Batch 1410/1540] avg loss 0.00324707, throughput 2.86976K wps
[Epoch 18 Batch 1440/1540] avg loss 0.0036005, throughput 2.81174K wps
[Epoch 18 Batch 1470/1540] avg loss 0.00342126, throughput 2.82035K wps
[Epoch 18 Batch 1500/1540] avg loss 0.00342725, throughput 2.81288K wps
[Epoch 18 Batch 1530/1540] avg loss 0.00331513, throughput 2.81493K wps
Begin Testing...
[Epoch 18] train avg loss 0.00349049, dev acc 0.8096, dev avg loss 0.451863, throughput 2.85304K wps
[Epoch 19 Batch 30/1540] avg loss 0.00318735, throughput 2.86704K wps
[Epoch 19 Batch 60/1540] avg loss 0.00329827, throughput 2.84633K wps
[Epoch 19 Batch 90/1540] avg loss 0.00295942, throughput 2.87147K wps
[Epoch 19 Batch 120/1540] avg loss 0.00317722, throughput 2.86827K wps
[Epoch 19 Batch 150/1540] avg loss 0.00319235, throughput 2.84556K wps
[Epoch 19 Batch 180/1540] avg loss 0.00358871, throughput 2.87535K wps
[Epoch 19 Batch 210/1540] avg loss 0.0032216, throughput 2.81075K wps
[Epoch 19 Batch 240/1540] avg loss 0.00331344, throughput 2.78933K wps
[Epoch 19 Batch 270/1540] avg loss 0.00383577, throughput 2.86782K wps
[Epoch 19 Batch 300/1540] avg loss 0.00300314, throughput 2.86806K wps
[Epoch 19 Batch 330/1540] avg loss 0.00362143, throughput 2.78831K wps
[Epoch 19 Batch 360/1540] avg loss 0.00310181, throughput 2.85062K wps
[Epoch 19 Batch 390/1540] avg loss 0.00328461, throughput 2.8693K wps
[Epoch 19 Batch 420/1540] avg loss 0.0033123, throughput 2.84265K wps
[Epoch 19 Batch 450/1540] avg loss 0.00406618, throughput 2.81006K wps
[Epoch 19 Batch 480/1540] avg loss 0.0033118, throughput 2.87635K wps
[Epoch 19 Batch 510/1540] avg loss 0.0037313, throughput 2.86046K wps
[Epoch 19 Batch 540/1540] avg loss 0.00365229, throughput 2.86706K wps
[Epoch 19 Batch 570/1540] avg loss 0.00356581, throughput 2.87633K wps
[Epoch 19 Batch 600/1540] avg loss 0.00318694, throughput 2.87783K wps
[Epoch 19 Batch 630/1540] avg loss 0.00320496, throughput 2.88167K wps
[Epoch 19 Batch 660/1540] avg loss 0.00324332, throughput 2.86276K wps
[Epoch 19 Batch 690/1540] avg loss 0.00345855, throughput 2.86727K wps
[Epoch 19 Batch 720/1540] avg loss 0.00314163, throughput 2.86091K wps
[Epoch 19 Batch 750/1540] avg loss 0.00355368, throughput 2.81585K wps
[Epoch 19 Batch 780/1540] avg loss 0.00324602, throughput 2.86045K wps
[Epoch 19 Batch 810/1540] avg loss 0.00370243, throughput 2.83406K wps
[Epoch 19 Batch 840/1540] avg loss 0.00368683, throughput 2.86505K wps
[Epoch 19 Batch 870/1540] avg loss 0.00327352, throughput 2.80645K wps
[Epoch 19 Batch 900/1540] avg loss 0.00332074, throughput 2.82758K wps
[Epoch 19 Batch 930/1540] avg loss 0.00361743, throughput 2.87025K wps
[Epoch 19 Batch 960/1540] avg loss 0.00300051, throughput 2.86002K wps
[Epoch 19 Batch 990/1540] avg loss 0.00321304, throughput 2.80352K wps
[Epoch 19 Batch 1020/1540] avg loss 0.00369922, throughput 2.87685K wps
[Epoch 19 Batch 1050/1540] avg loss 0.00305007, throughput 2.83707K wps
[Epoch 19 Batch 1080/1540] avg loss 0.00358453, throughput 2.82909K wps
[Epoch 19 Batch 1110/1540] avg loss 0.00343419, throughput 2.88046K wps
[Epoch 19 Batch 1140/1540] avg loss 0.00326795, throughput 2.8748K wps
[Epoch 19 Batch 1170/1540] avg loss 0.00373046, throughput 2.87656K wps
[Epoch 19 Batch 1200/1540] avg loss 0.0034502, throughput 2.87201K wps
[Epoch 19 Batch 1230/1540] avg loss 0.00334682, throughput 2.87895K wps
[Epoch 19 Batch 1260/1540] avg loss 0.00339547, throughput 2.80381K wps
[Epoch 19 Batch 1290/1540] avg loss 0.00339138, throughput 2.84529K wps
[Epoch 19 Batch 1320/1540] avg loss 0.00357528, throughput 2.83887K wps
[Epoch 19 Batch 1350/1540] avg loss 0.00364623, throughput 2.87K wps
[Epoch 19 Batch 1380/1540] avg loss 0.00313599, throughput 2.85182K wps
[Epoch 19 Batch 1410/1540] avg loss 0.00299692, throughput 2.87934K wps
[Epoch 19 Batch 1440/1540] avg loss 0.00317699, throughput 2.87542K wps
[Epoch 19 Batch 1470/1540] avg loss 0.00334431, throughput 2.83182K wps
[Epoch 19 Batch 1500/1540] avg loss 0.00341411, throughput 2.83651K wps
[Epoch 19 Batch 1530/1540] avg loss 0.00376304, throughput 2.87732K wps
Begin Testing...
[Epoch 19] train avg loss 0.00338364, dev acc 0.8131, dev avg loss 0.446204, throughput 2.85203K wps
[Epoch 20 Batch 30/1540] avg loss 0.00322291, throughput 2.92462K wps
[Epoch 20 Batch 60/1540] avg loss 0.00287007, throughput 2.8529K wps
[Epoch 20 Batch 90/1540] avg loss 0.00303769, throughput 2.79475K wps
[Epoch 20 Batch 120/1540] avg loss 0.00276825, throughput 2.86558K wps
[Epoch 20 Batch 150/1540] avg loss 0.00305162, throughput 2.86841K wps
[Epoch 20 Batch 180/1540] avg loss 0.0032986, throughput 2.87617K wps
[Epoch 20 Batch 210/1540] avg loss 0.00350877, throughput 2.85078K wps
[Epoch 20 Batch 240/1540] avg loss 0.003069, throughput 2.79045K wps
[Epoch 20 Batch 270/1540] avg loss 0.0034995, throughput 2.87852K wps
[Epoch 20 Batch 300/1540] avg loss 0.00309145, throughput 2.8165K wps
[Epoch 20 Batch 330/1540] avg loss 0.00335601, throughput 2.84819K wps
[Epoch 20 Batch 360/1540] avg loss 0.00325714, throughput 2.84457K wps
[Epoch 20 Batch 390/1540] avg loss 0.00325351, throughput 2.86507K wps
[Epoch 20 Batch 420/1540] avg loss 0.00315532, throughput 2.8773K wps
[Epoch 20 Batch 450/1540] avg loss 0.00318432, throughput 2.86665K wps
[Epoch 20 Batch 480/1540] avg loss 0.00316532, throughput 2.87281K wps
[Epoch 20 Batch 510/1540] avg loss 0.00335802, throughput 2.78694K wps
[Epoch 20 Batch 540/1540] avg loss 0.0032944, throughput 2.87322K wps
[Epoch 20 Batch 570/1540] avg loss 0.00307869, throughput 2.88114K wps
[Epoch 20 Batch 600/1540] avg loss 0.00326062, throughput 2.88304K wps
[Epoch 20 Batch 630/1540] avg loss 0.00329051, throughput 2.87915K wps
[Epoch 20 Batch 660/1540] avg loss 0.00316112, throughput 2.85358K wps
[Epoch 20 Batch 690/1540] avg loss 0.00332212, throughput 2.87665K wps
[Epoch 20 Batch 720/1540] avg loss 0.00349856, throughput 2.85323K wps
[Epoch 20 Batch 750/1540] avg loss 0.00342787, throughput 2.8696K wps
[Epoch 20 Batch 780/1540] avg loss 0.00292761, throughput 2.84878K wps
[Epoch 20 Batch 810/1540] avg loss 0.00309589, throughput 2.86684K wps
[Epoch 20 Batch 840/1540] avg loss 0.00315749, throughput 2.84673K wps
[Epoch 20 Batch 870/1540] avg loss 0.00320325, throughput 2.79478K wps
[Epoch 20 Batch 900/1540] avg loss 0.0032549, throughput 2.87752K wps
[Epoch 20 Batch 930/1540] avg loss 0.00311146, throughput 2.86185K wps
[Epoch 20 Batch 960/1540] avg loss 0.00353997, throughput 2.85309K wps
[Epoch 20 Batch 990/1540] avg loss 0.0037487, throughput 2.86043K wps
[Epoch 20 Batch 1020/1540] avg loss 0.00315399, throughput 2.85797K wps
[Epoch 20 Batch 1050/1540] avg loss 0.00326294, throughput 2.87623K wps
[Epoch 20 Batch 1080/1540] avg loss 0.00298629, throughput 2.82635K wps
[Epoch 20 Batch 1110/1540] avg loss 0.00295518, throughput 2.85597K wps
[Epoch 20 Batch 1140/1540] avg loss 0.00334232, throughput 2.86511K wps
[Epoch 20 Batch 1170/1540] avg loss 0.00361975, throughput 2.79842K wps
[Epoch 20 Batch 1200/1540] avg loss 0.00332491, throughput 2.80976K wps
[Epoch 20 Batch 1230/1540] avg loss 0.00338287, throughput 2.8808K wps
[Epoch 20 Batch 1260/1540] avg loss 0.0026053, throughput 2.87229K wps
[Epoch 20 Batch 1290/1540] avg loss 0.0033712, throughput 2.86433K wps
[Epoch 20 Batch 1320/1540] avg loss 0.00339137, throughput 2.884K wps
[Epoch 20 Batch 1350/1540] avg loss 0.00349193, throughput 2.85217K wps
[Epoch 20 Batch 1380/1540] avg loss 0.00339059, throughput 2.7952K wps
[Epoch 20 Batch 1410/1540] avg loss 0.00371818, throughput 2.8401K wps
[Epoch 20 Batch 1440/1540] avg loss 0.00305314, throughput 2.86594K wps
[Epoch 20 Batch 1470/1540] avg loss 0.00323899, throughput 2.87791K wps
[Epoch 20 Batch 1500/1540] avg loss 0.00352124, throughput 2.87684K wps
[Epoch 20 Batch 1530/1540] avg loss 0.0033381, throughput 2.85945K wps
Begin Testing...
[Epoch 20] train avg loss 0.00324707, dev acc 0.8211, dev avg loss 0.449274, throughput 2.85455K wps
[Epoch 21 Batch 30/1540] avg loss 0.00313334, throughput 2.91814K wps
[Epoch 21 Batch 60/1540] avg loss 0.00317189, throughput 2.81536K wps
[Epoch 21 Batch 90/1540] avg loss 0.00303604, throughput 2.8796K wps
[Epoch 21 Batch 120/1540] avg loss 0.00275792, throughput 2.8732K wps
[Epoch 21 Batch 150/1540] avg loss 0.00330277, throughput 2.87519K wps
[Epoch 21 Batch 180/1540] avg loss 0.00352442, throughput 2.86927K wps
[Epoch 21 Batch 210/1540] avg loss 0.00324427, throughput 2.86545K wps
[Epoch 21 Batch 240/1540] avg loss 0.00354215, throughput 2.86938K wps
[Epoch 21 Batch 270/1540] avg loss 0.00286154, throughput 2.84255K wps
[Epoch 21 Batch 300/1540] avg loss 0.00266311, throughput 2.88382K wps
[Epoch 21 Batch 330/1540] avg loss 0.00324052, throughput 2.88248K wps
[Epoch 21 Batch 360/1540] avg loss 0.00296289, throughput 2.84734K wps
[Epoch 21 Batch 390/1540] avg loss 0.002875, throughput 2.87143K wps
[Epoch 21 Batch 420/1540] avg loss 0.00312895, throughput 2.81585K wps
[Epoch 21 Batch 450/1540] avg loss 0.00293955, throughput 2.83926K wps
[Epoch 21 Batch 480/1540] avg loss 0.00308991, throughput 2.86278K wps
[Epoch 21 Batch 510/1540] avg loss 0.00306917, throughput 2.82739K wps
[Epoch 21 Batch 540/1540] avg loss 0.00324099, throughput 2.83513K wps
[Epoch 21 Batch 570/1540] avg loss 0.00321909, throughput 2.87749K wps
[Epoch 21 Batch 600/1540] avg loss 0.00311013, throughput 2.86831K wps
[Epoch 21 Batch 630/1540] avg loss 0.00327312, throughput 2.80174K wps
[Epoch 21 Batch 660/1540] avg loss 0.00344773, throughput 2.85005K wps
[Epoch 21 Batch 690/1540] avg loss 0.00363532, throughput 2.85606K wps
[Epoch 21 Batch 720/1540] avg loss 0.00302558, throughput 2.86123K wps
[Epoch 21 Batch 750/1540] avg loss 0.00288845, throughput 2.86808K wps
[Epoch 21 Batch 780/1540] avg loss 0.00319066, throughput 2.86136K wps
[Epoch 21 Batch 810/1540] avg loss 0.00309795, throughput 2.83712K wps
[Epoch 21 Batch 840/1540] avg loss 0.00340161, throughput 2.87855K wps
[Epoch 21 Batch 870/1540] avg loss 0.00289211, throughput 2.87989K wps
[Epoch 21 Batch 900/1540] avg loss 0.00327628, throughput 2.85901K wps
[Epoch 21 Batch 930/1540] avg loss 0.0030395, throughput 2.8682K wps
[Epoch 21 Batch 960/1540] avg loss 0.00335489, throughput 2.87423K wps
[Epoch 21 Batch 990/1540] avg loss 0.00378134, throughput 2.86996K wps
[Epoch 21 Batch 1020/1540] avg loss 0.00306519, throughput 2.86663K wps
[Epoch 21 Batch 1050/1540] avg loss 0.00310666, throughput 2.84069K wps
[Epoch 21 Batch 1080/1540] avg loss 0.00307959, throughput 2.8486K wps
[Epoch 21 Batch 1110/1540] avg loss 0.00294899, throughput 2.87957K wps
[Epoch 21 Batch 1140/1540] avg loss 0.00323469, throughput 2.87273K wps
[Epoch 21 Batch 1170/1540] avg loss 0.00335863, throughput 2.86675K wps
[Epoch 21 Batch 1200/1540] avg loss 0.00277829, throughput 2.86083K wps
[Epoch 21 Batch 1230/1540] avg loss 0.00321977, throughput 2.84172K wps
[Epoch 21 Batch 1260/1540] avg loss 0.00280524, throughput 2.85028K wps
[Epoch 21 Batch 1290/1540] avg loss 0.0033545, throughput 2.83499K wps
[Epoch 21 Batch 1320/1540] avg loss 0.00313087, throughput 2.88148K wps
[Epoch 21 Batch 1350/1540] avg loss 0.0031993, throughput 2.86098K wps
[Epoch 21 Batch 1380/1540] avg loss 0.00338701, throughput 2.865K wps
[Epoch 21 Batch 1410/1540] avg loss 0.0032147, throughput 2.87203K wps
[Epoch 21 Batch 1440/1540] avg loss 0.00295939, throughput 2.85929K wps
[Epoch 21 Batch 1470/1540] avg loss 0.0030755, throughput 2.80241K wps
[Epoch 21 Batch 1500/1540] avg loss 0.00287541, throughput 2.87201K wps
[Epoch 21 Batch 1530/1540] avg loss 0.00299449, throughput 2.8429K wps
Begin Testing...
[Epoch 21] train avg loss 0.00313782, dev acc 0.8177, dev avg loss 0.467425, throughput 2.85884K wps
[Epoch 22 Batch 30/1540] avg loss 0.00282733, throughput 2.92973K wps
[Epoch 22 Batch 60/1540] avg loss 0.00278696, throughput 2.86666K wps
[Epoch 22 Batch 90/1540] avg loss 0.00324692, throughput 2.87315K wps
[Epoch 22 Batch 120/1540] avg loss 0.00300725, throughput 2.86509K wps
[Epoch 22 Batch 150/1540] avg loss 0.00297408, throughput 2.87337K wps
[Epoch 22 Batch 180/1540] avg loss 0.00286091, throughput 2.86416K wps
[Epoch 22 Batch 210/1540] avg loss 0.00278911, throughput 2.86701K wps
[Epoch 22 Batch 240/1540] avg loss 0.00291024, throughput 2.86352K wps
[Epoch 22 Batch 270/1540] avg loss 0.00322752, throughput 2.86028K wps
[Epoch 22 Batch 300/1540] avg loss 0.00288793, throughput 2.87147K wps
[Epoch 22 Batch 330/1540] avg loss 0.0030328, throughput 2.85605K wps
[Epoch 22 Batch 360/1540] avg loss 0.00317558, throughput 2.8152K wps
[Epoch 22 Batch 390/1540] avg loss 0.00287794, throughput 2.8662K wps
[Epoch 22 Batch 420/1540] avg loss 0.00272743, throughput 2.85039K wps
[Epoch 22 Batch 450/1540] avg loss 0.00289203, throughput 2.86104K wps
[Epoch 22 Batch 480/1540] avg loss 0.0028317, throughput 2.85957K wps
[Epoch 22 Batch 510/1540] avg loss 0.00292185, throughput 2.8766K wps
[Epoch 22 Batch 540/1540] avg loss 0.0029785, throughput 2.832K wps
[Epoch 22 Batch 570/1540] avg loss 0.00281449, throughput 2.81408K wps
[Epoch 22 Batch 600/1540] avg loss 0.00328502, throughput 2.7855K wps
[Epoch 22 Batch 630/1540] avg loss 0.00315896, throughput 2.8011K wps
[Epoch 22 Batch 660/1540] avg loss 0.00294471, throughput 2.87003K wps
[Epoch 22 Batch 690/1540] avg loss 0.00310993, throughput 2.87529K wps
[Epoch 22 Batch 720/1540] avg loss 0.00277707, throughput 2.86435K wps
[Epoch 22 Batch 750/1540] avg loss 0.00309243, throughput 2.87763K wps
[Epoch 22 Batch 780/1540] avg loss 0.00353386, throughput 2.85315K wps
[Epoch 22 Batch 810/1540] avg loss 0.00325083, throughput 2.86563K wps
[Epoch 22 Batch 840/1540] avg loss 0.00247711, throughput 2.87933K wps
[Epoch 22 Batch 870/1540] avg loss 0.00344158, throughput 2.87441K wps
[Epoch 22 Batch 900/1540] avg loss 0.00262524, throughput 2.86554K wps
[Epoch 22 Batch 930/1540] avg loss 0.00314025, throughput 2.85158K wps
[Epoch 22 Batch 960/1540] avg loss 0.00300459, throughput 2.87485K wps
[Epoch 22 Batch 990/1540] avg loss 0.00305307, throughput 2.86408K wps
[Epoch 22 Batch 1020/1540] avg loss 0.00294867, throughput 2.81877K wps
[Epoch 22 Batch 1050/1540] avg loss 0.00308634, throughput 2.8534K wps
[Epoch 22 Batch 1080/1540] avg loss 0.00327687, throughput 2.8535K wps
[Epoch 22 Batch 1110/1540] avg loss 0.00297118, throughput 2.81816K wps
[Epoch 22 Batch 1140/1540] avg loss 0.0027898, throughput 2.86765K wps
[Epoch 22 Batch 1170/1540] avg loss 0.00292083, throughput 2.87226K wps
[Epoch 22 Batch 1200/1540] avg loss 0.00318261, throughput 2.8646K wps
[Epoch 22 Batch 1230/1540] avg loss 0.00327711, throughput 2.83095K wps
[Epoch 22 Batch 1260/1540] avg loss 0.00303457, throughput 2.87204K wps
[Epoch 22 Batch 1290/1540] avg loss 0.00325259, throughput 2.88018K wps
[Epoch 22 Batch 1320/1540] avg loss 0.00316599, throughput 2.84129K wps
[Epoch 22 Batch 1350/1540] avg loss 0.00336852, throughput 2.84523K wps
[Epoch 22 Batch 1380/1540] avg loss 0.0029842, throughput 2.88054K wps
[Epoch 22 Batch 1410/1540] avg loss 0.00290526, throughput 2.87453K wps
[Epoch 22 Batch 1440/1540] avg loss 0.00316248, throughput 2.8697K wps
[Epoch 22 Batch 1470/1540] avg loss 0.00331497, throughput 2.87896K wps
[Epoch 22 Batch 1500/1540] avg loss 0.00289617, throughput 2.87031K wps
[Epoch 22 Batch 1530/1540] avg loss 0.00327411, throughput 2.7794K wps
Begin Testing...
[Epoch 22] train avg loss 0.00302828, dev acc 0.8142, dev avg loss 0.479162, throughput 2.85694K wps
[Epoch 23 Batch 30/1540] avg loss 0.00286773, throughput 2.92895K wps
[Epoch 23 Batch 60/1540] avg loss 0.00274873, throughput 2.87904K wps
[Epoch 23 Batch 90/1540] avg loss 0.00293792, throughput 2.87483K wps
[Epoch 23 Batch 120/1540] avg loss 0.00280889, throughput 2.87123K wps
[Epoch 23 Batch 150/1540] avg loss 0.00246361, throughput 2.83668K wps
[Epoch 23 Batch 180/1540] avg loss 0.00281801, throughput 2.86564K wps
[Epoch 23 Batch 210/1540] avg loss 0.00238389, throughput 2.87084K wps
[Epoch 23 Batch 240/1540] avg loss 0.0029477, throughput 2.86648K wps
[Epoch 23 Batch 270/1540] avg loss 0.00272324, throughput 2.8809K wps
[Epoch 23 Batch 300/1540] avg loss 0.00254789, throughput 2.83165K wps
[Epoch 23 Batch 330/1540] avg loss 0.00289714, throughput 2.86351K wps
[Epoch 23 Batch 360/1540] avg loss 0.00318455, throughput 2.86726K wps
[Epoch 23 Batch 390/1540] avg loss 0.00310095, throughput 2.86282K wps
[Epoch 23 Batch 420/1540] avg loss 0.00300737, throughput 2.86004K wps
[Epoch 23 Batch 450/1540] avg loss 0.00274201, throughput 2.86597K wps
[Epoch 23 Batch 480/1540] avg loss 0.00291038, throughput 2.87539K wps
[Epoch 23 Batch 510/1540] avg loss 0.0028225, throughput 2.8711K wps
[Epoch 23 Batch 540/1540] avg loss 0.00319809, throughput 2.87392K wps
[Epoch 23 Batch 570/1540] avg loss 0.002833, throughput 2.87782K wps
[Epoch 23 Batch 600/1540] avg loss 0.00253814, throughput 2.81454K wps
[Epoch 23 Batch 630/1540] avg loss 0.00291726, throughput 2.83638K wps
[Epoch 23 Batch 660/1540] avg loss 0.00304206, throughput 2.87139K wps
[Epoch 23 Batch 690/1540] avg loss 0.00237228, throughput 2.8755K wps
[Epoch 23 Batch 720/1540] avg loss 0.00331781, throughput 2.85092K wps
[Epoch 23 Batch 750/1540] avg loss 0.00322385, throughput 2.8784K wps
[Epoch 23 Batch 780/1540] avg loss 0.00290321, throughput 2.87555K wps
[Epoch 23 Batch 810/1540] avg loss 0.00286966, throughput 2.82096K wps
[Epoch 23 Batch 840/1540] avg loss 0.00346712, throughput 2.86078K wps
[Epoch 23 Batch 870/1540] avg loss 0.00290061, throughput 2.84107K wps
[Epoch 23 Batch 900/1540] avg loss 0.00289271, throughput 2.84332K wps
[Epoch 23 Batch 930/1540] avg loss 0.00275391, throughput 2.8727K wps
[Epoch 23 Batch 960/1540] avg loss 0.00269665, throughput 2.87774K wps
[Epoch 23 Batch 990/1540] avg loss 0.00309035, throughput 2.81989K wps
[Epoch 23 Batch 1020/1540] avg loss 0.00296705, throughput 2.87164K wps
[Epoch 23 Batch 1050/1540] avg loss 0.0031935, throughput 2.8112K wps
[Epoch 23 Batch 1080/1540] avg loss 0.00318004, throughput 2.87269K wps
[Epoch 23 Batch 1110/1540] avg loss 0.00297858, throughput 2.86409K wps
[Epoch 23 Batch 1140/1540] avg loss 0.00295833, throughput 2.85563K wps
[Epoch 23 Batch 1170/1540] avg loss 0.00288467, throughput 2.86134K wps
[Epoch 23 Batch 1200/1540] avg loss 0.00293214, throughput 2.87326K wps
[Epoch 23 Batch 1230/1540] avg loss 0.00321484, throughput 2.88035K wps
[Epoch 23 Batch 1260/1540] avg loss 0.00313475, throughput 2.87544K wps
[Epoch 23 Batch 1290/1540] avg loss 0.00250774, throughput 2.87365K wps
[Epoch 23 Batch 1320/1540] avg loss 0.00277714, throughput 2.79115K wps
[Epoch 23 Batch 1350/1540] avg loss 0.00278417, throughput 2.80668K wps
[Epoch 23 Batch 1380/1540] avg loss 0.00280519, throughput 2.81328K wps
[Epoch 23 Batch 1410/1540] avg loss 0.0031202, throughput 2.8734K wps
[Epoch 23 Batch 1440/1540] avg loss 0.00281972, throughput 2.86365K wps
[Epoch 23 Batch 1470/1540] avg loss 0.00299263, throughput 2.88113K wps
[Epoch 23 Batch 1500/1540] avg loss 0.00325375, throughput 2.8546K wps
[Epoch 23 Batch 1530/1540] avg loss 0.00294169, throughput 2.79523K wps
Begin Testing...
[Epoch 23] train avg loss 0.00290931, dev acc 0.8245, dev avg loss 0.471665, throughput 2.85823K wps
[Epoch 24 Batch 30/1540] avg loss 0.0027535, throughput 2.93546K wps
[Epoch 24 Batch 60/1540] avg loss 0.00283967, throughput 2.87195K wps
[Epoch 24 Batch 90/1540] avg loss 0.00267324, throughput 2.87079K wps
[Epoch 24 Batch 120/1540] avg loss 0.00243618, throughput 2.8045K wps
[Epoch 24 Batch 150/1540] avg loss 0.00254263, throughput 2.87777K wps
[Epoch 24 Batch 180/1540] avg loss 0.00257524, throughput 2.81295K wps
[Epoch 24 Batch 210/1540] avg loss 0.0026824, throughput 2.86583K wps
[Epoch 24 Batch 240/1540] avg loss 0.00251548, throughput 2.86809K wps
[Epoch 24 Batch 270/1540] avg loss 0.00259465, throughput 2.84216K wps
[Epoch 24 Batch 300/1540] avg loss 0.00249184, throughput 2.83959K wps
[Epoch 24 Batch 330/1540] avg loss 0.00278713, throughput 2.86815K wps
[Epoch 24 Batch 360/1540] avg loss 0.00294722, throughput 2.86137K wps
[Epoch 24 Batch 390/1540] avg loss 0.00280355, throughput 2.86184K wps
[Epoch 24 Batch 420/1540] avg loss 0.00284389, throughput 2.8335K wps
[Epoch 24 Batch 450/1540] avg loss 0.0028293, throughput 2.86712K wps
[Epoch 24 Batch 480/1540] avg loss 0.00303276, throughput 2.86092K wps
[Epoch 24 Batch 510/1540] avg loss 0.00294255, throughput 2.86071K wps
[Epoch 24 Batch 540/1540] avg loss 0.00292161, throughput 2.87517K wps
[Epoch 24 Batch 570/1540] avg loss 0.00309398, throughput 2.81509K wps
[Epoch 24 Batch 600/1540] avg loss 0.00292812, throughput 2.88067K wps
[Epoch 24 Batch 630/1540] avg loss 0.00316362, throughput 2.88013K wps
[Epoch 24 Batch 660/1540] avg loss 0.00309564, throughput 2.86913K wps
[Epoch 24 Batch 690/1540] avg loss 0.0027192, throughput 2.88115K wps
[Epoch 24 Batch 720/1540] avg loss 0.00274694, throughput 2.87721K wps
[Epoch 24 Batch 750/1540] avg loss 0.00286279, throughput 2.82806K wps
[Epoch 24 Batch 780/1540] avg loss 0.00266064, throughput 2.87895K wps
[Epoch 24 Batch 810/1540] avg loss 0.00291759, throughput 2.83291K wps
[Epoch 24 Batch 840/1540] avg loss 0.00253504, throughput 2.88458K wps
[Epoch 24 Batch 870/1540] avg loss 0.00322491, throughput 2.87172K wps
[Epoch 24 Batch 900/1540] avg loss 0.00266742, throughput 2.87498K wps
[Epoch 24 Batch 930/1540] avg loss 0.00297642, throughput 2.873K wps
[Epoch 24 Batch 960/1540] avg loss 0.00286695, throughput 2.86398K wps
[Epoch 24 Batch 990/1540] avg loss 0.0030373, throughput 2.86228K wps
[Epoch 24 Batch 1020/1540] avg loss 0.00314148, throughput 2.86995K wps
[Epoch 24 Batch 1050/1540] avg loss 0.00314522, throughput 2.85576K wps
[Epoch 24 Batch 1080/1540] avg loss 0.0027721, throughput 2.84225K wps
[Epoch 24 Batch 1110/1540] avg loss 0.00318235, throughput 2.86272K wps
[Epoch 24 Batch 1140/1540] avg loss 0.00322502, throughput 2.84763K wps
[Epoch 24 Batch 1170/1540] avg loss 0.00279356, throughput 2.86821K wps
[Epoch 24 Batch 1200/1540] avg loss 0.00241805, throughput 2.8647K wps
[Epoch 24 Batch 1230/1540] avg loss 0.00299595, throughput 2.86942K wps
[Epoch 24 Batch 1260/1540] avg loss 0.00276273, throughput 2.88167K wps
[Epoch 24 Batch 1290/1540] avg loss 0.00288227, throughput 2.84005K wps
[Epoch 24 Batch 1320/1540] avg loss 0.0026863, throughput 2.87175K wps
[Epoch 24 Batch 1350/1540] avg loss 0.00283038, throughput 2.86456K wps
[Epoch 24 Batch 1380/1540] avg loss 0.00274184, throughput 2.83716K wps
[Epoch 24 Batch 1410/1540] avg loss 0.0027683, throughput 2.87105K wps
[Epoch 24 Batch 1440/1540] avg loss 0.00272055, throughput 2.85368K wps
[Epoch 24 Batch 1470/1540] avg loss 0.00313037, throughput 2.83046K wps
[Epoch 24 Batch 1500/1540] avg loss 0.00280752, throughput 2.88113K wps
[Epoch 24 Batch 1530/1540] avg loss 0.00301511, throughput 2.86691K wps
Begin Testing...
[Epoch 24] train avg loss 0.0028412, dev acc 0.8177, dev avg loss 0.483309, throughput 2.86136K wps
[Epoch 25 Batch 30/1540] avg loss 0.00266207, throughput 2.84153K wps
[Epoch 25 Batch 60/1540] avg loss 0.00244357, throughput 2.79583K wps
[Epoch 25 Batch 90/1540] avg loss 0.00282656, throughput 2.85275K wps
[Epoch 25 Batch 120/1540] avg loss 0.00274608, throughput 2.85391K wps
[Epoch 25 Batch 150/1540] avg loss 0.00252018, throughput 2.85551K wps
[Epoch 25 Batch 180/1540] avg loss 0.00252817, throughput 2.87158K wps
[Epoch 25 Batch 210/1540] avg loss 0.00248763, throughput 2.81833K wps
[Epoch 25 Batch 240/1540] avg loss 0.00273261, throughput 2.80737K wps
[Epoch 25 Batch 270/1540] avg loss 0.00271718, throughput 2.87341K wps
[Epoch 25 Batch 300/1540] avg loss 0.00262288, throughput 2.85194K wps
[Epoch 25 Batch 330/1540] avg loss 0.00246257, throughput 2.80893K wps
[Epoch 25 Batch 360/1540] avg loss 0.00255895, throughput 2.83862K wps
[Epoch 25 Batch 390/1540] avg loss 0.0026047, throughput 2.8407K wps
[Epoch 25 Batch 420/1540] avg loss 0.00264311, throughput 2.88042K wps
[Epoch 25 Batch 450/1540] avg loss 0.00265039, throughput 2.87435K wps
[Epoch 25 Batch 480/1540] avg loss 0.00279353, throughput 2.87696K wps
[Epoch 25 Batch 510/1540] avg loss 0.00270168, throughput 2.8759K wps
[Epoch 25 Batch 540/1540] avg loss 0.00272125, throughput 2.87432K wps
[Epoch 25 Batch 570/1540] avg loss 0.00287344, throughput 2.77828K wps
[Epoch 25 Batch 600/1540] avg loss 0.00253746, throughput 2.80119K wps
[Epoch 25 Batch 630/1540] avg loss 0.00224462, throughput 2.87785K wps
[Epoch 25 Batch 660/1540] avg loss 0.00269117, throughput 2.84239K wps
[Epoch 25 Batch 690/1540] avg loss 0.00285172, throughput 2.8165K wps
[Epoch 25 Batch 720/1540] avg loss 0.00284792, throughput 2.86593K wps
[Epoch 25 Batch 750/1540] avg loss 0.00320145, throughput 2.85385K wps
[Epoch 25 Batch 780/1540] avg loss 0.00298935, throughput 2.86935K wps
[Epoch 25 Batch 810/1540] avg loss 0.00289699, throughput 2.8144K wps
[Epoch 25 Batch 840/1540] avg loss 0.00262486, throughput 2.82211K wps
[Epoch 25 Batch 870/1540] avg loss 0.00248235, throughput 2.82522K wps
[Epoch 25 Batch 900/1540] avg loss 0.00269453, throughput 2.83888K wps
[Epoch 25 Batch 930/1540] avg loss 0.002994, throughput 2.85975K wps
[Epoch 25 Batch 960/1540] avg loss 0.00270713, throughput 2.87674K wps
[Epoch 25 Batch 990/1540] avg loss 0.00260148, throughput 2.87123K wps
[Epoch 25 Batch 1020/1540] avg loss 0.00303346, throughput 2.86993K wps
[Epoch 25 Batch 1050/1540] avg loss 0.00281362, throughput 2.80162K wps
[Epoch 25 Batch 1080/1540] avg loss 0.00283846, throughput 2.8296K wps
[Epoch 25 Batch 1110/1540] avg loss 0.00261867, throughput 2.86226K wps
[Epoch 25 Batch 1140/1540] avg loss 0.00289001, throughput 2.86796K wps
[Epoch 25 Batch 1170/1540] avg loss 0.00282253, throughput 2.868K wps
[Epoch 25 Batch 1200/1540] avg loss 0.00306379, throughput 2.84872K wps
[Epoch 25 Batch 1230/1540] avg loss 0.00297488, throughput 2.86199K wps
[Epoch 25 Batch 1260/1540] avg loss 0.00305977, throughput 2.87063K wps
[Epoch 25 Batch 1290/1540] avg loss 0.00293299, throughput 2.82155K wps
[Epoch 25 Batch 1320/1540] avg loss 0.00288766, throughput 2.79851K wps
[Epoch 25 Batch 1350/1540] avg loss 0.0028363, throughput 2.87568K wps
[Epoch 25 Batch 1380/1540] avg loss 0.00288244, throughput 2.87729K wps
[Epoch 25 Batch 1410/1540] avg loss 0.00294812, throughput 2.87132K wps
[Epoch 25 Batch 1440/1540] avg loss 0.00299643, throughput 2.87707K wps
[Epoch 25 Batch 1470/1540] avg loss 0.00273169, throughput 2.858K wps
[Epoch 25 Batch 1500/1540] avg loss 0.00283984, throughput 2.87097K wps
[Epoch 25 Batch 1530/1540] avg loss 0.00273135, throughput 2.85077K wps
Begin Testing...
[Epoch 25] train avg loss 0.00275846, dev acc 0.8119, dev avg loss 0.491096, throughput 2.84844K wps
[Epoch 26 Batch 30/1540] avg loss 0.00218321, throughput 2.85747K wps
[Epoch 26 Batch 60/1540] avg loss 0.00264815, throughput 2.87151K wps
[Epoch 26 Batch 90/1540] avg loss 0.00234005, throughput 2.8791K wps
[Epoch 26 Batch 120/1540] avg loss 0.00258123, throughput 2.87254K wps
[Epoch 26 Batch 150/1540] avg loss 0.00260827, throughput 2.87477K wps
[Epoch 26 Batch 180/1540] avg loss 0.00264439, throughput 2.84173K wps
[Epoch 26 Batch 210/1540] avg loss 0.0026221, throughput 2.87244K wps
[Epoch 26 Batch 240/1540] avg loss 0.00277864, throughput 2.79499K wps
[Epoch 26 Batch 270/1540] avg loss 0.00240666, throughput 2.84094K wps
[Epoch 26 Batch 300/1540] avg loss 0.00246204, throughput 2.86753K wps
[Epoch 26 Batch 330/1540] avg loss 0.00268191, throughput 2.87132K wps
[Epoch 26 Batch 360/1540] avg loss 0.00270588, throughput 2.83776K wps
[Epoch 26 Batch 390/1540] avg loss 0.0026429, throughput 2.77473K wps
[Epoch 26 Batch 420/1540] avg loss 0.00312285, throughput 2.85647K wps
[Epoch 26 Batch 450/1540] avg loss 0.00238521, throughput 2.84916K wps
[Epoch 26 Batch 480/1540] avg loss 0.00221521, throughput 2.87635K wps
[Epoch 26 Batch 510/1540] avg loss 0.00246514, throughput 2.87318K wps
[Epoch 26 Batch 540/1540] avg loss 0.00282442, throughput 2.83832K wps
[Epoch 26 Batch 570/1540] avg loss 0.00277465, throughput 2.78992K wps
[Epoch 26 Batch 600/1540] avg loss 0.0024088, throughput 2.86898K wps
[Epoch 26 Batch 630/1540] avg loss 0.00233399, throughput 2.82512K wps
[Epoch 26 Batch 660/1540] avg loss 0.00269161, throughput 2.7973K wps
[Epoch 26 Batch 690/1540] avg loss 0.00246152, throughput 2.86296K wps
[Epoch 26 Batch 720/1540] avg loss 0.00296261, throughput 2.88123K wps
[Epoch 26 Batch 750/1540] avg loss 0.00211901, throughput 2.86477K wps
[Epoch 26 Batch 780/1540] avg loss 0.00255868, throughput 2.84577K wps
[Epoch 26 Batch 810/1540] avg loss 0.00273517, throughput 2.83244K wps
[Epoch 26 Batch 840/1540] avg loss 0.00265202, throughput 2.83766K wps
[Epoch 26 Batch 870/1540] avg loss 0.00223408, throughput 2.86792K wps
[Epoch 26 Batch 900/1540] avg loss 0.00255829, throughput 2.86664K wps
[Epoch 26 Batch 930/1540] avg loss 0.00268503, throughput 2.87112K wps
[Epoch 26 Batch 960/1540] avg loss 0.00246925, throughput 2.87054K wps
[Epoch 26 Batch 990/1540] avg loss 0.00255938, throughput 2.86426K wps
[Epoch 26 Batch 1020/1540] avg loss 0.0029436, throughput 2.87613K wps
[Epoch 26 Batch 1050/1540] avg loss 0.00266188, throughput 2.86584K wps
[Epoch 26 Batch 1080/1540] avg loss 0.00259524, throughput 2.8627K wps
[Epoch 26 Batch 1110/1540] avg loss 0.00264649, throughput 2.86904K wps
[Epoch 26 Batch 1140/1540] avg loss 0.00239486, throughput 2.85016K wps
[Epoch 26 Batch 1170/1540] avg loss 0.00316717, throughput 2.87064K wps
[Epoch 26 Batch 1200/1540] avg loss 0.00298445, throughput 2.8159K wps
[Epoch 26 Batch 1230/1540] avg loss 0.00304746, throughput 2.83937K wps
[Epoch 26 Batch 1260/1540] avg loss 0.00324882, throughput 2.87217K wps
[Epoch 26 Batch 1290/1540] avg loss 0.00293062, throughput 2.87396K wps
[Epoch 26 Batch 1320/1540] avg loss 0.00291952, throughput 2.7904K wps
[Epoch 26 Batch 1350/1540] avg loss 0.00283546, throughput 2.8595K wps
[Epoch 26 Batch 1380/1540] avg loss 0.00302675, throughput 2.87004K wps
[Epoch 26 Batch 1410/1540] avg loss 0.00285152, throughput 2.83345K wps
[Epoch 26 Batch 1440/1540] avg loss 0.00274447, throughput 2.809K wps
[Epoch 26 Batch 1470/1540] avg loss 0.0028066, throughput 2.86874K wps
[Epoch 26 Batch 1500/1540] avg loss 0.00269647, throughput 2.80441K wps
[Epoch 26 Batch 1530/1540] avg loss 0.00270831, throughput 2.87358K wps
Begin Testing...
[Epoch 26] train avg loss 0.00266137, dev acc 0.8096, dev avg loss 0.495286, throughput 2.85082K wps
[Epoch 27 Batch 30/1540] avg loss 0.00246118, throughput 2.87808K wps
[Epoch 27 Batch 60/1540] avg loss 0.00240395, throughput 2.8556K wps
[Epoch 27 Batch 90/1540] avg loss 0.00269905, throughput 2.86007K wps
[Epoch 27 Batch 120/1540] avg loss 0.00271742, throughput 2.85273K wps
[Epoch 27 Batch 150/1540] avg loss 0.0022783, throughput 2.87022K wps
[Epoch 27 Batch 180/1540] avg loss 0.00225897, throughput 2.81318K wps
[Epoch 27 Batch 210/1540] avg loss 0.00256017, throughput 2.78767K wps
[Epoch 27 Batch 240/1540] avg loss 0.00245576, throughput 2.82512K wps
[Epoch 27 Batch 270/1540] avg loss 0.00228544, throughput 2.8763K wps
[Epoch 27 Batch 300/1540] avg loss 0.00231599, throughput 2.84594K wps
[Epoch 27 Batch 330/1540] avg loss 0.00232084, throughput 2.82182K wps
[Epoch 27 Batch 360/1540] avg loss 0.00227463, throughput 2.85401K wps
[Epoch 27 Batch 390/1540] avg loss 0.00279022, throughput 2.81756K wps
[Epoch 27 Batch 420/1540] avg loss 0.00263864, throughput 2.86821K wps
[Epoch 27 Batch 450/1540] avg loss 0.00269081, throughput 2.79516K wps
[Epoch 27 Batch 480/1540] avg loss 0.0025738, throughput 2.79656K wps
[Epoch 27 Batch 510/1540] avg loss 0.00286828, throughput 2.87269K wps
[Epoch 27 Batch 540/1540] avg loss 0.00263527, throughput 2.87103K wps
[Epoch 27 Batch 570/1540] avg loss 0.00217656, throughput 2.87664K wps
[Epoch 27 Batch 600/1540] avg loss 0.00253169, throughput 2.87971K wps
[Epoch 27 Batch 630/1540] avg loss 0.00255721, throughput 2.87781K wps
[Epoch 27 Batch 660/1540] avg loss 0.002426, throughput 2.87048K wps
[Epoch 27 Batch 690/1540] avg loss 0.00230612, throughput 2.84023K wps
[Epoch 27 Batch 720/1540] avg loss 0.00288651, throughput 2.82388K wps
[Epoch 27 Batch 750/1540] avg loss 0.00271023, throughput 2.8069K wps
[Epoch 27 Batch 780/1540] avg loss 0.00287535, throughput 2.88074K wps
[Epoch 27 Batch 810/1540] avg loss 0.0028715, throughput 2.8615K wps
[Epoch 27 Batch 840/1540] avg loss 0.00245226, throughput 2.87299K wps
[Epoch 27 Batch 870/1540] avg loss 0.0027245, throughput 2.8653K wps
[Epoch 27 Batch 900/1540] avg loss 0.00272985, throughput 2.83066K wps
[Epoch 27 Batch 930/1540] avg loss 0.00266352, throughput 2.87067K wps
[Epoch 27 Batch 960/1540] avg loss 0.00266061, throughput 2.81529K wps
[Epoch 27 Batch 990/1540] avg loss 0.00269541, throughput 2.8664K wps
[Epoch 27 Batch 1020/1540] avg loss 0.00274142, throughput 2.83468K wps
[Epoch 27 Batch 1050/1540] avg loss 0.00238116, throughput 2.87795K wps
[Epoch 27 Batch 1080/1540] avg loss 0.00230881, throughput 2.85835K wps
[Epoch 27 Batch 1110/1540] avg loss 0.00247955, throughput 2.85671K wps
[Epoch 27 Batch 1140/1540] avg loss 0.00282179, throughput 2.84238K wps
[Epoch 27 Batch 1170/1540] avg loss 0.00283841, throughput 2.83261K wps
[Epoch 27 Batch 1200/1540] avg loss 0.00233445, throughput 2.87606K wps
[Epoch 27 Batch 1230/1540] avg loss 0.00273525, throughput 2.87638K wps
[Epoch 27 Batch 1260/1540] avg loss 0.00261169, throughput 2.84653K wps
[Epoch 27 Batch 1290/1540] avg loss 0.00235058, throughput 2.86823K wps
[Epoch 27 Batch 1320/1540] avg loss 0.00244526, throughput 2.88128K wps
[Epoch 27 Batch 1350/1540] avg loss 0.00319654, throughput 2.86168K wps
[Epoch 27 Batch 1380/1540] avg loss 0.00279997, throughput 2.85505K wps
[Epoch 27 Batch 1410/1540] avg loss 0.00290737, throughput 2.84507K wps
[Epoch 27 Batch 1440/1540] avg loss 0.00255679, throughput 2.85172K wps
[Epoch 27 Batch 1470/1540] avg loss 0.00270105, throughput 2.79048K wps
[Epoch 27 Batch 1500/1540] avg loss 0.00274212, throughput 2.87828K wps
[Epoch 27 Batch 1530/1540] avg loss 0.00237778, throughput 2.87945K wps
Begin Testing...
[Epoch 27] train avg loss 0.0025902, dev acc 0.7982, dev avg loss 0.515343, throughput 2.85119K wps
[Epoch 28 Batch 30/1540] avg loss 0.00228338, throughput 2.89132K wps
[Epoch 28 Batch 60/1540] avg loss 0.00233125, throughput 2.81261K wps
[Epoch 28 Batch 90/1540] avg loss 0.00253886, throughput 2.86148K wps
[Epoch 28 Batch 120/1540] avg loss 0.00245367, throughput 2.84798K wps
[Epoch 28 Batch 150/1540] avg loss 0.0023146, throughput 2.86013K wps
[Epoch 28 Batch 180/1540] avg loss 0.00223532, throughput 2.86028K wps
[Epoch 28 Batch 210/1540] avg loss 0.00242364, throughput 2.84039K wps
[Epoch 28 Batch 240/1540] avg loss 0.00249072, throughput 2.86368K wps
[Epoch 28 Batch 270/1540] avg loss 0.00197505, throughput 2.87967K wps
[Epoch 28 Batch 300/1540] avg loss 0.00259979, throughput 2.88021K wps
[Epoch 28 Batch 330/1540] avg loss 0.00234831, throughput 2.87102K wps
[Epoch 28 Batch 360/1540] avg loss 0.00216768, throughput 2.87226K wps
[Epoch 28 Batch 390/1540] avg loss 0.00285854, throughput 2.86992K wps
[Epoch 28 Batch 420/1540] avg loss 0.00253271, throughput 2.85416K wps
[Epoch 28 Batch 450/1540] avg loss 0.00258677, throughput 2.87274K wps
[Epoch 28 Batch 480/1540] avg loss 0.00235767, throughput 2.87232K wps
[Epoch 28 Batch 510/1540] avg loss 0.00235342, throughput 2.8453K wps
[Epoch 28 Batch 540/1540] avg loss 0.00245616, throughput 2.87947K wps
[Epoch 28 Batch 570/1540] avg loss 0.00274652, throughput 2.87849K wps
[Epoch 28 Batch 600/1540] avg loss 0.00284016, throughput 2.87783K wps
[Epoch 28 Batch 630/1540] avg loss 0.00238182, throughput 2.87911K wps
[Epoch 28 Batch 660/1540] avg loss 0.00248645, throughput 2.86713K wps
[Epoch 28 Batch 690/1540] avg loss 0.00251373, throughput 2.88577K wps
[Epoch 28 Batch 720/1540] avg loss 0.00251666, throughput 2.85217K wps
[Epoch 28 Batch 750/1540] avg loss 0.00284883, throughput 2.8649K wps
[Epoch 28 Batch 780/1540] avg loss 0.00242574, throughput 2.81753K wps
[Epoch 28 Batch 810/1540] avg loss 0.00247685, throughput 2.80774K wps
[Epoch 28 Batch 840/1540] avg loss 0.00262612, throughput 2.83531K wps
[Epoch 28 Batch 870/1540] avg loss 0.00244886, throughput 2.86931K wps
[Epoch 28 Batch 900/1540] avg loss 0.00250142, throughput 2.88178K wps
[Epoch 28 Batch 930/1540] avg loss 0.00267023, throughput 2.8876K wps
[Epoch 28 Batch 960/1540] avg loss 0.00237948, throughput 2.85451K wps
[Epoch 28 Batch 990/1540] avg loss 0.00239708, throughput 2.86119K wps
[Epoch 28 Batch 1020/1540] avg loss 0.0024045, throughput 2.82237K wps
[Epoch 28 Batch 1050/1540] avg loss 0.00250392, throughput 2.87394K wps
[Epoch 28 Batch 1080/1540] avg loss 0.0024827, throughput 2.85558K wps
[Epoch 28 Batch 1110/1540] avg loss 0.00277882, throughput 2.87575K wps
[Epoch 28 Batch 1140/1540] avg loss 0.0025416, throughput 2.8487K wps
[Epoch 28 Batch 1170/1540] avg loss 0.00266478, throughput 2.81752K wps
[Epoch 28 Batch 1200/1540] avg loss 0.00228312, throughput 2.86405K wps
[Epoch 28 Batch 1230/1540] avg loss 0.00263939, throughput 2.83652K wps
[Epoch 28 Batch 1260/1540] avg loss 0.00272009, throughput 2.83712K wps
[Epoch 28 Batch 1290/1540] avg loss 0.00238782, throughput 2.84294K wps
[Epoch 28 Batch 1320/1540] avg loss 0.00269143, throughput 2.87406K wps
[Epoch 28 Batch 1350/1540] avg loss 0.00261923, throughput 2.8436K wps
[Epoch 28 Batch 1380/1540] avg loss 0.00244292, throughput 2.86726K wps
[Epoch 28 Batch 1410/1540] avg loss 0.00283314, throughput 2.85948K wps
[Epoch 28 Batch 1440/1540] avg loss 0.00296519, throughput 2.85382K wps
[Epoch 28 Batch 1470/1540] avg loss 0.0028381, throughput 2.85992K wps
[Epoch 28 Batch 1500/1540] avg loss 0.00274499, throughput 2.8747K wps
[Epoch 28 Batch 1530/1540] avg loss 0.00244384, throughput 2.86842K wps
Begin Testing...
[Epoch 28] train avg loss 0.00251822, dev acc 0.8096, dev avg loss 0.504692, throughput 2.85917K wps
[Epoch 29 Batch 30/1540] avg loss 0.00220243, throughput 2.93209K wps
[Epoch 29 Batch 60/1540] avg loss 0.00210587, throughput 2.87543K wps
[Epoch 29 Batch 90/1540] avg loss 0.00197657, throughput 2.83075K wps
[Epoch 29 Batch 120/1540] avg loss 0.00226427, throughput 2.88428K wps
[Epoch 29 Batch 150/1540] avg loss 0.00238262, throughput 2.87188K wps
[Epoch 29 Batch 180/1540] avg loss 0.00260317, throughput 2.87276K wps
[Epoch 29 Batch 210/1540] avg loss 0.00275745, throughput 2.85899K wps
[Epoch 29 Batch 240/1540] avg loss 0.00265075, throughput 2.88135K wps
[Epoch 29 Batch 270/1540] avg loss 0.00217534, throughput 2.81097K wps
[Epoch 29 Batch 300/1540] avg loss 0.00235779, throughput 2.88226K wps
[Epoch 29 Batch 330/1540] avg loss 0.00241207, throughput 2.81043K wps
[Epoch 29 Batch 360/1540] avg loss 0.00216112, throughput 2.87903K wps
[Epoch 29 Batch 390/1540] avg loss 0.00275802, throughput 2.86638K wps
[Epoch 29 Batch 420/1540] avg loss 0.00228035, throughput 2.8688K wps
[Epoch 29 Batch 450/1540] avg loss 0.00223184, throughput 2.83573K wps
[Epoch 29 Batch 480/1540] avg loss 0.00209789, throughput 2.83949K wps
[Epoch 29 Batch 510/1540] avg loss 0.0024355, throughput 2.85662K wps
[Epoch 29 Batch 540/1540] avg loss 0.00264685, throughput 2.86145K wps
[Epoch 29 Batch 570/1540] avg loss 0.00261647, throughput 2.86975K wps
[Epoch 29 Batch 600/1540] avg loss 0.00249194, throughput 2.87534K wps
[Epoch 29 Batch 630/1540] avg loss 0.00268032, throughput 2.88172K wps
[Epoch 29 Batch 660/1540] avg loss 0.00258318, throughput 2.88031K wps
[Epoch 29 Batch 690/1540] avg loss 0.00276549, throughput 2.86385K wps
[Epoch 29 Batch 720/1540] avg loss 0.00240866, throughput 2.86482K wps
[Epoch 29 Batch 750/1540] avg loss 0.00249284, throughput 2.87368K wps
[Epoch 29 Batch 780/1540] avg loss 0.00273856, throughput 2.88159K wps
[Epoch 29 Batch 810/1540] avg loss 0.00262014, throughput 2.86703K wps
[Epoch 29 Batch 840/1540] avg loss 0.00233887, throughput 2.83469K wps
[Epoch 29 Batch 870/1540] avg loss 0.00244755, throughput 2.88054K wps
[Epoch 29 Batch 900/1540] avg loss 0.00303119, throughput 2.81453K wps
[Epoch 29 Batch 930/1540] avg loss 0.00222622, throughput 2.86964K wps
[Epoch 29 Batch 960/1540] avg loss 0.00252494, throughput 2.87435K wps
[Epoch 29 Batch 990/1540] avg loss 0.00274682, throughput 2.86684K wps
[Epoch 29 Batch 1020/1540] avg loss 0.00224375, throughput 2.86833K wps
[Epoch 29 Batch 1050/1540] avg loss 0.00262307, throughput 2.86041K wps
[Epoch 29 Batch 1080/1540] avg loss 0.00263917, throughput 2.78711K wps
[Epoch 29 Batch 1110/1540] avg loss 0.0026632, throughput 2.8619K wps
[Epoch 29 Batch 1140/1540] avg loss 0.00230619, throughput 2.87159K wps
[Epoch 29 Batch 1170/1540] avg loss 0.00230045, throughput 2.84917K wps
[Epoch 29 Batch 1200/1540] avg loss 0.0023643, throughput 2.79813K wps
[Epoch 29 Batch 1230/1540] avg loss 0.00225357, throughput 2.84219K wps
[Epoch 29 Batch 1260/1540] avg loss 0.00230815, throughput 2.81972K wps
[Epoch 29 Batch 1290/1540] avg loss 0.00267943, throughput 2.87262K wps
[Epoch 29 Batch 1320/1540] avg loss 0.00268418, throughput 2.85925K wps
[Epoch 29 Batch 1350/1540] avg loss 0.00269808, throughput 2.80299K wps
[Epoch 29 Batch 1380/1540] avg loss 0.00256758, throughput 2.86826K wps
[Epoch 29 Batch 1410/1540] avg loss 0.00212008, throughput 2.85703K wps
[Epoch 29 Batch 1440/1540] avg loss 0.00247645, throughput 2.8653K wps
[Epoch 29 Batch 1470/1540] avg loss 0.00270505, throughput 2.8239K wps
[Epoch 29 Batch 1500/1540] avg loss 0.00279965, throughput 2.877K wps
[Epoch 29 Batch 1530/1540] avg loss 0.00279424, throughput 2.87309K wps
Begin Testing...
[Epoch 29] train avg loss 0.00248326, dev acc 0.8177, dev avg loss 0.516655, throughput 2.85814K wps
[Epoch 30 Batch 30/1540] avg loss 0.00249684, throughput 2.84692K wps
[Epoch 30 Batch 60/1540] avg loss 0.00224051, throughput 2.80346K wps
[Epoch 30 Batch 90/1540] avg loss 0.00211147, throughput 2.79707K wps
[Epoch 30 Batch 120/1540] avg loss 0.00249741, throughput 2.82393K wps
[Epoch 30 Batch 150/1540] avg loss 0.00240749, throughput 2.87294K wps
[Epoch 30 Batch 180/1540] avg loss 0.00228212, throughput 2.85892K wps
[Epoch 30 Batch 210/1540] avg loss 0.00233092, throughput 2.83533K wps
[Epoch 30 Batch 240/1540] avg loss 0.00182019, throughput 2.88076K wps
[Epoch 30 Batch 270/1540] avg loss 0.00241824, throughput 2.87565K wps
[Epoch 30 Batch 300/1540] avg loss 0.00217923, throughput 2.87798K wps
[Epoch 30 Batch 330/1540] avg loss 0.00247861, throughput 2.83475K wps
[Epoch 30 Batch 360/1540] avg loss 0.00249643, throughput 2.8807K wps
[Epoch 30 Batch 390/1540] avg loss 0.00233962, throughput 2.86414K wps
[Epoch 30 Batch 420/1540] avg loss 0.00263992, throughput 2.83819K wps
[Epoch 30 Batch 450/1540] avg loss 0.00224389, throughput 2.87914K wps
[Epoch 30 Batch 480/1540] avg loss 0.00267016, throughput 2.86616K wps
[Epoch 30 Batch 510/1540] avg loss 0.00271132, throughput 2.8525K wps
[Epoch 30 Batch 540/1540] avg loss 0.00266553, throughput 2.87063K wps
[Epoch 30 Batch 570/1540] avg loss 0.00252963, throughput 2.78864K wps
[Epoch 30 Batch 600/1540] avg loss 0.00208616, throughput 2.84121K wps
[Epoch 30 Batch 630/1540] avg loss 0.00200684, throughput 2.86594K wps
[Epoch 30 Batch 660/1540] avg loss 0.00237625, throughput 2.81404K wps
[Epoch 30 Batch 690/1540] avg loss 0.00218422, throughput 2.79076K wps
[Epoch 30 Batch 720/1540] avg loss 0.00219682, throughput 2.80399K wps
[Epoch 30 Batch 750/1540] avg loss 0.00229147, throughput 2.87999K wps
[Epoch 30 Batch 780/1540] avg loss 0.00233648, throughput 2.87323K wps
[Epoch 30 Batch 810/1540] avg loss 0.00264328, throughput 2.87955K wps
[Epoch 30 Batch 840/1540] avg loss 0.00238581, throughput 2.84479K wps
[Epoch 30 Batch 870/1540] avg loss 0.00240443, throughput 2.87833K wps
[Epoch 30 Batch 900/1540] avg loss 0.00262961, throughput 2.88165K wps
[Epoch 30 Batch 930/1540] avg loss 0.002459, throughput 2.80111K wps
[Epoch 30 Batch 960/1540] avg loss 0.00222966, throughput 2.8803K wps
[Epoch 30 Batch 990/1540] avg loss 0.00289183, throughput 2.8867K wps
[Epoch 30 Batch 1020/1540] avg loss 0.00255286, throughput 2.88239K wps
[Epoch 30 Batch 1050/1540] avg loss 0.00268509, throughput 2.87941K wps
[Epoch 30 Batch 1080/1540] avg loss 0.00229046, throughput 2.88672K wps
[Epoch 30 Batch 1110/1540] avg loss 0.00231073, throughput 2.87443K wps
[Epoch 30 Batch 1140/1540] avg loss 0.00241119, throughput 2.88173K wps
[Epoch 30 Batch 1170/1540] avg loss 0.00260786, throughput 2.88001K wps
[Epoch 30 Batch 1200/1540] avg loss 0.00254282, throughput 2.87745K wps
[Epoch 30 Batch 1230/1540] avg loss 0.00230332, throughput 2.85858K wps
[Epoch 30 Batch 1260/1540] avg loss 0.00292424, throughput 2.87277K wps
[Epoch 30 Batch 1290/1540] avg loss 0.00230319, throughput 2.87746K wps
[Epoch 30 Batch 1320/1540] avg loss 0.00301152, throughput 2.87651K wps
[Epoch 30 Batch 1350/1540] avg loss 0.00254093, throughput 2.88325K wps
[Epoch 30 Batch 1380/1540] avg loss 0.00246553, throughput 2.85992K wps
[Epoch 30 Batch 1410/1540] avg loss 0.00257992, throughput 2.81248K wps
[Epoch 30 Batch 1440/1540] avg loss 0.0022797, throughput 2.87931K wps
[Epoch 30 Batch 1470/1540] avg loss 0.00257673, throughput 2.83721K wps
[Epoch 30 Batch 1500/1540] avg loss 0.00243389, throughput 2.88206K wps
[Epoch 30 Batch 1530/1540] avg loss 0.00253533, throughput 2.8694K wps
Begin Testing...
[Epoch 30] train avg loss 0.00243702, dev acc 0.8154, dev avg loss 0.516638, throughput 2.85755K wps
[Epoch 31 Batch 30/1540] avg loss 0.00219411, throughput 2.90708K wps
[Epoch 31 Batch 60/1540] avg loss 0.00205942, throughput 2.88101K wps
[Epoch 31 Batch 90/1540] avg loss 0.00222492, throughput 2.80635K wps
[Epoch 31 Batch 120/1540] avg loss 0.00214728, throughput 2.8347K wps
[Epoch 31 Batch 150/1540] avg loss 0.00207643, throughput 2.87381K wps
[Epoch 31 Batch 180/1540] avg loss 0.00196659, throughput 2.82518K wps
[Epoch 31 Batch 210/1540] avg loss 0.00230899, throughput 2.86587K wps
[Epoch 31 Batch 240/1540] avg loss 0.0023188, throughput 2.84854K wps
[Epoch 31 Batch 270/1540] avg loss 0.00229944, throughput 2.83883K wps
[Epoch 31 Batch 300/1540] avg loss 0.00225168, throughput 2.87791K wps
[Epoch 31 Batch 330/1540] avg loss 0.00251071, throughput 2.83947K wps
[Epoch 31 Batch 360/1540] avg loss 0.00222413, throughput 2.82538K wps
[Epoch 31 Batch 390/1540] avg loss 0.00217893, throughput 2.87949K wps
[Epoch 31 Batch 420/1540] avg loss 0.00220619, throughput 2.87669K wps
[Epoch 31 Batch 450/1540] avg loss 0.00239147, throughput 2.86577K wps
[Epoch 31 Batch 480/1540] avg loss 0.00211935, throughput 2.84098K wps
[Epoch 31 Batch 510/1540] avg loss 0.00214073, throughput 2.87617K wps
[Epoch 31 Batch 540/1540] avg loss 0.00245475, throughput 2.81411K wps
[Epoch 31 Batch 570/1540] avg loss 0.00237386, throughput 2.85405K wps
[Epoch 31 Batch 600/1540] avg loss 0.00250113, throughput 2.81768K wps
[Epoch 31 Batch 630/1540] avg loss 0.00277091, throughput 2.80837K wps
[Epoch 31 Batch 660/1540] avg loss 0.00235698, throughput 2.88049K wps
[Epoch 31 Batch 690/1540] avg loss 0.00254591, throughput 2.80085K wps
[Epoch 31 Batch 720/1540] avg loss 0.00250336, throughput 2.85967K wps
[Epoch 31 Batch 750/1540] avg loss 0.00243692, throughput 2.88311K wps
[Epoch 31 Batch 780/1540] avg loss 0.00261564, throughput 2.84254K wps
[Epoch 31 Batch 810/1540] avg loss 0.00241309, throughput 2.87043K wps
[Epoch 31 Batch 840/1540] avg loss 0.00248606, throughput 2.8825K wps
[Epoch 31 Batch 870/1540] avg loss 0.0024686, throughput 2.88461K wps
[Epoch 31 Batch 900/1540] avg loss 0.00222189, throughput 2.87109K wps
[Epoch 31 Batch 930/1540] avg loss 0.00234837, throughput 2.84498K wps
[Epoch 31 Batch 960/1540] avg loss 0.00223518, throughput 2.87765K wps
[Epoch 31 Batch 990/1540] avg loss 0.00232127, throughput 2.87271K wps
[Epoch 31 Batch 1020/1540] avg loss 0.00239307, throughput 2.82028K wps
[Epoch 31 Batch 1050/1540] avg loss 0.00217816, throughput 2.80185K wps
[Epoch 31 Batch 1080/1540] avg loss 0.00226759, throughput 2.85077K wps
[Epoch 31 Batch 1110/1540] avg loss 0.00235543, throughput 2.85122K wps
[Epoch 31 Batch 1140/1540] avg loss 0.00260483, throughput 2.81749K wps
[Epoch 31 Batch 1170/1540] avg loss 0.00245269, throughput 2.86976K wps
[Epoch 31 Batch 1200/1540] avg loss 0.00220001, throughput 2.83038K wps
[Epoch 31 Batch 1230/1540] avg loss 0.0026128, throughput 2.86337K wps
[Epoch 31 Batch 1260/1540] avg loss 0.00229015, throughput 2.88265K wps
[Epoch 31 Batch 1290/1540] avg loss 0.00242302, throughput 2.86374K wps
[Epoch 31 Batch 1320/1540] avg loss 0.00209875, throughput 2.8733K wps
[Epoch 31 Batch 1350/1540] avg loss 0.00238127, throughput 2.88107K wps
[Epoch 31 Batch 1380/1540] avg loss 0.00266171, throughput 2.87448K wps
[Epoch 31 Batch 1410/1540] avg loss 0.00246678, throughput 2.87371K wps
[Epoch 31 Batch 1440/1540] avg loss 0.00290741, throughput 2.8734K wps
[Epoch 31 Batch 1470/1540] avg loss 0.00234536, throughput 2.88207K wps
[Epoch 31 Batch 1500/1540] avg loss 0.00267041, throughput 2.88081K wps
[Epoch 31 Batch 1530/1540] avg loss 0.0024056, throughput 2.86819K wps
Begin Testing...
[Epoch 31] train avg loss 0.00235816, dev acc 0.8165, dev avg loss 0.52717, throughput 2.85616K wps
[Epoch 32 Batch 30/1540] avg loss 0.00211436, throughput 2.90277K wps
[Epoch 32 Batch 60/1540] avg loss 0.00203118, throughput 2.87101K wps
[Epoch 32 Batch 90/1540] avg loss 0.00183313, throughput 2.87019K wps
[Epoch 32 Batch 120/1540] avg loss 0.00222616, throughput 2.85972K wps
[Epoch 32 Batch 150/1540] avg loss 0.00187605, throughput 2.87751K wps
[Epoch 32 Batch 180/1540] avg loss 0.00207781, throughput 2.88123K wps
[Epoch 32 Batch 210/1540] avg loss 0.0021645, throughput 2.87135K wps
[Epoch 32 Batch 240/1540] avg loss 0.00224863, throughput 2.87482K wps
[Epoch 32 Batch 270/1540] avg loss 0.00267401, throughput 2.85655K wps
[Epoch 32 Batch 300/1540] avg loss 0.00209379, throughput 2.86763K wps
[Epoch 32 Batch 330/1540] avg loss 0.00217112, throughput 2.83764K wps
[Epoch 32 Batch 360/1540] avg loss 0.00208362, throughput 2.87869K wps
[Epoch 32 Batch 390/1540] avg loss 0.00222926, throughput 2.87161K wps
[Epoch 32 Batch 420/1540] avg loss 0.00215904, throughput 2.87215K wps
[Epoch 32 Batch 450/1540] avg loss 0.00205951, throughput 2.87373K wps
[Epoch 32 Batch 480/1540] avg loss 0.00213944, throughput 2.85716K wps
[Epoch 32 Batch 510/1540] avg loss 0.002194, throughput 2.81045K wps
[Epoch 32 Batch 540/1540] avg loss 0.00200761, throughput 2.85571K wps
[Epoch 32 Batch 570/1540] avg loss 0.00241187, throughput 2.78898K wps
[Epoch 32 Batch 600/1540] avg loss 0.00244464, throughput 2.83995K wps
[Epoch 32 Batch 630/1540] avg loss 0.00209909, throughput 2.86353K wps
[Epoch 32 Batch 660/1540] avg loss 0.00224067, throughput 2.86819K wps
[Epoch 32 Batch 690/1540] avg loss 0.00267477, throughput 2.86914K wps
[Epoch 32 Batch 720/1540] avg loss 0.002766, throughput 2.86665K wps
[Epoch 32 Batch 750/1540] avg loss 0.00190201, throughput 2.84002K wps
[Epoch 32 Batch 780/1540] avg loss 0.00211018, throughput 2.8583K wps
[Epoch 32 Batch 810/1540] avg loss 0.00250544, throughput 2.84365K wps
[Epoch 32 Batch 840/1540] avg loss 0.00231367, throughput 2.7983K wps
[Epoch 32 Batch 870/1540] avg loss 0.00279162, throughput 2.84359K wps
[Epoch 32 Batch 900/1540] avg loss 0.00228412, throughput 2.86716K wps
[Epoch 32 Batch 930/1540] avg loss 0.00245598, throughput 2.86161K wps
[Epoch 32 Batch 960/1540] avg loss 0.00232981, throughput 2.83784K wps
[Epoch 32 Batch 990/1540] avg loss 0.00234548, throughput 2.88126K wps
[Epoch 32 Batch 1020/1540] avg loss 0.00233246, throughput 2.85673K wps
[Epoch 32 Batch 1050/1540] avg loss 0.00195456, throughput 2.87016K wps
[Epoch 32 Batch 1080/1540] avg loss 0.00239443, throughput 2.87208K wps
[Epoch 32 Batch 1110/1540] avg loss 0.00197155, throughput 2.79251K wps
[Epoch 32 Batch 1140/1540] avg loss 0.00240771, throughput 2.88495K wps
[Epoch 32 Batch 1170/1540] avg loss 0.0021934, throughput 2.82483K wps
[Epoch 32 Batch 1200/1540] avg loss 0.00240031, throughput 2.87241K wps
[Epoch 32 Batch 1230/1540] avg loss 0.00225106, throughput 2.82701K wps
[Epoch 32 Batch 1260/1540] avg loss 0.00301525, throughput 2.87448K wps
[Epoch 32 Batch 1290/1540] avg loss 0.00240669, throughput 2.8722K wps
[Epoch 32 Batch 1320/1540] avg loss 0.00229283, throughput 2.87912K wps
[Epoch 32 Batch 1350/1540] avg loss 0.00261169, throughput 2.87254K wps
[Epoch 32 Batch 1380/1540] avg loss 0.00237748, throughput 2.87887K wps
[Epoch 32 Batch 1410/1540] avg loss 0.00237952, throughput 2.88371K wps
[Epoch 32 Batch 1440/1540] avg loss 0.00254333, throughput 2.86681K wps
[Epoch 32 Batch 1470/1540] avg loss 0.00250628, throughput 2.87861K wps
[Epoch 32 Batch 1500/1540] avg loss 0.00251843, throughput 2.87753K wps
[Epoch 32 Batch 1530/1540] avg loss 0.00225214, throughput 2.86891K wps
Begin Testing...
[Epoch 32] train avg loss 0.00229141, dev acc 0.8154, dev avg loss 0.536363, throughput 2.86009K wps
[Epoch 33 Batch 30/1540] avg loss 0.00225799, throughput 2.92338K wps
[Epoch 33 Batch 60/1540] avg loss 0.00214523, throughput 2.83063K wps
[Epoch 33 Batch 90/1540] avg loss 0.00236228, throughput 2.83426K wps
[Epoch 33 Batch 120/1540] avg loss 0.0021248, throughput 2.84179K wps
[Epoch 33 Batch 150/1540] avg loss 0.00187805, throughput 2.85181K wps
[Epoch 33 Batch 180/1540] avg loss 0.00185418, throughput 2.859K wps
[Epoch 33 Batch 210/1540] avg loss 0.00210872, throughput 2.86489K wps
[Epoch 33 Batch 240/1540] avg loss 0.00196198, throughput 2.86395K wps
[Epoch 33 Batch 270/1540] avg loss 0.00232542, throughput 2.84213K wps
[Epoch 33 Batch 300/1540] avg loss 0.00211268, throughput 2.86001K wps
[Epoch 33 Batch 330/1540] avg loss 0.00204724, throughput 2.87371K wps
[Epoch 33 Batch 360/1540] avg loss 0.00203589, throughput 2.87163K wps
[Epoch 33 Batch 390/1540] avg loss 0.00195799, throughput 2.87002K wps
[Epoch 33 Batch 420/1540] avg loss 0.00240106, throughput 2.87638K wps
[Epoch 33 Batch 450/1540] avg loss 0.00233312, throughput 2.87021K wps
[Epoch 33 Batch 480/1540] avg loss 0.00245062, throughput 2.8402K wps
[Epoch 33 Batch 510/1540] avg loss 0.00208068, throughput 2.82314K wps
[Epoch 33 Batch 540/1540] avg loss 0.00211097, throughput 2.85254K wps
[Epoch 33 Batch 570/1540] avg loss 0.00222104, throughput 2.85858K wps
[Epoch 33 Batch 600/1540] avg loss 0.00233959, throughput 2.8616K wps
[Epoch 33 Batch 630/1540] avg loss 0.00219302, throughput 2.83379K wps
[Epoch 33 Batch 660/1540] avg loss 0.00192819, throughput 2.85889K wps
[Epoch 33 Batch 690/1540] avg loss 0.00214907, throughput 2.86604K wps
[Epoch 33 Batch 720/1540] avg loss 0.00253004, throughput 2.87428K wps
[Epoch 33 Batch 750/1540] avg loss 0.00211787, throughput 2.84251K wps
[Epoch 33 Batch 780/1540] avg loss 0.00247597, throughput 2.85586K wps
[Epoch 33 Batch 810/1540] avg loss 0.00234229, throughput 2.83306K wps
[Epoch 33 Batch 840/1540] avg loss 0.00210054, throughput 2.81666K wps
[Epoch 33 Batch 870/1540] avg loss 0.0023982, throughput 2.88144K wps
[Epoch 33 Batch 900/1540] avg loss 0.00250825, throughput 2.88074K wps
[Epoch 33 Batch 930/1540] avg loss 0.00245583, throughput 2.84135K wps
[Epoch 33 Batch 960/1540] avg loss 0.00208338, throughput 2.82925K wps
[Epoch 33 Batch 990/1540] avg loss 0.00245968, throughput 2.86317K wps
[Epoch 33 Batch 1020/1540] avg loss 0.00217815, throughput 2.87821K wps
[Epoch 33 Batch 1050/1540] avg loss 0.0023714, throughput 2.84873K wps
[Epoch 33 Batch 1080/1540] avg loss 0.00217928, throughput 2.8604K wps
[Epoch 33 Batch 1110/1540] avg loss 0.0023243, throughput 2.87394K wps
[Epoch 33 Batch 1140/1540] avg loss 0.00252394, throughput 2.85549K wps
[Epoch 33 Batch 1170/1540] avg loss 0.00227218, throughput 2.86604K wps
[Epoch 33 Batch 1200/1540] avg loss 0.00232203, throughput 2.85986K wps
[Epoch 33 Batch 1230/1540] avg loss 0.00205795, throughput 2.88381K wps
[Epoch 33 Batch 1260/1540] avg loss 0.00225449, throughput 2.88363K wps
[Epoch 33 Batch 1290/1540] avg loss 0.00243244, throughput 2.80266K wps
[Epoch 33 Batch 1320/1540] avg loss 0.00238188, throughput 2.82778K wps
[Epoch 33 Batch 1350/1540] avg loss 0.00240426, throughput 2.81736K wps
[Epoch 33 Batch 1380/1540] avg loss 0.00240073, throughput 2.8224K wps
[Epoch 33 Batch 1410/1540] avg loss 0.00218195, throughput 2.82969K wps
[Epoch 33 Batch 1440/1540] avg loss 0.00224162, throughput 2.87371K wps
[Epoch 33 Batch 1470/1540] avg loss 0.00230394, throughput 2.83565K wps
[Epoch 33 Batch 1500/1540] avg loss 0.00211028, throughput 2.83565K wps
[Epoch 33 Batch 1530/1540] avg loss 0.00268628, throughput 2.8257K wps
Begin Testing...
[Epoch 33] train avg loss 0.00224773, dev acc 0.8096, dev avg loss 0.542604, throughput 2.85297K wps
[Epoch 34 Batch 30/1540] avg loss 0.00185699, throughput 2.88105K wps
[Epoch 34 Batch 60/1540] avg loss 0.00221423, throughput 2.83323K wps
[Epoch 34 Batch 90/1540] avg loss 0.00216446, throughput 2.80278K wps
[Epoch 34 Batch 120/1540] avg loss 0.00224172, throughput 2.8684K wps
[Epoch 34 Batch 150/1540] avg loss 0.00250105, throughput 2.85259K wps
[Epoch 34 Batch 180/1540] avg loss 0.0017713, throughput 2.81965K wps
[Epoch 34 Batch 210/1540] avg loss 0.00223324, throughput 2.84702K wps
[Epoch 34 Batch 240/1540] avg loss 0.00199088, throughput 2.87065K wps
[Epoch 34 Batch 270/1540] avg loss 0.00221241, throughput 2.87288K wps
[Epoch 34 Batch 300/1540] avg loss 0.00180324, throughput 2.81408K wps
[Epoch 34 Batch 330/1540] avg loss 0.00201388, throughput 2.86678K wps
[Epoch 34 Batch 360/1540] avg loss 0.00208103, throughput 2.87282K wps
[Epoch 34 Batch 390/1540] avg loss 0.00172043, throughput 2.82917K wps
[Epoch 34 Batch 420/1540] avg loss 0.0019157, throughput 2.8736K wps
[Epoch 34 Batch 450/1540] avg loss 0.00223167, throughput 2.88166K wps
[Epoch 34 Batch 480/1540] avg loss 0.0022687, throughput 2.86746K wps
[Epoch 34 Batch 510/1540] avg loss 0.00233402, throughput 2.84351K wps
[Epoch 34 Batch 540/1540] avg loss 0.00221038, throughput 2.87219K wps
[Epoch 34 Batch 570/1540] avg loss 0.0020499, throughput 2.87179K wps
[Epoch 34 Batch 600/1540] avg loss 0.00236584, throughput 2.86971K wps
[Epoch 34 Batch 630/1540] avg loss 0.00192739, throughput 2.87805K wps
[Epoch 34 Batch 660/1540] avg loss 0.00194575, throughput 2.88104K wps
[Epoch 34 Batch 690/1540] avg loss 0.00209689, throughput 2.84906K wps
[Epoch 34 Batch 720/1540] avg loss 0.00235259, throughput 2.87877K wps
[Epoch 34 Batch 750/1540] avg loss 0.00210533, throughput 2.80525K wps
[Epoch 34 Batch 780/1540] avg loss 0.00207546, throughput 2.85425K wps
[Epoch 34 Batch 810/1540] avg loss 0.00257213, throughput 2.82433K wps
[Epoch 34 Batch 840/1540] avg loss 0.00240324, throughput 2.841K wps
[Epoch 34 Batch 870/1540] avg loss 0.0021328, throughput 2.8693K wps
[Epoch 34 Batch 900/1540] avg loss 0.00200586, throughput 2.87921K wps
[Epoch 34 Batch 930/1540] avg loss 0.00251672, throughput 2.80258K wps
[Epoch 34 Batch 960/1540] avg loss 0.00215009, throughput 2.85116K wps
[Epoch 34 Batch 990/1540] avg loss 0.00255931, throughput 2.8681K wps
[Epoch 34 Batch 1020/1540] avg loss 0.00232108, throughput 2.8421K wps
[Epoch 34 Batch 1050/1540] avg loss 0.00242086, throughput 2.85429K wps
[Epoch 34 Batch 1080/1540] avg loss 0.00202535, throughput 2.85449K wps
[Epoch 34 Batch 1110/1540] avg loss 0.00198176, throughput 2.85708K wps
[Epoch 34 Batch 1140/1540] avg loss 0.00227741, throughput 2.86429K wps
[Epoch 34 Batch 1170/1540] avg loss 0.00268322, throughput 2.8361K wps
[Epoch 34 Batch 1200/1540] avg loss 0.00257884, throughput 2.86798K wps
[Epoch 34 Batch 1230/1540] avg loss 0.00246881, throughput 2.87453K wps
[Epoch 34 Batch 1260/1540] avg loss 0.00230341, throughput 2.86539K wps
[Epoch 34 Batch 1290/1540] avg loss 0.00227805, throughput 2.86089K wps
[Epoch 34 Batch 1320/1540] avg loss 0.00254792, throughput 2.78563K wps
[Epoch 34 Batch 1350/1540] avg loss 0.00216339, throughput 2.84127K wps
[Epoch 34 Batch 1380/1540] avg loss 0.00214711, throughput 2.87647K wps
[Epoch 34 Batch 1410/1540] avg loss 0.00242091, throughput 2.87934K wps
[Epoch 34 Batch 1440/1540] avg loss 0.00206269, throughput 2.83214K wps
[Epoch 34 Batch 1470/1540] avg loss 0.00244916, throughput 2.77757K wps
[Epoch 34 Batch 1500/1540] avg loss 0.00247765, throughput 2.79383K wps
[Epoch 34 Batch 1530/1540] avg loss 0.00243584, throughput 2.8428K wps
Begin Testing...
[Epoch 34] train avg loss 0.00221815, dev acc 0.8108, dev avg loss 0.538255, throughput 2.8504K wps
[Epoch 35 Batch 30/1540] avg loss 0.00185896, throughput 2.93092K wps
[Epoch 35 Batch 60/1540] avg loss 0.00194331, throughput 2.88066K wps
[Epoch 35 Batch 90/1540] avg loss 0.0018295, throughput 2.88343K wps
[Epoch 35 Batch 120/1540] avg loss 0.00200853, throughput 2.8639K wps
[Epoch 35 Batch 150/1540] avg loss 0.00207023, throughput 2.81308K wps
[Epoch 35 Batch 180/1540] avg loss 0.00245854, throughput 2.83842K wps
[Epoch 35 Batch 210/1540] avg loss 0.00176947, throughput 2.81358K wps
[Epoch 35 Batch 240/1540] avg loss 0.00214897, throughput 2.86969K wps
[Epoch 35 Batch 270/1540] avg loss 0.00180631, throughput 2.88416K wps
[Epoch 35 Batch 300/1540] avg loss 0.00201603, throughput 2.87079K wps
[Epoch 35 Batch 330/1540] avg loss 0.00234687, throughput 2.87166K wps
[Epoch 35 Batch 360/1540] avg loss 0.00213212, throughput 2.85862K wps
[Epoch 35 Batch 390/1540] avg loss 0.00212888, throughput 2.85493K wps
[Epoch 35 Batch 420/1540] avg loss 0.0019776, throughput 2.8532K wps
[Epoch 35 Batch 450/1540] avg loss 0.00215199, throughput 2.85115K wps
[Epoch 35 Batch 480/1540] avg loss 0.00237216, throughput 2.7891K wps
[Epoch 35 Batch 510/1540] avg loss 0.00208151, throughput 2.80287K wps
[Epoch 35 Batch 540/1540] avg loss 0.00231398, throughput 2.87873K wps
[Epoch 35 Batch 570/1540] avg loss 0.00197178, throughput 2.84386K wps
[Epoch 35 Batch 600/1540] avg loss 0.00220246, throughput 2.86811K wps
[Epoch 35 Batch 630/1540] avg loss 0.00192577, throughput 2.82235K wps
[Epoch 35 Batch 660/1540] avg loss 0.00196806, throughput 2.80827K wps
[Epoch 35 Batch 690/1540] avg loss 0.00209082, throughput 2.8324K wps
[Epoch 35 Batch 720/1540] avg loss 0.00198852, throughput 2.80425K wps
[Epoch 35 Batch 750/1540] avg loss 0.00216805, throughput 2.81132K wps
[Epoch 35 Batch 780/1540] avg loss 0.00210384, throughput 2.86782K wps
[Epoch 35 Batch 810/1540] avg loss 0.00246273, throughput 2.87144K wps
[Epoch 35 Batch 840/1540] avg loss 0.00224649, throughput 2.84351K wps
[Epoch 35 Batch 870/1540] avg loss 0.00198038, throughput 2.82386K wps
[Epoch 35 Batch 900/1540] avg loss 0.0020952, throughput 2.81345K wps
[Epoch 35 Batch 930/1540] avg loss 0.00227447, throughput 2.8633K wps
[Epoch 35 Batch 960/1540] avg loss 0.00240877, throughput 2.83807K wps
[Epoch 35 Batch 990/1540] avg loss 0.00233842, throughput 2.85507K wps
[Epoch 35 Batch 1020/1540] avg loss 0.00214066, throughput 2.86261K wps
[Epoch 35 Batch 1050/1540] avg loss 0.00222928, throughput 2.81984K wps
[Epoch 35 Batch 1080/1540] avg loss 0.00200818, throughput 2.82665K wps
[Epoch 35 Batch 1110/1540] avg loss 0.00203176, throughput 2.86025K wps
[Epoch 35 Batch 1140/1540] avg loss 0.00272861, throughput 2.86462K wps
[Epoch 35 Batch 1170/1540] avg loss 0.00232807, throughput 2.86727K wps
[Epoch 35 Batch 1200/1540] avg loss 0.00235257, throughput 2.87302K wps
[Epoch 35 Batch 1230/1540] avg loss 0.00257599, throughput 2.85327K wps
[Epoch 35 Batch 1260/1540] avg loss 0.00246118, throughput 2.8617K wps
[Epoch 35 Batch 1290/1540] avg loss 0.00209027, throughput 2.81844K wps
[Epoch 35 Batch 1320/1540] avg loss 0.00223507, throughput 2.87909K wps
[Epoch 35 Batch 1350/1540] avg loss 0.00210801, throughput 2.88154K wps
[Epoch 35 Batch 1380/1540] avg loss 0.00217735, throughput 2.87081K wps
[Epoch 35 Batch 1410/1540] avg loss 0.0023871, throughput 2.81082K wps
[Epoch 35 Batch 1440/1540] avg loss 0.0021464, throughput 2.84424K wps
[Epoch 35 Batch 1470/1540] avg loss 0.002057, throughput 2.87136K wps
[Epoch 35 Batch 1500/1540] avg loss 0.00200549, throughput 2.85297K wps
[Epoch 35 Batch 1530/1540] avg loss 0.00257826, throughput 2.83305K wps
Begin Testing...
[Epoch 35] train avg loss 0.0021636, dev acc 0.8165, dev avg loss 0.553693, throughput 2.8489K wps
[Epoch 36 Batch 30/1540] avg loss 0.0021115, throughput 2.89839K wps
[Epoch 36 Batch 60/1540] avg loss 0.00207805, throughput 2.80277K wps
[Epoch 36 Batch 90/1540] avg loss 0.00205815, throughput 2.87815K wps
[Epoch 36 Batch 120/1540] avg loss 0.00205485, throughput 2.87807K wps
[Epoch 36 Batch 150/1540] avg loss 0.00184931, throughput 2.8713K wps
[Epoch 36 Batch 180/1540] avg loss 0.00186755, throughput 2.86863K wps
[Epoch 36 Batch 210/1540] avg loss 0.00186693, throughput 2.87464K wps
[Epoch 36 Batch 240/1540] avg loss 0.00177197, throughput 2.87898K wps
[Epoch 36 Batch 270/1540] avg loss 0.00197384, throughput 2.8652K wps
[Epoch 36 Batch 300/1540] avg loss 0.0019993, throughput 2.84924K wps
[Epoch 36 Batch 330/1540] avg loss 0.00199787, throughput 2.85005K wps
[Epoch 36 Batch 360/1540] avg loss 0.00188837, throughput 2.86355K wps
[Epoch 36 Batch 390/1540] avg loss 0.00217756, throughput 2.86712K wps
[Epoch 36 Batch 420/1540] avg loss 0.00212238, throughput 2.87535K wps
[Epoch 36 Batch 450/1540] avg loss 0.00173762, throughput 2.8571K wps
[Epoch 36 Batch 480/1540] avg loss 0.00241791, throughput 2.85129K wps
[Epoch 36 Batch 510/1540] avg loss 0.00211141, throughput 2.82308K wps
[Epoch 36 Batch 540/1540] avg loss 0.00233695, throughput 2.83648K wps
[Epoch 36 Batch 570/1540] avg loss 0.0019144, throughput 2.87751K wps
[Epoch 36 Batch 600/1540] avg loss 0.00202713, throughput 2.83897K wps
[Epoch 36 Batch 630/1540] avg loss 0.00210756, throughput 2.85252K wps
[Epoch 36 Batch 660/1540] avg loss 0.0021456, throughput 2.81444K wps
[Epoch 36 Batch 690/1540] avg loss 0.00225181, throughput 2.8229K wps
[Epoch 36 Batch 720/1540] avg loss 0.00219742, throughput 2.83646K wps
[Epoch 36 Batch 750/1540] avg loss 0.00240111, throughput 2.86988K wps
[Epoch 36 Batch 780/1540] avg loss 0.00221919, throughput 2.86896K wps
[Epoch 36 Batch 810/1540] avg loss 0.00228287, throughput 2.86865K wps
[Epoch 36 Batch 840/1540] avg loss 0.0022033, throughput 2.80233K wps
[Epoch 36 Batch 870/1540] avg loss 0.00204664, throughput 2.79094K wps
[Epoch 36 Batch 900/1540] avg loss 0.0018718, throughput 2.84466K wps
[Epoch 36 Batch 930/1540] avg loss 0.00209306, throughput 2.872K wps
[Epoch 36 Batch 960/1540] avg loss 0.00203598, throughput 2.86635K wps
[Epoch 36 Batch 990/1540] avg loss 0.00242442, throughput 2.86215K wps
[Epoch 36 Batch 1020/1540] avg loss 0.0021988, throughput 2.88412K wps
[Epoch 36 Batch 1050/1540] avg loss 0.00248499, throughput 2.87011K wps
[Epoch 36 Batch 1080/1540] avg loss 0.00222674, throughput 2.87588K wps
[Epoch 36 Batch 1110/1540] avg loss 0.00213861, throughput 2.8748K wps
[Epoch 36 Batch 1140/1540] avg loss 0.00200535, throughput 2.83911K wps
[Epoch 36 Batch 1170/1540] avg loss 0.00220015, throughput 2.87841K wps
[Epoch 36 Batch 1200/1540] avg loss 0.00201907, throughput 2.83236K wps
[Epoch 36 Batch 1230/1540] avg loss 0.0021985, throughput 2.86731K wps
[Epoch 36 Batch 1260/1540] avg loss 0.0020466, throughput 2.8519K wps
[Epoch 36 Batch 1290/1540] avg loss 0.00217537, throughput 2.8769K wps
[Epoch 36 Batch 1320/1540] avg loss 0.00198458, throughput 2.86548K wps
[Epoch 36 Batch 1350/1540] avg loss 0.0025639, throughput 2.84324K wps
[Epoch 36 Batch 1380/1540] avg loss 0.00238164, throughput 2.78711K wps
[Epoch 36 Batch 1410/1540] avg loss 0.00242361, throughput 2.86416K wps
[Epoch 36 Batch 1440/1540] avg loss 0.00219124, throughput 2.85147K wps
[Epoch 36 Batch 1470/1540] avg loss 0.00200508, throughput 2.84818K wps
[Epoch 36 Batch 1500/1540] avg loss 0.00229067, throughput 2.84719K wps
[Epoch 36 Batch 1530/1540] avg loss 0.00223855, throughput 2.87129K wps
Begin Testing...
[Epoch 36] train avg loss 0.00212507, dev acc 0.8096, dev avg loss 0.554618, throughput 2.85464K wps
[Epoch 37 Batch 30/1540] avg loss 0.00210436, throughput 2.93619K wps
[Epoch 37 Batch 60/1540] avg loss 0.00180592, throughput 2.86578K wps
[Epoch 37 Batch 90/1540] avg loss 0.00234734, throughput 2.79721K wps
[Epoch 37 Batch 120/1540] avg loss 0.00184235, throughput 2.87658K wps
[Epoch 37 Batch 150/1540] avg loss 0.00206192, throughput 2.8674K wps
[Epoch 37 Batch 180/1540] avg loss 0.00202121, throughput 2.82734K wps
[Epoch 37 Batch 210/1540] avg loss 0.00187125, throughput 2.7942K wps
[Epoch 37 Batch 240/1540] avg loss 0.00167456, throughput 2.85961K wps
[Epoch 37 Batch 270/1540] avg loss 0.00230817, throughput 2.8587K wps
[Epoch 37 Batch 300/1540] avg loss 0.00196444, throughput 2.8271K wps
[Epoch 37 Batch 330/1540] avg loss 0.00194583, throughput 2.78978K wps
[Epoch 37 Batch 360/1540] avg loss 0.00184367, throughput 2.7902K wps
[Epoch 37 Batch 390/1540] avg loss 0.0022973, throughput 2.83419K wps
[Epoch 37 Batch 420/1540] avg loss 0.00210572, throughput 2.86415K wps
[Epoch 37 Batch 450/1540] avg loss 0.00204075, throughput 2.85247K wps
[Epoch 37 Batch 480/1540] avg loss 0.00254676, throughput 2.88298K wps
[Epoch 37 Batch 510/1540] avg loss 0.00197504, throughput 2.88082K wps
[Epoch 37 Batch 540/1540] avg loss 0.00200175, throughput 2.84706K wps
[Epoch 37 Batch 570/1540] avg loss 0.00201804, throughput 2.85232K wps
[Epoch 37 Batch 600/1540] avg loss 0.00218968, throughput 2.80061K wps
[Epoch 37 Batch 630/1540] avg loss 0.00180424, throughput 2.87844K wps
[Epoch 37 Batch 660/1540] avg loss 0.00219104, throughput 2.8K wps
[Epoch 37 Batch 690/1540] avg loss 0.00228279, throughput 2.85192K wps
[Epoch 37 Batch 720/1540] avg loss 0.00185204, throughput 2.8787K wps
[Epoch 37 Batch 750/1540] avg loss 0.00217934, throughput 2.81664K wps
[Epoch 37 Batch 780/1540] avg loss 0.00217237, throughput 2.83286K wps
[Epoch 37 Batch 810/1540] avg loss 0.00203625, throughput 2.87717K wps
[Epoch 37 Batch 840/1540] avg loss 0.00208638, throughput 2.8852K wps
[Epoch 37 Batch 870/1540] avg loss 0.00218632, throughput 2.87763K wps
[Epoch 37 Batch 900/1540] avg loss 0.00229563, throughput 2.87357K wps
[Epoch 37 Batch 930/1540] avg loss 0.00192038, throughput 2.85562K wps
[Epoch 37 Batch 960/1540] avg loss 0.00198916, throughput 2.87994K wps
[Epoch 37 Batch 990/1540] avg loss 0.00186056, throughput 2.87933K wps
[Epoch 37 Batch 1020/1540] avg loss 0.00229617, throughput 2.87639K wps
[Epoch 37 Batch 1050/1540] avg loss 0.00196085, throughput 2.87697K wps
[Epoch 37 Batch 1080/1540] avg loss 0.00195098, throughput 2.87589K wps
[Epoch 37 Batch 1110/1540] avg loss 0.00233814, throughput 2.87953K wps
[Epoch 37 Batch 1140/1540] avg loss 0.00271168, throughput 2.87449K wps
[Epoch 37 Batch 1170/1540] avg loss 0.00206024, throughput 2.87665K wps
[Epoch 37 Batch 1200/1540] avg loss 0.00206163, throughput 2.87314K wps
[Epoch 37 Batch 1230/1540] avg loss 0.00231264, throughput 2.82295K wps
[Epoch 37 Batch 1260/1540] avg loss 0.00204586, throughput 2.83773K wps
[Epoch 37 Batch 1290/1540] avg loss 0.00216765, throughput 2.8621K wps
[Epoch 37 Batch 1320/1540] avg loss 0.00167285, throughput 2.88343K wps
[Epoch 37 Batch 1350/1540] avg loss 0.00211054, throughput 2.8806K wps
[Epoch 37 Batch 1380/1540] avg loss 0.00216382, throughput 2.86759K wps
[Epoch 37 Batch 1410/1540] avg loss 0.00248898, throughput 2.88103K wps
[Epoch 37 Batch 1440/1540] avg loss 0.00217757, throughput 2.79742K wps
[Epoch 37 Batch 1470/1540] avg loss 0.0021514, throughput 2.86971K wps
[Epoch 37 Batch 1500/1540] avg loss 0.00193607, throughput 2.87656K wps
[Epoch 37 Batch 1530/1540] avg loss 0.00231819, throughput 2.82095K wps
Begin Testing...
[Epoch 37] train avg loss 0.00209352, dev acc 0.8096, dev avg loss 0.565882, throughput 2.85459K wps
[Epoch 38 Batch 30/1540] avg loss 0.00180095, throughput 2.9147K wps
[Epoch 38 Batch 60/1540] avg loss 0.0017208, throughput 2.86075K wps
[Epoch 38 Batch 90/1540] avg loss 0.00201787, throughput 2.85928K wps
[Epoch 38 Batch 120/1540] avg loss 0.00202718, throughput 2.88261K wps
[Epoch 38 Batch 150/1540] avg loss 0.00205406, throughput 2.87638K wps
[Epoch 38 Batch 180/1540] avg loss 0.00204528, throughput 2.85737K wps
[Epoch 38 Batch 210/1540] avg loss 0.0017033, throughput 2.88081K wps
[Epoch 38 Batch 240/1540] avg loss 0.00215977, throughput 2.85978K wps
[Epoch 38 Batch 270/1540] avg loss 0.00183184, throughput 2.83699K wps
[Epoch 38 Batch 300/1540] avg loss 0.00156806, throughput 2.87484K wps
[Epoch 38 Batch 330/1540] avg loss 0.00180864, throughput 2.82375K wps
[Epoch 38 Batch 360/1540] avg loss 0.00199462, throughput 2.87238K wps
[Epoch 38 Batch 390/1540] avg loss 0.00191809, throughput 2.85462K wps
[Epoch 38 Batch 420/1540] avg loss 0.00216524, throughput 2.84924K wps
[Epoch 38 Batch 450/1540] avg loss 0.002003, throughput 2.79958K wps
[Epoch 38 Batch 480/1540] avg loss 0.0025177, throughput 2.82679K wps
[Epoch 38 Batch 510/1540] avg loss 0.00214566, throughput 2.81577K wps
[Epoch 38 Batch 540/1540] avg loss 0.0019765, throughput 2.81903K wps
[Epoch 38 Batch 570/1540] avg loss 0.00174708, throughput 2.86512K wps
[Epoch 38 Batch 600/1540] avg loss 0.0019421, throughput 2.87982K wps
[Epoch 38 Batch 630/1540] avg loss 0.00179642, throughput 2.86988K wps
[Epoch 38 Batch 660/1540] avg loss 0.00216928, throughput 2.87994K wps
[Epoch 38 Batch 690/1540] avg loss 0.00224404, throughput 2.87609K wps
[Epoch 38 Batch 720/1540] avg loss 0.0021105, throughput 2.8659K wps
[Epoch 38 Batch 750/1540] avg loss 0.00182211, throughput 2.84648K wps
[Epoch 38 Batch 780/1540] avg loss 0.00223217, throughput 2.84967K wps
[Epoch 38 Batch 810/1540] avg loss 0.00233699, throughput 2.85761K wps
[Epoch 38 Batch 840/1540] avg loss 0.00202785, throughput 2.88677K wps
[Epoch 38 Batch 870/1540] avg loss 0.00233091, throughput 2.8758K wps
[Epoch 38 Batch 900/1540] avg loss 0.00209934, throughput 2.83856K wps
[Epoch 38 Batch 930/1540] avg loss 0.00186704, throughput 2.81176K wps
[Epoch 38 Batch 960/1540] avg loss 0.0021071, throughput 2.87064K wps
[Epoch 38 Batch 990/1540] avg loss 0.00211989, throughput 2.85586K wps
[Epoch 38 Batch 1020/1540] avg loss 0.00280565, throughput 2.81515K wps
[Epoch 38 Batch 1050/1540] avg loss 0.00215591, throughput 2.85516K wps
[Epoch 38 Batch 1080/1540] avg loss 0.00191293, throughput 2.84864K wps
[Epoch 38 Batch 1110/1540] avg loss 0.00208784, throughput 2.84009K wps
[Epoch 38 Batch 1140/1540] avg loss 0.0019147, throughput 2.83967K wps
[Epoch 38 Batch 1170/1540] avg loss 0.00202231, throughput 2.87934K wps
[Epoch 38 Batch 1200/1540] avg loss 0.00196531, throughput 2.8398K wps
[Epoch 38 Batch 1230/1540] avg loss 0.00231756, throughput 2.8469K wps
[Epoch 38 Batch 1260/1540] avg loss 0.00211065, throughput 2.84669K wps
[Epoch 38 Batch 1290/1540] avg loss 0.00191927, throughput 2.80657K wps
[Epoch 38 Batch 1320/1540] avg loss 0.00209143, throughput 2.87651K wps
[Epoch 38 Batch 1350/1540] avg loss 0.00218222, throughput 2.87075K wps
[Epoch 38 Batch 1380/1540] avg loss 0.00206696, throughput 2.87966K wps
[Epoch 38 Batch 1410/1540] avg loss 0.00201909, throughput 2.87737K wps
[Epoch 38 Batch 1440/1540] avg loss 0.00202192, throughput 2.8337K wps
[Epoch 38 Batch 1470/1540] avg loss 0.00184309, throughput 2.86892K wps
[Epoch 38 Batch 1500/1540] avg loss 0.0023982, throughput 2.84931K wps
[Epoch 38 Batch 1530/1540] avg loss 0.00211437, throughput 2.86319K wps
Begin Testing...
[Epoch 38] train avg loss 0.00204496, dev acc 0.8096, dev avg loss 0.562796, throughput 2.85538K wps
[Epoch 39 Batch 30/1540] avg loss 0.00153012, throughput 2.91749K wps
[Epoch 39 Batch 60/1540] avg loss 0.00195696, throughput 2.88058K wps
[Epoch 39 Batch 90/1540] avg loss 0.00184284, throughput 2.79921K wps
[Epoch 39 Batch 120/1540] avg loss 0.00197958, throughput 2.84031K wps
[Epoch 39 Batch 150/1540] avg loss 0.00164252, throughput 2.87511K wps
[Epoch 39 Batch 180/1540] avg loss 0.00189357, throughput 2.83699K wps
[Epoch 39 Batch 210/1540] avg loss 0.00196673, throughput 2.85114K wps
[Epoch 39 Batch 240/1540] avg loss 0.00165407, throughput 2.85445K wps
[Epoch 39 Batch 270/1540] avg loss 0.00193866, throughput 2.86385K wps
[Epoch 39 Batch 300/1540] avg loss 0.00216221, throughput 2.82249K wps
[Epoch 39 Batch 330/1540] avg loss 0.00211454, throughput 2.8172K wps
[Epoch 39 Batch 360/1540] avg loss 0.00188173, throughput 2.87644K wps
[Epoch 39 Batch 390/1540] avg loss 0.00218001, throughput 2.8755K wps
[Epoch 39 Batch 420/1540] avg loss 0.00167905, throughput 2.8677K wps
[Epoch 39 Batch 450/1540] avg loss 0.00192989, throughput 2.85733K wps
[Epoch 39 Batch 480/1540] avg loss 0.0020026, throughput 2.86614K wps
[Epoch 39 Batch 510/1540] avg loss 0.0021556, throughput 2.85441K wps
[Epoch 39 Batch 540/1540] avg loss 0.00215714, throughput 2.86689K wps
[Epoch 39 Batch 570/1540] avg loss 0.00225613, throughput 2.85375K wps
[Epoch 39 Batch 600/1540] avg loss 0.00186799, throughput 2.82486K wps
[Epoch 39 Batch 630/1540] avg loss 0.00208429, throughput 2.87744K wps
[Epoch 39 Batch 660/1540] avg loss 0.00190992, throughput 2.8771K wps
[Epoch 39 Batch 690/1540] avg loss 0.00176221, throughput 2.88322K wps
[Epoch 39 Batch 720/1540] avg loss 0.0018107, throughput 2.8193K wps
[Epoch 39 Batch 750/1540] avg loss 0.00233997, throughput 2.87724K wps
[Epoch 39 Batch 780/1540] avg loss 0.00196236, throughput 2.8813K wps
[Epoch 39 Batch 810/1540] avg loss 0.00205055, throughput 2.87512K wps
[Epoch 39 Batch 840/1540] avg loss 0.00209519, throughput 2.87575K wps
[Epoch 39 Batch 870/1540] avg loss 0.00214716, throughput 2.87615K wps
[Epoch 39 Batch 900/1540] avg loss 0.00195357, throughput 2.86409K wps
[Epoch 39 Batch 930/1540] avg loss 0.00183115, throughput 2.86873K wps
[Epoch 39 Batch 960/1540] avg loss 0.00191255, throughput 2.8755K wps
[Epoch 39 Batch 990/1540] avg loss 0.00217186, throughput 2.88237K wps
[Epoch 39 Batch 1020/1540] avg loss 0.00219625, throughput 2.87137K wps
[Epoch 39 Batch 1050/1540] avg loss 0.00187426, throughput 2.81665K wps
[Epoch 39 Batch 1080/1540] avg loss 0.00195803, throughput 2.8332K wps
[Epoch 39 Batch 1110/1540] avg loss 0.00181246, throughput 2.83685K wps
[Epoch 39 Batch 1140/1540] avg loss 0.00216798, throughput 2.8402K wps
[Epoch 39 Batch 1170/1540] avg loss 0.00206864, throughput 2.82461K wps
[Epoch 39 Batch 1200/1540] avg loss 0.00226328, throughput 2.84692K wps
[Epoch 39 Batch 1230/1540] avg loss 0.00221326, throughput 2.80599K wps
[Epoch 39 Batch 1260/1540] avg loss 0.00223156, throughput 2.88376K wps
[Epoch 39 Batch 1290/1540] avg loss 0.00189147, throughput 2.88401K wps
[Epoch 39 Batch 1320/1540] avg loss 0.00252209, throughput 2.85678K wps
[Epoch 39 Batch 1350/1540] avg loss 0.00219865, throughput 2.804K wps
[Epoch 39 Batch 1380/1540] avg loss 0.00233366, throughput 2.85097K wps
[Epoch 39 Batch 1410/1540] avg loss 0.00211024, throughput 2.8594K wps
[Epoch 39 Batch 1440/1540] avg loss 0.00191699, throughput 2.88425K wps
[Epoch 39 Batch 1470/1540] avg loss 0.0024491, throughput 2.84465K wps
[Epoch 39 Batch 1500/1540] avg loss 0.00232505, throughput 2.88042K wps
[Epoch 39 Batch 1530/1540] avg loss 0.00194146, throughput 2.84917K wps
Begin Testing...
[Epoch 39] train avg loss 0.00202279, dev acc 0.8131, dev avg loss 0.578561, throughput 2.85695K wps
[Epoch 40 Batch 30/1540] avg loss 0.00161785, throughput 2.93513K wps
[Epoch 40 Batch 60/1540] avg loss 0.00185255, throughput 2.86558K wps
[Epoch 40 Batch 90/1540] avg loss 0.00198759, throughput 2.88039K wps
[Epoch 40 Batch 120/1540] avg loss 0.00210937, throughput 2.87688K wps
[Epoch 40 Batch 150/1540] avg loss 0.00174658, throughput 2.8789K wps
[Epoch 40 Batch 180/1540] avg loss 0.00204225, throughput 2.8578K wps
[Epoch 40 Batch 210/1540] avg loss 0.00174001, throughput 2.82342K wps
[Epoch 40 Batch 240/1540] avg loss 0.00200586, throughput 2.87841K wps
[Epoch 40 Batch 270/1540] avg loss 0.00161794, throughput 2.85678K wps
[Epoch 40 Batch 300/1540] avg loss 0.0016471, throughput 2.85809K wps
[Epoch 40 Batch 330/1540] avg loss 0.0016341, throughput 2.87828K wps
[Epoch 40 Batch 360/1540] avg loss 0.0020939, throughput 2.86677K wps
[Epoch 40 Batch 390/1540] avg loss 0.00186234, throughput 2.8736K wps
[Epoch 40 Batch 420/1540] avg loss 0.00215001, throughput 2.85342K wps
[Epoch 40 Batch 450/1540] avg loss 0.00184841, throughput 2.83403K wps
[Epoch 40 Batch 480/1540] avg loss 0.00179378, throughput 2.88689K wps
[Epoch 40 Batch 510/1540] avg loss 0.00207638, throughput 2.85525K wps
[Epoch 40 Batch 540/1540] avg loss 0.00181646, throughput 2.86999K wps
[Epoch 40 Batch 570/1540] avg loss 0.00201161, throughput 2.87428K wps
[Epoch 40 Batch 600/1540] avg loss 0.00222042, throughput 2.87041K wps
[Epoch 40 Batch 630/1540] avg loss 0.00209101, throughput 2.8543K wps
[Epoch 40 Batch 660/1540] avg loss 0.00209549, throughput 2.82199K wps
[Epoch 40 Batch 690/1540] avg loss 0.00203968, throughput 2.83375K wps
[Epoch 40 Batch 720/1540] avg loss 0.00223001, throughput 2.8769K wps
[Epoch 40 Batch 750/1540] avg loss 0.00206453, throughput 2.87183K wps
[Epoch 40 Batch 780/1540] avg loss 0.00187584, throughput 2.88221K wps
[Epoch 40 Batch 810/1540] avg loss 0.00177128, throughput 2.87872K wps
[Epoch 40 Batch 840/1540] avg loss 0.00228532, throughput 2.84758K wps
[Epoch 40 Batch 870/1540] avg loss 0.00183352, throughput 2.85755K wps
[Epoch 40 Batch 900/1540] avg loss 0.00173027, throughput 2.87702K wps
[Epoch 40 Batch 930/1540] avg loss 0.00205834, throughput 2.87429K wps
[Epoch 40 Batch 960/1540] avg loss 0.0019566, throughput 2.84227K wps
[Epoch 40 Batch 990/1540] avg loss 0.00197673, throughput 2.78424K wps
[Epoch 40 Batch 1020/1540] avg loss 0.0018756, throughput 2.83753K wps
[Epoch 40 Batch 1050/1540] avg loss 0.00193235, throughput 2.86105K wps
[Epoch 40 Batch 1080/1540] avg loss 0.0021129, throughput 2.877K wps
[Epoch 40 Batch 1110/1540] avg loss 0.00222743, throughput 2.87656K wps
[Epoch 40 Batch 1140/1540] avg loss 0.00189794, throughput 2.88059K wps
[Epoch 40 Batch 1170/1540] avg loss 0.00192612, throughput 2.87509K wps
[Epoch 40 Batch 1200/1540] avg loss 0.00243412, throughput 2.86397K wps
[Epoch 40 Batch 1230/1540] avg loss 0.00214396, throughput 2.86037K wps
[Epoch 40 Batch 1260/1540] avg loss 0.00188561, throughput 2.83051K wps
[Epoch 40 Batch 1290/1540] avg loss 0.0020524, throughput 2.85282K wps
[Epoch 40 Batch 1320/1540] avg loss 0.00202463, throughput 2.8324K wps
[Epoch 40 Batch 1350/1540] avg loss 0.00198515, throughput 2.85979K wps
[Epoch 40 Batch 1380/1540] avg loss 0.00202081, throughput 2.88306K wps
[Epoch 40 Batch 1410/1540] avg loss 0.00213992, throughput 2.87167K wps
[Epoch 40 Batch 1440/1540] avg loss 0.00187656, throughput 2.88043K wps
[Epoch 40 Batch 1470/1540] avg loss 0.00188926, throughput 2.8728K wps
[Epoch 40 Batch 1500/1540] avg loss 0.00203265, throughput 2.85918K wps
[Epoch 40 Batch 1530/1540] avg loss 0.00197755, throughput 2.88599K wps
Begin Testing...
[Epoch 40] train avg loss 0.00196974, dev acc 0.8142, dev avg loss 0.57774, throughput 2.86342K wps
[Epoch 41 Batch 30/1540] avg loss 0.00159096, throughput 2.91503K wps
[Epoch 41 Batch 60/1540] avg loss 0.0017278, throughput 2.87797K wps
[Epoch 41 Batch 90/1540] avg loss 0.00153473, throughput 2.86723K wps
[Epoch 41 Batch 120/1540] avg loss 0.00190806, throughput 2.86437K wps
[Epoch 41 Batch 150/1540] avg loss 0.00193701, throughput 2.85801K wps
[Epoch 41 Batch 180/1540] avg loss 0.00153396, throughput 2.85826K wps
[Epoch 41 Batch 210/1540] avg loss 0.00195348, throughput 2.86768K wps
[Epoch 41 Batch 240/1540] avg loss 0.00170882, throughput 2.87695K wps
[Epoch 41 Batch 270/1540] avg loss 0.00212377, throughput 2.88251K wps
[Epoch 41 Batch 300/1540] avg loss 0.00190021, throughput 2.84439K wps
[Epoch 41 Batch 330/1540] avg loss 0.00209046, throughput 2.79188K wps
[Epoch 41 Batch 360/1540] avg loss 0.00188598, throughput 2.84022K wps
[Epoch 41 Batch 390/1540] avg loss 0.0015331, throughput 2.84926K wps
[Epoch 41 Batch 420/1540] avg loss 0.00158417, throughput 2.81069K wps
[Epoch 41 Batch 450/1540] avg loss 0.00204872, throughput 2.80834K wps
[Epoch 41 Batch 480/1540] avg loss 0.00165684, throughput 2.87865K wps
[Epoch 41 Batch 510/1540] avg loss 0.00205232, throughput 2.87426K wps
[Epoch 41 Batch 540/1540] avg loss 0.00212382, throughput 2.87473K wps
[Epoch 41 Batch 570/1540] avg loss 0.00203334, throughput 2.88035K wps
[Epoch 41 Batch 600/1540] avg loss 0.00151008, throughput 2.8703K wps
[Epoch 41 Batch 630/1540] avg loss 0.00196644, throughput 2.87743K wps
[Epoch 41 Batch 660/1540] avg loss 0.00191291, throughput 2.8829K wps
[Epoch 41 Batch 690/1540] avg loss 0.00181601, throughput 2.87624K wps
[Epoch 41 Batch 720/1540] avg loss 0.00174525, throughput 2.84444K wps
[Epoch 41 Batch 750/1540] avg loss 0.00190222, throughput 2.85897K wps
[Epoch 41 Batch 780/1540] avg loss 0.00186207, throughput 2.86562K wps
[Epoch 41 Batch 810/1540] avg loss 0.00223136, throughput 2.8678K wps
[Epoch 41 Batch 840/1540] avg loss 0.00161833, throughput 2.81958K wps
[Epoch 41 Batch 870/1540] avg loss 0.00190202, throughput 2.80535K wps
[Epoch 41 Batch 900/1540] avg loss 0.00182166, throughput 2.81536K wps
[Epoch 41 Batch 930/1540] avg loss 0.00184733, throughput 2.88499K wps
[Epoch 41 Batch 960/1540] avg loss 0.00229674, throughput 2.83816K wps
[Epoch 41 Batch 990/1540] avg loss 0.00196698, throughput 2.79831K wps
[Epoch 41 Batch 1020/1540] avg loss 0.001903, throughput 2.8513K wps
[Epoch 41 Batch 1050/1540] avg loss 0.00209876, throughput 2.88039K wps
[Epoch 41 Batch 1080/1540] avg loss 0.00218946, throughput 2.8412K wps
[Epoch 41 Batch 1110/1540] avg loss 0.0019529, throughput 2.86067K wps
[Epoch 41 Batch 1140/1540] avg loss 0.00218116, throughput 2.86407K wps
[Epoch 41 Batch 1170/1540] avg loss 0.00223796, throughput 2.86837K wps
[Epoch 41 Batch 1200/1540] avg loss 0.00194345, throughput 2.81795K wps
[Epoch 41 Batch 1230/1540] avg loss 0.00248052, throughput 2.85221K wps
[Epoch 41 Batch 1260/1540] avg loss 0.00226129, throughput 2.86653K wps
[Epoch 41 Batch 1290/1540] avg loss 0.00197151, throughput 2.88136K wps
[Epoch 41 Batch 1320/1540] avg loss 0.00182588, throughput 2.88406K wps
[Epoch 41 Batch 1350/1540] avg loss 0.00218226, throughput 2.8724K wps
[Epoch 41 Batch 1380/1540] avg loss 0.00221001, throughput 2.86963K wps
[Epoch 41 Batch 1410/1540] avg loss 0.00202806, throughput 2.88403K wps
[Epoch 41 Batch 1440/1540] avg loss 0.00202143, throughput 2.80294K wps
[Epoch 41 Batch 1470/1540] avg loss 0.00168593, throughput 2.84984K wps
[Epoch 41 Batch 1500/1540] avg loss 0.00174493, throughput 2.87264K wps
[Epoch 41 Batch 1530/1540] avg loss 0.00187284, throughput 2.84898K wps
Begin Testing...
[Epoch 41] train avg loss 0.0019289, dev acc 0.8028, dev avg loss 0.622761, throughput 2.85616K wps
[Epoch 42 Batch 30/1540] avg loss 0.00190722, throughput 2.90303K wps
[Epoch 42 Batch 60/1540] avg loss 0.00193595, throughput 2.88001K wps
[Epoch 42 Batch 90/1540] avg loss 0.00172442, throughput 2.88052K wps
[Epoch 42 Batch 120/1540] avg loss 0.00166201, throughput 2.87698K wps
[Epoch 42 Batch 150/1540] avg loss 0.00157431, throughput 2.82095K wps
[Epoch 42 Batch 180/1540] avg loss 0.00191111, throughput 2.8819K wps
[Epoch 42 Batch 210/1540] avg loss 0.00162648, throughput 2.83551K wps
[Epoch 42 Batch 240/1540] avg loss 0.00199454, throughput 2.80359K wps
[Epoch 42 Batch 270/1540] avg loss 0.00152483, throughput 2.83863K wps
[Epoch 42 Batch 300/1540] avg loss 0.00201804, throughput 2.80255K wps
[Epoch 42 Batch 330/1540] avg loss 0.00172918, throughput 2.84714K wps
[Epoch 42 Batch 360/1540] avg loss 0.00220597, throughput 2.80327K wps
[Epoch 42 Batch 390/1540] avg loss 0.00193881, throughput 2.86271K wps
[Epoch 42 Batch 420/1540] avg loss 0.00189905, throughput 2.87896K wps
[Epoch 42 Batch 450/1540] avg loss 0.00173614, throughput 2.8801K wps
[Epoch 42 Batch 480/1540] avg loss 0.00178563, throughput 2.87524K wps
[Epoch 42 Batch 510/1540] avg loss 0.0018636, throughput 2.7933K wps
[Epoch 42 Batch 540/1540] avg loss 0.00167232, throughput 2.8636K wps
[Epoch 42 Batch 570/1540] avg loss 0.00156458, throughput 2.87752K wps
[Epoch 42 Batch 600/1540] avg loss 0.00184272, throughput 2.8716K wps
[Epoch 42 Batch 630/1540] avg loss 0.00239768, throughput 2.88581K wps
[Epoch 42 Batch 660/1540] avg loss 0.00227655, throughput 2.87782K wps
[Epoch 42 Batch 690/1540] avg loss 0.00215603, throughput 2.85792K wps
[Epoch 42 Batch 720/1540] avg loss 0.00187691, throughput 2.85784K wps
[Epoch 42 Batch 750/1540] avg loss 0.00230324, throughput 2.86878K wps
[Epoch 42 Batch 780/1540] avg loss 0.00185111, throughput 2.87284K wps
[Epoch 42 Batch 810/1540] avg loss 0.00242319, throughput 2.86667K wps
[Epoch 42 Batch 840/1540] avg loss 0.00192204, throughput 2.8778K wps
[Epoch 42 Batch 870/1540] avg loss 0.00194514, throughput 2.87004K wps
[Epoch 42 Batch 900/1540] avg loss 0.00190372, throughput 2.88296K wps
[Epoch 42 Batch 930/1540] avg loss 0.00160831, throughput 2.87305K wps
[Epoch 42 Batch 960/1540] avg loss 0.00186844, throughput 2.87113K wps
[Epoch 42 Batch 990/1540] avg loss 0.00222196, throughput 2.848K wps
[Epoch 42 Batch 1020/1540] avg loss 0.00207424, throughput 2.81987K wps
[Epoch 42 Batch 1050/1540] avg loss 0.00174084, throughput 2.88152K wps
[Epoch 42 Batch 1080/1540] avg loss 0.00181984, throughput 2.87557K wps
[Epoch 42 Batch 1110/1540] avg loss 0.00213637, throughput 2.8874K wps
[Epoch 42 Batch 1140/1540] avg loss 0.00165722, throughput 2.85784K wps
[Epoch 42 Batch 1170/1540] avg loss 0.00188067, throughput 2.87093K wps
[Epoch 42 Batch 1200/1540] avg loss 0.00205945, throughput 2.88238K wps
[Epoch 42 Batch 1230/1540] avg loss 0.00200224, throughput 2.86357K wps
[Epoch 42 Batch 1260/1540] avg loss 0.00181519, throughput 2.87912K wps
[Epoch 42 Batch 1290/1540] avg loss 0.00203238, throughput 2.86838K wps
[Epoch 42 Batch 1320/1540] avg loss 0.00202622, throughput 2.81746K wps
[Epoch 42 Batch 1350/1540] avg loss 0.00168596, throughput 2.8753K wps
[Epoch 42 Batch 1380/1540] avg loss 0.00225139, throughput 2.88652K wps
[Epoch 42 Batch 1410/1540] avg loss 0.00193772, throughput 2.86547K wps
[Epoch 42 Batch 1440/1540] avg loss 0.00201013, throughput 2.8597K wps
[Epoch 42 Batch 1470/1540] avg loss 0.00193114, throughput 2.85347K wps
[Epoch 42 Batch 1500/1540] avg loss 0.00176515, throughput 2.86694K wps
[Epoch 42 Batch 1530/1540] avg loss 0.00201825, throughput 2.82703K wps
Begin Testing...
[Epoch 42] train avg loss 0.00191661, dev acc 0.8142, dev avg loss 0.588445, throughput 2.86122K wps
[Epoch 43 Batch 30/1540] avg loss 0.0016286, throughput 2.88612K wps
[Epoch 43 Batch 60/1540] avg loss 0.00158185, throughput 2.84539K wps
[Epoch 43 Batch 90/1540] avg loss 0.00171192, throughput 2.88685K wps
[Epoch 43 Batch 120/1540] avg loss 0.00191114, throughput 2.88587K wps
[Epoch 43 Batch 150/1540] avg loss 0.00175032, throughput 2.87427K wps
[Epoch 43 Batch 180/1540] avg loss 0.00164616, throughput 2.8836K wps
[Epoch 43 Batch 210/1540] avg loss 0.0017189, throughput 2.87754K wps
[Epoch 43 Batch 240/1540] avg loss 0.00169152, throughput 2.88269K wps
[Epoch 43 Batch 270/1540] avg loss 0.00151935, throughput 2.8665K wps
[Epoch 43 Batch 300/1540] avg loss 0.00185193, throughput 2.797K wps
[Epoch 43 Batch 330/1540] avg loss 0.00197746, throughput 2.83852K wps
[Epoch 43 Batch 360/1540] avg loss 0.00169875, throughput 2.85068K wps
[Epoch 43 Batch 390/1540] avg loss 0.00176788, throughput 2.87417K wps
[Epoch 43 Batch 420/1540] avg loss 0.00172462, throughput 2.88196K wps
[Epoch 43 Batch 450/1540] avg loss 0.00167622, throughput 2.88287K wps
[Epoch 43 Batch 480/1540] avg loss 0.00215706, throughput 2.8806K wps
[Epoch 43 Batch 510/1540] avg loss 0.00158564, throughput 2.88036K wps
[Epoch 43 Batch 540/1540] avg loss 0.00218011, throughput 2.88012K wps
[Epoch 43 Batch 570/1540] avg loss 0.00165376, throughput 2.83097K wps
[Epoch 43 Batch 600/1540] avg loss 0.00174864, throughput 2.88535K wps
[Epoch 43 Batch 630/1540] avg loss 0.0017642, throughput 2.87727K wps
[Epoch 43 Batch 660/1540] avg loss 0.00175718, throughput 2.86833K wps
[Epoch 43 Batch 690/1540] avg loss 0.00189264, throughput 2.88004K wps
[Epoch 43 Batch 720/1540] avg loss 0.00168219, throughput 2.87401K wps
[Epoch 43 Batch 750/1540] avg loss 0.00182581, throughput 2.88294K wps
[Epoch 43 Batch 780/1540] avg loss 0.00214202, throughput 2.86423K wps
[Epoch 43 Batch 810/1540] avg loss 0.00214839, throughput 2.84585K wps
[Epoch 43 Batch 840/1540] avg loss 0.00177299, throughput 2.86342K wps
[Epoch 43 Batch 870/1540] avg loss 0.00169535, throughput 2.87863K wps
[Epoch 43 Batch 900/1540] avg loss 0.00190947, throughput 2.86849K wps
[Epoch 43 Batch 930/1540] avg loss 0.00221284, throughput 2.83783K wps
[Epoch 43 Batch 960/1540] avg loss 0.0017121, throughput 2.8367K wps
[Epoch 43 Batch 990/1540] avg loss 0.00186384, throughput 2.88425K wps
[Epoch 43 Batch 1020/1540] avg loss 0.00185923, throughput 2.8751K wps
[Epoch 43 Batch 1050/1540] avg loss 0.00175324, throughput 2.85775K wps
[Epoch 43 Batch 1080/1540] avg loss 0.00194426, throughput 2.88608K wps
[Epoch 43 Batch 1110/1540] avg loss 0.00220522, throughput 2.82518K wps
[Epoch 43 Batch 1140/1540] avg loss 0.0017786, throughput 2.82424K wps
[Epoch 43 Batch 1170/1540] avg loss 0.00221141, throughput 2.87599K wps
[Epoch 43 Batch 1200/1540] avg loss 0.0018622, throughput 2.87812K wps
[Epoch 43 Batch 1230/1540] avg loss 0.00187319, throughput 2.86987K wps
[Epoch 43 Batch 1260/1540] avg loss 0.00207581, throughput 2.83564K wps
[Epoch 43 Batch 1290/1540] avg loss 0.00208124, throughput 2.83146K wps
[Epoch 43 Batch 1320/1540] avg loss 0.00208163, throughput 2.86232K wps
[Epoch 43 Batch 1350/1540] avg loss 0.0018199, throughput 2.87988K wps
[Epoch 43 Batch 1380/1540] avg loss 0.00171421, throughput 2.87651K wps
[Epoch 43 Batch 1410/1540] avg loss 0.00181201, throughput 2.86419K wps
[Epoch 43 Batch 1440/1540] avg loss 0.00197139, throughput 2.79543K wps
[Epoch 43 Batch 1470/1540] avg loss 0.00193528, throughput 2.88361K wps
[Epoch 43 Batch 1500/1540] avg loss 0.00207711, throughput 2.88105K wps
[Epoch 43 Batch 1530/1540] avg loss 0.00208025, throughput 2.86387K wps
Begin Testing...
[Epoch 43] train avg loss 0.00186166, dev acc 0.7982, dev avg loss 0.619389, throughput 2.86409K wps
[Epoch 44 Batch 30/1540] avg loss 0.00178507, throughput 2.87912K wps
[Epoch 44 Batch 60/1540] avg loss 0.00165861, throughput 2.80237K wps
[Epoch 44 Batch 90/1540] avg loss 0.00197858, throughput 2.81557K wps
[Epoch 44 Batch 120/1540] avg loss 0.00197197, throughput 2.88459K wps
[Epoch 44 Batch 150/1540] avg loss 0.00176752, throughput 2.85957K wps
[Epoch 44 Batch 180/1540] avg loss 0.00158065, throughput 2.82309K wps
[Epoch 44 Batch 210/1540] avg loss 0.00154851, throughput 2.87378K wps
[Epoch 44 Batch 240/1540] avg loss 0.00170776, throughput 2.81527K wps
[Epoch 44 Batch 270/1540] avg loss 0.00179112, throughput 2.82628K wps
[Epoch 44 Batch 300/1540] avg loss 0.00183949, throughput 2.83323K wps
[Epoch 44 Batch 330/1540] avg loss 0.00187602, throughput 2.87004K wps
[Epoch 44 Batch 360/1540] avg loss 0.00206642, throughput 2.88941K wps
[Epoch 44 Batch 390/1540] avg loss 0.00208146, throughput 2.81891K wps
[Epoch 44 Batch 420/1540] avg loss 0.00196363, throughput 2.79994K wps
[Epoch 44 Batch 450/1540] avg loss 0.00202088, throughput 2.88159K wps
[Epoch 44 Batch 480/1540] avg loss 0.00179531, throughput 2.86017K wps
[Epoch 44 Batch 510/1540] avg loss 0.0018409, throughput 2.83784K wps
[Epoch 44 Batch 540/1540] avg loss 0.00165213, throughput 2.86967K wps
[Epoch 44 Batch 570/1540] avg loss 0.00175087, throughput 2.88213K wps
[Epoch 44 Batch 600/1540] avg loss 0.0017629, throughput 2.86913K wps
[Epoch 44 Batch 630/1540] avg loss 0.0016445, throughput 2.84831K wps
[Epoch 44 Batch 660/1540] avg loss 0.00172755, throughput 2.86975K wps
[Epoch 44 Batch 690/1540] avg loss 0.0017686, throughput 2.84785K wps
[Epoch 44 Batch 720/1540] avg loss 0.00185187, throughput 2.7996K wps
[Epoch 44 Batch 750/1540] avg loss 0.00180182, throughput 2.86716K wps
[Epoch 44 Batch 780/1540] avg loss 0.00193594, throughput 2.87887K wps
[Epoch 44 Batch 810/1540] avg loss 0.00178564, throughput 2.87781K wps
[Epoch 44 Batch 840/1540] avg loss 0.0018291, throughput 2.84193K wps
[Epoch 44 Batch 870/1540] avg loss 0.00171159, throughput 2.79293K wps
[Epoch 44 Batch 900/1540] avg loss 0.0018483, throughput 2.8684K wps
[Epoch 44 Batch 930/1540] avg loss 0.00211075, throughput 2.8696K wps
[Epoch 44 Batch 960/1540] avg loss 0.00188132, throughput 2.86379K wps
[Epoch 44 Batch 990/1540] avg loss 0.00183744, throughput 2.88191K wps
[Epoch 44 Batch 1020/1540] avg loss 0.00161534, throughput 2.87052K wps
[Epoch 44 Batch 1050/1540] avg loss 0.00171603, throughput 2.83464K wps
[Epoch 44 Batch 1080/1540] avg loss 0.00190541, throughput 2.83753K wps
[Epoch 44 Batch 1110/1540] avg loss 0.00173751, throughput 2.87264K wps
[Epoch 44 Batch 1140/1540] avg loss 0.00191962, throughput 2.87443K wps
[Epoch 44 Batch 1170/1540] avg loss 0.00164151, throughput 2.87377K wps
[Epoch 44 Batch 1200/1540] avg loss 0.00225167, throughput 2.87922K wps
[Epoch 44 Batch 1230/1540] avg loss 0.00192108, throughput 2.8674K wps
[Epoch 44 Batch 1260/1540] avg loss 0.00165659, throughput 2.87201K wps
[Epoch 44 Batch 1290/1540] avg loss 0.00184463, throughput 2.83537K wps
[Epoch 44 Batch 1320/1540] avg loss 0.00159044, throughput 2.86568K wps
[Epoch 44 Batch 1350/1540] avg loss 0.00177793, throughput 2.88235K wps
[Epoch 44 Batch 1380/1540] avg loss 0.00191169, throughput 2.87852K wps
[Epoch 44 Batch 1410/1540] avg loss 0.00194151, throughput 2.83297K wps
[Epoch 44 Batch 1440/1540] avg loss 0.00214917, throughput 2.8545K wps
[Epoch 44 Batch 1470/1540] avg loss 0.00181885, throughput 2.84949K wps
[Epoch 44 Batch 1500/1540] avg loss 0.00160105, throughput 2.82361K wps
[Epoch 44 Batch 1530/1540] avg loss 0.001903, throughput 2.84041K wps
Begin Testing...
[Epoch 44] train avg loss 0.00182497, dev acc 0.8096, dev avg loss 0.613337, throughput 2.85346K wps
[Epoch 45 Batch 30/1540] avg loss 0.00171434, throughput 2.90244K wps
[Epoch 45 Batch 60/1540] avg loss 0.00159487, throughput 2.8753K wps
[Epoch 45 Batch 90/1540] avg loss 0.001776, throughput 2.82457K wps
[Epoch 45 Batch 120/1540] avg loss 0.0017065, throughput 2.88304K wps
[Epoch 45 Batch 150/1540] avg loss 0.00174585, throughput 2.87514K wps
[Epoch 45 Batch 180/1540] avg loss 0.0016277, throughput 2.86141K wps
[Epoch 45 Batch 210/1540] avg loss 0.00173884, throughput 2.87678K wps
[Epoch 45 Batch 240/1540] avg loss 0.00155326, throughput 2.85033K wps
[Epoch 45 Batch 270/1540] avg loss 0.00149791, throughput 2.88213K wps
[Epoch 45 Batch 300/1540] avg loss 0.00160162, throughput 2.85586K wps
[Epoch 45 Batch 330/1540] avg loss 0.0018944, throughput 2.86662K wps
[Epoch 45 Batch 360/1540] avg loss 0.00169698, throughput 2.87056K wps
[Epoch 45 Batch 390/1540] avg loss 0.00169082, throughput 2.8544K wps
[Epoch 45 Batch 420/1540] avg loss 0.00156559, throughput 2.80012K wps
[Epoch 45 Batch 450/1540] avg loss 0.00159113, throughput 2.8777K wps
[Epoch 45 Batch 480/1540] avg loss 0.00184089, throughput 2.85231K wps
[Epoch 45 Batch 510/1540] avg loss 0.00209554, throughput 2.87428K wps
[Epoch 45 Batch 540/1540] avg loss 0.00182985, throughput 2.88761K wps
[Epoch 45 Batch 570/1540] avg loss 0.00156126, throughput 2.8832K wps
[Epoch 45 Batch 600/1540] avg loss 0.00153607, throughput 2.84943K wps
[Epoch 45 Batch 630/1540] avg loss 0.0019637, throughput 2.88435K wps
[Epoch 45 Batch 660/1540] avg loss 0.00178111, throughput 2.87907K wps
[Epoch 45 Batch 690/1540] avg loss 0.00180482, throughput 2.83217K wps
[Epoch 45 Batch 720/1540] avg loss 0.00188739, throughput 2.86336K wps
[Epoch 45 Batch 750/1540] avg loss 0.00197911, throughput 2.86382K wps
[Epoch 45 Batch 780/1540] avg loss 0.00189525, throughput 2.87392K wps
[Epoch 45 Batch 810/1540] avg loss 0.00178324, throughput 2.88339K wps
[Epoch 45 Batch 840/1540] avg loss 0.0020528, throughput 2.88345K wps
[Epoch 45 Batch 870/1540] avg loss 0.00215353, throughput 2.87997K wps
[Epoch 45 Batch 900/1540] avg loss 0.00167501, throughput 2.80657K wps
[Epoch 45 Batch 930/1540] avg loss 0.00161396, throughput 2.84381K wps
[Epoch 45 Batch 960/1540] avg loss 0.00194591, throughput 2.86771K wps
[Epoch 45 Batch 990/1540] avg loss 0.00210268, throughput 2.86975K wps
[Epoch 45 Batch 1020/1540] avg loss 0.0020844, throughput 2.83211K wps
[Epoch 45 Batch 1050/1540] avg loss 0.00182598, throughput 2.85628K wps
[Epoch 45 Batch 1080/1540] avg loss 0.00177023, throughput 2.82975K wps
[Epoch 45 Batch 1110/1540] avg loss 0.00176237, throughput 2.85869K wps
[Epoch 45 Batch 1140/1540] avg loss 0.0020235, throughput 2.8277K wps
[Epoch 45 Batch 1170/1540] avg loss 0.00180428, throughput 2.87863K wps
[Epoch 45 Batch 1200/1540] avg loss 0.00189951, throughput 2.87642K wps
[Epoch 45 Batch 1230/1540] avg loss 0.00172664, throughput 2.82487K wps
[Epoch 45 Batch 1260/1540] avg loss 0.00221405, throughput 2.85798K wps
[Epoch 45 Batch 1290/1540] avg loss 0.00171446, throughput 2.88294K wps
[Epoch 45 Batch 1320/1540] avg loss 0.00201468, throughput 2.81486K wps
[Epoch 45 Batch 1350/1540] avg loss 0.00198801, throughput 2.80496K wps
[Epoch 45 Batch 1380/1540] avg loss 0.00168462, throughput 2.85308K wps
[Epoch 45 Batch 1410/1540] avg loss 0.00203671, throughput 2.84285K wps
[Epoch 45 Batch 1440/1540] avg loss 0.00184934, throughput 2.84346K wps
[Epoch 45 Batch 1470/1540] avg loss 0.00167197, throughput 2.86366K wps
[Epoch 45 Batch 1500/1540] avg loss 0.00166206, throughput 2.88433K wps
[Epoch 45 Batch 1530/1540] avg loss 0.00188029, throughput 2.85535K wps
Begin Testing...
[Epoch 45] train avg loss 0.00181071, dev acc 0.7959, dev avg loss 0.625502, throughput 2.85888K wps
[Epoch 46 Batch 30/1540] avg loss 0.00138348, throughput 2.93907K wps
[Epoch 46 Batch 60/1540] avg loss 0.00178699, throughput 2.8808K wps
[Epoch 46 Batch 90/1540] avg loss 0.00154693, throughput 2.86191K wps
[Epoch 46 Batch 120/1540] avg loss 0.00182151, throughput 2.82615K wps
[Epoch 46 Batch 150/1540] avg loss 0.00170104, throughput 2.84934K wps
[Epoch 46 Batch 180/1540] avg loss 0.00169737, throughput 2.87323K wps
[Epoch 46 Batch 210/1540] avg loss 0.00148025, throughput 2.88292K wps
[Epoch 46 Batch 240/1540] avg loss 0.00169853, throughput 2.88375K wps
[Epoch 46 Batch 270/1540] avg loss 0.00149021, throughput 2.88025K wps
[Epoch 46 Batch 300/1540] avg loss 0.00160924, throughput 2.85698K wps
[Epoch 46 Batch 330/1540] avg loss 0.00181857, throughput 2.81839K wps
[Epoch 46 Batch 360/1540] avg loss 0.00192724, throughput 2.8558K wps
[Epoch 46 Batch 390/1540] avg loss 0.00171371, throughput 2.813K wps
[Epoch 46 Batch 420/1540] avg loss 0.00213249, throughput 2.87733K wps
[Epoch 46 Batch 450/1540] avg loss 0.00167015, throughput 2.88302K wps
[Epoch 46 Batch 480/1540] avg loss 0.00197623, throughput 2.88455K wps
[Epoch 46 Batch 510/1540] avg loss 0.00182287, throughput 2.88781K wps
[Epoch 46 Batch 540/1540] avg loss 0.00180968, throughput 2.85806K wps
[Epoch 46 Batch 570/1540] avg loss 0.00194523, throughput 2.82132K wps
[Epoch 46 Batch 600/1540] avg loss 0.00175154, throughput 2.81794K wps
[Epoch 46 Batch 630/1540] avg loss 0.0017486, throughput 2.8144K wps
[Epoch 46 Batch 660/1540] avg loss 0.0017276, throughput 2.83956K wps
[Epoch 46 Batch 690/1540] avg loss 0.00171071, throughput 2.87707K wps
[Epoch 46 Batch 720/1540] avg loss 0.00196381, throughput 2.85515K wps
[Epoch 46 Batch 750/1540] avg loss 0.00167457, throughput 2.87818K wps
[Epoch 46 Batch 780/1540] avg loss 0.00184698, throughput 2.87997K wps
[Epoch 46 Batch 810/1540] avg loss 0.0016432, throughput 2.88377K wps
[Epoch 46 Batch 840/1540] avg loss 0.00194091, throughput 2.85161K wps
[Epoch 46 Batch 870/1540] avg loss 0.00156575, throughput 2.80319K wps
[Epoch 46 Batch 900/1540] avg loss 0.00143551, throughput 2.84065K wps
[Epoch 46 Batch 930/1540] avg loss 0.00174613, throughput 2.88765K wps
[Epoch 46 Batch 960/1540] avg loss 0.00181177, throughput 2.86624K wps
[Epoch 46 Batch 990/1540] avg loss 0.00193004, throughput 2.79921K wps
[Epoch 46 Batch 1020/1540] avg loss 0.00214417, throughput 2.86146K wps
[Epoch 46 Batch 1050/1540] avg loss 0.00157426, throughput 2.84438K wps
[Epoch 46 Batch 1080/1540] avg loss 0.00198349, throughput 2.8589K wps
[Epoch 46 Batch 1110/1540] avg loss 0.00173747, throughput 2.83648K wps
[Epoch 46 Batch 1140/1540] avg loss 0.00160478, throughput 2.88412K wps
[Epoch 46 Batch 1170/1540] avg loss 0.00194609, throughput 2.87455K wps
[Epoch 46 Batch 1200/1540] avg loss 0.00171604, throughput 2.87752K wps
[Epoch 46 Batch 1230/1540] avg loss 0.00183921, throughput 2.86419K wps
[Epoch 46 Batch 1260/1540] avg loss 0.0018187, throughput 2.85657K wps
[Epoch 46 Batch 1290/1540] avg loss 0.00193736, throughput 2.87741K wps
[Epoch 46 Batch 1320/1540] avg loss 0.00193955, throughput 2.82687K wps
[Epoch 46 Batch 1350/1540] avg loss 0.00154859, throughput 2.88471K wps
[Epoch 46 Batch 1380/1540] avg loss 0.00148342, throughput 2.87997K wps
[Epoch 46 Batch 1410/1540] avg loss 0.00167957, throughput 2.87053K wps
[Epoch 46 Batch 1440/1540] avg loss 0.0018172, throughput 2.8633K wps
[Epoch 46 Batch 1470/1540] avg loss 0.00219718, throughput 2.80442K wps
[Epoch 46 Batch 1500/1540] avg loss 0.00169882, throughput 2.79634K wps
[Epoch 46 Batch 1530/1540] avg loss 0.00248202, throughput 2.80379K wps
Begin Testing...
[Epoch 46] train avg loss 0.00177807, dev acc 0.8085, dev avg loss 0.615314, throughput 2.85599K wps
[Epoch 47 Batch 30/1540] avg loss 0.00157056, throughput 2.93802K wps
[Epoch 47 Batch 60/1540] avg loss 0.00136046, throughput 2.88167K wps
[Epoch 47 Batch 90/1540] avg loss 0.0017547, throughput 2.87118K wps
[Epoch 47 Batch 120/1540] avg loss 0.00147473, throughput 2.83433K wps
[Epoch 47 Batch 150/1540] avg loss 0.00150423, throughput 2.81132K wps
[Epoch 47 Batch 180/1540] avg loss 0.00162904, throughput 2.84428K wps
[Epoch 47 Batch 210/1540] avg loss 0.00172555, throughput 2.80706K wps
[Epoch 47 Batch 240/1540] avg loss 0.00178632, throughput 2.85658K wps
[Epoch 47 Batch 270/1540] avg loss 0.00176977, throughput 2.83037K wps
[Epoch 47 Batch 300/1540] avg loss 0.0015759, throughput 2.87857K wps
[Epoch 47 Batch 330/1540] avg loss 0.0019696, throughput 2.87434K wps
[Epoch 47 Batch 360/1540] avg loss 0.00171098, throughput 2.85555K wps
[Epoch 47 Batch 390/1540] avg loss 0.00193088, throughput 2.88024K wps
[Epoch 47 Batch 420/1540] avg loss 0.00167592, throughput 2.87563K wps
[Epoch 47 Batch 450/1540] avg loss 0.00146858, throughput 2.87789K wps
[Epoch 47 Batch 480/1540] avg loss 0.00191875, throughput 2.83376K wps
[Epoch 47 Batch 510/1540] avg loss 0.00182365, throughput 2.87382K wps
[Epoch 47 Batch 540/1540] avg loss 0.00201161, throughput 2.87046K wps
[Epoch 47 Batch 570/1540] avg loss 0.00144965, throughput 2.87868K wps
[Epoch 47 Batch 600/1540] avg loss 0.00165746, throughput 2.877K wps
[Epoch 47 Batch 630/1540] avg loss 0.00209909, throughput 2.82639K wps
[Epoch 47 Batch 660/1540] avg loss 0.00184565, throughput 2.88203K wps
[Epoch 47 Batch 690/1540] avg loss 0.00172305, throughput 2.88365K wps
[Epoch 47 Batch 720/1540] avg loss 0.00207514, throughput 2.87607K wps
[Epoch 47 Batch 750/1540] avg loss 0.00178216, throughput 2.83608K wps
[Epoch 47 Batch 780/1540] avg loss 0.00167015, throughput 2.79372K wps
[Epoch 47 Batch 810/1540] avg loss 0.00167317, throughput 2.83739K wps
[Epoch 47 Batch 840/1540] avg loss 0.00141187, throughput 2.87453K wps
[Epoch 47 Batch 870/1540] avg loss 0.00171077, throughput 2.86279K wps
[Epoch 47 Batch 900/1540] avg loss 0.00205578, throughput 2.8737K wps
[Epoch 47 Batch 930/1540] avg loss 0.00176794, throughput 2.86183K wps
[Epoch 47 Batch 960/1540] avg loss 0.00166052, throughput 2.87742K wps
[Epoch 47 Batch 990/1540] avg loss 0.0020022, throughput 2.8589K wps
[Epoch 47 Batch 1020/1540] avg loss 0.00142442, throughput 2.86572K wps
[Epoch 47 Batch 1050/1540] avg loss 0.00219105, throughput 2.82347K wps
[Epoch 47 Batch 1080/1540] avg loss 0.00168032, throughput 2.807K wps
[Epoch 47 Batch 1110/1540] avg loss 0.00149384, throughput 2.88438K wps
[Epoch 47 Batch 1140/1540] avg loss 0.00213952, throughput 2.88474K wps
[Epoch 47 Batch 1170/1540] avg loss 0.00169201, throughput 2.8475K wps
[Epoch 47 Batch 1200/1540] avg loss 0.00157078, throughput 2.8508K wps
[Epoch 47 Batch 1230/1540] avg loss 0.00192521, throughput 2.86745K wps
[Epoch 47 Batch 1260/1540] avg loss 0.00186675, throughput 2.87239K wps
[Epoch 47 Batch 1290/1540] avg loss 0.001902, throughput 2.88354K wps
[Epoch 47 Batch 1320/1540] avg loss 0.00158413, throughput 2.87918K wps
[Epoch 47 Batch 1350/1540] avg loss 0.0020471, throughput 2.84578K wps
[Epoch 47 Batch 1380/1540] avg loss 0.00188353, throughput 2.88848K wps
[Epoch 47 Batch 1410/1540] avg loss 0.0021026, throughput 2.87713K wps
[Epoch 47 Batch 1440/1540] avg loss 0.00197176, throughput 2.88129K wps
[Epoch 47 Batch 1470/1540] avg loss 0.00184436, throughput 2.87658K wps
[Epoch 47 Batch 1500/1540] avg loss 0.00172456, throughput 2.8775K wps
[Epoch 47 Batch 1530/1540] avg loss 0.00179076, throughput 2.88328K wps
Begin Testing...
[Epoch 47] train avg loss 0.00176988, dev acc 0.7936, dev avg loss 0.673759, throughput 2.86245K wps
[Epoch 48 Batch 30/1540] avg loss 0.00175607, throughput 2.86271K wps
[Epoch 48 Batch 60/1540] avg loss 0.00145654, throughput 2.87054K wps
[Epoch 48 Batch 90/1540] avg loss 0.0014888, throughput 2.88619K wps
[Epoch 48 Batch 120/1540] avg loss 0.00171718, throughput 2.88511K wps
[Epoch 48 Batch 150/1540] avg loss 0.00170884, throughput 2.87456K wps
[Epoch 48 Batch 180/1540] avg loss 0.0014389, throughput 2.81489K wps
[Epoch 48 Batch 210/1540] avg loss 0.00199017, throughput 2.8633K wps
[Epoch 48 Batch 240/1540] avg loss 0.00148378, throughput 2.84141K wps
[Epoch 48 Batch 270/1540] avg loss 0.00138904, throughput 2.84404K wps
[Epoch 48 Batch 300/1540] avg loss 0.00148846, throughput 2.79687K wps
[Epoch 48 Batch 330/1540] avg loss 0.00162118, throughput 2.88334K wps
[Epoch 48 Batch 360/1540] avg loss 0.00167091, throughput 2.88031K wps
[Epoch 48 Batch 390/1540] avg loss 0.00153836, throughput 2.88353K wps
[Epoch 48 Batch 420/1540] avg loss 0.00143608, throughput 2.87374K wps
[Epoch 48 Batch 450/1540] avg loss 0.00154231, throughput 2.81888K wps
[Epoch 48 Batch 480/1540] avg loss 0.00156606, throughput 2.81708K wps
[Epoch 48 Batch 510/1540] avg loss 0.0019006, throughput 2.882K wps
[Epoch 48 Batch 540/1540] avg loss 0.00167015, throughput 2.88186K wps
[Epoch 48 Batch 570/1540] avg loss 0.00151218, throughput 2.86549K wps
[Epoch 48 Batch 600/1540] avg loss 0.00187291, throughput 2.8103K wps
[Epoch 48 Batch 630/1540] avg loss 0.00165066, throughput 2.87911K wps
[Epoch 48 Batch 660/1540] avg loss 0.0016774, throughput 2.80148K wps
[Epoch 48 Batch 690/1540] avg loss 0.00170924, throughput 2.85539K wps
[Epoch 48 Batch 720/1540] avg loss 0.00190137, throughput 2.85001K wps
[Epoch 48 Batch 750/1540] avg loss 0.00146695, throughput 2.88182K wps
[Epoch 48 Batch 780/1540] avg loss 0.0015782, throughput 2.86212K wps
[Epoch 48 Batch 810/1540] avg loss 0.00174739, throughput 2.8276K wps
[Epoch 48 Batch 840/1540] avg loss 0.00198502, throughput 2.79085K wps
[Epoch 48 Batch 870/1540] avg loss 0.00193054, throughput 2.86033K wps
[Epoch 48 Batch 900/1540] avg loss 0.00167951, throughput 2.88211K wps
[Epoch 48 Batch 930/1540] avg loss 0.00193494, throughput 2.88307K wps
[Epoch 48 Batch 960/1540] avg loss 0.00187257, throughput 2.87711K wps
[Epoch 48 Batch 990/1540] avg loss 0.00160432, throughput 2.88114K wps
[Epoch 48 Batch 1020/1540] avg loss 0.00200682, throughput 2.87867K wps
[Epoch 48 Batch 1050/1540] avg loss 0.00189173, throughput 2.88229K wps
[Epoch 48 Batch 1080/1540] avg loss 0.00169249, throughput 2.87951K wps
[Epoch 48 Batch 1110/1540] avg loss 0.00191599, throughput 2.85751K wps
[Epoch 48 Batch 1140/1540] avg loss 0.00188669, throughput 2.86883K wps
[Epoch 48 Batch 1170/1540] avg loss 0.00160894, throughput 2.84068K wps
[Epoch 48 Batch 1200/1540] avg loss 0.00175084, throughput 2.83614K wps
[Epoch 48 Batch 1230/1540] avg loss 0.00190402, throughput 2.82925K wps
[Epoch 48 Batch 1260/1540] avg loss 0.00199674, throughput 2.8842K wps
[Epoch 48 Batch 1290/1540] avg loss 0.00192296, throughput 2.83489K wps
[Epoch 48 Batch 1320/1540] avg loss 0.00188224, throughput 2.80184K wps
[Epoch 48 Batch 1350/1540] avg loss 0.00192133, throughput 2.84411K wps
[Epoch 48 Batch 1380/1540] avg loss 0.00187858, throughput 2.88464K wps
[Epoch 48 Batch 1410/1540] avg loss 0.00159738, throughput 2.88368K wps
[Epoch 48 Batch 1440/1540] avg loss 0.00193976, throughput 2.86487K wps
[Epoch 48 Batch 1470/1540] avg loss 0.00177031, throughput 2.87801K wps
[Epoch 48 Batch 1500/1540] avg loss 0.00198447, throughput 2.87705K wps
[Epoch 48 Batch 1530/1540] avg loss 0.00192413, throughput 2.8452K wps
Begin Testing...
[Epoch 48] train avg loss 0.00173643, dev acc 0.8062, dev avg loss 0.618443, throughput 2.85697K wps
[Epoch 49 Batch 30/1540] avg loss 0.0016943, throughput 2.93468K wps
[Epoch 49 Batch 60/1540] avg loss 0.00124838, throughput 2.8716K wps
[Epoch 49 Batch 90/1540] avg loss 0.00136113, throughput 2.83249K wps
[Epoch 49 Batch 120/1540] avg loss 0.00145599, throughput 2.85676K wps
[Epoch 49 Batch 150/1540] avg loss 0.00171545, throughput 2.871K wps
[Epoch 49 Batch 180/1540] avg loss 0.00164624, throughput 2.86478K wps
[Epoch 49 Batch 210/1540] avg loss 0.00156309, throughput 2.8727K wps
[Epoch 49 Batch 240/1540] avg loss 0.00161133, throughput 2.84047K wps
[Epoch 49 Batch 270/1540] avg loss 0.00178276, throughput 2.86026K wps
[Epoch 49 Batch 300/1540] avg loss 0.00160855, throughput 2.82949K wps
[Epoch 49 Batch 330/1540] avg loss 0.00157482, throughput 2.87458K wps
[Epoch 49 Batch 360/1540] avg loss 0.00164562, throughput 2.86538K wps
[Epoch 49 Batch 390/1540] avg loss 0.00181035, throughput 2.87588K wps
[Epoch 49 Batch 420/1540] avg loss 0.00188506, throughput 2.85297K wps
[Epoch 49 Batch 450/1540] avg loss 0.00162336, throughput 2.84857K wps
[Epoch 49 Batch 480/1540] avg loss 0.00164353, throughput 2.87921K wps
[Epoch 49 Batch 510/1540] avg loss 0.00151523, throughput 2.83718K wps
[Epoch 49 Batch 540/1540] avg loss 0.00161554, throughput 2.8629K wps
[Epoch 49 Batch 570/1540] avg loss 0.00170464, throughput 2.81153K wps
[Epoch 49 Batch 600/1540] avg loss 0.00208358, throughput 2.87018K wps
[Epoch 49 Batch 630/1540] avg loss 0.00157615, throughput 2.86624K wps
[Epoch 49 Batch 660/1540] avg loss 0.00174352, throughput 2.87056K wps
[Epoch 49 Batch 690/1540] avg loss 0.00157808, throughput 2.81648K wps
[Epoch 49 Batch 720/1540] avg loss 0.00194906, throughput 2.84786K wps
[Epoch 49 Batch 750/1540] avg loss 0.00168906, throughput 2.88708K wps
[Epoch 49 Batch 780/1540] avg loss 0.00190747, throughput 2.87445K wps
[Epoch 49 Batch 810/1540] avg loss 0.00186282, throughput 2.82714K wps
[Epoch 49 Batch 840/1540] avg loss 0.00171289, throughput 2.85518K wps
[Epoch 49 Batch 870/1540] avg loss 0.00154115, throughput 2.88588K wps
[Epoch 49 Batch 900/1540] avg loss 0.0016406, throughput 2.8219K wps
[Epoch 49 Batch 930/1540] avg loss 0.00177296, throughput 2.83533K wps
[Epoch 49 Batch 960/1540] avg loss 0.00175854, throughput 2.84656K wps
[Epoch 49 Batch 990/1540] avg loss 0.00159266, throughput 2.86158K wps
[Epoch 49 Batch 1020/1540] avg loss 0.00143534, throughput 2.88603K wps
[Epoch 49 Batch 1050/1540] avg loss 0.0017494, throughput 2.81286K wps
[Epoch 49 Batch 1080/1540] avg loss 0.00154035, throughput 2.88389K wps
[Epoch 49 Batch 1110/1540] avg loss 0.00162611, throughput 2.86666K wps
[Epoch 49 Batch 1140/1540] avg loss 0.00165233, throughput 2.83998K wps
[Epoch 49 Batch 1170/1540] avg loss 0.00197636, throughput 2.88421K wps
[Epoch 49 Batch 1200/1540] avg loss 0.00181606, throughput 2.85449K wps
[Epoch 49 Batch 1230/1540] avg loss 0.00190196, throughput 2.88059K wps
[Epoch 49 Batch 1260/1540] avg loss 0.00162723, throughput 2.88538K wps
[Epoch 49 Batch 1290/1540] avg loss 0.00176593, throughput 2.88781K wps
[Epoch 49 Batch 1320/1540] avg loss 0.00225487, throughput 2.86241K wps
[Epoch 49 Batch 1350/1540] avg loss 0.00206513, throughput 2.87755K wps
[Epoch 49 Batch 1380/1540] avg loss 0.00172451, throughput 2.8654K wps
[Epoch 49 Batch 1410/1540] avg loss 0.00177676, throughput 2.81384K wps
[Epoch 49 Batch 1440/1540] avg loss 0.00181851, throughput 2.85457K wps
[Epoch 49 Batch 1470/1540] avg loss 0.001651, throughput 2.88176K wps
[Epoch 49 Batch 1500/1540] avg loss 0.00184771, throughput 2.88309K wps
[Epoch 49 Batch 1530/1540] avg loss 0.00181548, throughput 2.87947K wps
Begin Testing...
[Epoch 49] train avg loss 0.00170663, dev acc 0.8028, dev avg loss 0.616752, throughput 2.86044K wps
[Epoch 50 Batch 30/1540] avg loss 0.00163128, throughput 2.89354K wps
[Epoch 50 Batch 60/1540] avg loss 0.00169885, throughput 2.81463K wps
[Epoch 50 Batch 90/1540] avg loss 0.00187768, throughput 2.86848K wps
[Epoch 50 Batch 120/1540] avg loss 0.00128065, throughput 2.87812K wps
[Epoch 50 Batch 150/1540] avg loss 0.00128999, throughput 2.8775K wps
[Epoch 50 Batch 180/1540] avg loss 0.00146044, throughput 2.87629K wps
[Epoch 50 Batch 210/1540] avg loss 0.00144011, throughput 2.8564K wps
[Epoch 50 Batch 240/1540] avg loss 0.00174062, throughput 2.81673K wps
[Epoch 50 Batch 270/1540] avg loss 0.00157989, throughput 2.84236K wps
[Epoch 50 Batch 300/1540] avg loss 0.00164608, throughput 2.85494K wps
[Epoch 50 Batch 330/1540] avg loss 0.0016891, throughput 2.81003K wps
[Epoch 50 Batch 360/1540] avg loss 0.00138429, throughput 2.86407K wps
[Epoch 50 Batch 390/1540] avg loss 0.00162261, throughput 2.88265K wps
[Epoch 50 Batch 420/1540] avg loss 0.00151709, throughput 2.88337K wps
[Epoch 50 Batch 450/1540] avg loss 0.00162266, throughput 2.87881K wps
[Epoch 50 Batch 480/1540] avg loss 0.00153045, throughput 2.83972K wps
[Epoch 50 Batch 510/1540] avg loss 0.00170866, throughput 2.79679K wps
[Epoch 50 Batch 540/1540] avg loss 0.00175352, throughput 2.85787K wps
[Epoch 50 Batch 570/1540] avg loss 0.00190543, throughput 2.83455K wps
[Epoch 50 Batch 600/1540] avg loss 0.00176354, throughput 2.88139K wps
[Epoch 50 Batch 630/1540] avg loss 0.00188401, throughput 2.86266K wps
[Epoch 50 Batch 660/1540] avg loss 0.00156928, throughput 2.79782K wps
[Epoch 50 Batch 690/1540] avg loss 0.00150282, throughput 2.80323K wps
[Epoch 50 Batch 720/1540] avg loss 0.00152066, throughput 2.85371K wps
[Epoch 50 Batch 750/1540] avg loss 0.00157031, throughput 2.87251K wps
[Epoch 50 Batch 780/1540] avg loss 0.0014994, throughput 2.86666K wps
[Epoch 50 Batch 810/1540] avg loss 0.00179906, throughput 2.85472K wps
[Epoch 50 Batch 840/1540] avg loss 0.00144611, throughput 2.87967K wps
[Epoch 50 Batch 870/1540] avg loss 0.00175845, throughput 2.87776K wps
[Epoch 50 Batch 900/1540] avg loss 0.0016952, throughput 2.83258K wps
[Epoch 50 Batch 930/1540] avg loss 0.00164074, throughput 2.86407K wps
[Epoch 50 Batch 960/1540] avg loss 0.00160138, throughput 2.77913K wps
[Epoch 50 Batch 990/1540] avg loss 0.00196298, throughput 2.84479K wps
[Epoch 50 Batch 1020/1540] avg loss 0.00185084, throughput 2.8832K wps
[Epoch 50 Batch 1050/1540] avg loss 0.00189249, throughput 2.85467K wps
[Epoch 50 Batch 1080/1540] avg loss 0.00153275, throughput 2.86995K wps
[Epoch 50 Batch 1110/1540] avg loss 0.00151609, throughput 2.87461K wps
[Epoch 50 Batch 1140/1540] avg loss 0.00175254, throughput 2.87721K wps
[Epoch 50 Batch 1170/1540] avg loss 0.00165091, throughput 2.88459K wps
[Epoch 50 Batch 1200/1540] avg loss 0.00158004, throughput 2.85394K wps
[Epoch 50 Batch 1230/1540] avg loss 0.00204346, throughput 2.87629K wps
[Epoch 50 Batch 1260/1540] avg loss 0.00195682, throughput 2.88044K wps
[Epoch 50 Batch 1290/1540] avg loss 0.00141836, throughput 2.8778K wps
[Epoch 50 Batch 1320/1540] avg loss 0.00190664, throughput 2.867K wps
[Epoch 50 Batch 1350/1540] avg loss 0.00190241, throughput 2.82131K wps
[Epoch 50 Batch 1380/1540] avg loss 0.00186319, throughput 2.87229K wps
[Epoch 50 Batch 1410/1540] avg loss 0.00179353, throughput 2.83436K wps
[Epoch 50 Batch 1440/1540] avg loss 0.00166092, throughput 2.86155K wps
[Epoch 50 Batch 1470/1540] avg loss 0.0019531, throughput 2.88182K wps
[Epoch 50 Batch 1500/1540] avg loss 0.00170867, throughput 2.88187K wps
[Epoch 50 Batch 1530/1540] avg loss 0.00214667, throughput 2.87111K wps
Begin Testing...
[Epoch 50] train avg loss 0.00168246, dev acc 0.7913, dev avg loss 0.660416, throughput 2.85713K wps
[Epoch 51 Batch 30/1540] avg loss 0.00142113, throughput 2.86834K wps
[Epoch 51 Batch 60/1540] avg loss 0.00145163, throughput 2.8741K wps
[Epoch 51 Batch 90/1540] avg loss 0.00134122, throughput 2.85712K wps
[Epoch 51 Batch 120/1540] avg loss 0.00182151, throughput 2.87014K wps
[Epoch 51 Batch 150/1540] avg loss 0.00124264, throughput 2.85787K wps
[Epoch 51 Batch 180/1540] avg loss 0.0014713, throughput 2.8658K wps
[Epoch 51 Batch 210/1540] avg loss 0.00152796, throughput 2.87085K wps
[Epoch 51 Batch 240/1540] avg loss 0.0015178, throughput 2.86691K wps
[Epoch 51 Batch 270/1540] avg loss 0.00131892, throughput 2.87903K wps
[Epoch 51 Batch 300/1540] avg loss 0.00159005, throughput 2.86954K wps
[Epoch 51 Batch 330/1540] avg loss 0.00151198, throughput 2.85942K wps
[Epoch 51 Batch 360/1540] avg loss 0.00182372, throughput 2.86946K wps
[Epoch 51 Batch 390/1540] avg loss 0.00154303, throughput 2.82293K wps
[Epoch 51 Batch 420/1540] avg loss 0.00156805, throughput 2.87063K wps
[Epoch 51 Batch 450/1540] avg loss 0.00161715, throughput 2.86853K wps
[Epoch 51 Batch 480/1540] avg loss 0.00152731, throughput 2.86659K wps
[Epoch 51 Batch 510/1540] avg loss 0.00149679, throughput 2.85674K wps
[Epoch 51 Batch 540/1540] avg loss 0.00180771, throughput 2.86877K wps
[Epoch 51 Batch 570/1540] avg loss 0.00185839, throughput 2.87935K wps
[Epoch 51 Batch 600/1540] avg loss 0.00139146, throughput 2.86637K wps
[Epoch 51 Batch 630/1540] avg loss 0.00180738, throughput 2.85123K wps
[Epoch 51 Batch 660/1540] avg loss 0.00176172, throughput 2.8692K wps
[Epoch 51 Batch 690/1540] avg loss 0.00171076, throughput 2.8605K wps
[Epoch 51 Batch 720/1540] avg loss 0.00165953, throughput 2.81385K wps
[Epoch 51 Batch 750/1540] avg loss 0.00151253, throughput 2.88476K wps
[Epoch 51 Batch 780/1540] avg loss 0.00167912, throughput 2.8696K wps
[Epoch 51 Batch 810/1540] avg loss 0.00202941, throughput 2.88401K wps
[Epoch 51 Batch 840/1540] avg loss 0.00154469, throughput 2.88482K wps
[Epoch 51 Batch 870/1540] avg loss 0.00173649, throughput 2.88579K wps
[Epoch 51 Batch 900/1540] avg loss 0.00190205, throughput 2.88536K wps
[Epoch 51 Batch 930/1540] avg loss 0.00187698, throughput 2.85479K wps
[Epoch 51 Batch 960/1540] avg loss 0.00162177, throughput 2.88415K wps
[Epoch 51 Batch 990/1540] avg loss 0.00176214, throughput 2.88701K wps
[Epoch 51 Batch 1020/1540] avg loss 0.00160294, throughput 2.88404K wps
[Epoch 51 Batch 1050/1540] avg loss 0.00170194, throughput 2.88482K wps
[Epoch 51 Batch 1080/1540] avg loss 0.00175652, throughput 2.87339K wps
[Epoch 51 Batch 1110/1540] avg loss 0.00187039, throughput 2.81641K wps
[Epoch 51 Batch 1140/1540] avg loss 0.00158918, throughput 2.88452K wps
[Epoch 51 Batch 1170/1540] avg loss 0.0015759, throughput 2.87086K wps
[Epoch 51 Batch 1200/1540] avg loss 0.00160434, throughput 2.88149K wps
[Epoch 51 Batch 1230/1540] avg loss 0.00165133, throughput 2.80859K wps
[Epoch 51 Batch 1260/1540] avg loss 0.0018894, throughput 2.88342K wps
[Epoch 51 Batch 1290/1540] avg loss 0.00192602, throughput 2.87718K wps
[Epoch 51 Batch 1320/1540] avg loss 0.00176111, throughput 2.87233K wps
[Epoch 51 Batch 1350/1540] avg loss 0.00200248, throughput 2.88203K wps
[Epoch 51 Batch 1380/1540] avg loss 0.001681, throughput 2.87404K wps
[Epoch 51 Batch 1410/1540] avg loss 0.00171559, throughput 2.85847K wps
[Epoch 51 Batch 1440/1540] avg loss 0.00179991, throughput 2.88215K wps
[Epoch 51 Batch 1470/1540] avg loss 0.0015412, throughput 2.87263K wps
[Epoch 51 Batch 1500/1540] avg loss 0.00171294, throughput 2.87423K wps
[Epoch 51 Batch 1530/1540] avg loss 0.00185338, throughput 2.88346K wps
Begin Testing...
[Epoch 51] train avg loss 0.00165996, dev acc 0.8062, dev avg loss 0.633453, throughput 2.86816K wps
[Epoch 52 Batch 30/1540] avg loss 0.00162537, throughput 2.86169K wps
[Epoch 52 Batch 60/1540] avg loss 0.00148024, throughput 2.8646K wps
[Epoch 52 Batch 90/1540] avg loss 0.00142208, throughput 2.8131K wps
[Epoch 52 Batch 120/1540] avg loss 0.00144493, throughput 2.85401K wps
[Epoch 52 Batch 150/1540] avg loss 0.00148324, throughput 2.86412K wps
[Epoch 52 Batch 180/1540] avg loss 0.00135026, throughput 2.81061K wps
[Epoch 52 Batch 210/1540] avg loss 0.00172884, throughput 2.80338K wps
[Epoch 52 Batch 240/1540] avg loss 0.00171706, throughput 2.87511K wps
[Epoch 52 Batch 270/1540] avg loss 0.00148485, throughput 2.88383K wps
[Epoch 52 Batch 300/1540] avg loss 0.00147482, throughput 2.87568K wps
[Epoch 52 Batch 330/1540] avg loss 0.00154557, throughput 2.85388K wps
[Epoch 52 Batch 360/1540] avg loss 0.00159798, throughput 2.82289K wps
[Epoch 52 Batch 390/1540] avg loss 0.00156701, throughput 2.87947K wps
[Epoch 52 Batch 420/1540] avg loss 0.00173656, throughput 2.85971K wps
[Epoch 52 Batch 450/1540] avg loss 0.00177486, throughput 2.88332K wps
[Epoch 52 Batch 480/1540] avg loss 0.00185811, throughput 2.83916K wps
[Epoch 52 Batch 510/1540] avg loss 0.00184607, throughput 2.82222K wps
[Epoch 52 Batch 540/1540] avg loss 0.00151204, throughput 2.86881K wps
[Epoch 52 Batch 570/1540] avg loss 0.00176057, throughput 2.84178K wps
[Epoch 52 Batch 600/1540] avg loss 0.00202902, throughput 2.85813K wps
[Epoch 52 Batch 630/1540] avg loss 0.00171614, throughput 2.86147K wps
[Epoch 52 Batch 660/1540] avg loss 0.00173948, throughput 2.85963K wps
[Epoch 52 Batch 690/1540] avg loss 0.00148115, throughput 2.87524K wps
[Epoch 52 Batch 720/1540] avg loss 0.00192555, throughput 2.86326K wps
[Epoch 52 Batch 750/1540] avg loss 0.00171542, throughput 2.79699K wps
[Epoch 52 Batch 780/1540] avg loss 0.00150116, throughput 2.78204K wps
[Epoch 52 Batch 810/1540] avg loss 0.00156722, throughput 2.80226K wps
[Epoch 52 Batch 840/1540] avg loss 0.00200594, throughput 2.87808K wps
[Epoch 52 Batch 870/1540] avg loss 0.00158052, throughput 2.87695K wps
[Epoch 52 Batch 900/1540] avg loss 0.00140851, throughput 2.86751K wps
[Epoch 52 Batch 930/1540] avg loss 0.00146551, throughput 2.86954K wps
[Epoch 52 Batch 960/1540] avg loss 0.00167644, throughput 2.87498K wps
[Epoch 52 Batch 990/1540] avg loss 0.00168439, throughput 2.8548K wps
[Epoch 52 Batch 1020/1540] avg loss 0.00165303, throughput 2.87458K wps
[Epoch 52 Batch 1050/1540] avg loss 0.00162632, throughput 2.8074K wps
[Epoch 52 Batch 1080/1540] avg loss 0.00168283, throughput 2.81428K wps
[Epoch 52 Batch 1110/1540] avg loss 0.0018335, throughput 2.7795K wps
[Epoch 52 Batch 1140/1540] avg loss 0.00167305, throughput 2.85064K wps
[Epoch 52 Batch 1170/1540] avg loss 0.00187811, throughput 2.88094K wps
[Epoch 52 Batch 1200/1540] avg loss 0.00180566, throughput 2.85154K wps
[Epoch 52 Batch 1230/1540] avg loss 0.00160238, throughput 2.87958K wps
[Epoch 52 Batch 1260/1540] avg loss 0.00205542, throughput 2.83911K wps
[Epoch 52 Batch 1290/1540] avg loss 0.00154399, throughput 2.85099K wps
[Epoch 52 Batch 1320/1540] avg loss 0.00145603, throughput 2.87235K wps
[Epoch 52 Batch 1350/1540] avg loss 0.00138091, throughput 2.87373K wps
[Epoch 52 Batch 1380/1540] avg loss 0.00171187, throughput 2.86495K wps
[Epoch 52 Batch 1410/1540] avg loss 0.00166282, throughput 2.87544K wps
[Epoch 52 Batch 1440/1540] avg loss 0.00208419, throughput 2.86192K wps
[Epoch 52 Batch 1470/1540] avg loss 0.00186393, throughput 2.85K wps
[Epoch 52 Batch 1500/1540] avg loss 0.00212444, throughput 2.54186K wps
[Epoch 52 Batch 1530/1540] avg loss 0.0017496, throughput 2.87165K wps
Begin Testing...
[Epoch 52] train avg loss 0.00167242, dev acc 0.8050, dev avg loss 0.655776, throughput 2.84503K wps
[Epoch 53 Batch 30/1540] avg loss 0.00138012, throughput 2.86331K wps
[Epoch 53 Batch 60/1540] avg loss 0.00157063, throughput 2.87591K wps
[Epoch 53 Batch 90/1540] avg loss 0.00139439, throughput 2.88467K wps
[Epoch 53 Batch 120/1540] avg loss 0.00133002, throughput 2.88124K wps
[Epoch 53 Batch 150/1540] avg loss 0.00164539, throughput 2.88087K wps
[Epoch 53 Batch 180/1540] avg loss 0.00152802, throughput 2.82601K wps
[Epoch 53 Batch 210/1540] avg loss 0.00147438, throughput 2.84066K wps
[Epoch 53 Batch 240/1540] avg loss 0.00178636, throughput 2.88152K wps
[Epoch 53 Batch 270/1540] avg loss 0.00140357, throughput 2.88066K wps
[Epoch 53 Batch 300/1540] avg loss 0.00154853, throughput 2.87625K wps
[Epoch 53 Batch 330/1540] avg loss 0.00170519, throughput 2.88164K wps
[Epoch 53 Batch 360/1540] avg loss 0.00177349, throughput 2.85953K wps
[Epoch 53 Batch 390/1540] avg loss 0.00168981, throughput 2.80832K wps
[Epoch 53 Batch 420/1540] avg loss 0.00165937, throughput 2.85164K wps
[Epoch 53 Batch 450/1540] avg loss 0.00157112, throughput 2.87831K wps
[Epoch 53 Batch 480/1540] avg loss 0.00181099, throughput 2.87934K wps
[Epoch 53 Batch 510/1540] avg loss 0.00169652, throughput 2.88212K wps
[Epoch 53 Batch 540/1540] avg loss 0.00149292, throughput 2.87237K wps
[Epoch 53 Batch 570/1540] avg loss 0.00170467, throughput 2.87726K wps
[Epoch 53 Batch 600/1540] avg loss 0.00154741, throughput 2.82721K wps
[Epoch 53 Batch 630/1540] avg loss 0.00133283, throughput 2.85948K wps
[Epoch 53 Batch 660/1540] avg loss 0.00159838, throughput 2.82048K wps
[Epoch 53 Batch 690/1540] avg loss 0.00180991, throughput 2.87223K wps
[Epoch 53 Batch 720/1540] avg loss 0.00192515, throughput 2.83291K wps
[Epoch 53 Batch 750/1540] avg loss 0.00160697, throughput 2.82786K wps
[Epoch 53 Batch 780/1540] avg loss 0.00147094, throughput 2.86267K wps
[Epoch 53 Batch 810/1540] avg loss 0.00150221, throughput 2.87425K wps
[Epoch 53 Batch 840/1540] avg loss 0.00154197, throughput 2.87199K wps
[Epoch 53 Batch 870/1540] avg loss 0.00150239, throughput 2.87396K wps
[Epoch 53 Batch 900/1540] avg loss 0.00155505, throughput 2.792K wps
[Epoch 53 Batch 930/1540] avg loss 0.00162928, throughput 2.87322K wps
[Epoch 53 Batch 960/1540] avg loss 0.00168191, throughput 2.86278K wps
[Epoch 53 Batch 990/1540] avg loss 0.00182835, throughput 2.79529K wps
[Epoch 53 Batch 1020/1540] avg loss 0.0016458, throughput 2.80344K wps
[Epoch 53 Batch 1050/1540] avg loss 0.0018479, throughput 2.86896K wps
[Epoch 53 Batch 1080/1540] avg loss 0.00120049, throughput 2.87188K wps
[Epoch 53 Batch 1110/1540] avg loss 0.00170693, throughput 2.86333K wps
[Epoch 53 Batch 1140/1540] avg loss 0.00163802, throughput 2.87176K wps
[Epoch 53 Batch 1170/1540] avg loss 0.00193366, throughput 2.8769K wps
[Epoch 53 Batch 1200/1540] avg loss 0.00144651, throughput 2.8557K wps
[Epoch 53 Batch 1230/1540] avg loss 0.00173029, throughput 2.85871K wps
[Epoch 53 Batch 1260/1540] avg loss 0.00192992, throughput 2.86149K wps
[Epoch 53 Batch 1290/1540] avg loss 0.00162727, throughput 2.87382K wps
[Epoch 53 Batch 1320/1540] avg loss 0.00199145, throughput 2.81355K wps
[Epoch 53 Batch 1350/1540] avg loss 0.00177148, throughput 2.86949K wps
[Epoch 53 Batch 1380/1540] avg loss 0.0015248, throughput 2.88547K wps
[Epoch 53 Batch 1410/1540] avg loss 0.00183203, throughput 2.84754K wps
[Epoch 53 Batch 1440/1540] avg loss 0.00190012, throughput 2.79583K wps
[Epoch 53 Batch 1470/1540] avg loss 0.00157552, throughput 2.83925K wps
[Epoch 53 Batch 1500/1540] avg loss 0.00165161, throughput 2.86491K wps
[Epoch 53 Batch 1530/1540] avg loss 0.0016431, throughput 2.83309K wps
Begin Testing...
[Epoch 53] train avg loss 0.00163323, dev acc 0.8085, dev avg loss 0.635103, throughput 2.8564K wps
[Epoch 54 Batch 30/1540] avg loss 0.00163539, throughput 2.91631K wps
[Epoch 54 Batch 60/1540] avg loss 0.00147205, throughput 2.87638K wps
[Epoch 54 Batch 90/1540] avg loss 0.00134389, throughput 2.87884K wps
[Epoch 54 Batch 120/1540] avg loss 0.00128834, throughput 2.86632K wps
[Epoch 54 Batch 150/1540] avg loss 0.00166614, throughput 2.88295K wps
[Epoch 54 Batch 180/1540] avg loss 0.00129822, throughput 2.87777K wps
[Epoch 54 Batch 210/1540] avg loss 0.00159612, throughput 2.8603K wps
[Epoch 54 Batch 240/1540] avg loss 0.00132451, throughput 2.87012K wps
[Epoch 54 Batch 270/1540] avg loss 0.00132529, throughput 2.84394K wps
[Epoch 54 Batch 300/1540] avg loss 0.0014761, throughput 2.83706K wps
[Epoch 54 Batch 330/1540] avg loss 0.00151154, throughput 2.80271K wps
[Epoch 54 Batch 360/1540] avg loss 0.0016082, throughput 2.85393K wps
[Epoch 54 Batch 390/1540] avg loss 0.00133203, throughput 2.82578K wps
[Epoch 54 Batch 420/1540] avg loss 0.00174571, throughput 2.86889K wps
[Epoch 54 Batch 450/1540] avg loss 0.00137586, throughput 2.88483K wps
[Epoch 54 Batch 480/1540] avg loss 0.00172536, throughput 2.87634K wps
[Epoch 54 Batch 510/1540] avg loss 0.00167793, throughput 2.87835K wps
[Epoch 54 Batch 540/1540] avg loss 0.00156317, throughput 2.872K wps
[Epoch 54 Batch 570/1540] avg loss 0.00151037, throughput 2.87435K wps
[Epoch 54 Batch 600/1540] avg loss 0.00157829, throughput 2.80165K wps
[Epoch 54 Batch 630/1540] avg loss 0.00108632, throughput 2.84868K wps
[Epoch 54 Batch 660/1540] avg loss 0.00177253, throughput 2.83419K wps
[Epoch 54 Batch 690/1540] avg loss 0.00169602, throughput 2.85752K wps
[Epoch 54 Batch 720/1540] avg loss 0.0017772, throughput 2.8811K wps
[Epoch 54 Batch 750/1540] avg loss 0.00169919, throughput 2.87949K wps
[Epoch 54 Batch 780/1540] avg loss 0.00140909, throughput 2.88607K wps
[Epoch 54 Batch 810/1540] avg loss 0.00168464, throughput 2.88158K wps
[Epoch 54 Batch 840/1540] avg loss 0.00155154, throughput 2.86996K wps
[Epoch 54 Batch 870/1540] avg loss 0.00168542, throughput 2.84763K wps
[Epoch 54 Batch 900/1540] avg loss 0.00185692, throughput 2.80756K wps
[Epoch 54 Batch 930/1540] avg loss 0.00184696, throughput 2.86485K wps
[Epoch 54 Batch 960/1540] avg loss 0.00193656, throughput 2.82947K wps
[Epoch 54 Batch 990/1540] avg loss 0.00185081, throughput 2.8521K wps
[Epoch 54 Batch 1020/1540] avg loss 0.00132971, throughput 2.82283K wps
[Epoch 54 Batch 1050/1540] avg loss 0.00161826, throughput 2.8322K wps
[Epoch 54 Batch 1080/1540] avg loss 0.00145201, throughput 2.88581K wps
[Epoch 54 Batch 1110/1540] avg loss 0.00178705, throughput 2.88436K wps
[Epoch 54 Batch 1140/1540] avg loss 0.00189586, throughput 2.85717K wps
[Epoch 54 Batch 1170/1540] avg loss 0.00180082, throughput 2.83546K wps
[Epoch 54 Batch 1200/1540] avg loss 0.00141061, throughput 2.87258K wps
[Epoch 54 Batch 1230/1540] avg loss 0.00157085, throughput 2.86546K wps
[Epoch 54 Batch 1260/1540] avg loss 0.00160421, throughput 2.80864K wps
[Epoch 54 Batch 1290/1540] avg loss 0.00185784, throughput 2.8629K wps
[Epoch 54 Batch 1320/1540] avg loss 0.00169134, throughput 2.8121K wps
[Epoch 54 Batch 1350/1540] avg loss 0.00159699, throughput 2.84051K wps
[Epoch 54 Batch 1380/1540] avg loss 0.00146613, throughput 2.87057K wps
[Epoch 54 Batch 1410/1540] avg loss 0.00151952, throughput 2.81977K wps
[Epoch 54 Batch 1440/1540] avg loss 0.00142099, throughput 2.81522K wps
[Epoch 54 Batch 1470/1540] avg loss 0.00185266, throughput 2.88317K wps
[Epoch 54 Batch 1500/1540] avg loss 0.00148345, throughput 2.82458K wps
[Epoch 54 Batch 1530/1540] avg loss 0.00186429, throughput 2.80659K wps
Begin Testing...
[Epoch 54] train avg loss 0.00159458, dev acc 0.8005, dev avg loss 0.657767, throughput 2.85406K wps
[Epoch 55 Batch 30/1540] avg loss 0.00124492, throughput 2.94217K wps
[Epoch 55 Batch 60/1540] avg loss 0.00147765, throughput 2.87665K wps
[Epoch 55 Batch 90/1540] avg loss 0.0014715, throughput 2.88333K wps
[Epoch 55 Batch 120/1540] avg loss 0.00127482, throughput 2.86448K wps
[Epoch 55 Batch 150/1540] avg loss 0.00158108, throughput 2.88045K wps
[Epoch 55 Batch 180/1540] avg loss 0.00153626, throughput 2.88327K wps
[Epoch 55 Batch 210/1540] avg loss 0.00131076, throughput 2.86745K wps
[Epoch 55 Batch 240/1540] avg loss 0.00130059, throughput 2.87916K wps
[Epoch 55 Batch 270/1540] avg loss 0.00122245, throughput 2.87604K wps
[Epoch 55 Batch 300/1540] avg loss 0.00161689, throughput 2.87422K wps
[Epoch 55 Batch 330/1540] avg loss 0.00148988, throughput 2.883K wps
[Epoch 55 Batch 360/1540] avg loss 0.0014667, throughput 2.85607K wps
[Epoch 55 Batch 390/1540] avg loss 0.00174823, throughput 2.87035K wps
[Epoch 55 Batch 420/1540] avg loss 0.00149389, throughput 2.86326K wps
[Epoch 55 Batch 450/1540] avg loss 0.00179486, throughput 2.87781K wps
[Epoch 55 Batch 480/1540] avg loss 0.00157939, throughput 2.87517K wps
[Epoch 55 Batch 510/1540] avg loss 0.00150466, throughput 2.87598K wps
[Epoch 55 Batch 540/1540] avg loss 0.0013907, throughput 2.87165K wps
[Epoch 55 Batch 570/1540] avg loss 0.00143572, throughput 2.83788K wps
[Epoch 55 Batch 600/1540] avg loss 0.0015909, throughput 2.82607K wps
[Epoch 55 Batch 630/1540] avg loss 0.00160312, throughput 2.88278K wps
[Epoch 55 Batch 660/1540] avg loss 0.00149862, throughput 2.87852K wps
[Epoch 55 Batch 690/1540] avg loss 0.00173266, throughput 2.87597K wps
[Epoch 55 Batch 720/1540] avg loss 0.00148964, throughput 2.79391K wps
[Epoch 55 Batch 750/1540] avg loss 0.0015979, throughput 2.84196K wps
[Epoch 55 Batch 780/1540] avg loss 0.00177361, throughput 2.87524K wps
[Epoch 55 Batch 810/1540] avg loss 0.00160129, throughput 2.87262K wps
[Epoch 55 Batch 840/1540] avg loss 0.0013774, throughput 2.87185K wps
[Epoch 55 Batch 870/1540] avg loss 0.00168366, throughput 2.82126K wps
[Epoch 55 Batch 900/1540] avg loss 0.00148098, throughput 2.79922K wps
[Epoch 55 Batch 930/1540] avg loss 0.0016431, throughput 2.8793K wps
[Epoch 55 Batch 960/1540] avg loss 0.00185475, throughput 2.88677K wps
[Epoch 55 Batch 990/1540] avg loss 0.00207485, throughput 2.87555K wps
[Epoch 55 Batch 1020/1540] avg loss 0.00150112, throughput 2.86345K wps
[Epoch 55 Batch 1050/1540] avg loss 0.00173785, throughput 2.86573K wps
[Epoch 55 Batch 1080/1540] avg loss 0.00136793, throughput 2.879K wps
[Epoch 55 Batch 1110/1540] avg loss 0.00142333, throughput 2.89026K wps
[Epoch 55 Batch 1140/1540] avg loss 0.00143336, throughput 2.88188K wps
[Epoch 55 Batch 1170/1540] avg loss 0.00148153, throughput 2.88846K wps
[Epoch 55 Batch 1200/1540] avg loss 0.00167603, throughput 2.83104K wps
[Epoch 55 Batch 1230/1540] avg loss 0.00159012, throughput 2.88364K wps
[Epoch 55 Batch 1260/1540] avg loss 0.00151897, throughput 2.85706K wps
[Epoch 55 Batch 1290/1540] avg loss 0.00166813, throughput 2.81419K wps
[Epoch 55 Batch 1320/1540] avg loss 0.00161345, throughput 2.80834K wps
[Epoch 55 Batch 1350/1540] avg loss 0.00177007, throughput 2.88157K wps
[Epoch 55 Batch 1380/1540] avg loss 0.00169843, throughput 2.87526K wps
[Epoch 55 Batch 1410/1540] avg loss 0.00175196, throughput 2.87951K wps
[Epoch 55 Batch 1440/1540] avg loss 0.0017585, throughput 2.85879K wps
[Epoch 55 Batch 1470/1540] avg loss 0.00170235, throughput 2.83321K wps
[Epoch 55 Batch 1500/1540] avg loss 0.00170964, throughput 2.84866K wps
[Epoch 55 Batch 1530/1540] avg loss 0.00165325, throughput 2.83324K wps
Begin Testing...
[Epoch 55] train avg loss 0.00156992, dev acc 0.7959, dev avg loss 0.685755, throughput 2.86445K wps
[Epoch 56 Batch 30/1540] avg loss 0.00180244, throughput 2.86188K wps
[Epoch 56 Batch 60/1540] avg loss 0.00105024, throughput 2.88728K wps
[Epoch 56 Batch 90/1540] avg loss 0.0015301, throughput 2.8593K wps
[Epoch 56 Batch 120/1540] avg loss 0.00146804, throughput 2.84137K wps
[Epoch 56 Batch 150/1540] avg loss 0.00129625, throughput 2.86782K wps
[Epoch 56 Batch 180/1540] avg loss 0.00156668, throughput 2.87431K wps
[Epoch 56 Batch 210/1540] avg loss 0.00157356, throughput 2.87594K wps
[Epoch 56 Batch 240/1540] avg loss 0.00163485, throughput 2.86238K wps
[Epoch 56 Batch 270/1540] avg loss 0.00141531, throughput 2.88131K wps
[Epoch 56 Batch 300/1540] avg loss 0.00143207, throughput 2.87271K wps
[Epoch 56 Batch 330/1540] avg loss 0.00162955, throughput 2.8747K wps
[Epoch 56 Batch 360/1540] avg loss 0.00133976, throughput 2.86268K wps
[Epoch 56 Batch 390/1540] avg loss 0.00158179, throughput 2.80506K wps
[Epoch 56 Batch 420/1540] avg loss 0.00168417, throughput 2.87031K wps
[Epoch 56 Batch 450/1540] avg loss 0.00146233, throughput 2.86751K wps
[Epoch 56 Batch 480/1540] avg loss 0.00140249, throughput 2.87294K wps
[Epoch 56 Batch 510/1540] avg loss 0.00155015, throughput 2.87101K wps
[Epoch 56 Batch 540/1540] avg loss 0.00142226, throughput 2.87101K wps
[Epoch 56 Batch 570/1540] avg loss 0.0016842, throughput 2.86902K wps
[Epoch 56 Batch 600/1540] avg loss 0.00188379, throughput 2.86726K wps
[Epoch 56 Batch 630/1540] avg loss 0.00145573, throughput 2.8615K wps
[Epoch 56 Batch 660/1540] avg loss 0.00156801, throughput 2.84122K wps
[Epoch 56 Batch 690/1540] avg loss 0.00164164, throughput 2.85993K wps
[Epoch 56 Batch 720/1540] avg loss 0.00146044, throughput 2.85565K wps
[Epoch 56 Batch 750/1540] avg loss 0.00146909, throughput 2.86088K wps
[Epoch 56 Batch 780/1540] avg loss 0.0020578, throughput 2.77242K wps
[Epoch 56 Batch 810/1540] avg loss 0.00158001, throughput 2.86375K wps
[Epoch 56 Batch 840/1540] avg loss 0.00153885, throughput 2.87653K wps
[Epoch 56 Batch 870/1540] avg loss 0.00148596, throughput 2.8639K wps
[Epoch 56 Batch 900/1540] avg loss 0.00162622, throughput 2.8721K wps
[Epoch 56 Batch 930/1540] avg loss 0.00147645, throughput 2.86784K wps
[Epoch 56 Batch 960/1540] avg loss 0.00136855, throughput 2.87083K wps
[Epoch 56 Batch 990/1540] avg loss 0.00168565, throughput 2.8515K wps
[Epoch 56 Batch 1020/1540] avg loss 0.00167823, throughput 2.82489K wps
[Epoch 56 Batch 1050/1540] avg loss 0.00169685, throughput 2.83455K wps
[Epoch 56 Batch 1080/1540] avg loss 0.00195807, throughput 2.87659K wps
[Epoch 56 Batch 1110/1540] avg loss 0.00159418, throughput 2.85473K wps
[Epoch 56 Batch 1140/1540] avg loss 0.00175116, throughput 2.83794K wps
[Epoch 56 Batch 1170/1540] avg loss 0.00168192, throughput 2.87374K wps
[Epoch 56 Batch 1200/1540] avg loss 0.00147368, throughput 2.83907K wps
[Epoch 56 Batch 1230/1540] avg loss 0.00170464, throughput 2.80119K wps
[Epoch 56 Batch 1260/1540] avg loss 0.00152644, throughput 2.78366K wps
[Epoch 56 Batch 1290/1540] avg loss 0.00141947, throughput 2.83598K wps
[Epoch 56 Batch 1320/1540] avg loss 0.00167867, throughput 2.79508K wps
[Epoch 56 Batch 1350/1540] avg loss 0.00149218, throughput 2.87341K wps
[Epoch 56 Batch 1380/1540] avg loss 0.00177889, throughput 2.87519K wps
[Epoch 56 Batch 1410/1540] avg loss 0.00147678, throughput 2.8847K wps
[Epoch 56 Batch 1440/1540] avg loss 0.00175865, throughput 2.88313K wps
[Epoch 56 Batch 1470/1540] avg loss 0.00149894, throughput 2.84294K wps
[Epoch 56 Batch 1500/1540] avg loss 0.00157985, throughput 2.84399K wps
[Epoch 56 Batch 1530/1540] avg loss 0.00169065, throughput 2.85541K wps
Begin Testing...
[Epoch 56] train avg loss 0.00157215, dev acc 0.8073, dev avg loss 0.657178, throughput 2.85576K wps
[Epoch 57 Batch 30/1540] avg loss 0.00129406, throughput 2.90139K wps
[Epoch 57 Batch 60/1540] avg loss 0.00133932, throughput 2.88339K wps
[Epoch 57 Batch 90/1540] avg loss 0.00155277, throughput 2.884K wps
[Epoch 57 Batch 120/1540] avg loss 0.00154759, throughput 2.87071K wps
[Epoch 57 Batch 150/1540] avg loss 0.00138028, throughput 2.88335K wps
[Epoch 57 Batch 180/1540] avg loss 0.00125524, throughput 2.79425K wps
[Epoch 57 Batch 210/1540] avg loss 0.00139049, throughput 2.85905K wps
[Epoch 57 Batch 240/1540] avg loss 0.00135416, throughput 2.88176K wps
[Epoch 57 Batch 270/1540] avg loss 0.00147437, throughput 2.87061K wps
[Epoch 57 Batch 300/1540] avg loss 0.0017262, throughput 2.86509K wps
[Epoch 57 Batch 330/1540] avg loss 0.00131657, throughput 2.85015K wps
[Epoch 57 Batch 360/1540] avg loss 0.00141367, throughput 2.88182K wps
[Epoch 57 Batch 390/1540] avg loss 0.00142911, throughput 2.88341K wps
[Epoch 57 Batch 420/1540] avg loss 0.00165859, throughput 2.8507K wps
[Epoch 57 Batch 450/1540] avg loss 0.0013082, throughput 2.85843K wps
[Epoch 57 Batch 480/1540] avg loss 0.00169842, throughput 2.80663K wps
[Epoch 57 Batch 510/1540] avg loss 0.00119489, throughput 2.84821K wps
[Epoch 57 Batch 540/1540] avg loss 0.00152175, throughput 2.85803K wps
[Epoch 57 Batch 570/1540] avg loss 0.00137764, throughput 2.85072K wps
[Epoch 57 Batch 600/1540] avg loss 0.00144227, throughput 2.88327K wps
[Epoch 57 Batch 630/1540] avg loss 0.00150098, throughput 2.86997K wps
[Epoch 57 Batch 660/1540] avg loss 0.00111399, throughput 2.85787K wps
[Epoch 57 Batch 690/1540] avg loss 0.00137922, throughput 2.8314K wps
[Epoch 57 Batch 720/1540] avg loss 0.00172716, throughput 2.87603K wps
[Epoch 57 Batch 750/1540] avg loss 0.00162057, throughput 2.81583K wps
[Epoch 57 Batch 780/1540] avg loss 0.0016453, throughput 2.80872K wps
[Epoch 57 Batch 810/1540] avg loss 0.00132312, throughput 2.88822K wps
[Epoch 57 Batch 840/1540] avg loss 0.00178436, throughput 2.88075K wps
[Epoch 57 Batch 870/1540] avg loss 0.00160303, throughput 2.8273K wps
[Epoch 57 Batch 900/1540] avg loss 0.00163372, throughput 2.87672K wps
[Epoch 57 Batch 930/1540] avg loss 0.00186424, throughput 2.86459K wps
[Epoch 57 Batch 960/1540] avg loss 0.00176927, throughput 2.86477K wps
[Epoch 57 Batch 990/1540] avg loss 0.00163969, throughput 2.86864K wps
[Epoch 57 Batch 1020/1540] avg loss 0.00209186, throughput 2.8736K wps
[Epoch 57 Batch 1050/1540] avg loss 0.00158411, throughput 2.87072K wps
[Epoch 57 Batch 1080/1540] avg loss 0.00177683, throughput 2.82401K wps
[Epoch 57 Batch 1110/1540] avg loss 0.00161747, throughput 2.83668K wps
[Epoch 57 Batch 1140/1540] avg loss 0.00145895, throughput 2.84477K wps
[Epoch 57 Batch 1170/1540] avg loss 0.00167422, throughput 2.88238K wps
[Epoch 57 Batch 1200/1540] avg loss 0.00161537, throughput 2.8365K wps
[Epoch 57 Batch 1230/1540] avg loss 0.00164841, throughput 2.81447K wps
[Epoch 57 Batch 1260/1540] avg loss 0.00164964, throughput 2.82555K wps
[Epoch 57 Batch 1290/1540] avg loss 0.00161747, throughput 2.85627K wps
[Epoch 57 Batch 1320/1540] avg loss 0.00179286, throughput 2.85611K wps
[Epoch 57 Batch 1350/1540] avg loss 0.0016082, throughput 2.88363K wps
[Epoch 57 Batch 1380/1540] avg loss 0.0014972, throughput 2.83392K wps
[Epoch 57 Batch 1410/1540] avg loss 0.00192229, throughput 2.84645K wps
[Epoch 57 Batch 1440/1540] avg loss 0.00138704, throughput 2.82374K wps
[Epoch 57 Batch 1470/1540] avg loss 0.00145789, throughput 2.83121K wps
[Epoch 57 Batch 1500/1540] avg loss 0.00170267, throughput 2.87094K wps
[Epoch 57 Batch 1530/1540] avg loss 0.00161501, throughput 2.83726K wps
Begin Testing...
[Epoch 57] train avg loss 0.00154779, dev acc 0.8005, dev avg loss 0.664925, throughput 2.85511K wps
[Epoch 58 Batch 30/1540] avg loss 0.00129303, throughput 2.85846K wps
[Epoch 58 Batch 60/1540] avg loss 0.00113181, throughput 2.86961K wps
[Epoch 58 Batch 90/1540] avg loss 0.00168711, throughput 2.83382K wps
[Epoch 58 Batch 120/1540] avg loss 0.00148442, throughput 2.82927K wps
[Epoch 58 Batch 150/1540] avg loss 0.00142422, throughput 2.88219K wps
[Epoch 58 Batch 180/1540] avg loss 0.00129752, throughput 2.88008K wps
[Epoch 58 Batch 210/1540] avg loss 0.00124683, throughput 2.87841K wps
[Epoch 58 Batch 240/1540] avg loss 0.00137467, throughput 2.86908K wps
[Epoch 58 Batch 270/1540] avg loss 0.00138056, throughput 2.87517K wps
[Epoch 58 Batch 300/1540] avg loss 0.00138423, throughput 2.87K wps
[Epoch 58 Batch 330/1540] avg loss 0.00165849, throughput 2.88302K wps
[Epoch 58 Batch 360/1540] avg loss 0.00151811, throughput 2.86743K wps
[Epoch 58 Batch 390/1540] avg loss 0.00127148, throughput 2.87K wps
[Epoch 58 Batch 420/1540] avg loss 0.00151953, throughput 2.87107K wps
[Epoch 58 Batch 450/1540] avg loss 0.00161737, throughput 2.80169K wps
[Epoch 58 Batch 480/1540] avg loss 0.001325, throughput 2.83576K wps
[Epoch 58 Batch 510/1540] avg loss 0.00168517, throughput 2.85643K wps
[Epoch 58 Batch 540/1540] avg loss 0.0014829, throughput 2.88118K wps
[Epoch 58 Batch 570/1540] avg loss 0.00150121, throughput 2.88089K wps
[Epoch 58 Batch 600/1540] avg loss 0.00169595, throughput 2.88035K wps
[Epoch 58 Batch 630/1540] avg loss 0.00138872, throughput 2.84243K wps
[Epoch 58 Batch 660/1540] avg loss 0.0014494, throughput 2.88051K wps
[Epoch 58 Batch 690/1540] avg loss 0.00151378, throughput 2.84643K wps
[Epoch 58 Batch 720/1540] avg loss 0.00204804, throughput 2.84273K wps
[Epoch 58 Batch 750/1540] avg loss 0.00156839, throughput 2.88487K wps
[Epoch 58 Batch 780/1540] avg loss 0.00127075, throughput 2.88554K wps
[Epoch 58 Batch 810/1540] avg loss 0.00141047, throughput 2.86696K wps
[Epoch 58 Batch 840/1540] avg loss 0.00135412, throughput 2.80089K wps
[Epoch 58 Batch 870/1540] avg loss 0.00153328, throughput 2.79483K wps
[Epoch 58 Batch 900/1540] avg loss 0.00136481, throughput 2.86328K wps
[Epoch 58 Batch 930/1540] avg loss 0.00147852, throughput 2.86779K wps
[Epoch 58 Batch 960/1540] avg loss 0.00172654, throughput 2.8827K wps
[Epoch 58 Batch 990/1540] avg loss 0.00169902, throughput 2.84401K wps
[Epoch 58 Batch 1020/1540] avg loss 0.00136539, throughput 2.84906K wps
[Epoch 58 Batch 1050/1540] avg loss 0.0016565, throughput 2.86984K wps
[Epoch 58 Batch 1080/1540] avg loss 0.00170997, throughput 2.8055K wps
[Epoch 58 Batch 1110/1540] avg loss 0.00146026, throughput 2.86358K wps
[Epoch 58 Batch 1140/1540] avg loss 0.00144474, throughput 2.87833K wps
[Epoch 58 Batch 1170/1540] avg loss 0.00166011, throughput 2.87509K wps
[Epoch 58 Batch 1200/1540] avg loss 0.00172343, throughput 2.88205K wps
[Epoch 58 Batch 1230/1540] avg loss 0.00140404, throughput 2.87473K wps
[Epoch 58 Batch 1260/1540] avg loss 0.00157241, throughput 2.83549K wps
[Epoch 58 Batch 1290/1540] avg loss 0.00149957, throughput 2.80755K wps
[Epoch 58 Batch 1320/1540] avg loss 0.00153691, throughput 2.8537K wps
[Epoch 58 Batch 1350/1540] avg loss 0.0015925, throughput 2.82142K wps
[Epoch 58 Batch 1380/1540] avg loss 0.00166416, throughput 2.79352K wps
[Epoch 58 Batch 1410/1540] avg loss 0.00181628, throughput 2.86475K wps
[Epoch 58 Batch 1440/1540] avg loss 0.00153643, throughput 2.84471K wps
[Epoch 58 Batch 1470/1540] avg loss 0.00146927, throughput 2.81547K wps
[Epoch 58 Batch 1500/1540] avg loss 0.00180491, throughput 2.84358K wps
[Epoch 58 Batch 1530/1540] avg loss 0.00144835, throughput 2.87319K wps
Begin Testing...
[Epoch 58] train avg loss 0.00151459, dev acc 0.8039, dev avg loss 0.684326, throughput 2.85525K wps
[Epoch 59 Batch 30/1540] avg loss 0.00145384, throughput 2.85579K wps
[Epoch 59 Batch 60/1540] avg loss 0.00143124, throughput 2.86851K wps
[Epoch 59 Batch 90/1540] avg loss 0.00116401, throughput 2.84883K wps
[Epoch 59 Batch 120/1540] avg loss 0.00143982, throughput 2.87951K wps
[Epoch 59 Batch 150/1540] avg loss 0.0014341, throughput 2.87778K wps
[Epoch 59 Batch 180/1540] avg loss 0.00122985, throughput 2.79998K wps
[Epoch 59 Batch 210/1540] avg loss 0.00153862, throughput 2.83904K wps
[Epoch 59 Batch 240/1540] avg loss 0.00132901, throughput 2.82556K wps
[Epoch 59 Batch 270/1540] avg loss 0.00140804, throughput 2.84223K wps
[Epoch 59 Batch 300/1540] avg loss 0.00145515, throughput 2.86795K wps
[Epoch 59 Batch 330/1540] avg loss 0.00157652, throughput 2.85145K wps
[Epoch 59 Batch 360/1540] avg loss 0.00135847, throughput 2.87217K wps
[Epoch 59 Batch 390/1540] avg loss 0.00158372, throughput 2.88692K wps
[Epoch 59 Batch 420/1540] avg loss 0.00147964, throughput 2.88757K wps
[Epoch 59 Batch 450/1540] avg loss 0.00136952, throughput 2.87489K wps
[Epoch 59 Batch 480/1540] avg loss 0.00140544, throughput 2.87945K wps
[Epoch 59 Batch 510/1540] avg loss 0.00160071, throughput 2.8827K wps
[Epoch 59 Batch 540/1540] avg loss 0.00136304, throughput 2.88699K wps
[Epoch 59 Batch 570/1540] avg loss 0.00140471, throughput 2.84877K wps
[Epoch 59 Batch 600/1540] avg loss 0.00138006, throughput 2.84303K wps
[Epoch 59 Batch 630/1540] avg loss 0.00188352, throughput 2.86643K wps
[Epoch 59 Batch 660/1540] avg loss 0.00152358, throughput 2.8837K wps
[Epoch 59 Batch 690/1540] avg loss 0.0013352, throughput 2.87859K wps
[Epoch 59 Batch 720/1540] avg loss 0.00152586, throughput 2.88133K wps
[Epoch 59 Batch 750/1540] avg loss 0.00156961, throughput 2.87534K wps
[Epoch 59 Batch 780/1540] avg loss 0.00143647, throughput 2.85028K wps
[Epoch 59 Batch 810/1540] avg loss 0.00146483, throughput 2.86558K wps
[Epoch 59 Batch 840/1540] avg loss 0.00151164, throughput 2.88385K wps
[Epoch 59 Batch 870/1540] avg loss 0.00156588, throughput 2.88141K wps
[Epoch 59 Batch 900/1540] avg loss 0.00137261, throughput 2.88307K wps
[Epoch 59 Batch 930/1540] avg loss 0.00170766, throughput 2.858K wps
[Epoch 59 Batch 960/1540] avg loss 0.0013793, throughput 2.88333K wps
[Epoch 59 Batch 990/1540] avg loss 0.00138645, throughput 2.87969K wps
[Epoch 59 Batch 1020/1540] avg loss 0.00183637, throughput 2.85528K wps
[Epoch 59 Batch 1050/1540] avg loss 0.00165778, throughput 2.83266K wps
[Epoch 59 Batch 1080/1540] avg loss 0.00162576, throughput 2.8038K wps
[Epoch 59 Batch 1110/1540] avg loss 0.00165606, throughput 2.85031K wps
[Epoch 59 Batch 1140/1540] avg loss 0.00140849, throughput 2.8768K wps
[Epoch 59 Batch 1170/1540] avg loss 0.00161777, throughput 2.88153K wps
[Epoch 59 Batch 1200/1540] avg loss 0.00131224, throughput 2.86136K wps
[Epoch 59 Batch 1230/1540] avg loss 0.00187434, throughput 2.808K wps
[Epoch 59 Batch 1260/1540] avg loss 0.001587, throughput 2.87115K wps
[Epoch 59 Batch 1290/1540] avg loss 0.00183639, throughput 2.88597K wps
[Epoch 59 Batch 1320/1540] avg loss 0.00179215, throughput 2.88217K wps
[Epoch 59 Batch 1350/1540] avg loss 0.00157088, throughput 2.8781K wps
[Epoch 59 Batch 1380/1540] avg loss 0.00178483, throughput 2.88048K wps
[Epoch 59 Batch 1410/1540] avg loss 0.00152591, throughput 2.84313K wps
[Epoch 59 Batch 1440/1540] avg loss 0.00141969, throughput 2.80303K wps
[Epoch 59 Batch 1470/1540] avg loss 0.00139359, throughput 2.86278K wps
[Epoch 59 Batch 1500/1540] avg loss 0.00162533, throughput 2.87786K wps
[Epoch 59 Batch 1530/1540] avg loss 0.0013556, throughput 2.85951K wps
Begin Testing...
[Epoch 59] train avg loss 0.00150726, dev acc 0.7959, dev avg loss 0.676562, throughput 2.86252K wps
[Epoch 60 Batch 30/1540] avg loss 0.00120245, throughput 2.90566K wps
[Epoch 60 Batch 60/1540] avg loss 0.00137074, throughput 2.85587K wps
[Epoch 60 Batch 90/1540] avg loss 0.00128877, throughput 2.87844K wps
[Epoch 60 Batch 120/1540] avg loss 0.00125785, throughput 2.87349K wps
[Epoch 60 Batch 150/1540] avg loss 0.00141898, throughput 2.8439K wps
[Epoch 60 Batch 180/1540] avg loss 0.00126264, throughput 2.8512K wps
[Epoch 60 Batch 210/1540] avg loss 0.00120799, throughput 2.84115K wps
[Epoch 60 Batch 240/1540] avg loss 0.00132141, throughput 2.86506K wps
[Epoch 60 Batch 270/1540] avg loss 0.00157662, throughput 2.85713K wps
[Epoch 60 Batch 300/1540] avg loss 0.00131525, throughput 2.88203K wps
[Epoch 60 Batch 330/1540] avg loss 0.00146616, throughput 2.885K wps
[Epoch 60 Batch 360/1540] avg loss 0.00122601, throughput 2.8866K wps
[Epoch 60 Batch 390/1540] avg loss 0.00167913, throughput 2.88201K wps
[Epoch 60 Batch 420/1540] avg loss 0.00136496, throughput 2.87522K wps
[Epoch 60 Batch 450/1540] avg loss 0.00127847, throughput 2.86898K wps
[Epoch 60 Batch 480/1540] avg loss 0.00159243, throughput 2.84925K wps
[Epoch 60 Batch 510/1540] avg loss 0.00119511, throughput 2.87089K wps
[Epoch 60 Batch 540/1540] avg loss 0.00159871, throughput 2.84967K wps
[Epoch 60 Batch 570/1540] avg loss 0.00172966, throughput 2.87777K wps
[Epoch 60 Batch 600/1540] avg loss 0.00144906, throughput 2.87777K wps
[Epoch 60 Batch 630/1540] avg loss 0.00138828, throughput 2.85421K wps
[Epoch 60 Batch 660/1540] avg loss 0.0016171, throughput 2.80197K wps
[Epoch 60 Batch 690/1540] avg loss 0.00142942, throughput 2.81281K wps
[Epoch 60 Batch 720/1540] avg loss 0.00160852, throughput 2.85536K wps
[Epoch 60 Batch 750/1540] avg loss 0.00165803, throughput 2.88133K wps
[Epoch 60 Batch 780/1540] avg loss 0.00145743, throughput 2.8776K wps
[Epoch 60 Batch 810/1540] avg loss 0.00107512, throughput 2.84693K wps
[Epoch 60 Batch 840/1540] avg loss 0.00165124, throughput 2.8666K wps
[Epoch 60 Batch 870/1540] avg loss 0.00157041, throughput 2.87031K wps
[Epoch 60 Batch 900/1540] avg loss 0.00132127, throughput 2.85795K wps
[Epoch 60 Batch 930/1540] avg loss 0.00132974, throughput 2.87086K wps
[Epoch 60 Batch 960/1540] avg loss 0.00193235, throughput 2.81055K wps
[Epoch 60 Batch 990/1540] avg loss 0.00127326, throughput 2.86677K wps
[Epoch 60 Batch 1020/1540] avg loss 0.00132862, throughput 2.86278K wps
[Epoch 60 Batch 1050/1540] avg loss 0.00146038, throughput 2.78755K wps
[Epoch 60 Batch 1080/1540] avg loss 0.00171618, throughput 2.8044K wps
[Epoch 60 Batch 1110/1540] avg loss 0.00143493, throughput 2.80335K wps
[Epoch 60 Batch 1140/1540] avg loss 0.00170767, throughput 2.83207K wps
[Epoch 60 Batch 1170/1540] avg loss 0.00170345, throughput 2.87742K wps
[Epoch 60 Batch 1200/1540] avg loss 0.00183156, throughput 2.88353K wps
[Epoch 60 Batch 1230/1540] avg loss 0.00150363, throughput 2.87424K wps
[Epoch 60 Batch 1260/1540] avg loss 0.00173297, throughput 2.87826K wps
[Epoch 60 Batch 1290/1540] avg loss 0.00176204, throughput 2.87485K wps
[Epoch 60 Batch 1320/1540] avg loss 0.00151444, throughput 2.84072K wps
[Epoch 60 Batch 1350/1540] avg loss 0.00153623, throughput 2.87639K wps
[Epoch 60 Batch 1380/1540] avg loss 0.00132984, throughput 2.86083K wps
[Epoch 60 Batch 1410/1540] avg loss 0.00181687, throughput 2.80846K wps
[Epoch 60 Batch 1440/1540] avg loss 0.00143378, throughput 2.87494K wps
[Epoch 60 Batch 1470/1540] avg loss 0.00150053, throughput 2.88486K wps
[Epoch 60 Batch 1500/1540] avg loss 0.00155848, throughput 2.88407K wps
[Epoch 60 Batch 1530/1540] avg loss 0.00154024, throughput 2.86852K wps
Begin Testing...
[Epoch 60] train avg loss 0.00148106, dev acc 0.7970, dev avg loss 0.69161, throughput 2.85874K wps
[Epoch 61 Batch 30/1540] avg loss 0.00131478, throughput 2.94079K wps
[Epoch 61 Batch 60/1540] avg loss 0.00117909, throughput 2.88309K wps
[Epoch 61 Batch 90/1540] avg loss 0.00132449, throughput 2.8644K wps
[Epoch 61 Batch 120/1540] avg loss 0.00138634, throughput 2.86265K wps
[Epoch 61 Batch 150/1540] avg loss 0.00126874, throughput 2.80704K wps
[Epoch 61 Batch 180/1540] avg loss 0.00140365, throughput 2.85976K wps
[Epoch 61 Batch 210/1540] avg loss 0.00146773, throughput 2.82958K wps
[Epoch 61 Batch 240/1540] avg loss 0.00146206, throughput 2.80376K wps
[Epoch 61 Batch 270/1540] avg loss 0.00140736, throughput 2.84261K wps
[Epoch 61 Batch 300/1540] avg loss 0.00168363, throughput 2.88317K wps
[Epoch 61 Batch 330/1540] avg loss 0.00140963, throughput 2.87256K wps
[Epoch 61 Batch 360/1540] avg loss 0.00131855, throughput 2.8763K wps
[Epoch 61 Batch 390/1540] avg loss 0.00137739, throughput 2.84741K wps
[Epoch 61 Batch 420/1540] avg loss 0.0011672, throughput 2.85129K wps
[Epoch 61 Batch 450/1540] avg loss 0.00151568, throughput 2.8817K wps
[Epoch 61 Batch 480/1540] avg loss 0.00120829, throughput 2.8761K wps
[Epoch 61 Batch 510/1540] avg loss 0.00156115, throughput 2.87526K wps
[Epoch 61 Batch 540/1540] avg loss 0.00158817, throughput 2.87552K wps
[Epoch 61 Batch 570/1540] avg loss 0.00171521, throughput 2.86958K wps
[Epoch 61 Batch 600/1540] avg loss 0.00143131, throughput 2.86281K wps
[Epoch 61 Batch 630/1540] avg loss 0.00138841, throughput 2.85439K wps
[Epoch 61 Batch 660/1540] avg loss 0.00171108, throughput 2.88492K wps
[Epoch 61 Batch 690/1540] avg loss 0.00164868, throughput 2.8861K wps
[Epoch 61 Batch 720/1540] avg loss 0.00176892, throughput 2.79362K wps
[Epoch 61 Batch 750/1540] avg loss 0.00163437, throughput 2.80869K wps
[Epoch 61 Batch 780/1540] avg loss 0.00159856, throughput 2.8753K wps
[Epoch 61 Batch 810/1540] avg loss 0.00114459, throughput 2.86836K wps
[Epoch 61 Batch 840/1540] avg loss 0.00157669, throughput 2.84343K wps
[Epoch 61 Batch 870/1540] avg loss 0.00156843, throughput 2.88413K wps
[Epoch 61 Batch 900/1540] avg loss 0.00174577, throughput 2.88986K wps
[Epoch 61 Batch 930/1540] avg loss 0.00104375, throughput 2.86718K wps
[Epoch 61 Batch 960/1540] avg loss 0.00129181, throughput 2.83703K wps
[Epoch 61 Batch 990/1540] avg loss 0.00150291, throughput 2.87685K wps
[Epoch 61 Batch 1020/1540] avg loss 0.00163178, throughput 2.80451K wps
[Epoch 61 Batch 1050/1540] avg loss 0.00156491, throughput 2.85209K wps
[Epoch 61 Batch 1080/1540] avg loss 0.00151249, throughput 2.88075K wps
[Epoch 61 Batch 1110/1540] avg loss 0.00142286, throughput 2.88792K wps
[Epoch 61 Batch 1140/1540] avg loss 0.00151636, throughput 2.87864K wps
[Epoch 61 Batch 1170/1540] avg loss 0.00162214, throughput 2.8719K wps
[Epoch 61 Batch 1200/1540] avg loss 0.00169515, throughput 2.8652K wps
[Epoch 61 Batch 1230/1540] avg loss 0.00161447, throughput 2.8497K wps
[Epoch 61 Batch 1260/1540] avg loss 0.00192721, throughput 2.84378K wps
[Epoch 61 Batch 1290/1540] avg loss 0.00151312, throughput 2.86872K wps
[Epoch 61 Batch 1320/1540] avg loss 0.0016705, throughput 2.87906K wps
[Epoch 61 Batch 1350/1540] avg loss 0.00172396, throughput 2.87306K wps
[Epoch 61 Batch 1380/1540] avg loss 0.0012977, throughput 2.86888K wps
[Epoch 61 Batch 1410/1540] avg loss 0.00156535, throughput 2.84118K wps
[Epoch 61 Batch 1440/1540] avg loss 0.0011826, throughput 2.79363K wps
[Epoch 61 Batch 1470/1540] avg loss 0.0013929, throughput 2.78764K wps
[Epoch 61 Batch 1500/1540] avg loss 0.00133268, throughput 2.80173K wps
[Epoch 61 Batch 1530/1540] avg loss 0.00159632, throughput 2.8706K wps
Begin Testing...
[Epoch 61] train avg loss 0.00148174, dev acc 0.8050, dev avg loss 0.692253, throughput 2.85759K wps
[Epoch 62 Batch 30/1540] avg loss 0.0014608, throughput 2.92165K wps
[Epoch 62 Batch 60/1540] avg loss 0.00139396, throughput 2.89025K wps
[Epoch 62 Batch 90/1540] avg loss 0.00130864, throughput 2.88545K wps
[Epoch 62 Batch 120/1540] avg loss 0.00148001, throughput 2.83477K wps
[Epoch 62 Batch 150/1540] avg loss 0.00158948, throughput 2.88042K wps
[Epoch 62 Batch 180/1540] avg loss 0.00161449, throughput 2.87582K wps
[Epoch 62 Batch 210/1540] avg loss 0.00113817, throughput 2.83337K wps
[Epoch 62 Batch 240/1540] avg loss 0.0012825, throughput 2.80321K wps
[Epoch 62 Batch 270/1540] avg loss 0.0012889, throughput 2.83398K wps
[Epoch 62 Batch 300/1540] avg loss 0.00132653, throughput 2.88194K wps
[Epoch 62 Batch 330/1540] avg loss 0.00135628, throughput 2.88002K wps
[Epoch 62 Batch 360/1540] avg loss 0.00131182, throughput 2.88305K wps
[Epoch 62 Batch 390/1540] avg loss 0.00140409, throughput 2.87318K wps
[Epoch 62 Batch 420/1540] avg loss 0.00148405, throughput 2.87951K wps
[Epoch 62 Batch 450/1540] avg loss 0.00135808, throughput 2.87499K wps
[Epoch 62 Batch 480/1540] avg loss 0.00155737, throughput 2.86941K wps
[Epoch 62 Batch 510/1540] avg loss 0.00157236, throughput 2.86635K wps
[Epoch 62 Batch 540/1540] avg loss 0.00115881, throughput 2.87332K wps
[Epoch 62 Batch 570/1540] avg loss 0.0010958, throughput 2.87222K wps
[Epoch 62 Batch 600/1540] avg loss 0.00144549, throughput 2.8689K wps
[Epoch 62 Batch 630/1540] avg loss 0.00133805, throughput 2.87077K wps
[Epoch 62 Batch 660/1540] avg loss 0.00136056, throughput 2.86781K wps
[Epoch 62 Batch 690/1540] avg loss 0.0014986, throughput 2.83742K wps
[Epoch 62 Batch 720/1540] avg loss 0.00114309, throughput 2.88658K wps
[Epoch 62 Batch 750/1540] avg loss 0.00143869, throughput 2.88241K wps
[Epoch 62 Batch 780/1540] avg loss 0.00162726, throughput 2.87088K wps
[Epoch 62 Batch 810/1540] avg loss 0.00141126, throughput 2.8821K wps
[Epoch 62 Batch 840/1540] avg loss 0.00167746, throughput 2.88886K wps
[Epoch 62 Batch 870/1540] avg loss 0.00150443, throughput 2.88728K wps
[Epoch 62 Batch 900/1540] avg loss 0.00155171, throughput 2.87555K wps
[Epoch 62 Batch 930/1540] avg loss 0.00174564, throughput 2.8744K wps
[Epoch 62 Batch 960/1540] avg loss 0.0015592, throughput 2.88285K wps
[Epoch 62 Batch 990/1540] avg loss 0.00159293, throughput 2.88175K wps
[Epoch 62 Batch 1020/1540] avg loss 0.00113801, throughput 2.87906K wps
[Epoch 62 Batch 1050/1540] avg loss 0.0015816, throughput 2.8716K wps
[Epoch 62 Batch 1080/1540] avg loss 0.00142941, throughput 2.87067K wps
[Epoch 62 Batch 1110/1540] avg loss 0.0017649, throughput 2.80366K wps
[Epoch 62 Batch 1140/1540] avg loss 0.00178137, throughput 2.85208K wps
[Epoch 62 Batch 1170/1540] avg loss 0.00140872, throughput 2.84158K wps
[Epoch 62 Batch 1200/1540] avg loss 0.00147524, throughput 2.87764K wps
[Epoch 62 Batch 1230/1540] avg loss 0.00135903, throughput 2.87695K wps
[Epoch 62 Batch 1260/1540] avg loss 0.00154432, throughput 2.87553K wps
[Epoch 62 Batch 1290/1540] avg loss 0.00167385, throughput 2.88205K wps
[Epoch 62 Batch 1320/1540] avg loss 0.00172234, throughput 2.87754K wps
[Epoch 62 Batch 1350/1540] avg loss 0.00146875, throughput 2.884K wps
[Epoch 62 Batch 1380/1540] avg loss 0.00138098, throughput 2.88698K wps
[Epoch 62 Batch 1410/1540] avg loss 0.00134596, throughput 2.83201K wps
[Epoch 62 Batch 1440/1540] avg loss 0.00147188, throughput 2.82777K wps
[Epoch 62 Batch 1470/1540] avg loss 0.00129315, throughput 2.88291K wps
[Epoch 62 Batch 1500/1540] avg loss 0.00186492, throughput 2.82783K wps
[Epoch 62 Batch 1530/1540] avg loss 0.00142341, throughput 2.86984K wps
Begin Testing...
[Epoch 62] train avg loss 0.00145591, dev acc 0.7936, dev avg loss 0.693543, throughput 2.86815K wps
[Epoch 63 Batch 30/1540] avg loss 0.00138637, throughput 2.89955K wps
[Epoch 63 Batch 60/1540] avg loss 0.00134032, throughput 2.88748K wps
[Epoch 63 Batch 90/1540] avg loss 0.00104969, throughput 2.87956K wps
[Epoch 63 Batch 120/1540] avg loss 0.00121618, throughput 2.88255K wps
[Epoch 63 Batch 150/1540] avg loss 0.00116692, throughput 2.87174K wps
[Epoch 63 Batch 180/1540] avg loss 0.00122934, throughput 2.87306K wps
[Epoch 63 Batch 210/1540] avg loss 0.00126226, throughput 2.86195K wps
[Epoch 63 Batch 240/1540] avg loss 0.00149916, throughput 2.80273K wps
[Epoch 63 Batch 270/1540] avg loss 0.00113927, throughput 2.8021K wps
[Epoch 63 Batch 300/1540] avg loss 0.0011117, throughput 2.84091K wps
[Epoch 63 Batch 330/1540] avg loss 0.00104884, throughput 2.84041K wps
[Epoch 63 Batch 360/1540] avg loss 0.00150771, throughput 2.87184K wps
[Epoch 63 Batch 390/1540] avg loss 0.00154229, throughput 2.86519K wps
[Epoch 63 Batch 420/1540] avg loss 0.00127385, throughput 2.83782K wps
[Epoch 63 Batch 450/1540] avg loss 0.00136837, throughput 2.86213K wps
[Epoch 63 Batch 480/1540] avg loss 0.00155353, throughput 2.88213K wps
[Epoch 63 Batch 510/1540] avg loss 0.00146031, throughput 2.88643K wps
[Epoch 63 Batch 540/1540] avg loss 0.00120304, throughput 2.87815K wps
[Epoch 63 Batch 570/1540] avg loss 0.00119945, throughput 2.88073K wps
[Epoch 63 Batch 600/1540] avg loss 0.00128824, throughput 2.82694K wps
[Epoch 63 Batch 630/1540] avg loss 0.00145563, throughput 2.83179K wps
[Epoch 63 Batch 660/1540] avg loss 0.0015314, throughput 2.87304K wps
[Epoch 63 Batch 690/1540] avg loss 0.00139662, throughput 2.82344K wps
[Epoch 63 Batch 720/1540] avg loss 0.00148877, throughput 2.8759K wps
[Epoch 63 Batch 750/1540] avg loss 0.00140208, throughput 2.8804K wps
[Epoch 63 Batch 780/1540] avg loss 0.00131155, throughput 2.88282K wps
[Epoch 63 Batch 810/1540] avg loss 0.00169101, throughput 2.88817K wps
[Epoch 63 Batch 840/1540] avg loss 0.00141596, throughput 2.87956K wps
[Epoch 63 Batch 870/1540] avg loss 0.00160579, throughput 2.85719K wps
[Epoch 63 Batch 900/1540] avg loss 0.00131012, throughput 2.88552K wps
[Epoch 63 Batch 930/1540] avg loss 0.00206336, throughput 2.87453K wps
[Epoch 63 Batch 960/1540] avg loss 0.00144444, throughput 2.83439K wps
[Epoch 63 Batch 990/1540] avg loss 0.00156808, throughput 2.83647K wps
[Epoch 63 Batch 1020/1540] avg loss 0.00154591, throughput 2.83812K wps
[Epoch 63 Batch 1050/1540] avg loss 0.00137975, throughput 2.85648K wps
[Epoch 63 Batch 1080/1540] avg loss 0.0014682, throughput 2.85223K wps
[Epoch 63 Batch 1110/1540] avg loss 0.00165528, throughput 2.8628K wps
[Epoch 63 Batch 1140/1540] avg loss 0.00142698, throughput 2.88403K wps
[Epoch 63 Batch 1170/1540] avg loss 0.00123293, throughput 2.86632K wps
[Epoch 63 Batch 1200/1540] avg loss 0.00177847, throughput 2.86481K wps
[Epoch 63 Batch 1230/1540] avg loss 0.00147326, throughput 2.82887K wps
[Epoch 63 Batch 1260/1540] avg loss 0.00148242, throughput 2.86474K wps
[Epoch 63 Batch 1290/1540] avg loss 0.00156482, throughput 2.8835K wps
[Epoch 63 Batch 1320/1540] avg loss 0.00182512, throughput 2.87427K wps
[Epoch 63 Batch 1350/1540] avg loss 0.00177525, throughput 2.87688K wps
[Epoch 63 Batch 1380/1540] avg loss 0.00150945, throughput 2.81666K wps
[Epoch 63 Batch 1410/1540] avg loss 0.00155303, throughput 2.83051K wps
[Epoch 63 Batch 1440/1540] avg loss 0.00125028, throughput 2.81601K wps
[Epoch 63 Batch 1470/1540] avg loss 0.00145952, throughput 2.86639K wps
[Epoch 63 Batch 1500/1540] avg loss 0.00189058, throughput 2.83066K wps
[Epoch 63 Batch 1530/1540] avg loss 0.00176596, throughput 2.88222K wps
Begin Testing...
[Epoch 63] train avg loss 0.00144307, dev acc 0.7982, dev avg loss 0.701463, throughput 2.85976K wps
[Epoch 64 Batch 30/1540] avg loss 0.00117769, throughput 2.9385K wps
[Epoch 64 Batch 60/1540] avg loss 0.00105273, throughput 2.8767K wps
[Epoch 64 Batch 90/1540] avg loss 0.00133862, throughput 2.88633K wps
[Epoch 64 Batch 120/1540] avg loss 0.00133198, throughput 2.87575K wps
[Epoch 64 Batch 150/1540] avg loss 0.00134809, throughput 2.86167K wps
[Epoch 64 Batch 180/1540] avg loss 0.00149852, throughput 2.87512K wps
[Epoch 64 Batch 210/1540] avg loss 0.00129664, throughput 2.87205K wps
[Epoch 64 Batch 240/1540] avg loss 0.00130449, throughput 2.8572K wps
[Epoch 64 Batch 270/1540] avg loss 0.00147784, throughput 2.80031K wps
[Epoch 64 Batch 300/1540] avg loss 0.000978645, throughput 2.8115K wps
[Epoch 64 Batch 330/1540] avg loss 0.00121831, throughput 2.84587K wps
[Epoch 64 Batch 360/1540] avg loss 0.00141165, throughput 2.81797K wps
[Epoch 64 Batch 390/1540] avg loss 0.00135575, throughput 2.87736K wps
[Epoch 64 Batch 420/1540] avg loss 0.00159126, throughput 2.84174K wps
[Epoch 64 Batch 450/1540] avg loss 0.00122625, throughput 2.80295K wps
[Epoch 64 Batch 480/1540] avg loss 0.00159038, throughput 2.87636K wps
[Epoch 64 Batch 510/1540] avg loss 0.00157439, throughput 2.84765K wps
[Epoch 64 Batch 540/1540] avg loss 0.00178447, throughput 2.8624K wps
[Epoch 64 Batch 570/1540] avg loss 0.00151507, throughput 2.88425K wps
[Epoch 64 Batch 600/1540] avg loss 0.00149407, throughput 2.87679K wps
[Epoch 64 Batch 630/1540] avg loss 0.00119697, throughput 2.86501K wps
[Epoch 64 Batch 660/1540] avg loss 0.00145981, throughput 2.8453K wps
[Epoch 64 Batch 690/1540] avg loss 0.00124368, throughput 2.80698K wps
[Epoch 64 Batch 720/1540] avg loss 0.00143419, throughput 2.87793K wps
[Epoch 64 Batch 750/1540] avg loss 0.00135994, throughput 2.874K wps
[Epoch 64 Batch 780/1540] avg loss 0.00135243, throughput 2.87837K wps
[Epoch 64 Batch 810/1540] avg loss 0.00142273, throughput 2.88021K wps
[Epoch 64 Batch 840/1540] avg loss 0.00136815, throughput 2.86895K wps
[Epoch 64 Batch 870/1540] avg loss 0.00129468, throughput 2.82776K wps
[Epoch 64 Batch 900/1540] avg loss 0.00146663, throughput 2.80377K wps
[Epoch 64 Batch 930/1540] avg loss 0.0015077, throughput 2.87689K wps
[Epoch 64 Batch 960/1540] avg loss 0.00148238, throughput 2.84893K wps
[Epoch 64 Batch 990/1540] avg loss 0.00154602, throughput 2.88033K wps
[Epoch 64 Batch 1020/1540] avg loss 0.00137776, throughput 2.87609K wps
[Epoch 64 Batch 1050/1540] avg loss 0.00138246, throughput 2.87598K wps
[Epoch 64 Batch 1080/1540] avg loss 0.00174767, throughput 2.87554K wps
[Epoch 64 Batch 1110/1540] avg loss 0.00164823, throughput 2.87847K wps
[Epoch 64 Batch 1140/1540] avg loss 0.00159439, throughput 2.83226K wps
[Epoch 64 Batch 1170/1540] avg loss 0.00141982, throughput 2.87407K wps
[Epoch 64 Batch 1200/1540] avg loss 0.00133075, throughput 2.793K wps
[Epoch 64 Batch 1230/1540] avg loss 0.00146379, throughput 2.81158K wps
[Epoch 64 Batch 1260/1540] avg loss 0.00156105, throughput 2.86784K wps
[Epoch 64 Batch 1290/1540] avg loss 0.0012701, throughput 2.86829K wps
[Epoch 64 Batch 1320/1540] avg loss 0.00150198, throughput 2.87024K wps
[Epoch 64 Batch 1350/1540] avg loss 0.0013165, throughput 2.85929K wps
[Epoch 64 Batch 1380/1540] avg loss 0.00139111, throughput 2.87207K wps
[Epoch 64 Batch 1410/1540] avg loss 0.00130643, throughput 2.84801K wps
[Epoch 64 Batch 1440/1540] avg loss 0.00176947, throughput 2.86659K wps
[Epoch 64 Batch 1470/1540] avg loss 0.00128754, throughput 2.87209K wps
[Epoch 64 Batch 1500/1540] avg loss 0.00146498, throughput 2.85767K wps
[Epoch 64 Batch 1530/1540] avg loss 0.00123243, throughput 2.87921K wps
Begin Testing...
[Epoch 64] train avg loss 0.00140469, dev acc 0.7982, dev avg loss 0.705999, throughput 2.85859K wps
[Epoch 65 Batch 30/1540] avg loss 0.00135864, throughput 2.86169K wps
[Epoch 65 Batch 60/1540] avg loss 0.00116708, throughput 2.84618K wps
[Epoch 65 Batch 90/1540] avg loss 0.0011244, throughput 2.88195K wps
[Epoch 65 Batch 120/1540] avg loss 0.0015675, throughput 2.85975K wps
[Epoch 65 Batch 150/1540] avg loss 0.00134793, throughput 2.87694K wps
[Epoch 65 Batch 180/1540] avg loss 0.00121742, throughput 2.87982K wps
[Epoch 65 Batch 210/1540] avg loss 0.00160864, throughput 2.8753K wps
[Epoch 65 Batch 240/1540] avg loss 0.00110615, throughput 2.87081K wps
[Epoch 65 Batch 270/1540] avg loss 0.00172414, throughput 2.82316K wps
[Epoch 65 Batch 300/1540] avg loss 0.00124927, throughput 2.81787K wps
[Epoch 65 Batch 330/1540] avg loss 0.0013517, throughput 2.86386K wps
[Epoch 65 Batch 360/1540] avg loss 0.00146411, throughput 2.85726K wps
[Epoch 65 Batch 390/1540] avg loss 0.00132283, throughput 2.80253K wps
[Epoch 65 Batch 420/1540] avg loss 0.00119892, throughput 2.87759K wps
[Epoch 65 Batch 450/1540] avg loss 0.00150975, throughput 2.86186K wps
[Epoch 65 Batch 480/1540] avg loss 0.00141949, throughput 2.86194K wps
[Epoch 65 Batch 510/1540] avg loss 0.00137127, throughput 2.87699K wps
[Epoch 65 Batch 540/1540] avg loss 0.00141181, throughput 2.88105K wps
[Epoch 65 Batch 570/1540] avg loss 0.00142723, throughput 2.85221K wps
[Epoch 65 Batch 600/1540] avg loss 0.00169488, throughput 2.87258K wps
[Epoch 65 Batch 630/1540] avg loss 0.00129474, throughput 2.87877K wps
[Epoch 65 Batch 660/1540] avg loss 0.00170231, throughput 2.87048K wps
[Epoch 65 Batch 690/1540] avg loss 0.00141203, throughput 2.84175K wps
[Epoch 65 Batch 720/1540] avg loss 0.00138896, throughput 2.87316K wps
[Epoch 65 Batch 750/1540] avg loss 0.00133425, throughput 2.85649K wps
[Epoch 65 Batch 780/1540] avg loss 0.00124187, throughput 2.86494K wps
[Epoch 65 Batch 810/1540] avg loss 0.00137831, throughput 2.87852K wps
[Epoch 65 Batch 840/1540] avg loss 0.00105445, throughput 2.87955K wps
[Epoch 65 Batch 870/1540] avg loss 0.00135916, throughput 2.87503K wps
[Epoch 65 Batch 900/1540] avg loss 0.00153359, throughput 2.88337K wps
[Epoch 65 Batch 930/1540] avg loss 0.00136313, throughput 2.87167K wps
[Epoch 65 Batch 960/1540] avg loss 0.00121467, throughput 2.88571K wps
[Epoch 65 Batch 990/1540] avg loss 0.00124894, throughput 2.87564K wps
[Epoch 65 Batch 1020/1540] avg loss 0.00156046, throughput 2.88027K wps
[Epoch 65 Batch 1050/1540] avg loss 0.00135905, throughput 2.8521K wps
[Epoch 65 Batch 1080/1540] avg loss 0.00169769, throughput 2.82365K wps
[Epoch 65 Batch 1110/1540] avg loss 0.00151309, throughput 2.8764K wps
[Epoch 65 Batch 1140/1540] avg loss 0.00132438, throughput 2.88522K wps
[Epoch 65 Batch 1170/1540] avg loss 0.00139231, throughput 2.87414K wps
[Epoch 65 Batch 1200/1540] avg loss 0.0014443, throughput 2.87629K wps
[Epoch 65 Batch 1230/1540] avg loss 0.0014279, throughput 2.8273K wps
[Epoch 65 Batch 1260/1540] avg loss 0.00146021, throughput 2.83588K wps
[Epoch 65 Batch 1290/1540] avg loss 0.00153723, throughput 2.87703K wps
[Epoch 65 Batch 1320/1540] avg loss 0.00182373, throughput 2.87664K wps
[Epoch 65 Batch 1350/1540] avg loss 0.00162494, throughput 2.86786K wps
[Epoch 65 Batch 1380/1540] avg loss 0.00148996, throughput 2.85584K wps
[Epoch 65 Batch 1410/1540] avg loss 0.00134852, throughput 2.78684K wps
[Epoch 65 Batch 1440/1540] avg loss 0.0015024, throughput 2.85603K wps
[Epoch 65 Batch 1470/1540] avg loss 0.00141099, throughput 2.84567K wps
[Epoch 65 Batch 1500/1540] avg loss 0.00136961, throughput 2.87861K wps
[Epoch 65 Batch 1530/1540] avg loss 0.00106372, throughput 2.81411K wps
Begin Testing...
[Epoch 65] train avg loss 0.00140416, dev acc 0.7947, dev avg loss 0.712189, throughput 2.86115K wps
[Epoch 66 Batch 30/1540] avg loss 0.00127296, throughput 2.92888K wps
[Epoch 66 Batch 60/1540] avg loss 0.00131052, throughput 2.87637K wps
[Epoch 66 Batch 90/1540] avg loss 0.00136172, throughput 2.85959K wps
[Epoch 66 Batch 120/1540] avg loss 0.00129223, throughput 2.87284K wps
[Epoch 66 Batch 150/1540] avg loss 0.0011656, throughput 2.87542K wps
[Epoch 66 Batch 180/1540] avg loss 0.00138673, throughput 2.88035K wps
[Epoch 66 Batch 210/1540] avg loss 0.00108541, throughput 2.83625K wps
[Epoch 66 Batch 240/1540] avg loss 0.0014519, throughput 2.87392K wps
[Epoch 66 Batch 270/1540] avg loss 0.0011461, throughput 2.88087K wps
[Epoch 66 Batch 300/1540] avg loss 0.00139481, throughput 2.87824K wps
[Epoch 66 Batch 330/1540] avg loss 0.00133102, throughput 2.88493K wps
[Epoch 66 Batch 360/1540] avg loss 0.00106814, throughput 2.88212K wps
[Epoch 66 Batch 390/1540] avg loss 0.00126711, throughput 2.86149K wps
[Epoch 66 Batch 420/1540] avg loss 0.001258, throughput 2.85771K wps
[Epoch 66 Batch 450/1540] avg loss 0.00165762, throughput 2.86148K wps
[Epoch 66 Batch 480/1540] avg loss 0.00122495, throughput 2.87629K wps
[Epoch 66 Batch 510/1540] avg loss 0.00164661, throughput 2.84927K wps
[Epoch 66 Batch 540/1540] avg loss 0.00144247, throughput 2.8845K wps
[Epoch 66 Batch 570/1540] avg loss 0.00154407, throughput 2.85623K wps
[Epoch 66 Batch 600/1540] avg loss 0.00126339, throughput 2.85504K wps
[Epoch 66 Batch 630/1540] avg loss 0.00156497, throughput 2.86681K wps
[Epoch 66 Batch 660/1540] avg loss 0.00121659, throughput 2.84364K wps
[Epoch 66 Batch 690/1540] avg loss 0.00140733, throughput 2.88197K wps
[Epoch 66 Batch 720/1540] avg loss 0.00142489, throughput 2.87231K wps
[Epoch 66 Batch 750/1540] avg loss 0.00142205, throughput 2.83656K wps
[Epoch 66 Batch 780/1540] avg loss 0.00135829, throughput 2.85096K wps
[Epoch 66 Batch 810/1540] avg loss 0.00160215, throughput 2.88509K wps
[Epoch 66 Batch 840/1540] avg loss 0.0014316, throughput 2.85204K wps
[Epoch 66 Batch 870/1540] avg loss 0.0012224, throughput 2.8204K wps
[Epoch 66 Batch 900/1540] avg loss 0.00165676, throughput 2.87359K wps
[Epoch 66 Batch 930/1540] avg loss 0.00162252, throughput 2.86087K wps
[Epoch 66 Batch 960/1540] avg loss 0.00146342, throughput 2.87085K wps
[Epoch 66 Batch 990/1540] avg loss 0.00130375, throughput 2.83267K wps
[Epoch 66 Batch 1020/1540] avg loss 0.00150989, throughput 2.87397K wps
[Epoch 66 Batch 1050/1540] avg loss 0.00130153, throughput 2.86305K wps
[Epoch 66 Batch 1080/1540] avg loss 0.00163389, throughput 2.86859K wps
[Epoch 66 Batch 1110/1540] avg loss 0.0015353, throughput 2.79704K wps
[Epoch 66 Batch 1140/1540] avg loss 0.00125883, throughput 2.82674K wps
[Epoch 66 Batch 1170/1540] avg loss 0.00137844, throughput 2.87599K wps
[Epoch 66 Batch 1200/1540] avg loss 0.00129854, throughput 2.84851K wps
[Epoch 66 Batch 1230/1540] avg loss 0.00112331, throughput 2.84541K wps
[Epoch 66 Batch 1260/1540] avg loss 0.00121611, throughput 2.87717K wps
[Epoch 66 Batch 1290/1540] avg loss 0.00146363, throughput 2.88149K wps
[Epoch 66 Batch 1320/1540] avg loss 0.00129456, throughput 2.86987K wps
[Epoch 66 Batch 1350/1540] avg loss 0.00150397, throughput 2.87768K wps
[Epoch 66 Batch 1380/1540] avg loss 0.00142348, throughput 2.8718K wps
[Epoch 66 Batch 1410/1540] avg loss 0.00170415, throughput 2.81785K wps
[Epoch 66 Batch 1440/1540] avg loss 0.00150022, throughput 2.86702K wps
[Epoch 66 Batch 1470/1540] avg loss 0.00134069, throughput 2.84054K wps
[Epoch 66 Batch 1500/1540] avg loss 0.00132167, throughput 2.79714K wps
[Epoch 66 Batch 1530/1540] avg loss 0.00154356, throughput 2.79342K wps
Begin Testing...
[Epoch 66] train avg loss 0.00138724, dev acc 0.8050, dev avg loss 0.710395, throughput 2.85955K wps
[Epoch 67 Batch 30/1540] avg loss 0.00128354, throughput 2.86872K wps
[Epoch 67 Batch 60/1540] avg loss 0.0011927, throughput 2.78274K wps
[Epoch 67 Batch 90/1540] avg loss 0.00106239, throughput 2.86273K wps
[Epoch 67 Batch 120/1540] avg loss 0.00111617, throughput 2.87462K wps
[Epoch 67 Batch 150/1540] avg loss 0.00120439, throughput 2.88046K wps
[Epoch 67 Batch 180/1540] avg loss 0.00120761, throughput 2.86997K wps
[Epoch 67 Batch 210/1540] avg loss 0.00114949, throughput 2.8641K wps
[Epoch 67 Batch 240/1540] avg loss 0.00138368, throughput 2.82855K wps
[Epoch 67 Batch 270/1540] avg loss 0.00110411, throughput 2.86554K wps
[Epoch 67 Batch 300/1540] avg loss 0.00142149, throughput 2.81316K wps
[Epoch 67 Batch 330/1540] avg loss 0.0013373, throughput 2.86886K wps
[Epoch 67 Batch 360/1540] avg loss 0.00147957, throughput 2.88423K wps
[Epoch 67 Batch 390/1540] avg loss 0.00132644, throughput 2.87652K wps
[Epoch 67 Batch 420/1540] avg loss 0.00144741, throughput 2.80832K wps
[Epoch 67 Batch 450/1540] avg loss 0.0013313, throughput 2.84244K wps
[Epoch 67 Batch 480/1540] avg loss 0.00116393, throughput 2.80987K wps
[Epoch 67 Batch 510/1540] avg loss 0.00155002, throughput 2.82448K wps
[Epoch 67 Batch 540/1540] avg loss 0.00125249, throughput 2.8738K wps
[Epoch 67 Batch 570/1540] avg loss 0.00152926, throughput 2.87288K wps
[Epoch 67 Batch 600/1540] avg loss 0.000913149, throughput 2.84989K wps
[Epoch 67 Batch 630/1540] avg loss 0.00153403, throughput 2.77917K wps
[Epoch 67 Batch 660/1540] avg loss 0.00126011, throughput 2.82527K wps
[Epoch 67 Batch 690/1540] avg loss 0.00118272, throughput 2.8754K wps
[Epoch 67 Batch 720/1540] avg loss 0.00122676, throughput 2.86646K wps
[Epoch 67 Batch 750/1540] avg loss 0.00142917, throughput 2.82181K wps
[Epoch 67 Batch 780/1540] avg loss 0.00131482, throughput 2.81759K wps
[Epoch 67 Batch 810/1540] avg loss 0.00114612, throughput 2.85379K wps
[Epoch 67 Batch 840/1540] avg loss 0.0013978, throughput 2.84192K wps
[Epoch 67 Batch 870/1540] avg loss 0.00143805, throughput 2.8398K wps
[Epoch 67 Batch 900/1540] avg loss 0.00160063, throughput 2.84294K wps
[Epoch 67 Batch 930/1540] avg loss 0.00128115, throughput 2.86905K wps
[Epoch 67 Batch 960/1540] avg loss 0.00133373, throughput 2.87127K wps
[Epoch 67 Batch 990/1540] avg loss 0.00147027, throughput 2.8769K wps
[Epoch 67 Batch 1020/1540] avg loss 0.00147324, throughput 2.86696K wps
[Epoch 67 Batch 1050/1540] avg loss 0.00124212, throughput 2.86474K wps
[Epoch 67 Batch 1080/1540] avg loss 0.00183638, throughput 2.87769K wps
[Epoch 67 Batch 1110/1540] avg loss 0.00124529, throughput 2.87085K wps
[Epoch 67 Batch 1140/1540] avg loss 0.00157788, throughput 2.87128K wps
[Epoch 67 Batch 1170/1540] avg loss 0.00132704, throughput 2.85737K wps
[Epoch 67 Batch 1200/1540] avg loss 0.00148816, throughput 2.87289K wps
[Epoch 67 Batch 1230/1540] avg loss 0.00139041, throughput 2.87859K wps
[Epoch 67 Batch 1260/1540] avg loss 0.00153247, throughput 2.87816K wps
[Epoch 67 Batch 1290/1540] avg loss 0.00133618, throughput 2.87481K wps
[Epoch 67 Batch 1320/1540] avg loss 0.00164512, throughput 2.87206K wps
[Epoch 67 Batch 1350/1540] avg loss 0.00131037, throughput 2.86419K wps
[Epoch 67 Batch 1380/1540] avg loss 0.00147887, throughput 2.85676K wps
[Epoch 67 Batch 1410/1540] avg loss 0.00154637, throughput 2.85223K wps
[Epoch 67 Batch 1440/1540] avg loss 0.00149396, throughput 2.86109K wps
[Epoch 67 Batch 1470/1540] avg loss 0.00170094, throughput 2.86461K wps
[Epoch 67 Batch 1500/1540] avg loss 0.00129582, throughput 2.85808K wps
[Epoch 67 Batch 1530/1540] avg loss 0.00151147, throughput 2.86517K wps
Begin Testing...
[Epoch 67] train avg loss 0.00136488, dev acc 0.8016, dev avg loss 0.710172, throughput 2.85505K wps
[Epoch 68 Batch 30/1540] avg loss 0.00138491, throughput 2.85946K wps
[Epoch 68 Batch 60/1540] avg loss 0.00113984, throughput 2.84486K wps
[Epoch 68 Batch 90/1540] avg loss 0.00115619, throughput 2.86415K wps
[Epoch 68 Batch 120/1540] avg loss 0.00138668, throughput 2.85831K wps
[Epoch 68 Batch 150/1540] avg loss 0.00118362, throughput 2.83261K wps
[Epoch 68 Batch 180/1540] avg loss 0.00120757, throughput 2.81643K wps
[Epoch 68 Batch 210/1540] avg loss 0.00144233, throughput 2.87768K wps
[Epoch 68 Batch 240/1540] avg loss 0.00124299, throughput 2.88561K wps
[Epoch 68 Batch 270/1540] avg loss 0.00146579, throughput 2.87066K wps
[Epoch 68 Batch 300/1540] avg loss 0.00136144, throughput 2.84863K wps
[Epoch 68 Batch 330/1540] avg loss 0.00127276, throughput 2.88082K wps
[Epoch 68 Batch 360/1540] avg loss 0.00118131, throughput 2.87662K wps
[Epoch 68 Batch 390/1540] avg loss 0.00121002, throughput 2.87696K wps
[Epoch 68 Batch 420/1540] avg loss 0.00148879, throughput 2.84353K wps
[Epoch 68 Batch 450/1540] avg loss 0.00118207, throughput 2.85552K wps
[Epoch 68 Batch 480/1540] avg loss 0.00126864, throughput 2.88298K wps
[Epoch 68 Batch 510/1540] avg loss 0.00136322, throughput 2.83384K wps
[Epoch 68 Batch 540/1540] avg loss 0.00135538, throughput 2.85802K wps
[Epoch 68 Batch 570/1540] avg loss 0.00136025, throughput 2.8796K wps
[Epoch 68 Batch 600/1540] avg loss 0.00139865, throughput 2.86736K wps
[Epoch 68 Batch 630/1540] avg loss 0.00146072, throughput 2.87701K wps
[Epoch 68 Batch 660/1540] avg loss 0.00134608, throughput 2.88846K wps
[Epoch 68 Batch 690/1540] avg loss 0.00142137, throughput 2.85585K wps
[Epoch 68 Batch 720/1540] avg loss 0.00147293, throughput 2.87349K wps
[Epoch 68 Batch 750/1540] avg loss 0.00124596, throughput 2.84184K wps
[Epoch 68 Batch 780/1540] avg loss 0.00134268, throughput 2.86536K wps
[Epoch 68 Batch 810/1540] avg loss 0.00118601, throughput 2.88157K wps
[Epoch 68 Batch 840/1540] avg loss 0.00135527, throughput 2.85917K wps
[Epoch 68 Batch 870/1540] avg loss 0.00143757, throughput 2.83632K wps
[Epoch 68 Batch 900/1540] avg loss 0.00128205, throughput 2.81374K wps
[Epoch 68 Batch 930/1540] avg loss 0.00138094, throughput 2.86322K wps
[Epoch 68 Batch 960/1540] avg loss 0.00138868, throughput 2.87073K wps
[Epoch 68 Batch 990/1540] avg loss 0.00138386, throughput 2.87422K wps
[Epoch 68 Batch 1020/1540] avg loss 0.00131553, throughput 2.84358K wps
[Epoch 68 Batch 1050/1540] avg loss 0.00140384, throughput 2.88381K wps
[Epoch 68 Batch 1080/1540] avg loss 0.00161892, throughput 2.77232K wps
[Epoch 68 Batch 1110/1540] avg loss 0.00148205, throughput 2.81465K wps
[Epoch 68 Batch 1140/1540] avg loss 0.00153431, throughput 2.84545K wps
[Epoch 68 Batch 1170/1540] avg loss 0.00138349, throughput 2.81873K wps
[Epoch 68 Batch 1200/1540] avg loss 0.00140747, throughput 2.86449K wps
[Epoch 68 Batch 1230/1540] avg loss 0.00159407, throughput 2.87334K wps
[Epoch 68 Batch 1260/1540] avg loss 0.00124019, throughput 2.83877K wps
[Epoch 68 Batch 1290/1540] avg loss 0.0013837, throughput 2.88K wps
[Epoch 68 Batch 1320/1540] avg loss 0.0013709, throughput 2.87043K wps
[Epoch 68 Batch 1350/1540] avg loss 0.00134785, throughput 2.82007K wps
[Epoch 68 Batch 1380/1540] avg loss 0.00174242, throughput 2.86801K wps
[Epoch 68 Batch 1410/1540] avg loss 0.00128647, throughput 2.86212K wps
[Epoch 68 Batch 1440/1540] avg loss 0.00138818, throughput 2.87309K wps
[Epoch 68 Batch 1470/1540] avg loss 0.00119453, throughput 2.88283K wps
[Epoch 68 Batch 1500/1540] avg loss 0.00134178, throughput 2.8793K wps
[Epoch 68 Batch 1530/1540] avg loss 0.00151366, throughput 2.86484K wps
Begin Testing...
[Epoch 68] train avg loss 0.00136594, dev acc 0.8005, dev avg loss 0.730073, throughput 2.85813K wps
[Epoch 69 Batch 30/1540] avg loss 0.00108677, throughput 2.93316K wps
[Epoch 69 Batch 60/1540] avg loss 0.00134887, throughput 2.87616K wps
[Epoch 69 Batch 90/1540] avg loss 0.00123452, throughput 2.88014K wps
[Epoch 69 Batch 120/1540] avg loss 0.00115922, throughput 2.79294K wps
[Epoch 69 Batch 150/1540] avg loss 0.00120173, throughput 2.85999K wps
[Epoch 69 Batch 180/1540] avg loss 0.00133515, throughput 2.87775K wps
[Epoch 69 Batch 210/1540] avg loss 0.00130771, throughput 2.87925K wps
[Epoch 69 Batch 240/1540] avg loss 0.00115591, throughput 2.86455K wps
[Epoch 69 Batch 270/1540] avg loss 0.00136098, throughput 2.86961K wps
[Epoch 69 Batch 300/1540] avg loss 0.00159568, throughput 2.88481K wps
[Epoch 69 Batch 330/1540] avg loss 0.0010951, throughput 2.87791K wps
[Epoch 69 Batch 360/1540] avg loss 0.00108801, throughput 2.87676K wps
[Epoch 69 Batch 390/1540] avg loss 0.00119064, throughput 2.8744K wps
[Epoch 69 Batch 420/1540] avg loss 0.00130206, throughput 2.86436K wps
[Epoch 69 Batch 450/1540] avg loss 0.000966684, throughput 2.83045K wps
[Epoch 69 Batch 480/1540] avg loss 0.00122758, throughput 2.8812K wps
[Epoch 69 Batch 510/1540] avg loss 0.0012711, throughput 2.86265K wps
[Epoch 69 Batch 540/1540] avg loss 0.00124629, throughput 2.86758K wps
[Epoch 69 Batch 570/1540] avg loss 0.00133702, throughput 2.83996K wps
[Epoch 69 Batch 600/1540] avg loss 0.00153548, throughput 2.87091K wps
[Epoch 69 Batch 630/1540] avg loss 0.0011835, throughput 2.81232K wps
[Epoch 69 Batch 660/1540] avg loss 0.00145778, throughput 2.86717K wps
[Epoch 69 Batch 690/1540] avg loss 0.0014978, throughput 2.81336K wps
[Epoch 69 Batch 720/1540] avg loss 0.00138051, throughput 2.80532K wps
[Epoch 69 Batch 750/1540] avg loss 0.00164519, throughput 2.86651K wps
[Epoch 69 Batch 780/1540] avg loss 0.00156605, throughput 2.8027K wps
[Epoch 69 Batch 810/1540] avg loss 0.00134563, throughput 2.86924K wps
[Epoch 69 Batch 840/1540] avg loss 0.00136487, throughput 2.88479K wps
[Epoch 69 Batch 870/1540] avg loss 0.00128929, throughput 2.87521K wps
[Epoch 69 Batch 900/1540] avg loss 0.00115969, throughput 2.86471K wps
[Epoch 69 Batch 930/1540] avg loss 0.00139723, throughput 2.8698K wps
[Epoch 69 Batch 960/1540] avg loss 0.00113859, throughput 2.86811K wps
[Epoch 69 Batch 990/1540] avg loss 0.00159912, throughput 2.80308K wps
[Epoch 69 Batch 1020/1540] avg loss 0.00145419, throughput 2.86868K wps
[Epoch 69 Batch 1050/1540] avg loss 0.00120267, throughput 2.83571K wps
[Epoch 69 Batch 1080/1540] avg loss 0.00146918, throughput 2.87051K wps
[Epoch 69 Batch 1110/1540] avg loss 0.0015798, throughput 2.87018K wps
[Epoch 69 Batch 1140/1540] avg loss 0.00136862, throughput 2.86393K wps
[Epoch 69 Batch 1170/1540] avg loss 0.00149289, throughput 2.84741K wps
[Epoch 69 Batch 1200/1540] avg loss 0.00123901, throughput 2.87969K wps
[Epoch 69 Batch 1230/1540] avg loss 0.00142672, throughput 2.88023K wps
[Epoch 69 Batch 1260/1540] avg loss 0.00131831, throughput 2.88728K wps
[Epoch 69 Batch 1290/1540] avg loss 0.00154306, throughput 2.88538K wps
[Epoch 69 Batch 1320/1540] avg loss 0.0014756, throughput 2.87155K wps
[Epoch 69 Batch 1350/1540] avg loss 0.00151453, throughput 2.80499K wps
[Epoch 69 Batch 1380/1540] avg loss 0.00147185, throughput 2.83652K wps
[Epoch 69 Batch 1410/1540] avg loss 0.00139067, throughput 2.87921K wps
[Epoch 69 Batch 1440/1540] avg loss 0.00144767, throughput 2.8877K wps
[Epoch 69 Batch 1470/1540] avg loss 0.0013274, throughput 2.86122K wps
[Epoch 69 Batch 1500/1540] avg loss 0.00142919, throughput 2.86886K wps
[Epoch 69 Batch 1530/1540] avg loss 0.00133911, throughput 2.87448K wps
Begin Testing...
[Epoch 69] train avg loss 0.00134231, dev acc 0.8016, dev avg loss 0.702331, throughput 2.86145K wps
[Epoch 70 Batch 30/1540] avg loss 0.00161241, throughput 2.90551K wps
[Epoch 70 Batch 60/1540] avg loss 0.00116597, throughput 2.79096K wps
[Epoch 70 Batch 90/1540] avg loss 0.00132929, throughput 2.8697K wps
[Epoch 70 Batch 120/1540] avg loss 0.00116787, throughput 2.87665K wps
[Epoch 70 Batch 150/1540] avg loss 0.00142675, throughput 2.86704K wps
[Epoch 70 Batch 180/1540] avg loss 0.00121629, throughput 2.84366K wps
[Epoch 70 Batch 210/1540] avg loss 0.00122034, throughput 2.86494K wps
[Epoch 70 Batch 240/1540] avg loss 0.00136846, throughput 2.86643K wps
[Epoch 70 Batch 270/1540] avg loss 0.00138199, throughput 2.86313K wps
[Epoch 70 Batch 300/1540] avg loss 0.00121059, throughput 2.8578K wps
[Epoch 70 Batch 330/1540] avg loss 0.00131768, throughput 2.81638K wps
[Epoch 70 Batch 360/1540] avg loss 0.00135297, throughput 2.8701K wps
[Epoch 70 Batch 390/1540] avg loss 0.00129894, throughput 2.84545K wps
[Epoch 70 Batch 420/1540] avg loss 0.00143989, throughput 2.83176K wps
[Epoch 70 Batch 450/1540] avg loss 0.00113092, throughput 2.87737K wps
[Epoch 70 Batch 480/1540] avg loss 0.00117438, throughput 2.8608K wps
[Epoch 70 Batch 510/1540] avg loss 0.00103157, throughput 2.80794K wps
[Epoch 70 Batch 540/1540] avg loss 0.00137227, throughput 2.85383K wps
[Epoch 70 Batch 570/1540] avg loss 0.00115506, throughput 2.88223K wps
[Epoch 70 Batch 600/1540] avg loss 0.00138851, throughput 2.87526K wps
[Epoch 70 Batch 630/1540] avg loss 0.00130949, throughput 2.85267K wps
[Epoch 70 Batch 660/1540] avg loss 0.00163986, throughput 2.86049K wps
[Epoch 70 Batch 690/1540] avg loss 0.00130358, throughput 2.8478K wps
[Epoch 70 Batch 720/1540] avg loss 0.00136092, throughput 2.85549K wps
[Epoch 70 Batch 750/1540] avg loss 0.00124674, throughput 2.84792K wps
[Epoch 70 Batch 780/1540] avg loss 0.00142098, throughput 2.86633K wps
[Epoch 70 Batch 810/1540] avg loss 0.00144645, throughput 2.85562K wps
[Epoch 70 Batch 840/1540] avg loss 0.00128854, throughput 2.84351K wps
[Epoch 70 Batch 870/1540] avg loss 0.00134136, throughput 2.86982K wps
[Epoch 70 Batch 900/1540] avg loss 0.00137727, throughput 2.87818K wps
[Epoch 70 Batch 930/1540] avg loss 0.00140703, throughput 2.8117K wps
[Epoch 70 Batch 960/1540] avg loss 0.00154447, throughput 2.85399K wps
[Epoch 70 Batch 990/1540] avg loss 0.00106615, throughput 2.82614K wps
[Epoch 70 Batch 1020/1540] avg loss 0.00142417, throughput 2.78426K wps
[Epoch 70 Batch 1050/1540] avg loss 0.00139677, throughput 2.85575K wps
[Epoch 70 Batch 1080/1540] avg loss 0.00119622, throughput 2.84424K wps
[Epoch 70 Batch 1110/1540] avg loss 0.00133034, throughput 2.87774K wps
[Epoch 70 Batch 1140/1540] avg loss 0.00122278, throughput 2.86265K wps
[Epoch 70 Batch 1170/1540] avg loss 0.00125786, throughput 2.87532K wps
[Epoch 70 Batch 1200/1540] avg loss 0.00140981, throughput 2.86786K wps
[Epoch 70 Batch 1230/1540] avg loss 0.00108197, throughput 2.83862K wps
[Epoch 70 Batch 1260/1540] avg loss 0.00146097, throughput 2.88408K wps
[Epoch 70 Batch 1290/1540] avg loss 0.0016538, throughput 2.88654K wps
[Epoch 70 Batch 1320/1540] avg loss 0.00142483, throughput 2.87995K wps
[Epoch 70 Batch 1350/1540] avg loss 0.00171901, throughput 2.85074K wps
[Epoch 70 Batch 1380/1540] avg loss 0.00150377, throughput 2.80056K wps
[Epoch 70 Batch 1410/1540] avg loss 0.0011282, throughput 2.83782K wps
[Epoch 70 Batch 1440/1540] avg loss 0.00139776, throughput 2.87609K wps
[Epoch 70 Batch 1470/1540] avg loss 0.00155594, throughput 2.85667K wps
[Epoch 70 Batch 1500/1540] avg loss 0.00152614, throughput 2.86696K wps
[Epoch 70 Batch 1530/1540] avg loss 0.00121576, throughput 2.84739K wps
Begin Testing...
[Epoch 70] train avg loss 0.00134591, dev acc 0.8016, dev avg loss 0.706575, throughput 2.85462K wps
[Epoch 71 Batch 30/1540] avg loss 0.0010279, throughput 2.91053K wps
[Epoch 71 Batch 60/1540] avg loss 0.00100954, throughput 2.85338K wps
[Epoch 71 Batch 90/1540] avg loss 0.00105626, throughput 2.87695K wps
[Epoch 71 Batch 120/1540] avg loss 0.00105344, throughput 2.86925K wps
[Epoch 71 Batch 150/1540] avg loss 0.00119686, throughput 2.83835K wps
[Epoch 71 Batch 180/1540] avg loss 0.00109057, throughput 2.87573K wps
[Epoch 71 Batch 210/1540] avg loss 0.00113502, throughput 2.82673K wps
[Epoch 71 Batch 240/1540] avg loss 0.00113305, throughput 2.84598K wps
[Epoch 71 Batch 270/1540] avg loss 0.00112158, throughput 2.86746K wps
[Epoch 71 Batch 300/1540] avg loss 0.0011972, throughput 2.87693K wps
[Epoch 71 Batch 330/1540] avg loss 0.00118776, throughput 2.88021K wps
[Epoch 71 Batch 360/1540] avg loss 0.00125391, throughput 2.8823K wps
[Epoch 71 Batch 390/1540] avg loss 0.00119558, throughput 2.87601K wps
[Epoch 71 Batch 420/1540] avg loss 0.00122933, throughput 2.87961K wps
[Epoch 71 Batch 450/1540] avg loss 0.00122495, throughput 2.87347K wps
[Epoch 71 Batch 480/1540] avg loss 0.00111621, throughput 2.87246K wps
[Epoch 71 Batch 510/1540] avg loss 0.00111211, throughput 2.87533K wps
[Epoch 71 Batch 540/1540] avg loss 0.0012273, throughput 2.87001K wps
[Epoch 71 Batch 570/1540] avg loss 0.00137425, throughput 2.8648K wps
[Epoch 71 Batch 600/1540] avg loss 0.00128127, throughput 2.85561K wps
[Epoch 71 Batch 630/1540] avg loss 0.00131854, throughput 2.87712K wps
[Epoch 71 Batch 660/1540] avg loss 0.00159462, throughput 2.83419K wps
[Epoch 71 Batch 690/1540] avg loss 0.0014115, throughput 2.87461K wps
[Epoch 71 Batch 720/1540] avg loss 0.0012931, throughput 2.84228K wps
[Epoch 71 Batch 750/1540] avg loss 0.00142809, throughput 2.88076K wps
[Epoch 71 Batch 780/1540] avg loss 0.00148602, throughput 2.88514K wps
[Epoch 71 Batch 810/1540] avg loss 0.00127519, throughput 2.8734K wps
[Epoch 71 Batch 840/1540] avg loss 0.00109343, throughput 2.88309K wps
[Epoch 71 Batch 870/1540] avg loss 0.0012921, throughput 2.8676K wps
[Epoch 71 Batch 900/1540] avg loss 0.00133696, throughput 2.82794K wps
[Epoch 71 Batch 930/1540] avg loss 0.0017668, throughput 2.88266K wps
[Epoch 71 Batch 960/1540] avg loss 0.00161384, throughput 2.8557K wps
[Epoch 71 Batch 990/1540] avg loss 0.00123273, throughput 2.85606K wps
[Epoch 71 Batch 1020/1540] avg loss 0.00142805, throughput 2.86758K wps
[Epoch 71 Batch 1050/1540] avg loss 0.00157444, throughput 2.83803K wps
[Epoch 71 Batch 1080/1540] avg loss 0.00159362, throughput 2.85665K wps
[Epoch 71 Batch 1110/1540] avg loss 0.00167535, throughput 2.84338K wps
[Epoch 71 Batch 1140/1540] avg loss 0.00159995, throughput 2.87047K wps
[Epoch 71 Batch 1170/1540] avg loss 0.00127217, throughput 2.8623K wps
[Epoch 71 Batch 1200/1540] avg loss 0.00151047, throughput 2.88138K wps
[Epoch 71 Batch 1230/1540] avg loss 0.00159808, throughput 2.83551K wps
[Epoch 71 Batch 1260/1540] avg loss 0.00133709, throughput 2.83649K wps
[Epoch 71 Batch 1290/1540] avg loss 0.00147236, throughput 2.84384K wps
[Epoch 71 Batch 1320/1540] avg loss 0.00128736, throughput 2.85472K wps
[Epoch 71 Batch 1350/1540] avg loss 0.00166008, throughput 2.86507K wps
[Epoch 71 Batch 1380/1540] avg loss 0.00147781, throughput 2.8765K wps
[Epoch 71 Batch 1410/1540] avg loss 0.00138095, throughput 2.87463K wps
[Epoch 71 Batch 1440/1540] avg loss 0.00169856, throughput 2.87883K wps
[Epoch 71 Batch 1470/1540] avg loss 0.0013781, throughput 2.79136K wps
[Epoch 71 Batch 1500/1540] avg loss 0.00128072, throughput 2.81436K wps
[Epoch 71 Batch 1530/1540] avg loss 0.00138078, throughput 2.86307K wps
Begin Testing...
[Epoch 71] train avg loss 0.00133201, dev acc 0.7993, dev avg loss 0.711074, throughput 2.86204K wps
[Epoch 72 Batch 30/1540] avg loss 0.00130271, throughput 2.92277K wps
[Epoch 72 Batch 60/1540] avg loss 0.00102452, throughput 2.86383K wps
[Epoch 72 Batch 90/1540] avg loss 0.00107097, throughput 2.80596K wps
[Epoch 72 Batch 120/1540] avg loss 0.00127957, throughput 2.85855K wps
[Epoch 72 Batch 150/1540] avg loss 0.00134692, throughput 2.85898K wps
[Epoch 72 Batch 180/1540] avg loss 0.00126824, throughput 2.83397K wps
[Epoch 72 Batch 210/1540] avg loss 0.00120366, throughput 2.85972K wps
[Epoch 72 Batch 240/1540] avg loss 0.00123333, throughput 2.86941K wps
[Epoch 72 Batch 270/1540] avg loss 0.0011753, throughput 2.87748K wps
[Epoch 72 Batch 300/1540] avg loss 0.00122859, throughput 2.8385K wps
[Epoch 72 Batch 330/1540] avg loss 0.00161866, throughput 2.87968K wps
[Epoch 72 Batch 360/1540] avg loss 0.00138374, throughput 2.87342K wps
[Epoch 72 Batch 390/1540] avg loss 0.00128573, throughput 2.86344K wps
[Epoch 72 Batch 420/1540] avg loss 0.00161238, throughput 2.81608K wps
[Epoch 72 Batch 450/1540] avg loss 0.00158862, throughput 2.82011K wps
[Epoch 72 Batch 480/1540] avg loss 0.00118316, throughput 2.86062K wps
[Epoch 72 Batch 510/1540] avg loss 0.00125388, throughput 2.7957K wps
[Epoch 72 Batch 540/1540] avg loss 0.00148875, throughput 2.8609K wps
[Epoch 72 Batch 570/1540] avg loss 0.00102411, throughput 2.87393K wps
[Epoch 72 Batch 600/1540] avg loss 0.00135658, throughput 2.88854K wps
[Epoch 72 Batch 630/1540] avg loss 0.00112246, throughput 2.87635K wps
[Epoch 72 Batch 660/1540] avg loss 0.0014351, throughput 2.87717K wps
[Epoch 72 Batch 690/1540] avg loss 0.00125885, throughput 2.8751K wps
[Epoch 72 Batch 720/1540] avg loss 0.00142163, throughput 2.8705K wps
[Epoch 72 Batch 750/1540] avg loss 0.00143013, throughput 2.80203K wps
[Epoch 72 Batch 780/1540] avg loss 0.0012508, throughput 2.87527K wps
[Epoch 72 Batch 810/1540] avg loss 0.00128957, throughput 2.83875K wps
[Epoch 72 Batch 840/1540] avg loss 0.00119155, throughput 2.8391K wps
[Epoch 72 Batch 870/1540] avg loss 0.00124588, throughput 2.77792K wps
[Epoch 72 Batch 900/1540] avg loss 0.00120647, throughput 2.85905K wps
[Epoch 72 Batch 930/1540] avg loss 0.00142487, throughput 2.852K wps
[Epoch 72 Batch 960/1540] avg loss 0.00143261, throughput 2.85318K wps
[Epoch 72 Batch 990/1540] avg loss 0.0014151, throughput 2.84934K wps
[Epoch 72 Batch 1020/1540] avg loss 0.00137071, throughput 2.86469K wps
[Epoch 72 Batch 1050/1540] avg loss 0.00123111, throughput 2.87756K wps
[Epoch 72 Batch 1080/1540] avg loss 0.00141543, throughput 2.88388K wps
[Epoch 72 Batch 1110/1540] avg loss 0.00140636, throughput 2.88074K wps
[Epoch 72 Batch 1140/1540] avg loss 0.00136683, throughput 2.88355K wps
[Epoch 72 Batch 1170/1540] avg loss 0.00137051, throughput 2.85391K wps
[Epoch 72 Batch 1200/1540] avg loss 0.00131245, throughput 2.85531K wps
[Epoch 72 Batch 1230/1540] avg loss 0.00136883, throughput 2.856K wps
[Epoch 72 Batch 1260/1540] avg loss 0.00152859, throughput 2.86699K wps
[Epoch 72 Batch 1290/1540] avg loss 0.00129987, throughput 2.88024K wps
[Epoch 72 Batch 1320/1540] avg loss 0.00118424, throughput 2.82656K wps
[Epoch 72 Batch 1350/1540] avg loss 0.00152654, throughput 2.80489K wps
[Epoch 72 Batch 1380/1540] avg loss 0.00136547, throughput 2.87653K wps
[Epoch 72 Batch 1410/1540] avg loss 0.00173086, throughput 2.82331K wps
[Epoch 72 Batch 1440/1540] avg loss 0.00149549, throughput 2.83216K wps
[Epoch 72 Batch 1470/1540] avg loss 0.00140836, throughput 2.87118K wps
[Epoch 72 Batch 1500/1540] avg loss 0.0012833, throughput 2.84902K wps
[Epoch 72 Batch 1530/1540] avg loss 0.00136912, throughput 2.86201K wps
Begin Testing...
[Epoch 72] train avg loss 0.00133738, dev acc 0.7890, dev avg loss 0.739841, throughput 2.85504K wps
[Epoch 73 Batch 30/1540] avg loss 0.000983179, throughput 2.94603K wps
[Epoch 73 Batch 60/1540] avg loss 0.00124841, throughput 2.88696K wps
[Epoch 73 Batch 90/1540] avg loss 0.00111718, throughput 2.8508K wps
[Epoch 73 Batch 120/1540] avg loss 0.00101137, throughput 2.87194K wps
[Epoch 73 Batch 150/1540] avg loss 0.00151215, throughput 2.82676K wps
[Epoch 73 Batch 180/1540] avg loss 0.0012229, throughput 2.8307K wps
[Epoch 73 Batch 210/1540] avg loss 0.00140645, throughput 2.85106K wps
[Epoch 73 Batch 240/1540] avg loss 0.000980522, throughput 2.82419K wps
[Epoch 73 Batch 270/1540] avg loss 0.00119198, throughput 2.79162K wps
[Epoch 73 Batch 300/1540] avg loss 0.00133659, throughput 2.86077K wps
[Epoch 73 Batch 330/1540] avg loss 0.00143933, throughput 2.87188K wps
[Epoch 73 Batch 360/1540] avg loss 0.00104906, throughput 2.86961K wps
[Epoch 73 Batch 390/1540] avg loss 0.00128167, throughput 2.85441K wps
[Epoch 73 Batch 420/1540] avg loss 0.00144331, throughput 2.8651K wps
[Epoch 73 Batch 450/1540] avg loss 0.00165215, throughput 2.81705K wps
[Epoch 73 Batch 480/1540] avg loss 0.00152434, throughput 2.85831K wps
[Epoch 73 Batch 510/1540] avg loss 0.00124588, throughput 2.85108K wps
[Epoch 73 Batch 540/1540] avg loss 0.00140122, throughput 2.8733K wps
[Epoch 73 Batch 570/1540] avg loss 0.00129698, throughput 2.8477K wps
[Epoch 73 Batch 600/1540] avg loss 0.00132198, throughput 2.85136K wps
[Epoch 73 Batch 630/1540] avg loss 0.00110567, throughput 2.88336K wps
[Epoch 73 Batch 660/1540] avg loss 0.00120607, throughput 2.83345K wps
[Epoch 73 Batch 690/1540] avg loss 0.00120483, throughput 2.87909K wps
[Epoch 73 Batch 720/1540] avg loss 0.0011504, throughput 2.83922K wps
[Epoch 73 Batch 750/1540] avg loss 0.00122956, throughput 2.87995K wps
[Epoch 73 Batch 780/1540] avg loss 0.00120574, throughput 2.82466K wps
[Epoch 73 Batch 810/1540] avg loss 0.00132285, throughput 2.8638K wps
[Epoch 73 Batch 840/1540] avg loss 0.00154758, throughput 2.83571K wps
[Epoch 73 Batch 870/1540] avg loss 0.00129043, throughput 2.82935K wps
[Epoch 73 Batch 900/1540] avg loss 0.00135549, throughput 2.87215K wps
[Epoch 73 Batch 930/1540] avg loss 0.00167803, throughput 2.81724K wps
[Epoch 73 Batch 960/1540] avg loss 0.00113975, throughput 2.87866K wps
[Epoch 73 Batch 990/1540] avg loss 0.00132213, throughput 2.8536K wps
[Epoch 73 Batch 1020/1540] avg loss 0.00158036, throughput 2.87229K wps
[Epoch 73 Batch 1050/1540] avg loss 0.00119371, throughput 2.82483K wps
[Epoch 73 Batch 1080/1540] avg loss 0.00119423, throughput 2.88578K wps
[Epoch 73 Batch 1110/1540] avg loss 0.00155461, throughput 2.88099K wps
[Epoch 73 Batch 1140/1540] avg loss 0.00118893, throughput 2.88665K wps
[Epoch 73 Batch 1170/1540] avg loss 0.00153337, throughput 2.86867K wps
[Epoch 73 Batch 1200/1540] avg loss 0.00121237, throughput 2.84795K wps
[Epoch 73 Batch 1230/1540] avg loss 0.00128762, throughput 2.88229K wps
[Epoch 73 Batch 1260/1540] avg loss 0.00134014, throughput 2.88753K wps
[Epoch 73 Batch 1290/1540] avg loss 0.00131204, throughput 2.87109K wps
[Epoch 73 Batch 1320/1540] avg loss 0.000993579, throughput 2.85643K wps
[Epoch 73 Batch 1350/1540] avg loss 0.00157872, throughput 2.87346K wps
[Epoch 73 Batch 1380/1540] avg loss 0.00125208, throughput 2.87316K wps
[Epoch 73 Batch 1410/1540] avg loss 0.00142955, throughput 2.85061K wps
[Epoch 73 Batch 1440/1540] avg loss 0.00119635, throughput 2.85329K wps
[Epoch 73 Batch 1470/1540] avg loss 0.00155103, throughput 2.8841K wps
[Epoch 73 Batch 1500/1540] avg loss 0.00164105, throughput 2.85132K wps
[Epoch 73 Batch 1530/1540] avg loss 0.00143831, throughput 2.88267K wps
Begin Testing...
[Epoch 73] train avg loss 0.00131414, dev acc 0.8085, dev avg loss 0.728626, throughput 2.85928K wps
[Epoch 74 Batch 30/1540] avg loss 0.00108926, throughput 2.93233K wps
[Epoch 74 Batch 60/1540] avg loss 0.00118921, throughput 2.80855K wps
[Epoch 74 Batch 90/1540] avg loss 0.000993494, throughput 2.84322K wps
[Epoch 74 Batch 120/1540] avg loss 0.00122215, throughput 2.81013K wps
[Epoch 74 Batch 150/1540] avg loss 0.00121283, throughput 2.88128K wps
[Epoch 74 Batch 180/1540] avg loss 0.0012133, throughput 2.88063K wps
[Epoch 74 Batch 210/1540] avg loss 0.000899271, throughput 2.88036K wps
[Epoch 74 Batch 240/1540] avg loss 0.00108649, throughput 2.84209K wps
[Epoch 74 Batch 270/1540] avg loss 0.000980934, throughput 2.8311K wps
[Epoch 74 Batch 300/1540] avg loss 0.00111211, throughput 2.8834K wps
[Epoch 74 Batch 330/1540] avg loss 0.00093736, throughput 2.83674K wps
[Epoch 74 Batch 360/1540] avg loss 0.00138033, throughput 2.869K wps
[Epoch 74 Batch 390/1540] avg loss 0.00132374, throughput 2.81192K wps
[Epoch 74 Batch 420/1540] avg loss 0.00114099, throughput 2.79285K wps
[Epoch 74 Batch 450/1540] avg loss 0.00158986, throughput 2.86253K wps
[Epoch 74 Batch 480/1540] avg loss 0.00134347, throughput 2.84152K wps
[Epoch 74 Batch 510/1540] avg loss 0.00113831, throughput 2.85734K wps
[Epoch 74 Batch 540/1540] avg loss 0.00142984, throughput 2.81209K wps
[Epoch 74 Batch 570/1540] avg loss 0.00159788, throughput 2.8189K wps
[Epoch 74 Batch 600/1540] avg loss 0.00126762, throughput 2.87723K wps
[Epoch 74 Batch 630/1540] avg loss 0.00132105, throughput 2.86336K wps
[Epoch 74 Batch 660/1540] avg loss 0.00139685, throughput 2.87703K wps
[Epoch 74 Batch 690/1540] avg loss 0.00129984, throughput 2.87677K wps
[Epoch 74 Batch 720/1540] avg loss 0.00104952, throughput 2.87454K wps
[Epoch 74 Batch 750/1540] avg loss 0.00129771, throughput 2.86256K wps
[Epoch 74 Batch 780/1540] avg loss 0.00136558, throughput 2.85695K wps
[Epoch 74 Batch 810/1540] avg loss 0.001241, throughput 2.86756K wps
[Epoch 74 Batch 840/1540] avg loss 0.000997573, throughput 2.86309K wps
[Epoch 74 Batch 870/1540] avg loss 0.00140572, throughput 2.86117K wps
[Epoch 74 Batch 900/1540] avg loss 0.00133381, throughput 2.86239K wps
[Epoch 74 Batch 930/1540] avg loss 0.00111515, throughput 2.87099K wps
[Epoch 74 Batch 960/1540] avg loss 0.0013537, throughput 2.86626K wps
[Epoch 74 Batch 990/1540] avg loss 0.00162296, throughput 2.83653K wps
[Epoch 74 Batch 1020/1540] avg loss 0.00128363, throughput 2.87783K wps
[Epoch 74 Batch 1050/1540] avg loss 0.00111841, throughput 2.86817K wps
[Epoch 74 Batch 1080/1540] avg loss 0.00125084, throughput 2.82455K wps
[Epoch 74 Batch 1110/1540] avg loss 0.0015301, throughput 2.8747K wps
[Epoch 74 Batch 1140/1540] avg loss 0.00153223, throughput 2.87124K wps
[Epoch 74 Batch 1170/1540] avg loss 0.00174818, throughput 2.88386K wps
[Epoch 74 Batch 1200/1540] avg loss 0.00133119, throughput 2.87848K wps
[Epoch 74 Batch 1230/1540] avg loss 0.00145696, throughput 2.86748K wps
[Epoch 74 Batch 1260/1540] avg loss 0.00136685, throughput 2.86675K wps
[Epoch 74 Batch 1290/1540] avg loss 0.0013888, throughput 2.82826K wps
[Epoch 74 Batch 1320/1540] avg loss 0.00148013, throughput 2.85332K wps
[Epoch 74 Batch 1350/1540] avg loss 0.000923666, throughput 2.85781K wps
[Epoch 74 Batch 1380/1540] avg loss 0.00141658, throughput 2.82754K wps
[Epoch 74 Batch 1410/1540] avg loss 0.00115908, throughput 2.87955K wps
[Epoch 74 Batch 1440/1540] avg loss 0.00155115, throughput 2.88371K wps
[Epoch 74 Batch 1470/1540] avg loss 0.0015611, throughput 2.87345K wps
[Epoch 74 Batch 1500/1540] avg loss 0.0012903, throughput 2.86848K wps
[Epoch 74 Batch 1530/1540] avg loss 0.00141398, throughput 2.83022K wps
Begin Testing...
[Epoch 74] train avg loss 0.0012916, dev acc 0.7936, dev avg loss 0.724458, throughput 2.85708K wps
[Epoch 75 Batch 30/1540] avg loss 0.00105201, throughput 2.90705K wps
[Epoch 75 Batch 60/1540] avg loss 0.00117211, throughput 2.84279K wps
[Epoch 75 Batch 90/1540] avg loss 0.00120951, throughput 2.85551K wps
[Epoch 75 Batch 120/1540] avg loss 0.00132756, throughput 2.80319K wps
[Epoch 75 Batch 150/1540] avg loss 0.00093559, throughput 2.81736K wps
[Epoch 75 Batch 180/1540] avg loss 0.00139062, throughput 2.8552K wps
[Epoch 75 Batch 210/1540] avg loss 0.000873032, throughput 2.87083K wps
[Epoch 75 Batch 240/1540] avg loss 0.00127518, throughput 2.82957K wps
[Epoch 75 Batch 270/1540] avg loss 0.00119911, throughput 2.81005K wps
[Epoch 75 Batch 300/1540] avg loss 0.00154569, throughput 2.86728K wps
[Epoch 75 Batch 330/1540] avg loss 0.00131338, throughput 2.8861K wps
[Epoch 75 Batch 360/1540] avg loss 0.0013949, throughput 2.88102K wps
[Epoch 75 Batch 390/1540] avg loss 0.00104186, throughput 2.87834K wps
[Epoch 75 Batch 420/1540] avg loss 0.0010772, throughput 2.88723K wps
[Epoch 75 Batch 450/1540] avg loss 0.00130602, throughput 2.87699K wps
[Epoch 75 Batch 480/1540] avg loss 0.000963388, throughput 2.86751K wps
[Epoch 75 Batch 510/1540] avg loss 0.00128293, throughput 2.85284K wps
[Epoch 75 Batch 540/1540] avg loss 0.00109782, throughput 2.81938K wps
[Epoch 75 Batch 570/1540] avg loss 0.00130909, throughput 2.87922K wps
[Epoch 75 Batch 600/1540] avg loss 0.00117031, throughput 2.87483K wps
[Epoch 75 Batch 630/1540] avg loss 0.00117718, throughput 2.8482K wps
[Epoch 75 Batch 660/1540] avg loss 0.00138397, throughput 2.86842K wps
[Epoch 75 Batch 690/1540] avg loss 0.00126643, throughput 2.88089K wps
[Epoch 75 Batch 720/1540] avg loss 0.00127365, throughput 2.88422K wps
[Epoch 75 Batch 750/1540] avg loss 0.00131442, throughput 2.87505K wps
[Epoch 75 Batch 780/1540] avg loss 0.00130011, throughput 2.84057K wps
[Epoch 75 Batch 810/1540] avg loss 0.00151425, throughput 2.84156K wps
[Epoch 75 Batch 840/1540] avg loss 0.00136307, throughput 2.81069K wps
[Epoch 75 Batch 870/1540] avg loss 0.00111073, throughput 2.81772K wps
[Epoch 75 Batch 900/1540] avg loss 0.00123173, throughput 2.84649K wps
[Epoch 75 Batch 930/1540] avg loss 0.00124233, throughput 2.88934K wps
[Epoch 75 Batch 960/1540] avg loss 0.00152469, throughput 2.86891K wps
[Epoch 75 Batch 990/1540] avg loss 0.00168403, throughput 2.86333K wps
[Epoch 75 Batch 1020/1540] avg loss 0.00126896, throughput 2.84777K wps
[Epoch 75 Batch 1050/1540] avg loss 0.00167247, throughput 2.83938K wps
[Epoch 75 Batch 1080/1540] avg loss 0.0013523, throughput 2.83775K wps
[Epoch 75 Batch 1110/1540] avg loss 0.00124019, throughput 2.88123K wps
[Epoch 75 Batch 1140/1540] avg loss 0.00100219, throughput 2.87796K wps
[Epoch 75 Batch 1170/1540] avg loss 0.00138291, throughput 2.84122K wps
[Epoch 75 Batch 1200/1540] avg loss 0.00145421, throughput 2.86126K wps
[Epoch 75 Batch 1230/1540] avg loss 0.00140864, throughput 2.85704K wps
[Epoch 75 Batch 1260/1540] avg loss 0.0013368, throughput 2.85728K wps
[Epoch 75 Batch 1290/1540] avg loss 0.00148171, throughput 2.81306K wps
[Epoch 75 Batch 1320/1540] avg loss 0.00128734, throughput 2.80929K wps
[Epoch 75 Batch 1350/1540] avg loss 0.0012922, throughput 2.80617K wps
[Epoch 75 Batch 1380/1540] avg loss 0.00148572, throughput 2.85528K wps
[Epoch 75 Batch 1410/1540] avg loss 0.00114368, throughput 2.85442K wps
[Epoch 75 Batch 1440/1540] avg loss 0.00125075, throughput 2.86311K wps
[Epoch 75 Batch 1470/1540] avg loss 0.00132609, throughput 2.82795K wps
[Epoch 75 Batch 1500/1540] avg loss 0.0012719, throughput 2.83248K wps
[Epoch 75 Batch 1530/1540] avg loss 0.00149788, throughput 2.87705K wps
Begin Testing...
[Epoch 75] train avg loss 0.00128299, dev acc 0.8016, dev avg loss 0.725846, throughput 2.85357K wps
[Epoch 76 Batch 30/1540] avg loss 0.00110738, throughput 2.9018K wps
[Epoch 76 Batch 60/1540] avg loss 0.000960349, throughput 2.81288K wps
[Epoch 76 Batch 90/1540] avg loss 0.00107461, throughput 2.86226K wps
[Epoch 76 Batch 120/1540] avg loss 0.00103727, throughput 2.87843K wps
[Epoch 76 Batch 150/1540] avg loss 0.00127061, throughput 2.86876K wps
[Epoch 76 Batch 180/1540] avg loss 0.00104723, throughput 2.86176K wps
[Epoch 76 Batch 210/1540] avg loss 0.00110525, throughput 2.8546K wps
[Epoch 76 Batch 240/1540] avg loss 0.00105552, throughput 2.86126K wps
[Epoch 76 Batch 270/1540] avg loss 0.00116564, throughput 2.86368K wps
[Epoch 76 Batch 300/1540] avg loss 0.00123271, throughput 2.87255K wps
[Epoch 76 Batch 330/1540] avg loss 0.00133203, throughput 2.87466K wps
[Epoch 76 Batch 360/1540] avg loss 0.00133441, throughput 2.86132K wps
[Epoch 76 Batch 390/1540] avg loss 0.00127786, throughput 2.81779K wps
[Epoch 76 Batch 420/1540] avg loss 0.00122423, throughput 2.78892K wps
[Epoch 76 Batch 450/1540] avg loss 0.00114372, throughput 2.84806K wps
[Epoch 76 Batch 480/1540] avg loss 0.00120451, throughput 2.86246K wps
[Epoch 76 Batch 510/1540] avg loss 0.001154, throughput 2.87756K wps
[Epoch 76 Batch 540/1540] avg loss 0.00129487, throughput 2.86757K wps
[Epoch 76 Batch 570/1540] avg loss 0.00118598, throughput 2.86579K wps
[Epoch 76 Batch 600/1540] avg loss 0.00117647, throughput 2.85118K wps
[Epoch 76 Batch 630/1540] avg loss 0.00127636, throughput 2.82027K wps
[Epoch 76 Batch 660/1540] avg loss 0.00109243, throughput 2.87472K wps
[Epoch 76 Batch 690/1540] avg loss 0.00120636, throughput 2.79121K wps
[Epoch 76 Batch 720/1540] avg loss 0.00118935, throughput 2.87656K wps
[Epoch 76 Batch 750/1540] avg loss 0.00144519, throughput 2.85887K wps
[Epoch 76 Batch 780/1540] avg loss 0.00130569, throughput 2.83902K wps
[Epoch 76 Batch 810/1540] avg loss 0.0016774, throughput 2.84847K wps
[Epoch 76 Batch 840/1540] avg loss 0.00113611, throughput 2.85502K wps
[Epoch 76 Batch 870/1540] avg loss 0.00134164, throughput 2.87211K wps
[Epoch 76 Batch 900/1540] avg loss 0.0013786, throughput 2.85874K wps
[Epoch 76 Batch 930/1540] avg loss 0.00134714, throughput 2.8619K wps
[Epoch 76 Batch 960/1540] avg loss 0.00138523, throughput 2.83183K wps
[Epoch 76 Batch 990/1540] avg loss 0.00134273, throughput 2.8637K wps
[Epoch 76 Batch 1020/1540] avg loss 0.00124208, throughput 2.87452K wps
[Epoch 76 Batch 1050/1540] avg loss 0.0014162, throughput 2.84417K wps
[Epoch 76 Batch 1080/1540] avg loss 0.00132228, throughput 2.82093K wps
[Epoch 76 Batch 1110/1540] avg loss 0.00108706, throughput 2.86292K wps
[Epoch 76 Batch 1140/1540] avg loss 0.00161487, throughput 2.86007K wps
[Epoch 76 Batch 1170/1540] avg loss 0.00146798, throughput 2.86357K wps
[Epoch 76 Batch 1200/1540] avg loss 0.00120927, throughput 2.86482K wps
[Epoch 76 Batch 1230/1540] avg loss 0.00104914, throughput 2.87213K wps
[Epoch 76 Batch 1260/1540] avg loss 0.00155718, throughput 2.79996K wps
[Epoch 76 Batch 1290/1540] avg loss 0.00135335, throughput 2.87931K wps
[Epoch 76 Batch 1320/1540] avg loss 0.00143463, throughput 2.86285K wps
[Epoch 76 Batch 1350/1540] avg loss 0.00116212, throughput 2.85525K wps
[Epoch 76 Batch 1380/1540] avg loss 0.00141162, throughput 2.83557K wps
[Epoch 76 Batch 1410/1540] avg loss 0.00125774, throughput 2.88043K wps
[Epoch 76 Batch 1440/1540] avg loss 0.00125387, throughput 2.84415K wps
[Epoch 76 Batch 1470/1540] avg loss 0.00122557, throughput 2.87554K wps
[Epoch 76 Batch 1500/1540] avg loss 0.00123777, throughput 2.85557K wps
[Epoch 76 Batch 1530/1540] avg loss 0.00168401, throughput 2.85402K wps
Begin Testing...
[Epoch 76] train avg loss 0.00126783, dev acc 0.7936, dev avg loss 0.73382, throughput 2.85478K wps
[Epoch 77 Batch 30/1540] avg loss 0.00110014, throughput 2.91743K wps
[Epoch 77 Batch 60/1540] avg loss 0.00103485, throughput 2.85789K wps
[Epoch 77 Batch 90/1540] avg loss 0.00115348, throughput 2.83279K wps
[Epoch 77 Batch 120/1540] avg loss 0.00119572, throughput 2.81107K wps
[Epoch 77 Batch 150/1540] avg loss 0.00108149, throughput 2.79037K wps
[Epoch 77 Batch 180/1540] avg loss 0.00105338, throughput 2.87067K wps
[Epoch 77 Batch 210/1540] avg loss 0.00109288, throughput 2.85414K wps
[Epoch 77 Batch 240/1540] avg loss 0.00117382, throughput 2.84752K wps
[Epoch 77 Batch 270/1540] avg loss 0.00136203, throughput 2.86246K wps
[Epoch 77 Batch 300/1540] avg loss 0.00122936, throughput 2.85793K wps
[Epoch 77 Batch 330/1540] avg loss 0.000986657, throughput 2.87733K wps
[Epoch 77 Batch 360/1540] avg loss 0.00111355, throughput 2.82216K wps
[Epoch 77 Batch 390/1540] avg loss 0.00134429, throughput 2.87908K wps
[Epoch 77 Batch 420/1540] avg loss 0.00128611, throughput 2.88267K wps
[Epoch 77 Batch 450/1540] avg loss 0.00117512, throughput 2.8444K wps
[Epoch 77 Batch 480/1540] avg loss 0.00126569, throughput 2.84748K wps
[Epoch 77 Batch 510/1540] avg loss 0.00105346, throughput 2.82892K wps
[Epoch 77 Batch 540/1540] avg loss 0.00149562, throughput 2.86507K wps
[Epoch 77 Batch 570/1540] avg loss 0.00123826, throughput 2.87159K wps
[Epoch 77 Batch 600/1540] avg loss 0.0011492, throughput 2.86174K wps
[Epoch 77 Batch 630/1540] avg loss 0.00144372, throughput 2.80302K wps
[Epoch 77 Batch 660/1540] avg loss 0.00129814, throughput 2.85226K wps
[Epoch 77 Batch 690/1540] avg loss 0.00138786, throughput 2.85834K wps
[Epoch 77 Batch 720/1540] avg loss 0.00111977, throughput 2.83314K wps
[Epoch 77 Batch 750/1540] avg loss 0.00107124, throughput 2.87163K wps
[Epoch 77 Batch 780/1540] avg loss 0.00124532, throughput 2.8005K wps
[Epoch 77 Batch 810/1540] avg loss 0.00113339, throughput 2.80288K wps
[Epoch 77 Batch 840/1540] avg loss 0.00108939, throughput 2.84079K wps
[Epoch 77 Batch 870/1540] avg loss 0.00105246, throughput 2.86091K wps
[Epoch 77 Batch 900/1540] avg loss 0.00130167, throughput 2.87838K wps
[Epoch 77 Batch 930/1540] avg loss 0.0012716, throughput 2.88515K wps
[Epoch 77 Batch 960/1540] avg loss 0.00108774, throughput 2.86134K wps
[Epoch 77 Batch 990/1540] avg loss 0.00139461, throughput 2.87194K wps
[Epoch 77 Batch 1020/1540] avg loss 0.00152339, throughput 2.8504K wps
[Epoch 77 Batch 1050/1540] avg loss 0.00105837, throughput 2.84133K wps
[Epoch 77 Batch 1080/1540] avg loss 0.00149706, throughput 2.82334K wps
[Epoch 77 Batch 1110/1540] avg loss 0.00164804, throughput 2.84571K wps
[Epoch 77 Batch 1140/1540] avg loss 0.00149216, throughput 2.84663K wps
[Epoch 77 Batch 1170/1540] avg loss 0.00144061, throughput 2.87409K wps
[Epoch 77 Batch 1200/1540] avg loss 0.00156452, throughput 2.83233K wps
[Epoch 77 Batch 1230/1540] avg loss 0.00140154, throughput 2.87667K wps
[Epoch 77 Batch 1260/1540] avg loss 0.00136797, throughput 2.84335K wps
[Epoch 77 Batch 1290/1540] avg loss 0.00136743, throughput 2.82643K wps
[Epoch 77 Batch 1320/1540] avg loss 0.00146315, throughput 2.8725K wps
[Epoch 77 Batch 1350/1540] avg loss 0.00155136, throughput 2.81932K wps
[Epoch 77 Batch 1380/1540] avg loss 0.00128587, throughput 2.85546K wps
[Epoch 77 Batch 1410/1540] avg loss 0.00112483, throughput 2.8546K wps
[Epoch 77 Batch 1440/1540] avg loss 0.00137604, throughput 2.85708K wps
[Epoch 77 Batch 1470/1540] avg loss 0.00137639, throughput 2.87258K wps
[Epoch 77 Batch 1500/1540] avg loss 0.00131139, throughput 2.87123K wps
[Epoch 77 Batch 1530/1540] avg loss 0.00112699, throughput 2.86828K wps
Begin Testing...
[Epoch 77] train avg loss 0.00126506, dev acc 0.7947, dev avg loss 0.757195, throughput 2.85145K wps
[Epoch 78 Batch 30/1540] avg loss 0.00129937, throughput 2.92336K wps
[Epoch 78 Batch 60/1540] avg loss 0.00122043, throughput 2.84935K wps
[Epoch 78 Batch 90/1540] avg loss 0.00124478, throughput 2.7957K wps
[Epoch 78 Batch 120/1540] avg loss 0.00125225, throughput 2.85511K wps
[Epoch 78 Batch 150/1540] avg loss 0.00114456, throughput 2.87764K wps
[Epoch 78 Batch 180/1540] avg loss 0.00127012, throughput 2.8571K wps
[Epoch 78 Batch 210/1540] avg loss 0.0014171, throughput 2.86152K wps
[Epoch 78 Batch 240/1540] avg loss 0.00123048, throughput 2.88029K wps
[Epoch 78 Batch 270/1540] avg loss 0.00113139, throughput 2.87371K wps
[Epoch 78 Batch 300/1540] avg loss 0.00112207, throughput 2.84192K wps
[Epoch 78 Batch 330/1540] avg loss 0.00104866, throughput 2.81717K wps
[Epoch 78 Batch 360/1540] avg loss 0.00136384, throughput 2.8558K wps
[Epoch 78 Batch 390/1540] avg loss 0.00111314, throughput 2.86816K wps
[Epoch 78 Batch 420/1540] avg loss 0.00129543, throughput 2.83156K wps
[Epoch 78 Batch 450/1540] avg loss 0.00109574, throughput 2.85524K wps
[Epoch 78 Batch 480/1540] avg loss 0.00120049, throughput 2.86789K wps
[Epoch 78 Batch 510/1540] avg loss 0.000907048, throughput 2.85277K wps
[Epoch 78 Batch 540/1540] avg loss 0.00109924, throughput 2.80025K wps
[Epoch 78 Batch 570/1540] avg loss 0.00128509, throughput 2.87992K wps
[Epoch 78 Batch 600/1540] avg loss 0.000844632, throughput 2.87617K wps
[Epoch 78 Batch 630/1540] avg loss 0.00111855, throughput 2.87116K wps
[Epoch 78 Batch 660/1540] avg loss 0.00108189, throughput 2.86157K wps
[Epoch 78 Batch 690/1540] avg loss 0.0012564, throughput 2.83232K wps
[Epoch 78 Batch 720/1540] avg loss 0.0015441, throughput 2.87737K wps
[Epoch 78 Batch 750/1540] avg loss 0.00115891, throughput 2.83424K wps
[Epoch 78 Batch 780/1540] avg loss 0.00125726, throughput 2.84192K wps
[Epoch 78 Batch 810/1540] avg loss 0.00123898, throughput 2.85444K wps
[Epoch 78 Batch 840/1540] avg loss 0.00134984, throughput 2.82284K wps
[Epoch 78 Batch 870/1540] avg loss 0.00126381, throughput 2.86004K wps
[Epoch 78 Batch 900/1540] avg loss 0.00153912, throughput 2.84608K wps
[Epoch 78 Batch 930/1540] avg loss 0.00118237, throughput 2.80642K wps
[Epoch 78 Batch 960/1540] avg loss 0.0012202, throughput 2.8296K wps
[Epoch 78 Batch 990/1540] avg loss 0.0012893, throughput 2.86702K wps
[Epoch 78 Batch 1020/1540] avg loss 0.00116745, throughput 2.86038K wps
[Epoch 78 Batch 1050/1540] avg loss 0.00102366, throughput 2.80495K wps
[Epoch 78 Batch 1080/1540] avg loss 0.00163197, throughput 2.87995K wps
[Epoch 78 Batch 1110/1540] avg loss 0.0013402, throughput 2.875K wps
[Epoch 78 Batch 1140/1540] avg loss 0.00140773, throughput 2.87929K wps
[Epoch 78 Batch 1170/1540] avg loss 0.00152292, throughput 2.88609K wps
[Epoch 78 Batch 1200/1540] avg loss 0.00129346, throughput 2.83729K wps
[Epoch 78 Batch 1230/1540] avg loss 0.00122095, throughput 2.86417K wps
[Epoch 78 Batch 1260/1540] avg loss 0.00106639, throughput 2.84626K wps
[Epoch 78 Batch 1290/1540] avg loss 0.00117766, throughput 2.85321K wps
[Epoch 78 Batch 1320/1540] avg loss 0.001334, throughput 2.86514K wps
[Epoch 78 Batch 1350/1540] avg loss 0.00124474, throughput 2.8629K wps
[Epoch 78 Batch 1380/1540] avg loss 0.00130221, throughput 2.87303K wps
[Epoch 78 Batch 1410/1540] avg loss 0.00127484, throughput 2.84328K wps
[Epoch 78 Batch 1440/1540] avg loss 0.00144596, throughput 2.85926K wps
[Epoch 78 Batch 1470/1540] avg loss 0.00124839, throughput 2.84137K wps
[Epoch 78 Batch 1500/1540] avg loss 0.00114767, throughput 2.85629K wps
[Epoch 78 Batch 1530/1540] avg loss 0.00113587, throughput 2.86378K wps
Begin Testing...
[Epoch 78] train avg loss 0.00123807, dev acc 0.7936, dev avg loss 0.761412, throughput 2.85427K wps
[Epoch 79 Batch 30/1540] avg loss 0.000941235, throughput 2.89404K wps
[Epoch 79 Batch 60/1540] avg loss 0.00125455, throughput 2.85385K wps
[Epoch 79 Batch 90/1540] avg loss 0.00107937, throughput 2.87377K wps
[Epoch 79 Batch 120/1540] avg loss 0.00122805, throughput 2.88322K wps
[Epoch 79 Batch 150/1540] avg loss 0.00106402, throughput 2.8674K wps
[Epoch 79 Batch 180/1540] avg loss 0.00100455, throughput 2.82985K wps
[Epoch 79 Batch 210/1540] avg loss 0.00113023, throughput 2.86026K wps
[Epoch 79 Batch 240/1540] avg loss 0.00112194, throughput 2.87737K wps
[Epoch 79 Batch 270/1540] avg loss 0.00116653, throughput 2.86785K wps
[Epoch 79 Batch 300/1540] avg loss 0.00139226, throughput 2.83957K wps
[Epoch 79 Batch 330/1540] avg loss 0.00104916, throughput 2.84776K wps
[Epoch 79 Batch 360/1540] avg loss 0.0011277, throughput 2.85316K wps
[Epoch 79 Batch 390/1540] avg loss 0.000965304, throughput 2.86249K wps
[Epoch 79 Batch 420/1540] avg loss 0.00127223, throughput 2.84471K wps
[Epoch 79 Batch 450/1540] avg loss 0.000948586, throughput 2.83056K wps
[Epoch 79 Batch 480/1540] avg loss 0.001174, throughput 2.83626K wps
[Epoch 79 Batch 510/1540] avg loss 0.0014035, throughput 2.85464K wps
[Epoch 79 Batch 540/1540] avg loss 0.00107476, throughput 2.86219K wps
[Epoch 79 Batch 570/1540] avg loss 0.001223, throughput 2.85856K wps
[Epoch 79 Batch 600/1540] avg loss 0.00119362, throughput 2.8626K wps
[Epoch 79 Batch 630/1540] avg loss 0.00121343, throughput 2.84052K wps
[Epoch 79 Batch 660/1540] avg loss 0.00128296, throughput 2.85906K wps
[Epoch 79 Batch 690/1540] avg loss 0.00109432, throughput 2.85322K wps
[Epoch 79 Batch 720/1540] avg loss 0.00132946, throughput 2.87118K wps
[Epoch 79 Batch 750/1540] avg loss 0.00145629, throughput 2.8738K wps
[Epoch 79 Batch 780/1540] avg loss 0.00114545, throughput 2.85295K wps
[Epoch 79 Batch 810/1540] avg loss 0.00116155, throughput 2.86369K wps
[Epoch 79 Batch 840/1540] avg loss 0.0013572, throughput 2.81736K wps
[Epoch 79 Batch 870/1540] avg loss 0.00130094, throughput 2.79114K wps
[Epoch 79 Batch 900/1540] avg loss 0.00127826, throughput 2.77682K wps
[Epoch 79 Batch 930/1540] avg loss 0.00136548, throughput 2.83536K wps
[Epoch 79 Batch 960/1540] avg loss 0.00134266, throughput 2.86457K wps
[Epoch 79 Batch 990/1540] avg loss 0.00108045, throughput 2.84276K wps
[Epoch 79 Batch 1020/1540] avg loss 0.0012407, throughput 2.85058K wps
[Epoch 79 Batch 1050/1540] avg loss 0.00123908, throughput 2.82587K wps
[Epoch 79 Batch 1080/1540] avg loss 0.00121121, throughput 2.8726K wps
[Epoch 79 Batch 1110/1540] avg loss 0.001262, throughput 2.87746K wps
[Epoch 79 Batch 1140/1540] avg loss 0.00131157, throughput 2.85824K wps
[Epoch 79 Batch 1170/1540] avg loss 0.00150188, throughput 2.86282K wps
[Epoch 79 Batch 1200/1540] avg loss 0.00132917, throughput 2.87506K wps
[Epoch 79 Batch 1230/1540] avg loss 0.00152327, throughput 2.86247K wps
[Epoch 79 Batch 1260/1540] avg loss 0.00123565, throughput 2.85967K wps
[Epoch 79 Batch 1290/1540] avg loss 0.00161539, throughput 2.86281K wps
[Epoch 79 Batch 1320/1540] avg loss 0.00133378, throughput 2.83402K wps
[Epoch 79 Batch 1350/1540] avg loss 0.00128172, throughput 2.8808K wps
[Epoch 79 Batch 1380/1540] avg loss 0.00118504, throughput 2.87293K wps
[Epoch 79 Batch 1410/1540] avg loss 0.00129819, throughput 2.86354K wps
[Epoch 79 Batch 1440/1540] avg loss 0.00165747, throughput 2.84558K wps
[Epoch 79 Batch 1470/1540] avg loss 0.00162584, throughput 2.86327K wps
[Epoch 79 Batch 1500/1540] avg loss 0.00109422, throughput 2.85335K wps
[Epoch 79 Batch 1530/1540] avg loss 0.00125614, throughput 2.87019K wps
Begin Testing...
[Epoch 79] train avg loss 0.00124327, dev acc 0.8005, dev avg loss 0.753974, throughput 2.85471K wps
[Epoch 80 Batch 30/1540] avg loss 0.00119636, throughput 2.93562K wps
[Epoch 80 Batch 60/1540] avg loss 0.00109847, throughput 2.87664K wps
[Epoch 80 Batch 90/1540] avg loss 0.00105589, throughput 2.86126K wps
[Epoch 80 Batch 120/1540] avg loss 0.00103227, throughput 2.83994K wps
[Epoch 80 Batch 150/1540] avg loss 0.00108052, throughput 2.88048K wps
[Epoch 80 Batch 180/1540] avg loss 0.00115097, throughput 2.8696K wps
[Epoch 80 Batch 210/1540] avg loss 0.00139038, throughput 2.84215K wps
[Epoch 80 Batch 240/1540] avg loss 0.00124972, throughput 2.88855K wps
[Epoch 80 Batch 270/1540] avg loss 0.00110615, throughput 2.86988K wps
[Epoch 80 Batch 300/1540] avg loss 0.00106885, throughput 2.86497K wps
[Epoch 80 Batch 330/1540] avg loss 0.00111917, throughput 2.85593K wps
[Epoch 80 Batch 360/1540] avg loss 0.00112817, throughput 2.87387K wps
[Epoch 80 Batch 390/1540] avg loss 0.00107026, throughput 2.84558K wps
[Epoch 80 Batch 420/1540] avg loss 0.001137, throughput 2.86145K wps
[Epoch 80 Batch 450/1540] avg loss 0.00137361, throughput 2.77899K wps
[Epoch 80 Batch 480/1540] avg loss 0.00113507, throughput 2.77236K wps
[Epoch 80 Batch 510/1540] avg loss 0.00152617, throughput 2.88335K wps
[Epoch 80 Batch 540/1540] avg loss 0.00134533, throughput 2.8346K wps
[Epoch 80 Batch 570/1540] avg loss 0.00119339, throughput 2.853K wps
[Epoch 80 Batch 600/1540] avg loss 0.00110297, throughput 2.84258K wps
[Epoch 80 Batch 630/1540] avg loss 0.00131929, throughput 2.86272K wps
[Epoch 80 Batch 660/1540] avg loss 0.0011681, throughput 2.83014K wps
[Epoch 80 Batch 690/1540] avg loss 0.00127734, throughput 2.86531K wps
[Epoch 80 Batch 720/1540] avg loss 0.00115877, throughput 2.87997K wps
[Epoch 80 Batch 750/1540] avg loss 0.00129907, throughput 2.84997K wps
[Epoch 80 Batch 780/1540] avg loss 0.00110271, throughput 2.82202K wps
[Epoch 80 Batch 810/1540] avg loss 0.00136682, throughput 2.86604K wps
[Epoch 80 Batch 840/1540] avg loss 0.00117925, throughput 2.87505K wps
[Epoch 80 Batch 870/1540] avg loss 0.00113799, throughput 2.85395K wps
[Epoch 80 Batch 900/1540] avg loss 0.00129066, throughput 2.88697K wps
[Epoch 80 Batch 930/1540] avg loss 0.00135715, throughput 2.83494K wps
[Epoch 80 Batch 960/1540] avg loss 0.000977957, throughput 2.82918K wps
[Epoch 80 Batch 990/1540] avg loss 0.00129039, throughput 2.88087K wps
[Epoch 80 Batch 1020/1540] avg loss 0.00131146, throughput 2.84616K wps
[Epoch 80 Batch 1050/1540] avg loss 0.00114002, throughput 2.82559K wps
[Epoch 80 Batch 1080/1540] avg loss 0.00139472, throughput 2.86885K wps
[Epoch 80 Batch 1110/1540] avg loss 0.00112891, throughput 2.85783K wps
[Epoch 80 Batch 1140/1540] avg loss 0.00138553, throughput 2.8519K wps
[Epoch 80 Batch 1170/1540] avg loss 0.00119938, throughput 2.87078K wps
[Epoch 80 Batch 1200/1540] avg loss 0.00111761, throughput 2.88305K wps
[Epoch 80 Batch 1230/1540] avg loss 0.00141835, throughput 2.84149K wps
[Epoch 80 Batch 1260/1540] avg loss 0.00123925, throughput 2.87719K wps
[Epoch 80 Batch 1290/1540] avg loss 0.0011392, throughput 2.86778K wps
[Epoch 80 Batch 1320/1540] avg loss 0.00112278, throughput 2.8547K wps
[Epoch 80 Batch 1350/1540] avg loss 0.00118603, throughput 2.86156K wps
[Epoch 80 Batch 1380/1540] avg loss 0.00141398, throughput 2.83037K wps
[Epoch 80 Batch 1410/1540] avg loss 0.00127526, throughput 2.86865K wps
[Epoch 80 Batch 1440/1540] avg loss 0.00127751, throughput 2.86505K wps
[Epoch 80 Batch 1470/1540] avg loss 0.00163049, throughput 2.85407K wps
[Epoch 80 Batch 1500/1540] avg loss 0.00104354, throughput 2.84038K wps
[Epoch 80 Batch 1530/1540] avg loss 0.00149249, throughput 2.84985K wps
Begin Testing...
[Epoch 80] train avg loss 0.00122595, dev acc 0.7959, dev avg loss 0.767122, throughput 2.85641K wps
[Epoch 81 Batch 30/1540] avg loss 0.000974674, throughput 2.93394K wps
[Epoch 81 Batch 60/1540] avg loss 0.00106834, throughput 2.85028K wps
[Epoch 81 Batch 90/1540] avg loss 0.00104774, throughput 2.86765K wps
[Epoch 81 Batch 120/1540] avg loss 0.00105431, throughput 2.81598K wps
[Epoch 81 Batch 150/1540] avg loss 0.0010464, throughput 2.86787K wps
[Epoch 81 Batch 180/1540] avg loss 0.00102588, throughput 2.8027K wps
[Epoch 81 Batch 210/1540] avg loss 0.00109243, throughput 2.86979K wps
[Epoch 81 Batch 240/1540] avg loss 0.00108207, throughput 2.88125K wps
[Epoch 81 Batch 270/1540] avg loss 0.00105827, throughput 2.81098K wps
[Epoch 81 Batch 300/1540] avg loss 0.00115563, throughput 2.84376K wps
[Epoch 81 Batch 330/1540] avg loss 0.000911545, throughput 2.87102K wps
[Epoch 81 Batch 360/1540] avg loss 0.00118517, throughput 2.87521K wps
[Epoch 81 Batch 390/1540] avg loss 0.00113062, throughput 2.83949K wps
[Epoch 81 Batch 420/1540] avg loss 0.00113547, throughput 2.8569K wps
[Epoch 81 Batch 450/1540] avg loss 0.00118197, throughput 2.81355K wps
[Epoch 81 Batch 480/1540] avg loss 0.00113721, throughput 2.80968K wps
[Epoch 81 Batch 510/1540] avg loss 0.00122868, throughput 2.87715K wps
[Epoch 81 Batch 540/1540] avg loss 0.00114147, throughput 2.87258K wps
[Epoch 81 Batch 570/1540] avg loss 0.00122803, throughput 2.85326K wps
[Epoch 81 Batch 600/1540] avg loss 0.00118419, throughput 2.87795K wps
[Epoch 81 Batch 630/1540] avg loss 0.00136512, throughput 2.88349K wps
[Epoch 81 Batch 660/1540] avg loss 0.00131688, throughput 2.86484K wps
[Epoch 81 Batch 690/1540] avg loss 0.00112016, throughput 2.87264K wps
[Epoch 81 Batch 720/1540] avg loss 0.00134035, throughput 2.87327K wps
[Epoch 81 Batch 750/1540] avg loss 0.00105209, throughput 2.82184K wps
[Epoch 81 Batch 780/1540] avg loss 0.00114245, throughput 2.84837K wps
[Epoch 81 Batch 810/1540] avg loss 0.0011895, throughput 2.81438K wps
[Epoch 81 Batch 840/1540] avg loss 0.00110502, throughput 2.86224K wps
[Epoch 81 Batch 870/1540] avg loss 0.00122879, throughput 2.85933K wps
[Epoch 81 Batch 900/1540] avg loss 0.00107282, throughput 2.82082K wps
[Epoch 81 Batch 930/1540] avg loss 0.000912533, throughput 2.80885K wps
[Epoch 81 Batch 960/1540] avg loss 0.00110508, throughput 2.87282K wps
[Epoch 81 Batch 990/1540] avg loss 0.00135018, throughput 2.85984K wps
[Epoch 81 Batch 1020/1540] avg loss 0.00126976, throughput 2.85766K wps
[Epoch 81 Batch 1050/1540] avg loss 0.00159279, throughput 2.87527K wps
[Epoch 81 Batch 1080/1540] avg loss 0.00112126, throughput 2.84969K wps
[Epoch 81 Batch 1110/1540] avg loss 0.00123569, throughput 2.86133K wps
[Epoch 81 Batch 1140/1540] avg loss 0.00110354, throughput 2.87616K wps
[Epoch 81 Batch 1170/1540] avg loss 0.00115035, throughput 2.85797K wps
[Epoch 81 Batch 1200/1540] avg loss 0.00134082, throughput 2.87856K wps
[Epoch 81 Batch 1230/1540] avg loss 0.0015144, throughput 2.87928K wps
[Epoch 81 Batch 1260/1540] avg loss 0.00126454, throughput 2.87465K wps
[Epoch 81 Batch 1290/1540] avg loss 0.00150168, throughput 2.88369K wps
[Epoch 81 Batch 1320/1540] avg loss 0.00126797, throughput 2.86539K wps
[Epoch 81 Batch 1350/1540] avg loss 0.00114358, throughput 2.80295K wps
[Epoch 81 Batch 1380/1540] avg loss 0.00119277, throughput 2.8522K wps
[Epoch 81 Batch 1410/1540] avg loss 0.00153933, throughput 2.8744K wps
[Epoch 81 Batch 1440/1540] avg loss 0.00117545, throughput 2.86537K wps
[Epoch 81 Batch 1470/1540] avg loss 0.00140815, throughput 2.80739K wps
[Epoch 81 Batch 1500/1540] avg loss 0.00120818, throughput 2.85372K wps
[Epoch 81 Batch 1530/1540] avg loss 0.00136163, throughput 2.85927K wps
Begin Testing...
[Epoch 81] train avg loss 0.00119336, dev acc 0.7970, dev avg loss 0.749552, throughput 2.85526K wps
[Epoch 82 Batch 30/1540] avg loss 0.000943903, throughput 2.91186K wps
[Epoch 82 Batch 60/1540] avg loss 0.000984001, throughput 2.83807K wps
[Epoch 82 Batch 90/1540] avg loss 0.00112061, throughput 2.85321K wps
[Epoch 82 Batch 120/1540] avg loss 0.0010822, throughput 2.86641K wps
[Epoch 82 Batch 150/1540] avg loss 0.00115535, throughput 2.85446K wps
[Epoch 82 Batch 180/1540] avg loss 0.00119995, throughput 2.85899K wps
[Epoch 82 Batch 210/1540] avg loss 0.00115035, throughput 2.85508K wps
[Epoch 82 Batch 240/1540] avg loss 0.00114221, throughput 2.8614K wps
[Epoch 82 Batch 270/1540] avg loss 0.0010119, throughput 2.79264K wps
[Epoch 82 Batch 300/1540] avg loss 0.00109406, throughput 2.85432K wps
[Epoch 82 Batch 330/1540] avg loss 0.00117294, throughput 2.87339K wps
[Epoch 82 Batch 360/1540] avg loss 0.00129747, throughput 2.86264K wps
[Epoch 82 Batch 390/1540] avg loss 0.00113513, throughput 2.82995K wps
[Epoch 82 Batch 420/1540] avg loss 0.00124129, throughput 2.84263K wps
[Epoch 82 Batch 450/1540] avg loss 0.00121696, throughput 2.87062K wps
[Epoch 82 Batch 480/1540] avg loss 0.00121425, throughput 2.86096K wps
[Epoch 82 Batch 510/1540] avg loss 0.0011809, throughput 2.81365K wps
[Epoch 82 Batch 540/1540] avg loss 0.00102684, throughput 2.7808K wps
[Epoch 82 Batch 570/1540] avg loss 0.00131957, throughput 2.79687K wps
[Epoch 82 Batch 600/1540] avg loss 0.00132066, throughput 2.87616K wps
[Epoch 82 Batch 630/1540] avg loss 0.00117761, throughput 2.87677K wps
[Epoch 82 Batch 660/1540] avg loss 0.00135406, throughput 2.84755K wps
[Epoch 82 Batch 690/1540] avg loss 0.00111778, throughput 2.82221K wps
[Epoch 82 Batch 720/1540] avg loss 0.00127619, throughput 2.86783K wps
[Epoch 82 Batch 750/1540] avg loss 0.00098226, throughput 2.84877K wps
[Epoch 82 Batch 780/1540] avg loss 0.00113857, throughput 2.82145K wps
[Epoch 82 Batch 810/1540] avg loss 0.00127544, throughput 2.85936K wps
[Epoch 82 Batch 840/1540] avg loss 0.00118506, throughput 2.84K wps
[Epoch 82 Batch 870/1540] avg loss 0.00119354, throughput 2.8633K wps
[Epoch 82 Batch 900/1540] avg loss 0.00131722, throughput 2.85956K wps
[Epoch 82 Batch 930/1540] avg loss 0.0015362, throughput 2.87413K wps
[Epoch 82 Batch 960/1540] avg loss 0.00151023, throughput 2.86799K wps
[Epoch 82 Batch 990/1540] avg loss 0.00117044, throughput 2.8735K wps
[Epoch 82 Batch 1020/1540] avg loss 0.00121043, throughput 2.87189K wps
[Epoch 82 Batch 1050/1540] avg loss 0.00121919, throughput 2.84299K wps
[Epoch 82 Batch 1080/1540] avg loss 0.00134967, throughput 2.84624K wps
[Epoch 82 Batch 1110/1540] avg loss 0.00138898, throughput 2.8567K wps
[Epoch 82 Batch 1140/1540] avg loss 0.00102854, throughput 2.87419K wps
[Epoch 82 Batch 1170/1540] avg loss 0.00130001, throughput 2.85534K wps
[Epoch 82 Batch 1200/1540] avg loss 0.00123705, throughput 2.81513K wps
[Epoch 82 Batch 1230/1540] avg loss 0.00123895, throughput 2.86338K wps
[Epoch 82 Batch 1260/1540] avg loss 0.00127342, throughput 2.84565K wps
[Epoch 82 Batch 1290/1540] avg loss 0.001334, throughput 2.86384K wps
[Epoch 82 Batch 1320/1540] avg loss 0.00152181, throughput 2.85187K wps
[Epoch 82 Batch 1350/1540] avg loss 0.00148873, throughput 2.88652K wps
[Epoch 82 Batch 1380/1540] avg loss 0.00114305, throughput 2.88415K wps
[Epoch 82 Batch 1410/1540] avg loss 0.00112266, throughput 2.87176K wps
[Epoch 82 Batch 1440/1540] avg loss 0.0013033, throughput 2.82281K wps
[Epoch 82 Batch 1470/1540] avg loss 0.00144619, throughput 2.86243K wps
[Epoch 82 Batch 1500/1540] avg loss 0.00114262, throughput 2.85452K wps
[Epoch 82 Batch 1530/1540] avg loss 0.00129611, throughput 2.83205K wps
Begin Testing...
[Epoch 82] train avg loss 0.00122114, dev acc 0.7901, dev avg loss 0.770397, throughput 2.85245K wps
[Epoch 83 Batch 30/1540] avg loss 0.00147399, throughput 2.89906K wps
[Epoch 83 Batch 60/1540] avg loss 0.000924745, throughput 2.87731K wps
[Epoch 83 Batch 90/1540] avg loss 0.00110855, throughput 2.82311K wps
[Epoch 83 Batch 120/1540] avg loss 0.00110602, throughput 2.83119K wps
[Epoch 83 Batch 150/1540] avg loss 0.00106701, throughput 2.80065K wps
[Epoch 83 Batch 180/1540] avg loss 0.00138895, throughput 2.8671K wps
[Epoch 83 Batch 210/1540] avg loss 0.00162035, throughput 2.84421K wps
[Epoch 83 Batch 240/1540] avg loss 0.00100107, throughput 2.80501K wps
[Epoch 83 Batch 270/1540] avg loss 0.0011335, throughput 2.79576K wps
[Epoch 83 Batch 300/1540] avg loss 0.00103992, throughput 2.86758K wps
[Epoch 83 Batch 330/1540] avg loss 0.00112901, throughput 2.88459K wps
[Epoch 83 Batch 360/1540] avg loss 0.00131277, throughput 2.84725K wps
[Epoch 83 Batch 390/1540] avg loss 0.00138174, throughput 2.87382K wps
[Epoch 83 Batch 420/1540] avg loss 0.00151085, throughput 2.85958K wps
[Epoch 83 Batch 450/1540] avg loss 0.00106311, throughput 2.84535K wps
[Epoch 83 Batch 480/1540] avg loss 0.00118114, throughput 2.87469K wps
[Epoch 83 Batch 510/1540] avg loss 0.00133851, throughput 2.85749K wps
[Epoch 83 Batch 540/1540] avg loss 0.00105137, throughput 2.87282K wps
[Epoch 83 Batch 570/1540] avg loss 0.00132282, throughput 2.8663K wps
[Epoch 83 Batch 600/1540] avg loss 0.0010156, throughput 2.86366K wps
[Epoch 83 Batch 630/1540] avg loss 0.00131246, throughput 2.86262K wps
[Epoch 83 Batch 660/1540] avg loss 0.00102017, throughput 2.85881K wps
[Epoch 83 Batch 690/1540] avg loss 0.00105954, throughput 2.84043K wps
[Epoch 83 Batch 720/1540] avg loss 0.0010312, throughput 2.86254K wps
[Epoch 83 Batch 750/1540] avg loss 0.00129033, throughput 2.87188K wps
[Epoch 83 Batch 780/1540] avg loss 0.00126956, throughput 2.87218K wps
[Epoch 83 Batch 810/1540] avg loss 0.00106189, throughput 2.81659K wps
[Epoch 83 Batch 840/1540] avg loss 0.00135223, throughput 2.86485K wps
[Epoch 83 Batch 870/1540] avg loss 0.00088096, throughput 2.85553K wps
[Epoch 83 Batch 900/1540] avg loss 0.00112295, throughput 2.85961K wps
[Epoch 83 Batch 930/1540] avg loss 0.00137349, throughput 2.81482K wps
[Epoch 83 Batch 960/1540] avg loss 0.00116312, throughput 2.86608K wps
[Epoch 83 Batch 990/1540] avg loss 0.00112809, throughput 2.86664K wps
[Epoch 83 Batch 1020/1540] avg loss 0.00116918, throughput 2.86355K wps
[Epoch 83 Batch 1050/1540] avg loss 0.00131852, throughput 2.86215K wps
[Epoch 83 Batch 1080/1540] avg loss 0.00104172, throughput 2.88423K wps
[Epoch 83 Batch 1110/1540] avg loss 0.0012093, throughput 2.87502K wps
[Epoch 83 Batch 1140/1540] avg loss 0.00131209, throughput 2.88127K wps
[Epoch 83 Batch 1170/1540] avg loss 0.00134923, throughput 2.8726K wps
[Epoch 83 Batch 1200/1540] avg loss 0.00123744, throughput 2.86371K wps
[Epoch 83 Batch 1230/1540] avg loss 0.00126309, throughput 2.87542K wps
[Epoch 83 Batch 1260/1540] avg loss 0.00121237, throughput 2.86619K wps
[Epoch 83 Batch 1290/1540] avg loss 0.00105329, throughput 2.86883K wps
[Epoch 83 Batch 1320/1540] avg loss 0.00124665, throughput 2.83219K wps
[Epoch 83 Batch 1350/1540] avg loss 0.00130748, throughput 2.87314K wps
[Epoch 83 Batch 1380/1540] avg loss 0.00159497, throughput 2.86973K wps
[Epoch 83 Batch 1410/1540] avg loss 0.00138511, throughput 2.87588K wps
[Epoch 83 Batch 1440/1540] avg loss 0.00119994, throughput 2.84322K wps
[Epoch 83 Batch 1470/1540] avg loss 0.0011901, throughput 2.86491K wps
[Epoch 83 Batch 1500/1540] avg loss 0.00112461, throughput 2.84426K wps
[Epoch 83 Batch 1530/1540] avg loss 0.00135595, throughput 2.84928K wps
Begin Testing...
[Epoch 83] train avg loss 0.00121622, dev acc 0.7959, dev avg loss 0.768837, throughput 2.85683K wps
[Epoch 84 Batch 30/1540] avg loss 0.000940273, throughput 2.87191K wps
[Epoch 84 Batch 60/1540] avg loss 0.00111057, throughput 2.86766K wps
[Epoch 84 Batch 90/1540] avg loss 0.00128937, throughput 2.87367K wps
[Epoch 84 Batch 120/1540] avg loss 0.000906819, throughput 2.83594K wps
[Epoch 84 Batch 150/1540] avg loss 0.00103101, throughput 2.87608K wps
[Epoch 84 Batch 180/1540] avg loss 0.000908226, throughput 2.80384K wps
[Epoch 84 Batch 210/1540] avg loss 0.00112442, throughput 2.85833K wps
[Epoch 84 Batch 240/1540] avg loss 0.00113358, throughput 2.87406K wps
[Epoch 84 Batch 270/1540] avg loss 0.00108143, throughput 2.85639K wps
[Epoch 84 Batch 300/1540] avg loss 0.000887399, throughput 2.81625K wps
[Epoch 84 Batch 330/1540] avg loss 0.00093413, throughput 2.8529K wps
[Epoch 84 Batch 360/1540] avg loss 0.00120001, throughput 2.8167K wps
[Epoch 84 Batch 390/1540] avg loss 0.00111239, throughput 2.84752K wps
[Epoch 84 Batch 420/1540] avg loss 0.00116545, throughput 2.82697K wps
[Epoch 84 Batch 450/1540] avg loss 0.000942207, throughput 2.87635K wps
[Epoch 84 Batch 480/1540] avg loss 0.00128108, throughput 2.87936K wps
[Epoch 84 Batch 510/1540] avg loss 0.000992443, throughput 2.88254K wps
[Epoch 84 Batch 540/1540] avg loss 0.00124786, throughput 2.87154K wps
[Epoch 84 Batch 570/1540] avg loss 0.00129489, throughput 2.83932K wps
[Epoch 84 Batch 600/1540] avg loss 0.00126253, throughput 2.86072K wps
[Epoch 84 Batch 630/1540] avg loss 0.00128833, throughput 2.87776K wps
[Epoch 84 Batch 660/1540] avg loss 0.00110251, throughput 2.81988K wps
[Epoch 84 Batch 690/1540] avg loss 0.00104776, throughput 2.8746K wps
[Epoch 84 Batch 720/1540] avg loss 0.00119082, throughput 2.86698K wps
[Epoch 84 Batch 750/1540] avg loss 0.00112237, throughput 2.815K wps
[Epoch 84 Batch 780/1540] avg loss 0.00106499, throughput 2.87391K wps
[Epoch 84 Batch 810/1540] avg loss 0.00104997, throughput 2.85766K wps
[Epoch 84 Batch 840/1540] avg loss 0.00145364, throughput 2.85794K wps
[Epoch 84 Batch 870/1540] avg loss 0.00145629, throughput 2.85631K wps
[Epoch 84 Batch 900/1540] avg loss 0.00118651, throughput 2.85891K wps
[Epoch 84 Batch 930/1540] avg loss 0.00126655, throughput 2.88308K wps
[Epoch 84 Batch 960/1540] avg loss 0.00113884, throughput 2.84647K wps
[Epoch 84 Batch 990/1540] avg loss 0.00157614, throughput 2.78606K wps
[Epoch 84 Batch 1020/1540] avg loss 0.00123632, throughput 2.83294K wps
[Epoch 84 Batch 1050/1540] avg loss 0.0014366, throughput 2.86682K wps
[Epoch 84 Batch 1080/1540] avg loss 0.00127234, throughput 2.88061K wps
[Epoch 84 Batch 1110/1540] avg loss 0.00160704, throughput 2.87617K wps
[Epoch 84 Batch 1140/1540] avg loss 0.00116578, throughput 2.87842K wps
[Epoch 84 Batch 1170/1540] avg loss 0.00116051, throughput 2.86141K wps
[Epoch 84 Batch 1200/1540] avg loss 0.00113248, throughput 2.8792K wps
[Epoch 84 Batch 1230/1540] avg loss 0.00129785, throughput 2.87696K wps
[Epoch 84 Batch 1260/1540] avg loss 0.00125106, throughput 2.87682K wps
[Epoch 84 Batch 1290/1540] avg loss 0.00114877, throughput 2.88295K wps
[Epoch 84 Batch 1320/1540] avg loss 0.00153849, throughput 2.87167K wps
[Epoch 84 Batch 1350/1540] avg loss 0.00122629, throughput 2.88078K wps
[Epoch 84 Batch 1380/1540] avg loss 0.00121853, throughput 2.84513K wps
[Epoch 84 Batch 1410/1540] avg loss 0.0013121, throughput 2.84996K wps
[Epoch 84 Batch 1440/1540] avg loss 0.00139471, throughput 2.86489K wps
[Epoch 84 Batch 1470/1540] avg loss 0.00133994, throughput 2.86909K wps
[Epoch 84 Batch 1500/1540] avg loss 0.0012297, throughput 2.79222K wps
[Epoch 84 Batch 1530/1540] avg loss 0.00147156, throughput 2.84589K wps
Begin Testing...
[Epoch 84] train avg loss 0.00120188, dev acc 0.7947, dev avg loss 0.765788, throughput 2.85674K wps
[Epoch 85 Batch 30/1540] avg loss 0.00106279, throughput 2.87405K wps
[Epoch 85 Batch 60/1540] avg loss 0.000989156, throughput 2.80608K wps
[Epoch 85 Batch 90/1540] avg loss 0.00121273, throughput 2.86056K wps
[Epoch 85 Batch 120/1540] avg loss 0.00113137, throughput 2.85578K wps
[Epoch 85 Batch 150/1540] avg loss 0.00101277, throughput 2.82148K wps
[Epoch 85 Batch 180/1540] avg loss 0.000810325, throughput 2.79805K wps
[Epoch 85 Batch 210/1540] avg loss 0.00099268, throughput 2.83222K wps
[Epoch 85 Batch 240/1540] avg loss 0.0010085, throughput 2.83833K wps
[Epoch 85 Batch 270/1540] avg loss 0.00110378, throughput 2.8017K wps
[Epoch 85 Batch 300/1540] avg loss 0.000985267, throughput 2.78785K wps
[Epoch 85 Batch 330/1540] avg loss 0.00108894, throughput 2.82491K wps
[Epoch 85 Batch 360/1540] avg loss 0.00118637, throughput 2.85551K wps
[Epoch 85 Batch 390/1540] avg loss 0.00130065, throughput 2.79433K wps
[Epoch 85 Batch 420/1540] avg loss 0.0010445, throughput 2.80816K wps
[Epoch 85 Batch 450/1540] avg loss 0.00102457, throughput 2.86193K wps
[Epoch 85 Batch 480/1540] avg loss 0.00109763, throughput 2.8764K wps
[Epoch 85 Batch 510/1540] avg loss 0.00116532, throughput 2.86259K wps
[Epoch 85 Batch 540/1540] avg loss 0.00109141, throughput 2.85452K wps
[Epoch 85 Batch 570/1540] avg loss 0.00143585, throughput 2.87372K wps
[Epoch 85 Batch 600/1540] avg loss 0.0013108, throughput 2.83573K wps
[Epoch 85 Batch 630/1540] avg loss 0.00101833, throughput 2.82595K wps
[Epoch 85 Batch 660/1540] avg loss 0.00117624, throughput 2.80416K wps
[Epoch 85 Batch 690/1540] avg loss 0.00128273, throughput 2.86173K wps
[Epoch 85 Batch 720/1540] avg loss 0.00117193, throughput 2.86044K wps
[Epoch 85 Batch 750/1540] avg loss 0.00112995, throughput 2.85315K wps
[Epoch 85 Batch 780/1540] avg loss 0.00133265, throughput 2.88188K wps
[Epoch 85 Batch 810/1540] avg loss 0.00135845, throughput 2.80061K wps
[Epoch 85 Batch 840/1540] avg loss 0.0012596, throughput 2.87432K wps
[Epoch 85 Batch 870/1540] avg loss 0.00123476, throughput 2.86966K wps
[Epoch 85 Batch 900/1540] avg loss 0.00110229, throughput 2.87462K wps
[Epoch 85 Batch 930/1540] avg loss 0.00103248, throughput 2.8395K wps
[Epoch 85 Batch 960/1540] avg loss 0.00114207, throughput 2.82004K wps
[Epoch 85 Batch 990/1540] avg loss 0.00143626, throughput 2.842K wps
[Epoch 85 Batch 1020/1540] avg loss 0.00147634, throughput 2.84453K wps
[Epoch 85 Batch 1050/1540] avg loss 0.000948289, throughput 2.88454K wps
[Epoch 85 Batch 1080/1540] avg loss 0.0016523, throughput 2.86948K wps
[Epoch 85 Batch 1110/1540] avg loss 0.00137991, throughput 2.87974K wps
[Epoch 85 Batch 1140/1540] avg loss 0.00116482, throughput 2.84728K wps
[Epoch 85 Batch 1170/1540] avg loss 0.00125836, throughput 2.86662K wps
[Epoch 85 Batch 1200/1540] avg loss 0.000943145, throughput 2.87225K wps
[Epoch 85 Batch 1230/1540] avg loss 0.00115736, throughput 2.85892K wps
[Epoch 85 Batch 1260/1540] avg loss 0.00119012, throughput 2.84817K wps
[Epoch 85 Batch 1290/1540] avg loss 0.00129738, throughput 2.87663K wps
[Epoch 85 Batch 1320/1540] avg loss 0.00133757, throughput 2.84563K wps
[Epoch 85 Batch 1350/1540] avg loss 0.00105955, throughput 2.84561K wps
[Epoch 85 Batch 1380/1540] avg loss 0.00124382, throughput 2.82491K wps
[Epoch 85 Batch 1410/1540] avg loss 0.00124689, throughput 2.86911K wps
[Epoch 85 Batch 1440/1540] avg loss 0.00119601, throughput 2.84177K wps
[Epoch 85 Batch 1470/1540] avg loss 0.00154233, throughput 2.79985K wps
[Epoch 85 Batch 1500/1540] avg loss 0.00115192, throughput 2.8627K wps
[Epoch 85 Batch 1530/1540] avg loss 0.00131449, throughput 2.82489K wps
Begin Testing...
[Epoch 85] train avg loss 0.00118305, dev acc 0.7878, dev avg loss 0.768826, throughput 2.84483K wps
[Epoch 86 Batch 30/1540] avg loss 0.00106583, throughput 2.90055K wps
[Epoch 86 Batch 60/1540] avg loss 0.000883237, throughput 2.86428K wps
[Epoch 86 Batch 90/1540] avg loss 0.00120851, throughput 2.878K wps
[Epoch 86 Batch 120/1540] avg loss 0.00111178, throughput 2.85509K wps
[Epoch 86 Batch 150/1540] avg loss 0.00115574, throughput 2.83425K wps
[Epoch 86 Batch 180/1540] avg loss 0.00109465, throughput 2.88161K wps
[Epoch 86 Batch 210/1540] avg loss 0.00131921, throughput 2.85071K wps
[Epoch 86 Batch 240/1540] avg loss 0.00104569, throughput 2.85479K wps
[Epoch 86 Batch 270/1540] avg loss 0.00123353, throughput 2.87988K wps
[Epoch 86 Batch 300/1540] avg loss 0.00113477, throughput 2.8881K wps
[Epoch 86 Batch 330/1540] avg loss 0.00101656, throughput 2.81201K wps
[Epoch 86 Batch 360/1540] avg loss 0.000817123, throughput 2.85076K wps
[Epoch 86 Batch 390/1540] avg loss 0.000963369, throughput 2.84349K wps
[Epoch 86 Batch 420/1540] avg loss 0.00118585, throughput 2.81673K wps
[Epoch 86 Batch 450/1540] avg loss 0.0011252, throughput 2.81414K wps
[Epoch 86 Batch 480/1540] avg loss 0.00100018, throughput 2.87235K wps
[Epoch 86 Batch 510/1540] avg loss 0.00138722, throughput 2.87643K wps
[Epoch 86 Batch 540/1540] avg loss 0.00137687, throughput 2.8683K wps
[Epoch 86 Batch 570/1540] avg loss 0.00118609, throughput 2.87193K wps
[Epoch 86 Batch 600/1540] avg loss 0.00114981, throughput 2.87275K wps
[Epoch 86 Batch 630/1540] avg loss 0.00111456, throughput 2.84861K wps
[Epoch 86 Batch 660/1540] avg loss 0.00115949, throughput 2.86274K wps
[Epoch 86 Batch 690/1540] avg loss 0.00109039, throughput 2.86838K wps
[Epoch 86 Batch 720/1540] avg loss 0.00100796, throughput 2.85777K wps
[Epoch 86 Batch 750/1540] avg loss 0.00107726, throughput 2.84951K wps
[Epoch 86 Batch 780/1540] avg loss 0.000841363, throughput 2.86398K wps
[Epoch 86 Batch 810/1540] avg loss 0.0010671, throughput 2.86467K wps
[Epoch 86 Batch 840/1540] avg loss 0.00125471, throughput 2.85187K wps
[Epoch 86 Batch 870/1540] avg loss 0.00131253, throughput 2.84811K wps
[Epoch 86 Batch 900/1540] avg loss 0.00117929, throughput 2.78818K wps
[Epoch 86 Batch 930/1540] avg loss 0.00113072, throughput 2.82914K wps
[Epoch 86 Batch 960/1540] avg loss 0.00115259, throughput 2.8475K wps
[Epoch 86 Batch 990/1540] avg loss 0.00118415, throughput 2.84686K wps
[Epoch 86 Batch 1020/1540] avg loss 0.00130437, throughput 2.84633K wps
[Epoch 86 Batch 1050/1540] avg loss 0.00124585, throughput 2.83888K wps
[Epoch 86 Batch 1080/1540] avg loss 0.00128199, throughput 2.88437K wps
[Epoch 86 Batch 1110/1540] avg loss 0.00110434, throughput 2.86835K wps
[Epoch 86 Batch 1140/1540] avg loss 0.000934036, throughput 2.87464K wps
[Epoch 86 Batch 1170/1540] avg loss 0.00129048, throughput 2.84049K wps
[Epoch 86 Batch 1200/1540] avg loss 0.00125441, throughput 2.8431K wps
[Epoch 86 Batch 1230/1540] avg loss 0.00143212, throughput 2.86535K wps
[Epoch 86 Batch 1260/1540] avg loss 0.00132558, throughput 2.8738K wps
[Epoch 86 Batch 1290/1540] avg loss 0.00122208, throughput 2.82996K wps
[Epoch 86 Batch 1320/1540] avg loss 0.00131886, throughput 2.86558K wps
[Epoch 86 Batch 1350/1540] avg loss 0.000990363, throughput 2.86189K wps
[Epoch 86 Batch 1380/1540] avg loss 0.00143099, throughput 2.86653K wps
[Epoch 86 Batch 1410/1540] avg loss 0.00106743, throughput 2.87368K wps
[Epoch 86 Batch 1440/1540] avg loss 0.0012799, throughput 2.83134K wps
[Epoch 86 Batch 1470/1540] avg loss 0.00117737, throughput 2.86191K wps
[Epoch 86 Batch 1500/1540] avg loss 0.00113145, throughput 2.87863K wps
[Epoch 86 Batch 1530/1540] avg loss 0.00121488, throughput 2.87014K wps
Begin Testing...
[Epoch 86] train avg loss 0.00115821, dev acc 0.7936, dev avg loss 0.785694, throughput 2.8565K wps
[Epoch 87 Batch 30/1540] avg loss 0.00113621, throughput 2.91564K wps
[Epoch 87 Batch 60/1540] avg loss 0.00129804, throughput 2.86258K wps
[Epoch 87 Batch 90/1540] avg loss 0.000903434, throughput 2.88188K wps
[Epoch 87 Batch 120/1540] avg loss 0.00124603, throughput 2.84483K wps
[Epoch 87 Batch 150/1540] avg loss 0.00137721, throughput 2.88315K wps
[Epoch 87 Batch 180/1540] avg loss 0.0010661, throughput 2.86754K wps
[Epoch 87 Batch 210/1540] avg loss 0.000842932, throughput 2.82291K wps
[Epoch 87 Batch 240/1540] avg loss 0.00136016, throughput 2.85759K wps
[Epoch 87 Batch 270/1540] avg loss 0.000901188, throughput 2.85461K wps
[Epoch 87 Batch 300/1540] avg loss 0.000979424, throughput 2.8827K wps
[Epoch 87 Batch 330/1540] avg loss 0.00128916, throughput 2.87562K wps
[Epoch 87 Batch 360/1540] avg loss 0.00119596, throughput 2.86965K wps
[Epoch 87 Batch 390/1540] avg loss 0.000803419, throughput 2.87964K wps
[Epoch 87 Batch 420/1540] avg loss 0.0010486, throughput 2.86989K wps
[Epoch 87 Batch 450/1540] avg loss 0.00127918, throughput 2.8491K wps
[Epoch 87 Batch 480/1540] avg loss 0.00117995, throughput 2.87962K wps
[Epoch 87 Batch 510/1540] avg loss 0.000794391, throughput 2.8831K wps
[Epoch 87 Batch 540/1540] avg loss 0.00139785, throughput 2.85502K wps
[Epoch 87 Batch 570/1540] avg loss 0.00137604, throughput 2.86573K wps
[Epoch 87 Batch 600/1540] avg loss 0.00110105, throughput 2.82706K wps
[Epoch 87 Batch 630/1540] avg loss 0.00121406, throughput 2.87992K wps
[Epoch 87 Batch 660/1540] avg loss 0.00132523, throughput 2.86366K wps
[Epoch 87 Batch 690/1540] avg loss 0.00105069, throughput 2.86416K wps
[Epoch 87 Batch 720/1540] avg loss 0.00110761, throughput 2.84716K wps
[Epoch 87 Batch 750/1540] avg loss 0.00108782, throughput 2.869K wps
[Epoch 87 Batch 780/1540] avg loss 0.00126617, throughput 2.86144K wps
[Epoch 87 Batch 810/1540] avg loss 0.00115497, throughput 2.87636K wps
[Epoch 87 Batch 840/1540] avg loss 0.00110304, throughput 2.81328K wps
[Epoch 87 Batch 870/1540] avg loss 0.00116453, throughput 2.87471K wps
[Epoch 87 Batch 900/1540] avg loss 0.00117288, throughput 2.85007K wps
[Epoch 87 Batch 930/1540] avg loss 0.00111262, throughput 2.88374K wps
[Epoch 87 Batch 960/1540] avg loss 0.000949466, throughput 2.87567K wps
[Epoch 87 Batch 990/1540] avg loss 0.000928738, throughput 2.84035K wps
[Epoch 87 Batch 1020/1540] avg loss 0.00139042, throughput 2.87527K wps
[Epoch 87 Batch 1050/1540] avg loss 0.00111221, throughput 2.84896K wps
[Epoch 87 Batch 1080/1540] avg loss 0.00113915, throughput 2.86098K wps
[Epoch 87 Batch 1110/1540] avg loss 0.00129853, throughput 2.84992K wps
[Epoch 87 Batch 1140/1540] avg loss 0.00116857, throughput 2.81882K wps
[Epoch 87 Batch 1170/1540] avg loss 0.00117237, throughput 2.87595K wps
[Epoch 87 Batch 1200/1540] avg loss 0.00119793, throughput 2.82398K wps
[Epoch 87 Batch 1230/1540] avg loss 0.00133389, throughput 2.86857K wps
[Epoch 87 Batch 1260/1540] avg loss 0.00129545, throughput 2.82115K wps
[Epoch 87 Batch 1290/1540] avg loss 0.00114188, throughput 2.81351K wps
[Epoch 87 Batch 1320/1540] avg loss 0.000886829, throughput 2.85672K wps
[Epoch 87 Batch 1350/1540] avg loss 0.000950959, throughput 2.84319K wps
[Epoch 87 Batch 1380/1540] avg loss 0.0010572, throughput 2.87268K wps
[Epoch 87 Batch 1410/1540] avg loss 0.00138792, throughput 2.86695K wps
[Epoch 87 Batch 1440/1540] avg loss 0.000987884, throughput 2.7935K wps
[Epoch 87 Batch 1470/1540] avg loss 0.00117277, throughput 2.8791K wps
[Epoch 87 Batch 1500/1540] avg loss 0.00149107, throughput 2.86423K wps
[Epoch 87 Batch 1530/1540] avg loss 0.0014839, throughput 2.87215K wps
Begin Testing...
[Epoch 87] train avg loss 0.00115256, dev acc 0.7959, dev avg loss 0.769011, throughput 2.85936K wps
[Epoch 88 Batch 30/1540] avg loss 0.000910238, throughput 2.90662K wps
[Epoch 88 Batch 60/1540] avg loss 0.00119716, throughput 2.86648K wps
[Epoch 88 Batch 90/1540] avg loss 0.000998925, throughput 2.8765K wps
[Epoch 88 Batch 120/1540] avg loss 0.00141334, throughput 2.87351K wps
[Epoch 88 Batch 150/1540] avg loss 0.00089627, throughput 2.87768K wps
[Epoch 88 Batch 180/1540] avg loss 0.00102293, throughput 2.87K wps
[Epoch 88 Batch 210/1540] avg loss 0.00135256, throughput 2.86628K wps
[Epoch 88 Batch 240/1540] avg loss 0.00121021, throughput 2.82264K wps
[Epoch 88 Batch 270/1540] avg loss 0.0012856, throughput 2.82345K wps
[Epoch 88 Batch 300/1540] avg loss 0.00120931, throughput 2.82143K wps
[Epoch 88 Batch 330/1540] avg loss 0.000934562, throughput 2.80107K wps
[Epoch 88 Batch 360/1540] avg loss 0.00104046, throughput 2.87464K wps
[Epoch 88 Batch 390/1540] avg loss 0.00111655, throughput 2.86506K wps
[Epoch 88 Batch 420/1540] avg loss 0.00123387, throughput 2.83608K wps
[Epoch 88 Batch 450/1540] avg loss 0.00110371, throughput 2.87626K wps
[Epoch 88 Batch 480/1540] avg loss 0.00111815, throughput 2.86626K wps
[Epoch 88 Batch 510/1540] avg loss 0.00102913, throughput 2.87511K wps
[Epoch 88 Batch 540/1540] avg loss 0.00128176, throughput 2.87964K wps
[Epoch 88 Batch 570/1540] avg loss 0.00120931, throughput 2.85457K wps
[Epoch 88 Batch 600/1540] avg loss 0.00110681, throughput 2.87576K wps
[Epoch 88 Batch 630/1540] avg loss 0.00117151, throughput 2.86849K wps
[Epoch 88 Batch 660/1540] avg loss 0.00118995, throughput 2.86375K wps
[Epoch 88 Batch 690/1540] avg loss 0.000957171, throughput 2.82242K wps
[Epoch 88 Batch 720/1540] avg loss 0.00108101, throughput 2.87666K wps
[Epoch 88 Batch 750/1540] avg loss 0.00104112, throughput 2.86967K wps
[Epoch 88 Batch 780/1540] avg loss 0.001247, throughput 2.87429K wps
[Epoch 88 Batch 810/1540] avg loss 0.00112078, throughput 2.84077K wps
[Epoch 88 Batch 840/1540] avg loss 0.000985981, throughput 2.84503K wps
[Epoch 88 Batch 870/1540] avg loss 0.00109751, throughput 2.87702K wps
[Epoch 88 Batch 900/1540] avg loss 0.00114576, throughput 2.87338K wps
[Epoch 88 Batch 930/1540] avg loss 0.00124252, throughput 2.88195K wps
[Epoch 88 Batch 960/1540] avg loss 0.00140352, throughput 2.84899K wps
[Epoch 88 Batch 990/1540] avg loss 0.00131164, throughput 2.85418K wps
[Epoch 88 Batch 1020/1540] avg loss 0.00132356, throughput 2.83841K wps
[Epoch 88 Batch 1050/1540] avg loss 0.0013839, throughput 2.83282K wps
[Epoch 88 Batch 1080/1540] avg loss 0.00118001, throughput 2.84996K wps
[Epoch 88 Batch 1110/1540] avg loss 0.00119092, throughput 2.86423K wps
[Epoch 88 Batch 1140/1540] avg loss 0.00120139, throughput 2.83748K wps
[Epoch 88 Batch 1170/1540] avg loss 0.00111775, throughput 2.8385K wps
[Epoch 88 Batch 1200/1540] avg loss 0.0012621, throughput 2.79778K wps
[Epoch 88 Batch 1230/1540] avg loss 0.00160841, throughput 2.81255K wps
[Epoch 88 Batch 1260/1540] avg loss 0.00126467, throughput 2.82906K wps
[Epoch 88 Batch 1290/1540] avg loss 0.00122175, throughput 2.87872K wps
[Epoch 88 Batch 1320/1540] avg loss 0.00116452, throughput 2.85473K wps
[Epoch 88 Batch 1350/1540] avg loss 0.00135139, throughput 2.87194K wps
[Epoch 88 Batch 1380/1540] avg loss 0.00120794, throughput 2.88037K wps
[Epoch 88 Batch 1410/1540] avg loss 0.000951465, throughput 2.88352K wps
[Epoch 88 Batch 1440/1540] avg loss 0.001118, throughput 2.85818K wps
[Epoch 88 Batch 1470/1540] avg loss 0.0011374, throughput 2.86426K wps
[Epoch 88 Batch 1500/1540] avg loss 0.0012593, throughput 2.86897K wps
[Epoch 88 Batch 1530/1540] avg loss 0.00142139, throughput 2.87447K wps
Begin Testing...
[Epoch 88] train avg loss 0.00117828, dev acc 0.7959, dev avg loss 0.764135, throughput 2.85754K wps
[Epoch 89 Batch 30/1540] avg loss 0.00116668, throughput 2.88449K wps
[Epoch 89 Batch 60/1540] avg loss 0.000872646, throughput 2.84598K wps
[Epoch 89 Batch 90/1540] avg loss 0.00110387, throughput 2.8467K wps
[Epoch 89 Batch 120/1540] avg loss 0.0008781, throughput 2.79835K wps
[Epoch 89 Batch 150/1540] avg loss 0.0011664, throughput 2.85053K wps
[Epoch 89 Batch 180/1540] avg loss 0.00115569, throughput 2.84809K wps
[Epoch 89 Batch 210/1540] avg loss 0.00116253, throughput 2.83933K wps
[Epoch 89 Batch 240/1540] avg loss 0.00112858, throughput 2.85023K wps
[Epoch 89 Batch 270/1540] avg loss 0.00107949, throughput 2.86998K wps
[Epoch 89 Batch 300/1540] avg loss 0.00116356, throughput 2.86317K wps
[Epoch 89 Batch 330/1540] avg loss 0.00139412, throughput 2.87108K wps
[Epoch 89 Batch 360/1540] avg loss 0.000949512, throughput 2.84594K wps
[Epoch 89 Batch 390/1540] avg loss 0.00107639, throughput 2.84338K wps
[Epoch 89 Batch 420/1540] avg loss 0.0011683, throughput 2.87896K wps
[Epoch 89 Batch 450/1540] avg loss 0.0011365, throughput 2.86638K wps
[Epoch 89 Batch 480/1540] avg loss 0.00111098, throughput 2.85531K wps
[Epoch 89 Batch 510/1540] avg loss 0.00134112, throughput 2.85516K wps
[Epoch 89 Batch 540/1540] avg loss 0.00100545, throughput 2.85094K wps
[Epoch 89 Batch 570/1540] avg loss 0.000968389, throughput 2.88272K wps
[Epoch 89 Batch 600/1540] avg loss 0.00104819, throughput 2.8685K wps
[Epoch 89 Batch 630/1540] avg loss 0.00132131, throughput 2.8594K wps
[Epoch 89 Batch 660/1540] avg loss 0.00137818, throughput 2.8258K wps
[Epoch 89 Batch 690/1540] avg loss 0.00101657, throughput 2.81107K wps
[Epoch 89 Batch 720/1540] avg loss 0.00114001, throughput 2.84939K wps
[Epoch 89 Batch 750/1540] avg loss 0.00106463, throughput 2.84602K wps
[Epoch 89 Batch 780/1540] avg loss 0.00114527, throughput 2.87737K wps
[Epoch 89 Batch 810/1540] avg loss 0.00121122, throughput 2.81757K wps
[Epoch 89 Batch 840/1540] avg loss 0.000881996, throughput 2.79391K wps
[Epoch 89 Batch 870/1540] avg loss 0.00108034, throughput 2.82809K wps
[Epoch 89 Batch 900/1540] avg loss 0.00125133, throughput 2.88214K wps
[Epoch 89 Batch 930/1540] avg loss 0.00122684, throughput 2.82406K wps
[Epoch 89 Batch 960/1540] avg loss 0.00106624, throughput 2.87639K wps
[Epoch 89 Batch 990/1540] avg loss 0.00113047, throughput 2.87902K wps
[Epoch 89 Batch 1020/1540] avg loss 0.0012879, throughput 2.87267K wps
[Epoch 89 Batch 1050/1540] avg loss 0.00125432, throughput 2.86496K wps
[Epoch 89 Batch 1080/1540] avg loss 0.00118549, throughput 2.87235K wps
[Epoch 89 Batch 1110/1540] avg loss 0.0012245, throughput 2.87379K wps
[Epoch 89 Batch 1140/1540] avg loss 0.00101128, throughput 2.81546K wps
[Epoch 89 Batch 1170/1540] avg loss 0.00113429, throughput 2.86782K wps
[Epoch 89 Batch 1200/1540] avg loss 0.00107725, throughput 2.87381K wps
[Epoch 89 Batch 1230/1540] avg loss 0.00110104, throughput 2.87148K wps
[Epoch 89 Batch 1260/1540] avg loss 0.000905696, throughput 2.86456K wps
[Epoch 89 Batch 1290/1540] avg loss 0.00141692, throughput 2.81384K wps
[Epoch 89 Batch 1320/1540] avg loss 0.00121353, throughput 2.79836K wps
[Epoch 89 Batch 1350/1540] avg loss 0.00131564, throughput 2.85196K wps
[Epoch 89 Batch 1380/1540] avg loss 0.00113968, throughput 2.86784K wps
[Epoch 89 Batch 1410/1540] avg loss 0.0013388, throughput 2.83917K wps
[Epoch 89 Batch 1440/1540] avg loss 0.00116416, throughput 2.87001K wps
[Epoch 89 Batch 1470/1540] avg loss 0.00127577, throughput 2.82639K wps
[Epoch 89 Batch 1500/1540] avg loss 0.000972228, throughput 2.86794K wps
[Epoch 89 Batch 1530/1540] avg loss 0.00143074, throughput 2.87901K wps
Begin Testing...
[Epoch 89] train avg loss 0.00115314, dev acc 0.7924, dev avg loss 0.782757, throughput 2.85235K wps
[Epoch 90 Batch 30/1540] avg loss 0.00112066, throughput 2.90207K wps
[Epoch 90 Batch 60/1540] avg loss 0.00109239, throughput 2.81218K wps
[Epoch 90 Batch 90/1540] avg loss 0.000927459, throughput 2.87655K wps
[Epoch 90 Batch 120/1540] avg loss 0.00101231, throughput 2.87414K wps
[Epoch 90 Batch 150/1540] avg loss 0.00111287, throughput 2.8674K wps
[Epoch 90 Batch 180/1540] avg loss 0.00102792, throughput 2.86766K wps
[Epoch 90 Batch 210/1540] avg loss 0.00112106, throughput 2.87917K wps
[Epoch 90 Batch 240/1540] avg loss 0.000916559, throughput 2.87441K wps
[Epoch 90 Batch 270/1540] avg loss 0.00129157, throughput 2.87375K wps
[Epoch 90 Batch 300/1540] avg loss 0.00106035, throughput 2.85114K wps
[Epoch 90 Batch 330/1540] avg loss 0.00086611, throughput 2.79485K wps
[Epoch 90 Batch 360/1540] avg loss 0.00117076, throughput 2.87316K wps
[Epoch 90 Batch 390/1540] avg loss 0.00106719, throughput 2.86339K wps
[Epoch 90 Batch 420/1540] avg loss 0.0010357, throughput 2.8233K wps
[Epoch 90 Batch 450/1540] avg loss 0.00118734, throughput 2.87269K wps
[Epoch 90 Batch 480/1540] avg loss 0.00110073, throughput 2.8664K wps
[Epoch 90 Batch 510/1540] avg loss 0.0010526, throughput 2.79695K wps
[Epoch 90 Batch 540/1540] avg loss 0.00133567, throughput 2.81207K wps
[Epoch 90 Batch 570/1540] avg loss 0.00114588, throughput 2.86717K wps
[Epoch 90 Batch 600/1540] avg loss 0.00108191, throughput 2.86743K wps
[Epoch 90 Batch 630/1540] avg loss 0.000795651, throughput 2.84475K wps
[Epoch 90 Batch 660/1540] avg loss 0.00118121, throughput 2.85916K wps
[Epoch 90 Batch 690/1540] avg loss 0.00123097, throughput 2.87454K wps
[Epoch 90 Batch 720/1540] avg loss 0.00107299, throughput 2.85642K wps
[Epoch 90 Batch 750/1540] avg loss 0.00112622, throughput 2.81845K wps
[Epoch 90 Batch 780/1540] avg loss 0.00119599, throughput 2.83122K wps
[Epoch 90 Batch 810/1540] avg loss 0.000973921, throughput 2.86309K wps
[Epoch 90 Batch 840/1540] avg loss 0.000866177, throughput 2.87363K wps
[Epoch 90 Batch 870/1540] avg loss 0.000936305, throughput 2.86679K wps
[Epoch 90 Batch 900/1540] avg loss 0.00102185, throughput 2.82851K wps
[Epoch 90 Batch 930/1540] avg loss 0.0010605, throughput 2.82705K wps
[Epoch 90 Batch 960/1540] avg loss 0.00106462, throughput 2.81777K wps
[Epoch 90 Batch 990/1540] avg loss 0.00113851, throughput 2.86456K wps
[Epoch 90 Batch 1020/1540] avg loss 0.00125302, throughput 2.84239K wps
[Epoch 90 Batch 1050/1540] avg loss 0.000948237, throughput 2.86109K wps
[Epoch 90 Batch 1080/1540] avg loss 0.00114326, throughput 2.8482K wps
[Epoch 90 Batch 1110/1540] avg loss 0.00114587, throughput 2.87049K wps
[Epoch 90 Batch 1140/1540] avg loss 0.00102802, throughput 2.87599K wps
[Epoch 90 Batch 1170/1540] avg loss 0.00112062, throughput 2.86732K wps
[Epoch 90 Batch 1200/1540] avg loss 0.00105843, throughput 2.82508K wps
[Epoch 90 Batch 1230/1540] avg loss 0.000972288, throughput 2.85094K wps
[Epoch 90 Batch 1260/1540] avg loss 0.00108107, throughput 2.83029K wps
[Epoch 90 Batch 1290/1540] avg loss 0.00122035, throughput 2.82653K wps
[Epoch 90 Batch 1320/1540] avg loss 0.00169447, throughput 2.8595K wps
[Epoch 90 Batch 1350/1540] avg loss 0.00110727, throughput 2.87114K wps
[Epoch 90 Batch 1380/1540] avg loss 0.00152137, throughput 2.8776K wps
[Epoch 90 Batch 1410/1540] avg loss 0.00104922, throughput 2.83694K wps
[Epoch 90 Batch 1440/1540] avg loss 0.00128543, throughput 2.858K wps
[Epoch 90 Batch 1470/1540] avg loss 0.001244, throughput 2.79493K wps
[Epoch 90 Batch 1500/1540] avg loss 0.00106559, throughput 2.85022K wps
[Epoch 90 Batch 1530/1540] avg loss 0.00129449, throughput 2.84419K wps
Begin Testing...
[Epoch 90] train avg loss 0.00111188, dev acc 0.7982, dev avg loss 0.804744, throughput 2.85139K wps
[Epoch 91 Batch 30/1540] avg loss 0.000930075, throughput 2.83724K wps
[Epoch 91 Batch 60/1540] avg loss 0.000887232, throughput 2.87207K wps
[Epoch 91 Batch 90/1540] avg loss 0.00100813, throughput 2.8571K wps
[Epoch 91 Batch 120/1540] avg loss 0.00125107, throughput 2.86173K wps
[Epoch 91 Batch 150/1540] avg loss 0.00113207, throughput 2.83797K wps
[Epoch 91 Batch 180/1540] avg loss 0.000996484, throughput 2.78735K wps
[Epoch 91 Batch 210/1540] avg loss 0.00096006, throughput 2.86817K wps
[Epoch 91 Batch 240/1540] avg loss 0.000853493, throughput 2.85146K wps
[Epoch 91 Batch 270/1540] avg loss 0.0010225, throughput 2.84562K wps
[Epoch 91 Batch 300/1540] avg loss 0.00125495, throughput 2.88004K wps
[Epoch 91 Batch 330/1540] avg loss 0.00115762, throughput 2.86658K wps
[Epoch 91 Batch 360/1540] avg loss 0.00108358, throughput 2.85956K wps
[Epoch 91 Batch 390/1540] avg loss 0.000893778, throughput 2.83885K wps
[Epoch 91 Batch 420/1540] avg loss 0.00108913, throughput 2.79281K wps
[Epoch 91 Batch 450/1540] avg loss 0.00100603, throughput 2.86496K wps
[Epoch 91 Batch 480/1540] avg loss 0.00119088, throughput 2.87187K wps
[Epoch 91 Batch 510/1540] avg loss 0.00102818, throughput 2.82103K wps
[Epoch 91 Batch 540/1540] avg loss 0.00130917, throughput 2.83883K wps
[Epoch 91 Batch 570/1540] avg loss 0.00122505, throughput 2.86599K wps
[Epoch 91 Batch 600/1540] avg loss 0.000969435, throughput 2.84593K wps
[Epoch 91 Batch 630/1540] avg loss 0.00128352, throughput 2.79091K wps
[Epoch 91 Batch 660/1540] avg loss 0.00113744, throughput 2.87068K wps
[Epoch 91 Batch 690/1540] avg loss 0.00103743, throughput 2.87773K wps
[Epoch 91 Batch 720/1540] avg loss 0.00120373, throughput 2.85967K wps
[Epoch 91 Batch 750/1540] avg loss 0.00121709, throughput 2.80364K wps
[Epoch 91 Batch 780/1540] avg loss 0.00109731, throughput 2.84969K wps
[Epoch 91 Batch 810/1540] avg loss 0.00146385, throughput 2.85161K wps
[Epoch 91 Batch 840/1540] avg loss 0.00135337, throughput 2.87229K wps
[Epoch 91 Batch 870/1540] avg loss 0.000965721, throughput 2.87186K wps
[Epoch 91 Batch 900/1540] avg loss 0.0013783, throughput 2.87478K wps
[Epoch 91 Batch 930/1540] avg loss 0.000982566, throughput 2.84776K wps
[Epoch 91 Batch 960/1540] avg loss 0.00129816, throughput 2.84011K wps
[Epoch 91 Batch 990/1540] avg loss 0.00129841, throughput 2.87773K wps
[Epoch 91 Batch 1020/1540] avg loss 0.00107914, throughput 2.82878K wps
[Epoch 91 Batch 1050/1540] avg loss 0.00133011, throughput 2.85696K wps
[Epoch 91 Batch 1080/1540] avg loss 0.0012949, throughput 2.82405K wps
[Epoch 91 Batch 1110/1540] avg loss 0.00105923, throughput 2.79428K wps
[Epoch 91 Batch 1140/1540] avg loss 0.00121817, throughput 2.85351K wps
[Epoch 91 Batch 1170/1540] avg loss 0.000984717, throughput 2.86571K wps
[Epoch 91 Batch 1200/1540] avg loss 0.0012693, throughput 2.85068K wps
[Epoch 91 Batch 1230/1540] avg loss 0.00119174, throughput 2.85418K wps
[Epoch 91 Batch 1260/1540] avg loss 0.00101618, throughput 2.81432K wps
[Epoch 91 Batch 1290/1540] avg loss 0.00137223, throughput 2.87492K wps
[Epoch 91 Batch 1320/1540] avg loss 0.000993055, throughput 2.83244K wps
[Epoch 91 Batch 1350/1540] avg loss 0.00101681, throughput 2.87596K wps
[Epoch 91 Batch 1380/1540] avg loss 0.00146754, throughput 2.82762K wps
[Epoch 91 Batch 1410/1540] avg loss 0.00125638, throughput 2.86684K wps
[Epoch 91 Batch 1440/1540] avg loss 0.00105175, throughput 2.8583K wps
[Epoch 91 Batch 1470/1540] avg loss 0.00114592, throughput 2.8686K wps
[Epoch 91 Batch 1500/1540] avg loss 0.00106339, throughput 2.87993K wps
[Epoch 91 Batch 1530/1540] avg loss 0.00148276, throughput 2.85906K wps
Begin Testing...
[Epoch 91] train avg loss 0.00114271, dev acc 0.7959, dev avg loss 0.798534, throughput 2.84963K wps
[Epoch 92 Batch 30/1540] avg loss 0.00101286, throughput 2.87753K wps
[Epoch 92 Batch 60/1540] avg loss 0.000836821, throughput 2.85394K wps
[Epoch 92 Batch 90/1540] avg loss 0.00123538, throughput 2.86289K wps
[Epoch 92 Batch 120/1540] avg loss 0.000914198, throughput 2.86234K wps
[Epoch 92 Batch 150/1540] avg loss 0.0010037, throughput 2.82233K wps
[Epoch 92 Batch 180/1540] avg loss 0.00107393, throughput 2.86329K wps
[Epoch 92 Batch 210/1540] avg loss 0.00130739, throughput 2.86962K wps
[Epoch 92 Batch 240/1540] avg loss 0.00119787, throughput 2.87264K wps
[Epoch 92 Batch 270/1540] avg loss 0.00110408, throughput 2.87667K wps
[Epoch 92 Batch 300/1540] avg loss 0.000851803, throughput 2.87464K wps
[Epoch 92 Batch 330/1540] avg loss 0.00113708, throughput 2.8697K wps
[Epoch 92 Batch 360/1540] avg loss 0.00114638, throughput 2.85124K wps
[Epoch 92 Batch 390/1540] avg loss 0.00108223, throughput 2.80269K wps
[Epoch 92 Batch 420/1540] avg loss 0.0011214, throughput 2.86269K wps
[Epoch 92 Batch 450/1540] avg loss 0.000855298, throughput 2.84611K wps
[Epoch 92 Batch 480/1540] avg loss 0.000980371, throughput 2.8643K wps
[Epoch 92 Batch 510/1540] avg loss 0.00125254, throughput 2.87514K wps
[Epoch 92 Batch 540/1540] avg loss 0.00103227, throughput 2.87901K wps
[Epoch 92 Batch 570/1540] avg loss 0.00123457, throughput 2.88117K wps
[Epoch 92 Batch 600/1540] avg loss 0.00128349, throughput 2.87214K wps
[Epoch 92 Batch 630/1540] avg loss 0.000894386, throughput 2.87434K wps
[Epoch 92 Batch 660/1540] avg loss 0.00104088, throughput 2.87938K wps
[Epoch 92 Batch 690/1540] avg loss 0.00107672, throughput 2.87721K wps
[Epoch 92 Batch 720/1540] avg loss 0.00103007, throughput 2.84231K wps
[Epoch 92 Batch 750/1540] avg loss 0.00128935, throughput 2.83898K wps
[Epoch 92 Batch 780/1540] avg loss 0.00137143, throughput 2.82345K wps
[Epoch 92 Batch 810/1540] avg loss 0.000883438, throughput 2.80439K wps
[Epoch 92 Batch 840/1540] avg loss 0.00116801, throughput 2.78271K wps
[Epoch 92 Batch 870/1540] avg loss 0.00124336, throughput 2.78245K wps
[Epoch 92 Batch 900/1540] avg loss 0.00116894, throughput 2.81821K wps
[Epoch 92 Batch 930/1540] avg loss 0.00116571, throughput 2.81308K wps
[Epoch 92 Batch 960/1540] avg loss 0.00136941, throughput 2.83375K wps
[Epoch 92 Batch 990/1540] avg loss 0.00120881, throughput 2.8805K wps
[Epoch 92 Batch 1020/1540] avg loss 0.00117862, throughput 2.83151K wps
[Epoch 92 Batch 1050/1540] avg loss 0.00141862, throughput 2.83664K wps
[Epoch 92 Batch 1080/1540] avg loss 0.00115669, throughput 2.88426K wps
[Epoch 92 Batch 1110/1540] avg loss 0.000894744, throughput 2.86658K wps
[Epoch 92 Batch 1140/1540] avg loss 0.00114679, throughput 2.85948K wps
[Epoch 92 Batch 1170/1540] avg loss 0.000991736, throughput 2.86258K wps
[Epoch 92 Batch 1200/1540] avg loss 0.000955097, throughput 2.79945K wps
[Epoch 92 Batch 1230/1540] avg loss 0.00125408, throughput 2.83964K wps
[Epoch 92 Batch 1260/1540] avg loss 0.00124262, throughput 2.85239K wps
[Epoch 92 Batch 1290/1540] avg loss 0.0011905, throughput 2.79425K wps
[Epoch 92 Batch 1320/1540] avg loss 0.000990416, throughput 2.79488K wps
[Epoch 92 Batch 1350/1540] avg loss 0.000966546, throughput 2.79602K wps
[Epoch 92 Batch 1380/1540] avg loss 0.00116066, throughput 2.86975K wps
[Epoch 92 Batch 1410/1540] avg loss 0.00168225, throughput 2.87223K wps
[Epoch 92 Batch 1440/1540] avg loss 0.000999793, throughput 2.86959K wps
[Epoch 92 Batch 1470/1540] avg loss 0.00130702, throughput 2.84145K wps
[Epoch 92 Batch 1500/1540] avg loss 0.00116492, throughput 2.8509K wps
[Epoch 92 Batch 1530/1540] avg loss 0.00110869, throughput 2.87663K wps
Begin Testing...
[Epoch 92] train avg loss 0.00112728, dev acc 0.7936, dev avg loss 0.804578, throughput 2.84867K wps
[Epoch 93 Batch 30/1540] avg loss 0.000938427, throughput 2.90543K wps
[Epoch 93 Batch 60/1540] avg loss 0.000887375, throughput 2.85862K wps
[Epoch 93 Batch 90/1540] avg loss 0.000802714, throughput 2.87428K wps
[Epoch 93 Batch 120/1540] avg loss 0.00108688, throughput 2.83065K wps
[Epoch 93 Batch 150/1540] avg loss 0.00105164, throughput 2.84784K wps
[Epoch 93 Batch 180/1540] avg loss 0.00112738, throughput 2.81077K wps
[Epoch 93 Batch 210/1540] avg loss 0.00096368, throughput 2.84617K wps
[Epoch 93 Batch 240/1540] avg loss 0.0010972, throughput 2.83079K wps
[Epoch 93 Batch 270/1540] avg loss 0.00105245, throughput 2.8509K wps
[Epoch 93 Batch 300/1540] avg loss 0.000939584, throughput 2.8454K wps
[Epoch 93 Batch 330/1540] avg loss 0.00102052, throughput 2.85968K wps
[Epoch 93 Batch 360/1540] avg loss 0.00111237, throughput 2.87249K wps
[Epoch 93 Batch 390/1540] avg loss 0.000964529, throughput 2.83794K wps
[Epoch 93 Batch 420/1540] avg loss 0.000818762, throughput 2.81332K wps
[Epoch 93 Batch 450/1540] avg loss 0.00118946, throughput 2.84801K wps
[Epoch 93 Batch 480/1540] avg loss 0.00105262, throughput 2.80755K wps
[Epoch 93 Batch 510/1540] avg loss 0.00119921, throughput 2.87978K wps
[Epoch 93 Batch 540/1540] avg loss 0.000989027, throughput 2.79345K wps
[Epoch 93 Batch 570/1540] avg loss 0.00101028, throughput 2.86249K wps
[Epoch 93 Batch 600/1540] avg loss 0.00110651, throughput 2.86004K wps
[Epoch 93 Batch 630/1540] avg loss 0.00126716, throughput 2.83387K wps
[Epoch 93 Batch 660/1540] avg loss 0.00107668, throughput 2.86651K wps
[Epoch 93 Batch 690/1540] avg loss 0.00122589, throughput 2.84624K wps
[Epoch 93 Batch 720/1540] avg loss 0.00100738, throughput 2.87427K wps
[Epoch 93 Batch 750/1540] avg loss 0.00118277, throughput 2.83173K wps
[Epoch 93 Batch 780/1540] avg loss 0.0011548, throughput 2.85385K wps
[Epoch 93 Batch 810/1540] avg loss 0.0011185, throughput 2.87308K wps
[Epoch 93 Batch 840/1540] avg loss 0.000909796, throughput 2.86279K wps
[Epoch 93 Batch 870/1540] avg loss 0.00103392, throughput 2.87762K wps
[Epoch 93 Batch 900/1540] avg loss 0.00103866, throughput 2.88024K wps
[Epoch 93 Batch 930/1540] avg loss 0.0012735, throughput 2.86764K wps
[Epoch 93 Batch 960/1540] avg loss 0.00114067, throughput 2.82684K wps
[Epoch 93 Batch 990/1540] avg loss 0.00114581, throughput 2.83207K wps
[Epoch 93 Batch 1020/1540] avg loss 0.00116504, throughput 2.83396K wps
[Epoch 93 Batch 1050/1540] avg loss 0.00116229, throughput 2.86987K wps
[Epoch 93 Batch 1080/1540] avg loss 0.0014145, throughput 2.82085K wps
[Epoch 93 Batch 1110/1540] avg loss 0.00129884, throughput 2.83697K wps
[Epoch 93 Batch 1140/1540] avg loss 0.0010426, throughput 2.84074K wps
[Epoch 93 Batch 1170/1540] avg loss 0.00123307, throughput 2.8031K wps
[Epoch 93 Batch 1200/1540] avg loss 0.00102316, throughput 2.79617K wps
[Epoch 93 Batch 1230/1540] avg loss 0.00129643, throughput 2.83955K wps
[Epoch 93 Batch 1260/1540] avg loss 0.00115463, throughput 2.87136K wps
[Epoch 93 Batch 1290/1540] avg loss 0.00111038, throughput 2.87498K wps
[Epoch 93 Batch 1320/1540] avg loss 0.00119047, throughput 2.80071K wps
[Epoch 93 Batch 1350/1540] avg loss 0.00135553, throughput 2.79392K wps
[Epoch 93 Batch 1380/1540] avg loss 0.00112739, throughput 2.86752K wps
[Epoch 93 Batch 1410/1540] avg loss 0.000991804, throughput 2.88506K wps
[Epoch 93 Batch 1440/1540] avg loss 0.0012073, throughput 2.84719K wps
[Epoch 93 Batch 1470/1540] avg loss 0.00132449, throughput 2.87493K wps
[Epoch 93 Batch 1500/1540] avg loss 0.00133428, throughput 2.81917K wps
[Epoch 93 Batch 1530/1540] avg loss 0.00103395, throughput 2.84097K wps
Begin Testing...
[Epoch 93] train avg loss 0.00110697, dev acc 0.7970, dev avg loss 0.80597, throughput 2.84601K wps
[Epoch 94 Batch 30/1540] avg loss 0.000944365, throughput 2.85296K wps
[Epoch 94 Batch 60/1540] avg loss 0.000933586, throughput 2.86214K wps
[Epoch 94 Batch 90/1540] avg loss 0.00094731, throughput 2.79706K wps
[Epoch 94 Batch 120/1540] avg loss 0.00089742, throughput 2.83778K wps
[Epoch 94 Batch 150/1540] avg loss 0.000977039, throughput 2.87352K wps
[Epoch 94 Batch 180/1540] avg loss 0.000847173, throughput 2.87107K wps
[Epoch 94 Batch 210/1540] avg loss 0.000990789, throughput 2.87139K wps
[Epoch 94 Batch 240/1540] avg loss 0.00100719, throughput 2.87316K wps
[Epoch 94 Batch 270/1540] avg loss 0.000965594, throughput 2.86293K wps
[Epoch 94 Batch 300/1540] avg loss 0.00113172, throughput 2.77921K wps
[Epoch 94 Batch 330/1540] avg loss 0.00120721, throughput 2.84704K wps
[Epoch 94 Batch 360/1540] avg loss 0.00111499, throughput 2.77831K wps
[Epoch 94 Batch 390/1540] avg loss 0.00106826, throughput 2.86887K wps
[Epoch 94 Batch 420/1540] avg loss 0.00118329, throughput 2.85333K wps
[Epoch 94 Batch 450/1540] avg loss 0.0010616, throughput 2.86013K wps
[Epoch 94 Batch 480/1540] avg loss 0.00100031, throughput 2.84902K wps
[Epoch 94 Batch 510/1540] avg loss 0.000968515, throughput 2.78236K wps
[Epoch 94 Batch 540/1540] avg loss 0.000967468, throughput 2.86818K wps
[Epoch 94 Batch 570/1540] avg loss 0.00104516, throughput 2.85419K wps
[Epoch 94 Batch 600/1540] avg loss 0.00115116, throughput 2.86383K wps
[Epoch 94 Batch 630/1540] avg loss 0.00111278, throughput 2.86058K wps
[Epoch 94 Batch 660/1540] avg loss 0.00106123, throughput 2.86523K wps
[Epoch 94 Batch 690/1540] avg loss 0.000740049, throughput 2.85685K wps
[Epoch 94 Batch 720/1540] avg loss 0.000941488, throughput 2.8568K wps
[Epoch 94 Batch 750/1540] avg loss 0.00129278, throughput 2.8685K wps
[Epoch 94 Batch 780/1540] avg loss 0.0011605, throughput 2.87576K wps
[Epoch 94 Batch 810/1540] avg loss 0.00108531, throughput 2.85663K wps
[Epoch 94 Batch 840/1540] avg loss 0.00120591, throughput 2.8032K wps
[Epoch 94 Batch 870/1540] avg loss 0.000982917, throughput 2.86077K wps
[Epoch 94 Batch 900/1540] avg loss 0.00109294, throughput 2.79688K wps
[Epoch 94 Batch 930/1540] avg loss 0.00108089, throughput 2.83973K wps
[Epoch 94 Batch 960/1540] avg loss 0.00121993, throughput 2.87166K wps
[Epoch 94 Batch 990/1540] avg loss 0.00100811, throughput 2.84977K wps
[Epoch 94 Batch 1020/1540] avg loss 0.0010896, throughput 2.86973K wps
[Epoch 94 Batch 1050/1540] avg loss 0.00141519, throughput 2.81996K wps
[Epoch 94 Batch 1080/1540] avg loss 0.00112475, throughput 2.82274K wps
[Epoch 94 Batch 1110/1540] avg loss 0.00103639, throughput 2.84665K wps
[Epoch 94 Batch 1140/1540] avg loss 0.00134031, throughput 2.86191K wps
[Epoch 94 Batch 1170/1540] avg loss 0.00124945, throughput 2.84634K wps
[Epoch 94 Batch 1200/1540] avg loss 0.000916428, throughput 2.86062K wps
[Epoch 94 Batch 1230/1540] avg loss 0.00120926, throughput 2.86488K wps
[Epoch 94 Batch 1260/1540] avg loss 0.00126256, throughput 2.8688K wps
[Epoch 94 Batch 1290/1540] avg loss 0.000985262, throughput 2.87733K wps
[Epoch 94 Batch 1320/1540] avg loss 0.00121012, throughput 2.87102K wps
[Epoch 94 Batch 1350/1540] avg loss 0.00135035, throughput 2.84628K wps
[Epoch 94 Batch 1380/1540] avg loss 0.00112461, throughput 2.85283K wps
[Epoch 94 Batch 1410/1540] avg loss 0.00130373, throughput 2.84123K wps
[Epoch 94 Batch 1440/1540] avg loss 0.000996701, throughput 2.87518K wps
[Epoch 94 Batch 1470/1540] avg loss 0.00121952, throughput 2.83651K wps
[Epoch 94 Batch 1500/1540] avg loss 0.00135993, throughput 2.75649K wps
[Epoch 94 Batch 1530/1540] avg loss 0.00108968, throughput 2.81373K wps
Begin Testing...
[Epoch 94] train avg loss 0.00109289, dev acc 0.7913, dev avg loss 0.801039, throughput 2.84686K wps
[Epoch 95 Batch 30/1540] avg loss 0.00102519, throughput 2.92999K wps
[Epoch 95 Batch 60/1540] avg loss 0.0008652, throughput 2.83076K wps
[Epoch 95 Batch 90/1540] avg loss 0.00105682, throughput 2.8665K wps
[Epoch 95 Batch 120/1540] avg loss 0.00109709, throughput 2.83345K wps
[Epoch 95 Batch 150/1540] avg loss 0.00100541, throughput 2.87772K wps
[Epoch 95 Batch 180/1540] avg loss 0.00103775, throughput 2.86948K wps
[Epoch 95 Batch 210/1540] avg loss 0.00105459, throughput 2.87569K wps
[Epoch 95 Batch 240/1540] avg loss 0.00109536, throughput 2.83683K wps
[Epoch 95 Batch 270/1540] avg loss 0.000908913, throughput 2.86458K wps
[Epoch 95 Batch 300/1540] avg loss 0.00102152, throughput 2.87386K wps
[Epoch 95 Batch 330/1540] avg loss 0.000932943, throughput 2.88103K wps
[Epoch 95 Batch 360/1540] avg loss 0.000942084, throughput 2.87429K wps
[Epoch 95 Batch 390/1540] avg loss 0.00107415, throughput 2.82888K wps
[Epoch 95 Batch 420/1540] avg loss 0.00111034, throughput 2.80906K wps
[Epoch 95 Batch 450/1540] avg loss 0.000962645, throughput 2.86732K wps
[Epoch 95 Batch 480/1540] avg loss 0.000954929, throughput 2.86658K wps
[Epoch 95 Batch 510/1540] avg loss 0.00101914, throughput 2.83599K wps
[Epoch 95 Batch 540/1540] avg loss 0.00129094, throughput 2.8746K wps
[Epoch 95 Batch 570/1540] avg loss 0.00111497, throughput 2.86954K wps
[Epoch 95 Batch 600/1540] avg loss 0.00137804, throughput 2.80025K wps
[Epoch 95 Batch 630/1540] avg loss 0.00109308, throughput 2.87764K wps
[Epoch 95 Batch 660/1540] avg loss 0.00115767, throughput 2.87346K wps
[Epoch 95 Batch 690/1540] avg loss 0.00102799, throughput 2.86242K wps
[Epoch 95 Batch 720/1540] avg loss 0.00137619, throughput 2.86137K wps
[Epoch 95 Batch 750/1540] avg loss 0.00110101, throughput 2.86082K wps
[Epoch 95 Batch 780/1540] avg loss 0.000879479, throughput 2.85043K wps
[Epoch 95 Batch 810/1540] avg loss 0.00111114, throughput 2.86093K wps
[Epoch 95 Batch 840/1540] avg loss 0.00102099, throughput 2.84995K wps
[Epoch 95 Batch 870/1540] avg loss 0.00111233, throughput 2.79133K wps
[Epoch 95 Batch 900/1540] avg loss 0.000827053, throughput 2.79636K wps
[Epoch 95 Batch 930/1540] avg loss 0.00124077, throughput 2.86537K wps
[Epoch 95 Batch 960/1540] avg loss 0.000909598, throughput 2.85892K wps
[Epoch 95 Batch 990/1540] avg loss 0.00110498, throughput 2.81031K wps
[Epoch 95 Batch 1020/1540] avg loss 0.00106419, throughput 2.8788K wps
[Epoch 95 Batch 1050/1540] avg loss 0.000960963, throughput 2.87825K wps
[Epoch 95 Batch 1080/1540] avg loss 0.00112072, throughput 2.86491K wps
[Epoch 95 Batch 1110/1540] avg loss 0.00142763, throughput 2.81279K wps
[Epoch 95 Batch 1140/1540] avg loss 0.00114274, throughput 2.86957K wps
[Epoch 95 Batch 1170/1540] avg loss 0.0012922, throughput 2.83362K wps
[Epoch 95 Batch 1200/1540] avg loss 0.00126269, throughput 2.86623K wps
[Epoch 95 Batch 1230/1540] avg loss 0.00131125, throughput 2.82607K wps
[Epoch 95 Batch 1260/1540] avg loss 0.000823945, throughput 2.85135K wps
[Epoch 95 Batch 1290/1540] avg loss 0.001397, throughput 2.86401K wps
[Epoch 95 Batch 1320/1540] avg loss 0.000954624, throughput 2.84239K wps
[Epoch 95 Batch 1350/1540] avg loss 0.00105133, throughput 2.8411K wps
[Epoch 95 Batch 1380/1540] avg loss 0.00128736, throughput 2.7875K wps
[Epoch 95 Batch 1410/1540] avg loss 0.00107719, throughput 2.82428K wps
[Epoch 95 Batch 1440/1540] avg loss 0.0011522, throughput 2.86559K wps
[Epoch 95 Batch 1470/1540] avg loss 0.00123168, throughput 2.87841K wps
[Epoch 95 Batch 1500/1540] avg loss 0.00113862, throughput 2.86213K wps
[Epoch 95 Batch 1530/1540] avg loss 0.00130449, throughput 2.86618K wps
Begin Testing...
[Epoch 95] train avg loss 0.00109508, dev acc 0.7993, dev avg loss 0.79963, throughput 2.85278K wps
[Epoch 96 Batch 30/1540] avg loss 0.00103373, throughput 2.85216K wps
[Epoch 96 Batch 60/1540] avg loss 0.000949291, throughput 2.78608K wps
[Epoch 96 Batch 90/1540] avg loss 0.000942947, throughput 2.81113K wps
[Epoch 96 Batch 120/1540] avg loss 0.00088141, throughput 2.84485K wps
[Epoch 96 Batch 150/1540] avg loss 0.000950935, throughput 2.86078K wps
[Epoch 96 Batch 180/1540] avg loss 0.000938091, throughput 2.8783K wps
[Epoch 96 Batch 210/1540] avg loss 0.000828665, throughput 2.86794K wps
[Epoch 96 Batch 240/1540] avg loss 0.000877892, throughput 2.86918K wps
[Epoch 96 Batch 270/1540] avg loss 0.000934053, throughput 2.85313K wps
[Epoch 96 Batch 300/1540] avg loss 0.00091211, throughput 2.86557K wps
[Epoch 96 Batch 330/1540] avg loss 0.000974788, throughput 2.86267K wps
[Epoch 96 Batch 360/1540] avg loss 0.000782356, throughput 2.85625K wps
[Epoch 96 Batch 390/1540] avg loss 0.000988032, throughput 2.88492K wps
[Epoch 96 Batch 420/1540] avg loss 0.00106702, throughput 2.81229K wps
[Epoch 96 Batch 450/1540] avg loss 0.000842436, throughput 2.82959K wps
[Epoch 96 Batch 480/1540] avg loss 0.00085467, throughput 2.87298K wps
[Epoch 96 Batch 510/1540] avg loss 0.00100263, throughput 2.80329K wps
[Epoch 96 Batch 540/1540] avg loss 0.00107041, throughput 2.86432K wps
[Epoch 96 Batch 570/1540] avg loss 0.000781291, throughput 2.81408K wps
[Epoch 96 Batch 600/1540] avg loss 0.000894412, throughput 2.8168K wps
[Epoch 96 Batch 630/1540] avg loss 0.0010085, throughput 2.7836K wps
[Epoch 96 Batch 660/1540] avg loss 0.00116359, throughput 2.85223K wps
[Epoch 96 Batch 690/1540] avg loss 0.00132556, throughput 2.77582K wps
[Epoch 96 Batch 720/1540] avg loss 0.00108526, throughput 2.80454K wps
[Epoch 96 Batch 750/1540] avg loss 0.00123983, throughput 2.85561K wps
[Epoch 96 Batch 780/1540] avg loss 0.00112171, throughput 2.84225K wps
[Epoch 96 Batch 810/1540] avg loss 0.000843246, throughput 2.85327K wps
[Epoch 96 Batch 840/1540] avg loss 0.00106126, throughput 2.82169K wps
[Epoch 96 Batch 870/1540] avg loss 0.000948964, throughput 2.85709K wps
[Epoch 96 Batch 900/1540] avg loss 0.000903677, throughput 2.82264K wps
[Epoch 96 Batch 930/1540] avg loss 0.001221, throughput 2.83212K wps
[Epoch 96 Batch 960/1540] avg loss 0.00108284, throughput 2.86487K wps
[Epoch 96 Batch 990/1540] avg loss 0.00125688, throughput 2.84892K wps
[Epoch 96 Batch 1020/1540] avg loss 0.00127815, throughput 2.83942K wps
[Epoch 96 Batch 1050/1540] avg loss 0.00132553, throughput 2.85262K wps
[Epoch 96 Batch 1080/1540] avg loss 0.00114634, throughput 2.87231K wps
[Epoch 96 Batch 1110/1540] avg loss 0.00111689, throughput 2.86606K wps
[Epoch 96 Batch 1140/1540] avg loss 0.00104594, throughput 2.87377K wps
[Epoch 96 Batch 1170/1540] avg loss 0.00121829, throughput 2.82707K wps
[Epoch 96 Batch 1200/1540] avg loss 0.00111623, throughput 2.8723K wps
[Epoch 96 Batch 1230/1540] avg loss 0.0012379, throughput 2.87417K wps
[Epoch 96 Batch 1260/1540] avg loss 0.00100055, throughput 2.87654K wps
[Epoch 96 Batch 1290/1540] avg loss 0.00120412, throughput 2.86601K wps
[Epoch 96 Batch 1320/1540] avg loss 0.0012503, throughput 2.86535K wps
[Epoch 96 Batch 1350/1540] avg loss 0.00118992, throughput 2.8634K wps
[Epoch 96 Batch 1380/1540] avg loss 0.0011587, throughput 2.87143K wps
[Epoch 96 Batch 1410/1540] avg loss 0.00128076, throughput 2.85342K wps
[Epoch 96 Batch 1440/1540] avg loss 0.00122611, throughput 2.82506K wps
[Epoch 96 Batch 1470/1540] avg loss 0.00136043, throughput 2.81864K wps
[Epoch 96 Batch 1500/1540] avg loss 0.00124686, throughput 2.84477K wps
[Epoch 96 Batch 1530/1540] avg loss 0.00113509, throughput 2.84932K wps
Begin Testing...
[Epoch 96] train avg loss 0.00106521, dev acc 0.7924, dev avg loss 0.816457, throughput 2.84567K wps
[Epoch 97 Batch 30/1540] avg loss 0.000944241, throughput 2.91817K wps
[Epoch 97 Batch 60/1540] avg loss 0.000855895, throughput 2.82483K wps
[Epoch 97 Batch 90/1540] avg loss 0.000934267, throughput 2.84667K wps
[Epoch 97 Batch 120/1540] avg loss 0.000863574, throughput 2.79445K wps
[Epoch 97 Batch 150/1540] avg loss 0.000760644, throughput 2.80733K wps
[Epoch 97 Batch 180/1540] avg loss 0.0010568, throughput 2.8301K wps
[Epoch 97 Batch 210/1540] avg loss 0.00114446, throughput 2.86798K wps
[Epoch 97 Batch 240/1540] avg loss 0.00103404, throughput 2.88367K wps
[Epoch 97 Batch 270/1540] avg loss 0.00106456, throughput 2.87096K wps
[Epoch 97 Batch 300/1540] avg loss 0.00125814, throughput 2.8269K wps
[Epoch 97 Batch 330/1540] avg loss 0.00112869, throughput 2.84872K wps
[Epoch 97 Batch 360/1540] avg loss 0.00113151, throughput 2.87418K wps
[Epoch 97 Batch 390/1540] avg loss 0.00111485, throughput 2.85834K wps
[Epoch 97 Batch 420/1540] avg loss 0.000984668, throughput 2.87065K wps
[Epoch 97 Batch 450/1540] avg loss 0.000993081, throughput 2.87665K wps
[Epoch 97 Batch 480/1540] avg loss 0.00103981, throughput 2.81676K wps
[Epoch 97 Batch 510/1540] avg loss 0.000941972, throughput 2.80903K wps
[Epoch 97 Batch 540/1540] avg loss 0.00129011, throughput 2.80467K wps
[Epoch 97 Batch 570/1540] avg loss 0.00112214, throughput 2.81413K wps
[Epoch 97 Batch 600/1540] avg loss 0.00111641, throughput 2.834K wps
[Epoch 97 Batch 630/1540] avg loss 0.000991335, throughput 2.83449K wps
[Epoch 97 Batch 660/1540] avg loss 0.00100491, throughput 2.87669K wps
[Epoch 97 Batch 690/1540] avg loss 0.000912815, throughput 2.81372K wps
[Epoch 97 Batch 720/1540] avg loss 0.00103157, throughput 2.85656K wps
[Epoch 97 Batch 750/1540] avg loss 0.00121528, throughput 2.83801K wps
[Epoch 97 Batch 780/1540] avg loss 0.00109996, throughput 2.86848K wps
[Epoch 97 Batch 810/1540] avg loss 0.00105029, throughput 2.8591K wps
[Epoch 97 Batch 840/1540] avg loss 0.000993059, throughput 2.8591K wps
[Epoch 97 Batch 870/1540] avg loss 0.00132326, throughput 2.87077K wps
[Epoch 97 Batch 900/1540] avg loss 0.00099495, throughput 2.83051K wps
[Epoch 97 Batch 930/1540] avg loss 0.0012806, throughput 2.83313K wps
[Epoch 97 Batch 960/1540] avg loss 0.00116405, throughput 2.86069K wps
[Epoch 97 Batch 990/1540] avg loss 0.00126418, throughput 2.8634K wps
[Epoch 97 Batch 1020/1540] avg loss 0.00110333, throughput 2.86576K wps
[Epoch 97 Batch 1050/1540] avg loss 0.00123304, throughput 2.8801K wps
[Epoch 97 Batch 1080/1540] avg loss 0.000951701, throughput 2.8455K wps
[Epoch 97 Batch 1110/1540] avg loss 0.000966763, throughput 2.85267K wps
[Epoch 97 Batch 1140/1540] avg loss 0.0010982, throughput 2.84813K wps
[Epoch 97 Batch 1170/1540] avg loss 0.000953297, throughput 2.79515K wps
[Epoch 97 Batch 1200/1540] avg loss 0.00129911, throughput 2.83238K wps
[Epoch 97 Batch 1230/1540] avg loss 0.00106072, throughput 2.86846K wps
[Epoch 97 Batch 1260/1540] avg loss 0.00112725, throughput 2.86648K wps
[Epoch 97 Batch 1290/1540] avg loss 0.00100387, throughput 2.86325K wps
[Epoch 97 Batch 1320/1540] avg loss 0.00101185, throughput 2.79457K wps
[Epoch 97 Batch 1350/1540] avg loss 0.0012264, throughput 2.8427K wps
[Epoch 97 Batch 1380/1540] avg loss 0.00164385, throughput 2.86111K wps
[Epoch 97 Batch 1410/1540] avg loss 0.000939485, throughput 2.86803K wps
[Epoch 97 Batch 1440/1540] avg loss 0.00124027, throughput 2.80812K wps
[Epoch 97 Batch 1470/1540] avg loss 0.000999767, throughput 2.7772K wps
[Epoch 97 Batch 1500/1540] avg loss 0.000964079, throughput 2.79368K wps
[Epoch 97 Batch 1530/1540] avg loss 0.000798495, throughput 2.83598K wps
Begin Testing...
[Epoch 97] train avg loss 0.0010774, dev acc 0.7913, dev avg loss 0.873194, throughput 2.84372K wps
[Epoch 98 Batch 30/1540] avg loss 0.000973615, throughput 2.92253K wps
[Epoch 98 Batch 60/1540] avg loss 0.000919744, throughput 2.86061K wps
[Epoch 98 Batch 90/1540] avg loss 0.00117382, throughput 2.85161K wps
[Epoch 98 Batch 120/1540] avg loss 0.000886353, throughput 2.86347K wps
[Epoch 98 Batch 150/1540] avg loss 0.000901451, throughput 2.87817K wps
[Epoch 98 Batch 180/1540] avg loss 0.00106138, throughput 2.87468K wps
[Epoch 98 Batch 210/1540] avg loss 0.000940946, throughput 2.83921K wps
[Epoch 98 Batch 240/1540] avg loss 0.00110014, throughput 2.77806K wps
[Epoch 98 Batch 270/1540] avg loss 0.00108871, throughput 2.80949K wps
[Epoch 98 Batch 300/1540] avg loss 0.00112055, throughput 2.80469K wps
[Epoch 98 Batch 330/1540] avg loss 0.000822091, throughput 2.86202K wps
[Epoch 98 Batch 360/1540] avg loss 0.00101996, throughput 2.81724K wps
[Epoch 98 Batch 390/1540] avg loss 0.00121695, throughput 2.81728K wps
[Epoch 98 Batch 420/1540] avg loss 0.000894707, throughput 2.84832K wps
[Epoch 98 Batch 450/1540] avg loss 0.00095997, throughput 2.86941K wps
[Epoch 98 Batch 480/1540] avg loss 0.00106469, throughput 2.82732K wps
[Epoch 98 Batch 510/1540] avg loss 0.00136593, throughput 2.86116K wps
[Epoch 98 Batch 540/1540] avg loss 0.000897424, throughput 2.83061K wps
[Epoch 98 Batch 570/1540] avg loss 0.00106224, throughput 2.86091K wps
[Epoch 98 Batch 600/1540] avg loss 0.000850668, throughput 2.87127K wps
[Epoch 98 Batch 630/1540] avg loss 0.00103696, throughput 2.84987K wps
[Epoch 98 Batch 660/1540] avg loss 0.00095293, throughput 2.83895K wps
[Epoch 98 Batch 690/1540] avg loss 0.00097147, throughput 2.85808K wps
[Epoch 98 Batch 720/1540] avg loss 0.0011578, throughput 2.83286K wps
[Epoch 98 Batch 750/1540] avg loss 0.000971055, throughput 2.86173K wps
[Epoch 98 Batch 780/1540] avg loss 0.00101945, throughput 2.86601K wps
[Epoch 98 Batch 810/1540] avg loss 0.00119779, throughput 2.85239K wps
[Epoch 98 Batch 840/1540] avg loss 0.00109947, throughput 2.86664K wps
[Epoch 98 Batch 870/1540] avg loss 0.00107539, throughput 2.85921K wps
[Epoch 98 Batch 900/1540] avg loss 0.00118664, throughput 2.85025K wps
[Epoch 98 Batch 930/1540] avg loss 0.00119264, throughput 2.84747K wps
[Epoch 98 Batch 960/1540] avg loss 0.00120533, throughput 2.81339K wps
[Epoch 98 Batch 990/1540] avg loss 0.00124399, throughput 2.86433K wps
[Epoch 98 Batch 1020/1540] avg loss 0.00118571, throughput 2.85891K wps
[Epoch 98 Batch 1050/1540] avg loss 0.000932464, throughput 2.81942K wps
[Epoch 98 Batch 1080/1540] avg loss 0.000917311, throughput 2.8739K wps
[Epoch 98 Batch 1110/1540] avg loss 0.00135442, throughput 2.84517K wps
[Epoch 98 Batch 1140/1540] avg loss 0.00117119, throughput 2.84921K wps
[Epoch 98 Batch 1170/1540] avg loss 0.00128127, throughput 2.86453K wps
[Epoch 98 Batch 1200/1540] avg loss 0.00120033, throughput 2.86648K wps
[Epoch 98 Batch 1230/1540] avg loss 0.000863546, throughput 2.86365K wps
[Epoch 98 Batch 1260/1540] avg loss 0.00106681, throughput 2.85467K wps
[Epoch 98 Batch 1290/1540] avg loss 0.0013728, throughput 2.87404K wps
[Epoch 98 Batch 1320/1540] avg loss 0.00118428, throughput 2.85377K wps
[Epoch 98 Batch 1350/1540] avg loss 0.000881382, throughput 2.81993K wps
[Epoch 98 Batch 1380/1540] avg loss 0.000965176, throughput 2.81281K wps
[Epoch 98 Batch 1410/1540] avg loss 0.00105429, throughput 2.85685K wps
[Epoch 98 Batch 1440/1540] avg loss 0.00138921, throughput 2.85086K wps
[Epoch 98 Batch 1470/1540] avg loss 0.00105142, throughput 2.87761K wps
[Epoch 98 Batch 1500/1540] avg loss 0.00100695, throughput 2.86861K wps
[Epoch 98 Batch 1530/1540] avg loss 0.00159511, throughput 2.85279K wps
Begin Testing...
[Epoch 98] train avg loss 0.00108042, dev acc 0.7901, dev avg loss 0.797219, throughput 2.85003K wps
[Epoch 99 Batch 30/1540] avg loss 0.00071847, throughput 2.86471K wps
[Epoch 99 Batch 60/1540] avg loss 0.00110029, throughput 2.87629K wps
[Epoch 99 Batch 90/1540] avg loss 0.000735063, throughput 2.87424K wps
[Epoch 99 Batch 120/1540] avg loss 0.00109044, throughput 2.87119K wps
[Epoch 99 Batch 150/1540] avg loss 0.00119524, throughput 2.82553K wps
[Epoch 99 Batch 180/1540] avg loss 0.00122353, throughput 2.85924K wps
[Epoch 99 Batch 210/1540] avg loss 0.000912511, throughput 2.86372K wps
[Epoch 99 Batch 240/1540] avg loss 0.000888318, throughput 2.86724K wps
[Epoch 99 Batch 270/1540] avg loss 0.000969659, throughput 2.82013K wps
[Epoch 99 Batch 300/1540] avg loss 0.00102171, throughput 2.86782K wps
[Epoch 99 Batch 330/1540] avg loss 0.00114649, throughput 2.8504K wps
[Epoch 99 Batch 360/1540] avg loss 0.000889758, throughput 2.88076K wps
[Epoch 99 Batch 390/1540] avg loss 0.000967687, throughput 2.87858K wps
[Epoch 99 Batch 420/1540] avg loss 0.00103758, throughput 2.85923K wps
[Epoch 99 Batch 450/1540] avg loss 0.00097735, throughput 2.83321K wps
[Epoch 99 Batch 480/1540] avg loss 0.00123029, throughput 2.87353K wps
[Epoch 99 Batch 510/1540] avg loss 0.000873927, throughput 2.87423K wps
[Epoch 99 Batch 540/1540] avg loss 0.00108135, throughput 2.87232K wps
[Epoch 99 Batch 570/1540] avg loss 0.00104654, throughput 2.86854K wps
[Epoch 99 Batch 600/1540] avg loss 0.00089578, throughput 2.85983K wps
[Epoch 99 Batch 630/1540] avg loss 0.000867584, throughput 2.85354K wps
[Epoch 99 Batch 660/1540] avg loss 0.00109747, throughput 2.84742K wps
[Epoch 99 Batch 690/1540] avg loss 0.00108678, throughput 2.86131K wps
[Epoch 99 Batch 720/1540] avg loss 0.000879406, throughput 2.81251K wps
[Epoch 99 Batch 750/1540] avg loss 0.00118054, throughput 2.78529K wps
[Epoch 99 Batch 780/1540] avg loss 0.000962233, throughput 2.79541K wps
[Epoch 99 Batch 810/1540] avg loss 0.00108155, throughput 2.80193K wps
[Epoch 99 Batch 840/1540] avg loss 0.00079153, throughput 2.80074K wps
[Epoch 99 Batch 870/1540] avg loss 0.000962848, throughput 2.8531K wps
[Epoch 99 Batch 900/1540] avg loss 0.000945123, throughput 2.79489K wps
[Epoch 99 Batch 930/1540] avg loss 0.00126906, throughput 2.85766K wps
[Epoch 99 Batch 960/1540] avg loss 0.0011908, throughput 2.85066K wps
[Epoch 99 Batch 990/1540] avg loss 0.00115443, throughput 2.86083K wps
[Epoch 99 Batch 1020/1540] avg loss 0.00099432, throughput 2.85397K wps
[Epoch 99 Batch 1050/1540] avg loss 0.00115431, throughput 2.86872K wps
[Epoch 99 Batch 1080/1540] avg loss 0.00106632, throughput 2.87156K wps
[Epoch 99 Batch 1110/1540] avg loss 0.00120764, throughput 2.86246K wps
[Epoch 99 Batch 1140/1540] avg loss 0.00108436, throughput 2.87316K wps
[Epoch 99 Batch 1170/1540] avg loss 0.00129633, throughput 2.79932K wps
[Epoch 99 Batch 1200/1540] avg loss 0.00137592, throughput 2.83289K wps
[Epoch 99 Batch 1230/1540] avg loss 0.00135637, throughput 2.78008K wps
[Epoch 99 Batch 1260/1540] avg loss 0.000944879, throughput 2.87684K wps
[Epoch 99 Batch 1290/1540] avg loss 0.00107299, throughput 2.87799K wps
[Epoch 99 Batch 1320/1540] avg loss 0.00106211, throughput 2.86087K wps
[Epoch 99 Batch 1350/1540] avg loss 0.00110255, throughput 2.87635K wps
[Epoch 99 Batch 1380/1540] avg loss 0.00118162, throughput 2.8554K wps
[Epoch 99 Batch 1410/1540] avg loss 0.00123222, throughput 2.82777K wps
[Epoch 99 Batch 1440/1540] avg loss 0.00179308, throughput 2.85647K wps
[Epoch 99 Batch 1470/1540] avg loss 0.00088433, throughput 2.86318K wps
[Epoch 99 Batch 1500/1540] avg loss 0.000963199, throughput 2.8644K wps
[Epoch 99 Batch 1530/1540] avg loss 0.000998009, throughput 2.86182K wps
Begin Testing...
[Epoch 99] train avg loss 0.00106288, dev acc 0.7844, dev avg loss 0.801915, throughput 2.85053K wps
[Epoch 100 Batch 30/1540] avg loss 0.00083307, throughput 2.91199K wps
[Epoch 100 Batch 60/1540] avg loss 0.000805029, throughput 2.864K wps
[Epoch 100 Batch 90/1540] avg loss 0.000923221, throughput 2.85886K wps
[Epoch 100 Batch 120/1540] avg loss 0.000799724, throughput 2.86362K wps
[Epoch 100 Batch 150/1540] avg loss 0.000788273, throughput 2.84909K wps
[Epoch 100 Batch 180/1540] avg loss 0.000905097, throughput 2.8645K wps
[Epoch 100 Batch 210/1540] avg loss 0.00110163, throughput 2.86437K wps
[Epoch 100 Batch 240/1540] avg loss 0.0010202, throughput 2.85461K wps
[Epoch 100 Batch 270/1540] avg loss 0.00105259, throughput 2.86741K wps
[Epoch 100 Batch 300/1540] avg loss 0.00115425, throughput 2.86462K wps
[Epoch 100 Batch 330/1540] avg loss 0.000910799, throughput 2.86571K wps
[Epoch 100 Batch 360/1540] avg loss 0.000871561, throughput 2.86038K wps
[Epoch 100 Batch 390/1540] avg loss 0.00090377, throughput 2.86381K wps
[Epoch 100 Batch 420/1540] avg loss 0.00116672, throughput 2.83375K wps
[Epoch 100 Batch 450/1540] avg loss 0.000932023, throughput 2.85706K wps
[Epoch 100 Batch 480/1540] avg loss 0.00110604, throughput 2.84855K wps
[Epoch 100 Batch 510/1540] avg loss 0.00132743, throughput 2.86607K wps
[Epoch 100 Batch 540/1540] avg loss 0.00115676, throughput 2.86697K wps
[Epoch 100 Batch 570/1540] avg loss 0.00104583, throughput 2.81774K wps
[Epoch 100 Batch 600/1540] avg loss 0.00101591, throughput 2.8326K wps
[Epoch 100 Batch 630/1540] avg loss 0.0012178, throughput 2.87461K wps
[Epoch 100 Batch 660/1540] avg loss 0.000922345, throughput 2.80215K wps
[Epoch 100 Batch 690/1540] avg loss 0.00107975, throughput 2.79073K wps
[Epoch 100 Batch 720/1540] avg loss 0.000963721, throughput 2.84126K wps
[Epoch 100 Batch 750/1540] avg loss 0.00112196, throughput 2.86116K wps
[Epoch 100 Batch 780/1540] avg loss 0.00117327, throughput 2.86372K wps
[Epoch 100 Batch 810/1540] avg loss 0.00106804, throughput 2.87913K wps
[Epoch 100 Batch 840/1540] avg loss 0.00123947, throughput 2.85549K wps
[Epoch 100 Batch 870/1540] avg loss 0.00128019, throughput 2.87135K wps
[Epoch 100 Batch 900/1540] avg loss 0.0010815, throughput 2.82079K wps
[Epoch 100 Batch 930/1540] avg loss 0.00107803, throughput 2.79778K wps
[Epoch 100 Batch 960/1540] avg loss 0.00111935, throughput 2.86633K wps
[Epoch 100 Batch 990/1540] avg loss 0.000729788, throughput 2.8693K wps
[Epoch 100 Batch 1020/1540] avg loss 0.00136448, throughput 2.85965K wps
[Epoch 100 Batch 1050/1540] avg loss 0.00100228, throughput 2.81024K wps
[Epoch 100 Batch 1080/1540] avg loss 0.000993693, throughput 2.87056K wps
[Epoch 100 Batch 1110/1540] avg loss 0.00115834, throughput 2.84824K wps
[Epoch 100 Batch 1140/1540] avg loss 0.000829273, throughput 2.85508K wps
[Epoch 100 Batch 1170/1540] avg loss 0.00103627, throughput 2.87603K wps
[Epoch 100 Batch 1200/1540] avg loss 0.00122915, throughput 2.87214K wps
[Epoch 100 Batch 1230/1540] avg loss 0.000982127, throughput 2.849K wps
[Epoch 100 Batch 1260/1540] avg loss 0.00126414, throughput 2.87131K wps
[Epoch 100 Batch 1290/1540] avg loss 0.00110797, throughput 2.867K wps
[Epoch 100 Batch 1320/1540] avg loss 0.000864199, throughput 2.86479K wps
[Epoch 100 Batch 1350/1540] avg loss 0.00120119, throughput 2.84762K wps
[Epoch 100 Batch 1380/1540] avg loss 0.00107565, throughput 2.85378K wps
[Epoch 100 Batch 1410/1540] avg loss 0.000909541, throughput 2.80642K wps
[Epoch 100 Batch 1440/1540] avg loss 0.00108341, throughput 2.78986K wps
[Epoch 100 Batch 1470/1540] avg loss 0.00124405, throughput 2.80674K wps
[Epoch 100 Batch 1500/1540] avg loss 0.00095303, throughput 2.82522K wps
[Epoch 100 Batch 1530/1540] avg loss 0.0013146, throughput 2.86608K wps
Begin Testing...
[Epoch 100] train avg loss 0.00104883, dev acc 0.7970, dev avg loss 0.813147, throughput 2.85113K wps
[Epoch 101 Batch 30/1540] avg loss 0.000866963, throughput 2.93438K wps
[Epoch 101 Batch 60/1540] avg loss 0.00095137, throughput 2.85805K wps
[Epoch 101 Batch 90/1540] avg loss 0.000879958, throughput 2.87K wps
[Epoch 101 Batch 120/1540] avg loss 0.000827316, throughput 2.86778K wps
[Epoch 101 Batch 150/1540] avg loss 0.00074137, throughput 2.85347K wps
[Epoch 101 Batch 180/1540] avg loss 0.000917054, throughput 2.857K wps
[Epoch 101 Batch 210/1540] avg loss 0.000922141, throughput 2.84951K wps
[Epoch 101 Batch 240/1540] avg loss 0.000810452, throughput 2.86676K wps
[Epoch 101 Batch 270/1540] avg loss 0.000888909, throughput 2.86756K wps
[Epoch 101 Batch 300/1540] avg loss 0.00100108, throughput 2.86945K wps
[Epoch 101 Batch 330/1540] avg loss 0.00112504, throughput 2.83849K wps
[Epoch 101 Batch 360/1540] avg loss 0.000996611, throughput 2.86141K wps
[Epoch 101 Batch 390/1540] avg loss 0.000888743, throughput 2.87113K wps
[Epoch 101 Batch 420/1540] avg loss 0.000779645, throughput 2.87063K wps
[Epoch 101 Batch 450/1540] avg loss 0.000941173, throughput 2.85701K wps
[Epoch 101 Batch 480/1540] avg loss 0.00133055, throughput 2.78709K wps
[Epoch 101 Batch 510/1540] avg loss 0.000927623, throughput 2.86558K wps
[Epoch 101 Batch 540/1540] avg loss 0.000888272, throughput 2.86568K wps
[Epoch 101 Batch 570/1540] avg loss 0.000913302, throughput 2.85199K wps
[Epoch 101 Batch 600/1540] avg loss 0.000795876, throughput 2.84983K wps
[Epoch 101 Batch 630/1540] avg loss 0.000856831, throughput 2.85053K wps
[Epoch 101 Batch 660/1540] avg loss 0.000978345, throughput 2.86765K wps
[Epoch 101 Batch 690/1540] avg loss 0.000994952, throughput 2.8673K wps
[Epoch 101 Batch 720/1540] avg loss 0.00118207, throughput 2.86294K wps
[Epoch 101 Batch 750/1540] avg loss 0.00125123, throughput 2.8443K wps
[Epoch 101 Batch 780/1540] avg loss 0.00108505, throughput 2.86189K wps
[Epoch 101 Batch 810/1540] avg loss 0.000961734, throughput 2.8717K wps
[Epoch 101 Batch 840/1540] avg loss 0.0010897, throughput 2.86558K wps
[Epoch 101 Batch 870/1540] avg loss 0.00115825, throughput 2.82694K wps
[Epoch 101 Batch 900/1540] avg loss 0.00125628, throughput 2.86629K wps
[Epoch 101 Batch 930/1540] avg loss 0.00102939, throughput 2.87748K wps
[Epoch 101 Batch 960/1540] avg loss 0.00118239, throughput 2.85161K wps
[Epoch 101 Batch 990/1540] avg loss 0.000990273, throughput 2.84805K wps
[Epoch 101 Batch 1020/1540] avg loss 0.000945316, throughput 2.87173K wps
[Epoch 101 Batch 1050/1540] avg loss 0.0011277, throughput 2.86349K wps
[Epoch 101 Batch 1080/1540] avg loss 0.000949967, throughput 2.78515K wps
[Epoch 101 Batch 1110/1540] avg loss 0.0010242, throughput 2.85767K wps
[Epoch 101 Batch 1140/1540] avg loss 0.000983324, throughput 2.87007K wps
[Epoch 101 Batch 1170/1540] avg loss 0.00113242, throughput 2.84335K wps
[Epoch 101 Batch 1200/1540] avg loss 0.000933965, throughput 2.8028K wps
[Epoch 101 Batch 1230/1540] avg loss 0.00103394, throughput 2.83617K wps
[Epoch 101 Batch 1260/1540] avg loss 0.00131037, throughput 2.86155K wps
[Epoch 101 Batch 1290/1540] avg loss 0.00107952, throughput 2.87003K wps
[Epoch 101 Batch 1320/1540] avg loss 0.00136226, throughput 2.82954K wps
[Epoch 101 Batch 1350/1540] avg loss 0.00138626, throughput 2.86361K wps
[Epoch 101 Batch 1380/1540] avg loss 0.00110052, throughput 2.86159K wps
[Epoch 101 Batch 1410/1540] avg loss 0.00131176, throughput 2.85998K wps
[Epoch 101 Batch 1440/1540] avg loss 0.0012063, throughput 2.83928K wps
[Epoch 101 Batch 1470/1540] avg loss 0.000974574, throughput 2.87389K wps
[Epoch 101 Batch 1500/1540] avg loss 0.00115715, throughput 2.86409K wps
[Epoch 101 Batch 1530/1540] avg loss 0.00130553, throughput 2.81779K wps
Begin Testing...
[Epoch 101] train avg loss 0.00103682, dev acc 0.7970, dev avg loss 0.803463, throughput 2.85522K wps
[Epoch 102 Batch 30/1540] avg loss 0.000826705, throughput 2.91608K wps
[Epoch 102 Batch 60/1540] avg loss 0.0011111, throughput 2.88476K wps
[Epoch 102 Batch 90/1540] avg loss 0.000828854, throughput 2.88137K wps
[Epoch 102 Batch 120/1540] avg loss 0.00105916, throughput 2.87676K wps
[Epoch 102 Batch 150/1540] avg loss 0.000849306, throughput 2.83081K wps
[Epoch 102 Batch 180/1540] avg loss 0.000820787, throughput 2.86939K wps
[Epoch 102 Batch 210/1540] avg loss 0.00111849, throughput 2.85054K wps
[Epoch 102 Batch 240/1540] avg loss 0.000935493, throughput 2.85177K wps
[Epoch 102 Batch 270/1540] avg loss 0.00113139, throughput 2.8769K wps
[Epoch 102 Batch 300/1540] avg loss 0.000710588, throughput 2.86247K wps
[Epoch 102 Batch 330/1540] avg loss 0.000878253, throughput 2.85365K wps
[Epoch 102 Batch 360/1540] avg loss 0.000972053, throughput 2.86634K wps
[Epoch 102 Batch 390/1540] avg loss 0.0010184, throughput 2.86978K wps
[Epoch 102 Batch 420/1540] avg loss 0.000970868, throughput 2.85762K wps
[Epoch 102 Batch 450/1540] avg loss 0.000917104, throughput 2.79301K wps
[Epoch 102 Batch 480/1540] avg loss 0.000918328, throughput 2.8678K wps
[Epoch 102 Batch 510/1540] avg loss 0.00125315, throughput 2.865K wps
[Epoch 102 Batch 540/1540] avg loss 0.000981737, throughput 2.86335K wps
[Epoch 102 Batch 570/1540] avg loss 0.000920111, throughput 2.84846K wps
[Epoch 102 Batch 600/1540] avg loss 0.00109118, throughput 2.87544K wps
[Epoch 102 Batch 630/1540] avg loss 0.000830805, throughput 2.8436K wps
[Epoch 102 Batch 660/1540] avg loss 0.000794383, throughput 2.8537K wps
[Epoch 102 Batch 690/1540] avg loss 0.00113156, throughput 2.86585K wps
[Epoch 102 Batch 720/1540] avg loss 0.000958085, throughput 2.87787K wps
[Epoch 102 Batch 750/1540] avg loss 0.00118015, throughput 2.87042K wps
[Epoch 102 Batch 780/1540] avg loss 0.00095765, throughput 2.82348K wps
[Epoch 102 Batch 810/1540] avg loss 0.00105015, throughput 2.81051K wps
[Epoch 102 Batch 840/1540] avg loss 0.0010238, throughput 2.85085K wps
[Epoch 102 Batch 870/1540] avg loss 0.00106802, throughput 2.86653K wps
[Epoch 102 Batch 900/1540] avg loss 0.00128748, throughput 2.83485K wps
[Epoch 102 Batch 930/1540] avg loss 0.00107509, throughput 2.85875K wps
[Epoch 102 Batch 960/1540] avg loss 0.000832621, throughput 2.84699K wps
[Epoch 102 Batch 990/1540] avg loss 0.00131488, throughput 2.83212K wps
[Epoch 102 Batch 1020/1540] avg loss 0.00105386, throughput 2.84297K wps
[Epoch 102 Batch 1050/1540] avg loss 0.0011052, throughput 2.79053K wps
[Epoch 102 Batch 1080/1540] avg loss 0.00121578, throughput 2.86463K wps
[Epoch 102 Batch 1110/1540] avg loss 0.000998423, throughput 2.86188K wps
[Epoch 102 Batch 1140/1540] avg loss 0.00104142, throughput 2.87477K wps
[Epoch 102 Batch 1170/1540] avg loss 0.000973538, throughput 2.87528K wps
[Epoch 102 Batch 1200/1540] avg loss 0.00117474, throughput 2.8533K wps
[Epoch 102 Batch 1230/1540] avg loss 0.00111306, throughput 2.82084K wps
[Epoch 102 Batch 1260/1540] avg loss 0.00095059, throughput 2.87704K wps
[Epoch 102 Batch 1290/1540] avg loss 0.00108452, throughput 2.88013K wps
[Epoch 102 Batch 1320/1540] avg loss 0.00102386, throughput 2.84537K wps
[Epoch 102 Batch 1350/1540] avg loss 0.00123423, throughput 2.84197K wps
[Epoch 102 Batch 1380/1540] avg loss 0.00130946, throughput 2.87514K wps
[Epoch 102 Batch 1410/1540] avg loss 0.00118987, throughput 2.81872K wps
[Epoch 102 Batch 1440/1540] avg loss 0.000999613, throughput 2.87188K wps
[Epoch 102 Batch 1470/1540] avg loss 0.00121684, throughput 2.82343K wps
[Epoch 102 Batch 1500/1540] avg loss 0.000899137, throughput 2.85448K wps
[Epoch 102 Batch 1530/1540] avg loss 0.00102729, throughput 2.86849K wps
Begin Testing...
[Epoch 102] train avg loss 0.00103145, dev acc 0.7970, dev avg loss 0.812694, throughput 2.85553K wps
[Epoch 103 Batch 30/1540] avg loss 0.000932688, throughput 2.89984K wps
[Epoch 103 Batch 60/1540] avg loss 0.00101576, throughput 2.85796K wps
[Epoch 103 Batch 90/1540] avg loss 0.000818762, throughput 2.87399K wps
[Epoch 103 Batch 120/1540] avg loss 0.00109731, throughput 2.84447K wps
[Epoch 103 Batch 150/1540] avg loss 0.000781395, throughput 2.85982K wps
[Epoch 103 Batch 180/1540] avg loss 0.0011322, throughput 2.8083K wps
[Epoch 103 Batch 210/1540] avg loss 0.000912978, throughput 2.82495K wps
[Epoch 103 Batch 240/1540] avg loss 0.0010319, throughput 2.86433K wps
[Epoch 103 Batch 270/1540] avg loss 0.00139833, throughput 2.83508K wps
[Epoch 103 Batch 300/1540] avg loss 0.000935559, throughput 2.85677K wps
[Epoch 103 Batch 330/1540] avg loss 0.00107296, throughput 2.8797K wps
[Epoch 103 Batch 360/1540] avg loss 0.00100015, throughput 2.86394K wps
[Epoch 103 Batch 390/1540] avg loss 0.000860598, throughput 2.84639K wps
[Epoch 103 Batch 420/1540] avg loss 0.000986263, throughput 2.86041K wps
[Epoch 103 Batch 450/1540] avg loss 0.0008495, throughput 2.87529K wps
[Epoch 103 Batch 480/1540] avg loss 0.00085194, throughput 2.84197K wps
[Epoch 103 Batch 510/1540] avg loss 0.000886525, throughput 2.87192K wps
[Epoch 103 Batch 540/1540] avg loss 0.00100582, throughput 2.87428K wps
[Epoch 103 Batch 570/1540] avg loss 0.000857909, throughput 2.86492K wps
[Epoch 103 Batch 600/1540] avg loss 0.00102538, throughput 2.85212K wps
[Epoch 103 Batch 630/1540] avg loss 0.000887529, throughput 2.79649K wps
[Epoch 103 Batch 660/1540] avg loss 0.00107199, throughput 2.874K wps
[Epoch 103 Batch 690/1540] avg loss 0.00109468, throughput 2.86567K wps
[Epoch 103 Batch 720/1540] avg loss 0.00113814, throughput 2.84786K wps
[Epoch 103 Batch 750/1540] avg loss 0.00100587, throughput 2.83324K wps
[Epoch 103 Batch 780/1540] avg loss 0.000825938, throughput 2.80679K wps
[Epoch 103 Batch 810/1540] avg loss 0.000920378, throughput 2.78872K wps
[Epoch 103 Batch 840/1540] avg loss 0.000974818, throughput 2.82848K wps
[Epoch 103 Batch 870/1540] avg loss 0.00123964, throughput 2.85622K wps
[Epoch 103 Batch 900/1540] avg loss 0.00125764, throughput 2.86028K wps
[Epoch 103 Batch 930/1540] avg loss 0.000976447, throughput 2.87794K wps
[Epoch 103 Batch 960/1540] avg loss 0.00129965, throughput 2.85419K wps
[Epoch 103 Batch 990/1540] avg loss 0.00120823, throughput 2.86648K wps
[Epoch 103 Batch 1020/1540] avg loss 0.00114734, throughput 2.87041K wps
[Epoch 103 Batch 1050/1540] avg loss 0.0010059, throughput 2.8732K wps
[Epoch 103 Batch 1080/1540] avg loss 0.00129966, throughput 2.86919K wps
[Epoch 103 Batch 1110/1540] avg loss 0.00109128, throughput 2.83732K wps
[Epoch 103 Batch 1140/1540] avg loss 0.00106729, throughput 2.86861K wps
[Epoch 103 Batch 1170/1540] avg loss 0.00105874, throughput 2.86859K wps
[Epoch 103 Batch 1200/1540] avg loss 0.00125131, throughput 2.83927K wps
[Epoch 103 Batch 1230/1540] avg loss 0.00108351, throughput 2.87878K wps
[Epoch 103 Batch 1260/1540] avg loss 0.000772741, throughput 2.87208K wps
[Epoch 103 Batch 1290/1540] avg loss 0.00106908, throughput 2.8635K wps
[Epoch 103 Batch 1320/1540] avg loss 0.000919517, throughput 2.7953K wps
[Epoch 103 Batch 1350/1540] avg loss 0.000756778, throughput 2.82207K wps
[Epoch 103 Batch 1380/1540] avg loss 0.00124082, throughput 2.86332K wps
[Epoch 103 Batch 1410/1540] avg loss 0.00107457, throughput 2.86875K wps
[Epoch 103 Batch 1440/1540] avg loss 0.00133839, throughput 2.87597K wps
[Epoch 103 Batch 1470/1540] avg loss 0.00104193, throughput 2.86262K wps
[Epoch 103 Batch 1500/1540] avg loss 0.000980615, throughput 2.85674K wps
[Epoch 103 Batch 1530/1540] avg loss 0.00144272, throughput 2.87947K wps
Begin Testing...
[Epoch 103] train avg loss 0.0010406, dev acc 0.7890, dev avg loss 0.809089, throughput 2.85443K wps
[Epoch 104 Batch 30/1540] avg loss 0.00112729, throughput 2.89049K wps
[Epoch 104 Batch 60/1540] avg loss 0.000990217, throughput 2.84938K wps
[Epoch 104 Batch 90/1540] avg loss 0.00088997, throughput 2.83038K wps
[Epoch 104 Batch 120/1540] avg loss 0.000738748, throughput 2.87446K wps
[Epoch 104 Batch 150/1540] avg loss 0.00094369, throughput 2.8804K wps
[Epoch 104 Batch 180/1540] avg loss 0.00111506, throughput 2.8791K wps
[Epoch 104 Batch 210/1540] avg loss 0.00128319, throughput 2.85602K wps
[Epoch 104 Batch 240/1540] avg loss 0.000954488, throughput 2.82559K wps
[Epoch 104 Batch 270/1540] avg loss 0.0010509, throughput 2.83772K wps
[Epoch 104 Batch 300/1540] avg loss 0.00105378, throughput 2.83849K wps
[Epoch 104 Batch 330/1540] avg loss 0.000938042, throughput 2.87269K wps
[Epoch 104 Batch 360/1540] avg loss 0.00102111, throughput 2.79829K wps
[Epoch 104 Batch 390/1540] avg loss 0.000957253, throughput 2.86258K wps
[Epoch 104 Batch 420/1540] avg loss 0.000955757, throughput 2.86398K wps
[Epoch 104 Batch 450/1540] avg loss 0.000956535, throughput 2.86197K wps
[Epoch 104 Batch 480/1540] avg loss 0.00112184, throughput 2.81723K wps
[Epoch 104 Batch 510/1540] avg loss 0.000832318, throughput 2.86752K wps
[Epoch 104 Batch 540/1540] avg loss 0.0010738, throughput 2.78853K wps
[Epoch 104 Batch 570/1540] avg loss 0.000983559, throughput 2.81023K wps
[Epoch 104 Batch 600/1540] avg loss 0.000848554, throughput 2.85516K wps
[Epoch 104 Batch 630/1540] avg loss 0.0011061, throughput 2.86809K wps
[Epoch 104 Batch 660/1540] avg loss 0.000987188, throughput 2.82849K wps
[Epoch 104 Batch 690/1540] avg loss 0.00120447, throughput 2.80488K wps
[Epoch 104 Batch 720/1540] avg loss 0.00101134, throughput 2.85505K wps
[Epoch 104 Batch 750/1540] avg loss 0.00126114, throughput 2.87852K wps
[Epoch 104 Batch 780/1540] avg loss 0.00112268, throughput 2.86397K wps
[Epoch 104 Batch 810/1540] avg loss 0.00106279, throughput 2.85641K wps
[Epoch 104 Batch 840/1540] avg loss 0.00126643, throughput 2.85319K wps
[Epoch 104 Batch 870/1540] avg loss 0.001031, throughput 2.7993K wps
[Epoch 104 Batch 900/1540] avg loss 0.00102235, throughput 2.84465K wps
[Epoch 104 Batch 930/1540] avg loss 0.00104995, throughput 2.87664K wps
[Epoch 104 Batch 960/1540] avg loss 0.0010974, throughput 2.79061K wps
[Epoch 104 Batch 990/1540] avg loss 0.00108528, throughput 2.78823K wps
[Epoch 104 Batch 1020/1540] avg loss 0.000975735, throughput 2.8474K wps
[Epoch 104 Batch 1050/1540] avg loss 0.000963426, throughput 2.85485K wps
[Epoch 104 Batch 1080/1540] avg loss 0.000850331, throughput 2.82082K wps
[Epoch 104 Batch 1110/1540] avg loss 0.000929115, throughput 2.84399K wps
[Epoch 104 Batch 1140/1540] avg loss 0.0011337, throughput 2.86056K wps
[Epoch 104 Batch 1170/1540] avg loss 0.00120307, throughput 2.8559K wps
[Epoch 104 Batch 1200/1540] avg loss 0.00106139, throughput 2.87298K wps
[Epoch 104 Batch 1230/1540] avg loss 0.000970317, throughput 2.85821K wps
[Epoch 104 Batch 1260/1540] avg loss 0.00109451, throughput 2.83345K wps
[Epoch 104 Batch 1290/1540] avg loss 0.000853543, throughput 2.87555K wps
[Epoch 104 Batch 1320/1540] avg loss 0.00102557, throughput 2.85163K wps
[Epoch 104 Batch 1350/1540] avg loss 0.00130425, throughput 2.78777K wps
[Epoch 104 Batch 1380/1540] avg loss 0.00109455, throughput 2.87276K wps
[Epoch 104 Batch 1410/1540] avg loss 0.000996604, throughput 2.85291K wps
[Epoch 104 Batch 1440/1540] avg loss 0.00106615, throughput 2.87563K wps
[Epoch 104 Batch 1470/1540] avg loss 0.00111385, throughput 2.85036K wps
[Epoch 104 Batch 1500/1540] avg loss 0.00126808, throughput 2.86126K wps
[Epoch 104 Batch 1530/1540] avg loss 0.00122076, throughput 2.85701K wps
Begin Testing...
[Epoch 104] train avg loss 0.00104425, dev acc 0.7913, dev avg loss 0.823671, throughput 2.84649K wps
[Epoch 105 Batch 30/1540] avg loss 0.000955868, throughput 2.89515K wps
[Epoch 105 Batch 60/1540] avg loss 0.000812735, throughput 2.84326K wps
[Epoch 105 Batch 90/1540] avg loss 0.000886611, throughput 2.79642K wps
[Epoch 105 Batch 120/1540] avg loss 0.00086157, throughput 2.79072K wps
[Epoch 105 Batch 150/1540] avg loss 0.000899636, throughput 2.8379K wps
[Epoch 105 Batch 180/1540] avg loss 0.000974519, throughput 2.82133K wps
[Epoch 105 Batch 210/1540] avg loss 0.000930336, throughput 2.86792K wps
[Epoch 105 Batch 240/1540] avg loss 0.00101889, throughput 2.84258K wps
[Epoch 105 Batch 270/1540] avg loss 0.00118249, throughput 2.86658K wps
[Epoch 105 Batch 300/1540] avg loss 0.000891444, throughput 2.86592K wps
[Epoch 105 Batch 330/1540] avg loss 0.00082141, throughput 2.8124K wps
[Epoch 105 Batch 360/1540] avg loss 0.00104498, throughput 2.83791K wps
[Epoch 105 Batch 390/1540] avg loss 0.00108718, throughput 2.77547K wps
[Epoch 105 Batch 420/1540] avg loss 0.000913728, throughput 2.85925K wps
[Epoch 105 Batch 450/1540] avg loss 0.000760574, throughput 2.85978K wps
[Epoch 105 Batch 480/1540] avg loss 0.000905467, throughput 2.85949K wps
[Epoch 105 Batch 510/1540] avg loss 0.000842527, throughput 2.81968K wps
[Epoch 105 Batch 540/1540] avg loss 0.000931749, throughput 2.82115K wps
[Epoch 105 Batch 570/1540] avg loss 0.000923192, throughput 2.80228K wps
[Epoch 105 Batch 600/1540] avg loss 0.00126728, throughput 2.80486K wps
[Epoch 105 Batch 630/1540] avg loss 0.000988068, throughput 2.7894K wps
[Epoch 105 Batch 660/1540] avg loss 0.000791017, throughput 2.86002K wps
[Epoch 105 Batch 690/1540] avg loss 0.00118132, throughput 2.85385K wps
[Epoch 105 Batch 720/1540] avg loss 0.00120113, throughput 2.83412K wps
[Epoch 105 Batch 750/1540] avg loss 0.00111424, throughput 2.79536K wps
[Epoch 105 Batch 780/1540] avg loss 0.00116609, throughput 2.85189K wps
[Epoch 105 Batch 810/1540] avg loss 0.0010306, throughput 2.84797K wps
[Epoch 105 Batch 840/1540] avg loss 0.00101076, throughput 2.86033K wps
[Epoch 105 Batch 870/1540] avg loss 0.00108181, throughput 2.78488K wps
[Epoch 105 Batch 900/1540] avg loss 0.00121574, throughput 2.81237K wps
[Epoch 105 Batch 930/1540] avg loss 0.00105521, throughput 2.86635K wps
[Epoch 105 Batch 960/1540] avg loss 0.00141731, throughput 2.8364K wps
[Epoch 105 Batch 990/1540] avg loss 0.00108409, throughput 2.8595K wps
[Epoch 105 Batch 1020/1540] avg loss 0.00105727, throughput 2.84786K wps
[Epoch 105 Batch 1050/1540] avg loss 0.00103712, throughput 2.83946K wps
[Epoch 105 Batch 1080/1540] avg loss 0.00102917, throughput 2.82541K wps
[Epoch 105 Batch 1110/1540] avg loss 0.00114141, throughput 2.85947K wps
[Epoch 105 Batch 1140/1540] avg loss 0.000852807, throughput 2.81082K wps
[Epoch 105 Batch 1170/1540] avg loss 0.0011193, throughput 2.79072K wps
[Epoch 105 Batch 1200/1540] avg loss 0.00138913, throughput 2.86602K wps
[Epoch 105 Batch 1230/1540] avg loss 0.00124393, throughput 2.86498K wps
[Epoch 105 Batch 1260/1540] avg loss 0.00119541, throughput 2.85072K wps
[Epoch 105 Batch 1290/1540] avg loss 0.0011624, throughput 2.85909K wps
[Epoch 105 Batch 1320/1540] avg loss 0.00107109, throughput 2.83014K wps
[Epoch 105 Batch 1350/1540] avg loss 0.000858337, throughput 2.86559K wps
[Epoch 105 Batch 1380/1540] avg loss 0.00111129, throughput 2.86044K wps
[Epoch 105 Batch 1410/1540] avg loss 0.00097388, throughput 2.861K wps
[Epoch 105 Batch 1440/1540] avg loss 0.00109338, throughput 2.84174K wps
[Epoch 105 Batch 1470/1540] avg loss 0.00110755, throughput 2.82423K wps
[Epoch 105 Batch 1500/1540] avg loss 0.00108775, throughput 2.77459K wps
[Epoch 105 Batch 1530/1540] avg loss 0.000942978, throughput 2.80031K wps
Begin Testing...
[Epoch 105] train avg loss 0.001035, dev acc 0.7936, dev avg loss 0.817582, throughput 2.83481K wps
[Epoch 106 Batch 30/1540] avg loss 0.000888418, throughput 2.92485K wps
[Epoch 106 Batch 60/1540] avg loss 0.00079392, throughput 2.84367K wps
[Epoch 106 Batch 90/1540] avg loss 0.000948315, throughput 2.83436K wps
[Epoch 106 Batch 120/1540] avg loss 0.00081972, throughput 2.80719K wps
[Epoch 106 Batch 150/1540] avg loss 0.00103182, throughput 2.81167K wps
[Epoch 106 Batch 180/1540] avg loss 0.00096215, throughput 2.8451K wps
[Epoch 106 Batch 210/1540] avg loss 0.000898147, throughput 2.86181K wps
[Epoch 106 Batch 240/1540] avg loss 0.0010272, throughput 2.8329K wps
[Epoch 106 Batch 270/1540] avg loss 0.00111152, throughput 2.84374K wps
[Epoch 106 Batch 300/1540] avg loss 0.000890051, throughput 2.86462K wps
[Epoch 106 Batch 330/1540] avg loss 0.000960062, throughput 2.84324K wps
[Epoch 106 Batch 360/1540] avg loss 0.000795008, throughput 2.84258K wps
[Epoch 106 Batch 390/1540] avg loss 0.000878168, throughput 2.80412K wps
[Epoch 106 Batch 420/1540] avg loss 0.0010675, throughput 2.82671K wps
[Epoch 106 Batch 450/1540] avg loss 0.00123971, throughput 2.83567K wps
[Epoch 106 Batch 480/1540] avg loss 0.00143036, throughput 2.84608K wps
[Epoch 106 Batch 510/1540] avg loss 0.00109876, throughput 2.8786K wps
[Epoch 106 Batch 540/1540] avg loss 0.000975872, throughput 2.83078K wps
[Epoch 106 Batch 570/1540] avg loss 0.00117519, throughput 2.83947K wps
[Epoch 106 Batch 600/1540] avg loss 0.00120357, throughput 2.84733K wps
[Epoch 106 Batch 630/1540] avg loss 0.00106141, throughput 2.81877K wps
[Epoch 106 Batch 660/1540] avg loss 0.00108038, throughput 2.86778K wps
[Epoch 106 Batch 690/1540] avg loss 0.00101835, throughput 2.86738K wps
[Epoch 106 Batch 720/1540] avg loss 0.00118523, throughput 2.87781K wps
[Epoch 106 Batch 750/1540] avg loss 0.00100016, throughput 2.85965K wps
[Epoch 106 Batch 780/1540] avg loss 0.00110089, throughput 2.8607K wps
[Epoch 106 Batch 810/1540] avg loss 0.00085568, throughput 2.84187K wps
[Epoch 106 Batch 840/1540] avg loss 0.000977337, throughput 2.77071K wps
[Epoch 106 Batch 870/1540] avg loss 0.000937602, throughput 2.86245K wps
[Epoch 106 Batch 900/1540] avg loss 0.00120821, throughput 2.86969K wps
[Epoch 106 Batch 930/1540] avg loss 0.00112228, throughput 2.88164K wps
[Epoch 106 Batch 960/1540] avg loss 0.00104945, throughput 2.85058K wps
[Epoch 106 Batch 990/1540] avg loss 0.000812876, throughput 2.86688K wps
[Epoch 106 Batch 1020/1540] avg loss 0.00117805, throughput 2.85363K wps
[Epoch 106 Batch 1050/1540] avg loss 0.00103562, throughput 2.83358K wps
[Epoch 106 Batch 1080/1540] avg loss 0.000943117, throughput 2.86964K wps
[Epoch 106 Batch 1110/1540] avg loss 0.00108564, throughput 2.85966K wps
[Epoch 106 Batch 1140/1540] avg loss 0.0011639, throughput 2.83936K wps
[Epoch 106 Batch 1170/1540] avg loss 0.000745245, throughput 2.86597K wps
[Epoch 106 Batch 1200/1540] avg loss 0.000660622, throughput 2.87936K wps
[Epoch 106 Batch 1230/1540] avg loss 0.00109815, throughput 2.88484K wps
[Epoch 106 Batch 1260/1540] avg loss 0.00111102, throughput 2.87786K wps
[Epoch 106 Batch 1290/1540] avg loss 0.00102041, throughput 2.87924K wps
[Epoch 106 Batch 1320/1540] avg loss 0.00117717, throughput 2.8624K wps
[Epoch 106 Batch 1350/1540] avg loss 0.00109206, throughput 2.86306K wps
[Epoch 106 Batch 1380/1540] avg loss 0.000944573, throughput 2.88274K wps
[Epoch 106 Batch 1410/1540] avg loss 0.00128899, throughput 2.86986K wps
[Epoch 106 Batch 1440/1540] avg loss 0.00108348, throughput 2.8802K wps
[Epoch 106 Batch 1470/1540] avg loss 0.00102047, throughput 2.87912K wps
[Epoch 106 Batch 1500/1540] avg loss 0.0008956, throughput 2.86202K wps
[Epoch 106 Batch 1530/1540] avg loss 0.000913667, throughput 2.8799K wps
Begin Testing...
[Epoch 106] train avg loss 0.00102244, dev acc 0.7947, dev avg loss 0.815487, throughput 2.85446K wps
[Epoch 107 Batch 30/1540] avg loss 0.000891415, throughput 2.93406K wps
[Epoch 107 Batch 60/1540] avg loss 0.000814482, throughput 2.86561K wps
[Epoch 107 Batch 90/1540] avg loss 0.000848699, throughput 2.86113K wps
[Epoch 107 Batch 120/1540] avg loss 0.001114, throughput 2.8635K wps
[Epoch 107 Batch 150/1540] avg loss 0.000777638, throughput 2.85576K wps
[Epoch 107 Batch 180/1540] avg loss 0.000940494, throughput 2.84785K wps
[Epoch 107 Batch 210/1540] avg loss 0.000927369, throughput 2.8308K wps
[Epoch 107 Batch 240/1540] avg loss 0.00096111, throughput 2.85375K wps
[Epoch 107 Batch 270/1540] avg loss 0.00100701, throughput 2.86465K wps
[Epoch 107 Batch 300/1540] avg loss 0.00117675, throughput 2.8056K wps
[Epoch 107 Batch 330/1540] avg loss 0.000824808, throughput 2.85132K wps
[Epoch 107 Batch 360/1540] avg loss 0.000956906, throughput 2.85597K wps
[Epoch 107 Batch 390/1540] avg loss 0.000739404, throughput 2.87904K wps
[Epoch 107 Batch 420/1540] avg loss 0.000769791, throughput 2.85111K wps
[Epoch 107 Batch 450/1540] avg loss 0.00123194, throughput 2.85614K wps
[Epoch 107 Batch 480/1540] avg loss 0.000803118, throughput 2.88016K wps
[Epoch 107 Batch 510/1540] avg loss 0.00136691, throughput 2.87197K wps
[Epoch 107 Batch 540/1540] avg loss 0.000933164, throughput 2.874K wps
[Epoch 107 Batch 570/1540] avg loss 0.00105853, throughput 2.86005K wps
[Epoch 107 Batch 600/1540] avg loss 0.00107989, throughput 2.82056K wps
[Epoch 107 Batch 630/1540] avg loss 0.000991435, throughput 2.80347K wps
[Epoch 107 Batch 660/1540] avg loss 0.000720349, throughput 2.86197K wps
[Epoch 107 Batch 690/1540] avg loss 0.000998159, throughput 2.80122K wps
[Epoch 107 Batch 720/1540] avg loss 0.00121097, throughput 2.85612K wps
[Epoch 107 Batch 750/1540] avg loss 0.00101781, throughput 2.80116K wps
[Epoch 107 Batch 780/1540] avg loss 0.000884208, throughput 2.84215K wps
[Epoch 107 Batch 810/1540] avg loss 0.000915745, throughput 2.82058K wps
[Epoch 107 Batch 840/1540] avg loss 0.000977785, throughput 2.88102K wps
[Epoch 107 Batch 870/1540] avg loss 0.000828819, throughput 2.85846K wps
[Epoch 107 Batch 900/1540] avg loss 0.000741771, throughput 2.86201K wps
[Epoch 107 Batch 930/1540] avg loss 0.000998104, throughput 2.87587K wps
[Epoch 107 Batch 960/1540] avg loss 0.00104315, throughput 2.87962K wps
[Epoch 107 Batch 990/1540] avg loss 0.000931169, throughput 2.84837K wps
[Epoch 107 Batch 1020/1540] avg loss 0.000990349, throughput 2.87194K wps
[Epoch 107 Batch 1050/1540] avg loss 0.00120264, throughput 2.81856K wps
[Epoch 107 Batch 1080/1540] avg loss 0.000965731, throughput 2.82409K wps
[Epoch 107 Batch 1110/1540] avg loss 0.000952151, throughput 2.79868K wps
[Epoch 107 Batch 1140/1540] avg loss 0.000965724, throughput 2.82446K wps
[Epoch 107 Batch 1170/1540] avg loss 0.00107469, throughput 2.85946K wps
[Epoch 107 Batch 1200/1540] avg loss 0.000894261, throughput 2.86593K wps
[Epoch 107 Batch 1230/1540] avg loss 0.0013743, throughput 2.8536K wps
[Epoch 107 Batch 1260/1540] avg loss 0.000989031, throughput 2.87726K wps
[Epoch 107 Batch 1290/1540] avg loss 0.00108726, throughput 2.86053K wps
[Epoch 107 Batch 1320/1540] avg loss 0.00111688, throughput 2.86378K wps
[Epoch 107 Batch 1350/1540] avg loss 0.00112195, throughput 2.86253K wps
[Epoch 107 Batch 1380/1540] avg loss 0.00113969, throughput 2.85756K wps
[Epoch 107 Batch 1410/1540] avg loss 0.000972075, throughput 2.8368K wps
[Epoch 107 Batch 1440/1540] avg loss 0.00108008, throughput 2.85461K wps
[Epoch 107 Batch 1470/1540] avg loss 0.000977403, throughput 2.80018K wps
[Epoch 107 Batch 1500/1540] avg loss 0.00110653, throughput 2.8033K wps
[Epoch 107 Batch 1530/1540] avg loss 0.00119651, throughput 2.78673K wps
Begin Testing...
[Epoch 107] train avg loss 0.000997814, dev acc 0.7913, dev avg loss 0.859481, throughput 2.84847K wps
[Epoch 108 Batch 30/1540] avg loss 0.00070461, throughput 2.91907K wps
[Epoch 108 Batch 60/1540] avg loss 0.000712908, throughput 2.88155K wps
[Epoch 108 Batch 90/1540] avg loss 0.0010367, throughput 2.83862K wps
[Epoch 108 Batch 120/1540] avg loss 0.000889277, throughput 2.86897K wps
[Epoch 108 Batch 150/1540] avg loss 0.00103969, throughput 2.82066K wps
[Epoch 108 Batch 180/1540] avg loss 0.00107649, throughput 2.87923K wps
[Epoch 108 Batch 210/1540] avg loss 0.000965025, throughput 2.86244K wps
[Epoch 108 Batch 240/1540] avg loss 0.00108677, throughput 2.8361K wps
[Epoch 108 Batch 270/1540] avg loss 0.000944681, throughput 2.87465K wps
[Epoch 108 Batch 300/1540] avg loss 0.00119158, throughput 2.8446K wps
[Epoch 108 Batch 330/1540] avg loss 0.000855921, throughput 2.86616K wps
[Epoch 108 Batch 360/1540] avg loss 0.00108431, throughput 2.83357K wps
[Epoch 108 Batch 390/1540] avg loss 0.00109873, throughput 2.85786K wps
[Epoch 108 Batch 420/1540] avg loss 0.000851001, throughput 2.85575K wps
[Epoch 108 Batch 450/1540] avg loss 0.00105198, throughput 2.82086K wps
[Epoch 108 Batch 480/1540] avg loss 0.000750829, throughput 2.84231K wps
[Epoch 108 Batch 510/1540] avg loss 0.00100232, throughput 2.84038K wps
[Epoch 108 Batch 540/1540] avg loss 0.000860381, throughput 2.88244K wps
[Epoch 108 Batch 570/1540] avg loss 0.000957312, throughput 2.86729K wps
[Epoch 108 Batch 600/1540] avg loss 0.0012607, throughput 2.84406K wps
[Epoch 108 Batch 630/1540] avg loss 0.00120527, throughput 2.87726K wps
[Epoch 108 Batch 660/1540] avg loss 0.000889268, throughput 2.88689K wps
[Epoch 108 Batch 690/1540] avg loss 0.0010933, throughput 2.86763K wps
[Epoch 108 Batch 720/1540] avg loss 0.00108304, throughput 2.87401K wps
[Epoch 108 Batch 750/1540] avg loss 0.000908101, throughput 2.88176K wps
[Epoch 108 Batch 780/1540] avg loss 0.00107943, throughput 2.86164K wps
[Epoch 108 Batch 810/1540] avg loss 0.00138495, throughput 2.85063K wps
[Epoch 108 Batch 840/1540] avg loss 0.00102253, throughput 2.8807K wps
[Epoch 108 Batch 870/1540] avg loss 0.000968282, throughput 2.8315K wps
[Epoch 108 Batch 900/1540] avg loss 0.0011503, throughput 2.87383K wps
[Epoch 108 Batch 930/1540] avg loss 0.000906233, throughput 2.87423K wps
[Epoch 108 Batch 960/1540] avg loss 0.00118664, throughput 2.8305K wps
[Epoch 108 Batch 990/1540] avg loss 0.00102388, throughput 2.84351K wps
[Epoch 108 Batch 1020/1540] avg loss 0.00100244, throughput 2.84762K wps
[Epoch 108 Batch 1050/1540] avg loss 0.00101324, throughput 2.83088K wps
[Epoch 108 Batch 1080/1540] avg loss 0.00092636, throughput 2.85364K wps
[Epoch 108 Batch 1110/1540] avg loss 0.00101603, throughput 2.85427K wps
[Epoch 108 Batch 1140/1540] avg loss 0.00108336, throughput 2.86656K wps
[Epoch 108 Batch 1170/1540] avg loss 0.000966185, throughput 2.86311K wps
[Epoch 108 Batch 1200/1540] avg loss 0.000896359, throughput 2.82207K wps
[Epoch 108 Batch 1230/1540] avg loss 0.000738917, throughput 2.83733K wps
[Epoch 108 Batch 1260/1540] avg loss 0.000899197, throughput 2.88136K wps
[Epoch 108 Batch 1290/1540] avg loss 0.00108315, throughput 2.86412K wps
[Epoch 108 Batch 1320/1540] avg loss 0.00108477, throughput 2.79362K wps
[Epoch 108 Batch 1350/1540] avg loss 0.00132226, throughput 2.86892K wps
[Epoch 108 Batch 1380/1540] avg loss 0.00118118, throughput 2.88117K wps
[Epoch 108 Batch 1410/1540] avg loss 0.00114942, throughput 2.82003K wps
[Epoch 108 Batch 1440/1540] avg loss 0.00100719, throughput 2.87757K wps
[Epoch 108 Batch 1470/1540] avg loss 0.00093029, throughput 2.88014K wps
[Epoch 108 Batch 1500/1540] avg loss 0.00109135, throughput 2.8697K wps
[Epoch 108 Batch 1530/1540] avg loss 0.000805501, throughput 2.83448K wps
Begin Testing...
[Epoch 108] train avg loss 0.00101347, dev acc 0.7821, dev avg loss 0.890049, throughput 2.85687K wps
[Epoch 109 Batch 30/1540] avg loss 0.00112778, throughput 2.88892K wps
[Epoch 109 Batch 60/1540] avg loss 0.0008404, throughput 2.85082K wps
[Epoch 109 Batch 90/1540] avg loss 0.000756001, throughput 2.85219K wps
[Epoch 109 Batch 120/1540] avg loss 0.00103431, throughput 2.82693K wps
[Epoch 109 Batch 150/1540] avg loss 0.00104267, throughput 2.87432K wps
[Epoch 109 Batch 180/1540] avg loss 0.000850403, throughput 2.86885K wps
[Epoch 109 Batch 210/1540] avg loss 0.0010653, throughput 2.86583K wps
[Epoch 109 Batch 240/1540] avg loss 0.00106456, throughput 2.86902K wps
[Epoch 109 Batch 270/1540] avg loss 0.000833287, throughput 2.86242K wps
[Epoch 109 Batch 300/1540] avg loss 0.000877085, throughput 2.8407K wps
[Epoch 109 Batch 330/1540] avg loss 0.00080538, throughput 2.81416K wps
[Epoch 109 Batch 360/1540] avg loss 0.000987906, throughput 2.76428K wps
[Epoch 109 Batch 390/1540] avg loss 0.000902862, throughput 2.80395K wps
[Epoch 109 Batch 420/1540] avg loss 0.00104345, throughput 2.88441K wps
[Epoch 109 Batch 450/1540] avg loss 0.000942314, throughput 2.87914K wps
[Epoch 109 Batch 480/1540] avg loss 0.00115674, throughput 2.87062K wps
[Epoch 109 Batch 510/1540] avg loss 0.00106092, throughput 2.86011K wps
[Epoch 109 Batch 540/1540] avg loss 0.00101564, throughput 2.84752K wps
[Epoch 109 Batch 570/1540] avg loss 0.000950102, throughput 2.86648K wps
[Epoch 109 Batch 600/1540] avg loss 0.000938103, throughput 2.87835K wps
[Epoch 109 Batch 630/1540] avg loss 0.000935015, throughput 2.85675K wps
[Epoch 109 Batch 660/1540] avg loss 0.00081808, throughput 2.84721K wps
[Epoch 109 Batch 690/1540] avg loss 0.00104062, throughput 2.83231K wps
[Epoch 109 Batch 720/1540] avg loss 0.000869027, throughput 2.79224K wps
[Epoch 109 Batch 750/1540] avg loss 0.000728284, throughput 2.88006K wps
[Epoch 109 Batch 780/1540] avg loss 0.000955227, throughput 2.86967K wps
[Epoch 109 Batch 810/1540] avg loss 0.000963804, throughput 2.883K wps
[Epoch 109 Batch 840/1540] avg loss 0.00132497, throughput 2.88169K wps
[Epoch 109 Batch 870/1540] avg loss 0.00116899, throughput 2.88722K wps
[Epoch 109 Batch 900/1540] avg loss 0.00113422, throughput 2.87518K wps
[Epoch 109 Batch 930/1540] avg loss 0.00101639, throughput 2.86485K wps
[Epoch 109 Batch 960/1540] avg loss 0.000850868, throughput 2.86539K wps
[Epoch 109 Batch 990/1540] avg loss 0.00111566, throughput 2.88028K wps
[Epoch 109 Batch 1020/1540] avg loss 0.00096853, throughput 2.82383K wps
[Epoch 109 Batch 1050/1540] avg loss 0.000769883, throughput 2.84591K wps
[Epoch 109 Batch 1080/1540] avg loss 0.00106555, throughput 2.84341K wps
[Epoch 109 Batch 1110/1540] avg loss 0.00094271, throughput 2.84821K wps
[Epoch 109 Batch 1140/1540] avg loss 0.000952172, throughput 2.88136K wps
[Epoch 109 Batch 1170/1540] avg loss 0.00100263, throughput 2.8533K wps
[Epoch 109 Batch 1200/1540] avg loss 0.000993697, throughput 2.80903K wps
[Epoch 109 Batch 1230/1540] avg loss 0.00105894, throughput 2.82314K wps
[Epoch 109 Batch 1260/1540] avg loss 0.00099566, throughput 2.76287K wps
[Epoch 109 Batch 1290/1540] avg loss 0.00129889, throughput 2.85217K wps
[Epoch 109 Batch 1320/1540] avg loss 0.000735162, throughput 2.86874K wps
[Epoch 109 Batch 1350/1540] avg loss 0.00111083, throughput 2.84105K wps
[Epoch 109 Batch 1380/1540] avg loss 0.000987717, throughput 2.78284K wps
[Epoch 109 Batch 1410/1540] avg loss 0.00102348, throughput 2.78138K wps
[Epoch 109 Batch 1440/1540] avg loss 0.00110947, throughput 2.78015K wps
[Epoch 109 Batch 1470/1540] avg loss 0.00120921, throughput 2.85139K wps
[Epoch 109 Batch 1500/1540] avg loss 0.00100621, throughput 2.8621K wps
[Epoch 109 Batch 1530/1540] avg loss 0.00096045, throughput 2.78869K wps
Begin Testing...
[Epoch 109] train avg loss 0.000989063, dev acc 0.7936, dev avg loss 0.829905, throughput 2.84585K wps
[Epoch 110 Batch 30/1540] avg loss 0.000986037, throughput 2.92661K wps
[Epoch 110 Batch 60/1540] avg loss 0.00103028, throughput 2.88003K wps
[Epoch 110 Batch 90/1540] avg loss 0.000841663, throughput 2.87433K wps
[Epoch 110 Batch 120/1540] avg loss 0.00102759, throughput 2.85723K wps
[Epoch 110 Batch 150/1540] avg loss 0.000954222, throughput 2.77982K wps
[Epoch 110 Batch 180/1540] avg loss 0.000860511, throughput 2.86631K wps
[Epoch 110 Batch 210/1540] avg loss 0.00109109, throughput 2.86006K wps
[Epoch 110 Batch 240/1540] avg loss 0.000733348, throughput 2.82649K wps
[Epoch 110 Batch 270/1540] avg loss 0.00108504, throughput 2.8101K wps
[Epoch 110 Batch 300/1540] avg loss 0.0010007, throughput 2.84678K wps
[Epoch 110 Batch 330/1540] avg loss 0.0008956, throughput 2.83239K wps
[Epoch 110 Batch 360/1540] avg loss 0.000949981, throughput 2.85953K wps
[Epoch 110 Batch 390/1540] avg loss 0.00108761, throughput 2.86143K wps
[Epoch 110 Batch 420/1540] avg loss 0.000989005, throughput 2.85487K wps
[Epoch 110 Batch 450/1540] avg loss 0.00101898, throughput 2.86753K wps
[Epoch 110 Batch 480/1540] avg loss 0.000884021, throughput 2.85121K wps
[Epoch 110 Batch 510/1540] avg loss 0.00093364, throughput 2.83685K wps
[Epoch 110 Batch 540/1540] avg loss 0.000975003, throughput 2.84674K wps
[Epoch 110 Batch 570/1540] avg loss 0.000918635, throughput 2.83652K wps
[Epoch 110 Batch 600/1540] avg loss 0.000908523, throughput 2.85969K wps
[Epoch 110 Batch 630/1540] avg loss 0.00094736, throughput 2.86284K wps
[Epoch 110 Batch 660/1540] avg loss 0.000776233, throughput 2.86245K wps
[Epoch 110 Batch 690/1540] avg loss 0.00110598, throughput 2.87386K wps
[Epoch 110 Batch 720/1540] avg loss 0.000900898, throughput 2.79786K wps
[Epoch 110 Batch 750/1540] avg loss 0.00106968, throughput 2.85181K wps
[Epoch 110 Batch 780/1540] avg loss 0.000942987, throughput 2.88178K wps
[Epoch 110 Batch 810/1540] avg loss 0.00113455, throughput 2.85785K wps
[Epoch 110 Batch 840/1540] avg loss 0.000930318, throughput 2.80989K wps
[Epoch 110 Batch 870/1540] avg loss 0.000893014, throughput 2.86224K wps
[Epoch 110 Batch 900/1540] avg loss 0.000993263, throughput 2.83165K wps
[Epoch 110 Batch 930/1540] avg loss 0.00115187, throughput 2.85005K wps
[Epoch 110 Batch 960/1540] avg loss 0.000961479, throughput 2.86466K wps
[Epoch 110 Batch 990/1540] avg loss 0.00082262, throughput 2.86754K wps
[Epoch 110 Batch 1020/1540] avg loss 0.00116849, throughput 2.84385K wps
[Epoch 110 Batch 1050/1540] avg loss 0.00131978, throughput 2.87481K wps
[Epoch 110 Batch 1080/1540] avg loss 0.00128616, throughput 2.87883K wps
[Epoch 110 Batch 1110/1540] avg loss 0.00093045, throughput 2.88069K wps
[Epoch 110 Batch 1140/1540] avg loss 0.00105593, throughput 2.87357K wps
[Epoch 110 Batch 1170/1540] avg loss 0.000996886, throughput 2.7975K wps
[Epoch 110 Batch 1200/1540] avg loss 0.00123733, throughput 2.79024K wps
[Epoch 110 Batch 1230/1540] avg loss 0.00103061, throughput 2.86473K wps
[Epoch 110 Batch 1260/1540] avg loss 0.000861792, throughput 2.87904K wps
[Epoch 110 Batch 1290/1540] avg loss 0.000930364, throughput 2.84915K wps
[Epoch 110 Batch 1320/1540] avg loss 0.00111443, throughput 2.86588K wps
[Epoch 110 Batch 1350/1540] avg loss 0.000912351, throughput 2.87473K wps
[Epoch 110 Batch 1380/1540] avg loss 0.00098769, throughput 2.87187K wps
[Epoch 110 Batch 1410/1540] avg loss 0.00100443, throughput 2.85043K wps
[Epoch 110 Batch 1440/1540] avg loss 0.00114939, throughput 2.86698K wps
[Epoch 110 Batch 1470/1540] avg loss 0.00107612, throughput 2.80316K wps
[Epoch 110 Batch 1500/1540] avg loss 0.000963444, throughput 2.85151K wps
[Epoch 110 Batch 1530/1540] avg loss 0.0011298, throughput 2.86767K wps
Begin Testing...
[Epoch 110] train avg loss 0.0010011, dev acc 0.7890, dev avg loss 0.843244, throughput 2.85254K wps
[Epoch 111 Batch 30/1540] avg loss 0.0010046, throughput 2.9221K wps
[Epoch 111 Batch 60/1540] avg loss 0.00118204, throughput 2.81205K wps
[Epoch 111 Batch 90/1540] avg loss 0.000944875, throughput 2.86266K wps
[Epoch 111 Batch 120/1540] avg loss 0.000810318, throughput 2.82456K wps
[Epoch 111 Batch 150/1540] avg loss 0.000773049, throughput 2.8429K wps
[Epoch 111 Batch 180/1540] avg loss 0.000685673, throughput 2.87128K wps
[Epoch 111 Batch 210/1540] avg loss 0.000837494, throughput 2.83869K wps
[Epoch 111 Batch 240/1540] avg loss 0.00065063, throughput 2.86162K wps
[Epoch 111 Batch 270/1540] avg loss 0.00109731, throughput 2.8716K wps
[Epoch 111 Batch 300/1540] avg loss 0.000909108, throughput 2.86209K wps
[Epoch 111 Batch 330/1540] avg loss 0.00081174, throughput 2.87159K wps
[Epoch 111 Batch 360/1540] avg loss 0.000973002, throughput 2.86054K wps
[Epoch 111 Batch 390/1540] avg loss 0.000814607, throughput 2.84573K wps
[Epoch 111 Batch 420/1540] avg loss 0.000942509, throughput 2.84377K wps
[Epoch 111 Batch 450/1540] avg loss 0.000940008, throughput 2.8361K wps
[Epoch 111 Batch 480/1540] avg loss 0.000974366, throughput 2.84412K wps
[Epoch 111 Batch 510/1540] avg loss 0.000707326, throughput 2.86632K wps
[Epoch 111 Batch 540/1540] avg loss 0.000974041, throughput 2.8632K wps
[Epoch 111 Batch 570/1540] avg loss 0.000997024, throughput 2.87018K wps
[Epoch 111 Batch 600/1540] avg loss 0.00112962, throughput 2.80341K wps
[Epoch 111 Batch 630/1540] avg loss 0.00098317, throughput 2.79194K wps
[Epoch 111 Batch 660/1540] avg loss 0.00109952, throughput 2.85145K wps
[Epoch 111 Batch 690/1540] avg loss 0.00128386, throughput 2.81403K wps
[Epoch 111 Batch 720/1540] avg loss 0.000859897, throughput 2.83372K wps
[Epoch 111 Batch 750/1540] avg loss 0.001179, throughput 2.78622K wps
[Epoch 111 Batch 780/1540] avg loss 0.00117629, throughput 2.83954K wps
[Epoch 111 Batch 810/1540] avg loss 0.00130356, throughput 2.85562K wps
[Epoch 111 Batch 840/1540] avg loss 0.00101714, throughput 2.84019K wps
[Epoch 111 Batch 870/1540] avg loss 0.000997487, throughput 2.85677K wps
[Epoch 111 Batch 900/1540] avg loss 0.000969442, throughput 2.87475K wps
[Epoch 111 Batch 930/1540] avg loss 0.00101283, throughput 2.85131K wps
[Epoch 111 Batch 960/1540] avg loss 0.00112984, throughput 2.86372K wps
[Epoch 111 Batch 990/1540] avg loss 0.000929492, throughput 2.80913K wps
[Epoch 111 Batch 1020/1540] avg loss 0.000821408, throughput 2.82777K wps
[Epoch 111 Batch 1050/1540] avg loss 0.001027, throughput 2.83702K wps
[Epoch 111 Batch 1080/1540] avg loss 0.000964237, throughput 2.85945K wps
[Epoch 111 Batch 1110/1540] avg loss 0.00100487, throughput 2.86929K wps
[Epoch 111 Batch 1140/1540] avg loss 0.000977199, throughput 2.87126K wps
[Epoch 111 Batch 1170/1540] avg loss 0.000931177, throughput 2.86485K wps
[Epoch 111 Batch 1200/1540] avg loss 0.000961648, throughput 2.86669K wps
[Epoch 111 Batch 1230/1540] avg loss 0.00107565, throughput 2.86445K wps
[Epoch 111 Batch 1260/1540] avg loss 0.000948418, throughput 2.86937K wps
[Epoch 111 Batch 1290/1540] avg loss 0.00115369, throughput 2.84393K wps
[Epoch 111 Batch 1320/1540] avg loss 0.000948911, throughput 2.80479K wps
[Epoch 111 Batch 1350/1540] avg loss 0.000885302, throughput 2.84629K wps
[Epoch 111 Batch 1380/1540] avg loss 0.00086208, throughput 2.84993K wps
[Epoch 111 Batch 1410/1540] avg loss 0.0009435, throughput 2.77729K wps
[Epoch 111 Batch 1440/1540] avg loss 0.00100378, throughput 2.85816K wps
[Epoch 111 Batch 1470/1540] avg loss 0.00111034, throughput 2.84834K wps
[Epoch 111 Batch 1500/1540] avg loss 0.00140791, throughput 2.84843K wps
[Epoch 111 Batch 1530/1540] avg loss 0.00100542, throughput 2.82763K wps
Begin Testing...
[Epoch 111] train avg loss 0.00098842, dev acc 0.7878, dev avg loss 0.88153, throughput 2.8458K wps
[Epoch 112 Batch 30/1540] avg loss 0.00115435, throughput 2.90259K wps
[Epoch 112 Batch 60/1540] avg loss 0.000900967, throughput 2.86427K wps
[Epoch 112 Batch 90/1540] avg loss 0.000724198, throughput 2.86746K wps
[Epoch 112 Batch 120/1540] avg loss 0.000731083, throughput 2.82994K wps
[Epoch 112 Batch 150/1540] avg loss 0.000716106, throughput 2.82274K wps
[Epoch 112 Batch 180/1540] avg loss 0.000957539, throughput 2.86514K wps
[Epoch 112 Batch 210/1540] avg loss 0.00127878, throughput 2.86276K wps
[Epoch 112 Batch 240/1540] avg loss 0.00124074, throughput 2.83886K wps
[Epoch 112 Batch 270/1540] avg loss 0.00069983, throughput 2.85039K wps
[Epoch 112 Batch 300/1540] avg loss 0.00102555, throughput 2.85905K wps
[Epoch 112 Batch 330/1540] avg loss 0.000921923, throughput 2.86297K wps
[Epoch 112 Batch 360/1540] avg loss 0.000803795, throughput 2.83417K wps
[Epoch 112 Batch 390/1540] avg loss 0.000955329, throughput 2.77935K wps
[Epoch 112 Batch 420/1540] avg loss 0.0010271, throughput 2.79409K wps
[Epoch 112 Batch 450/1540] avg loss 0.00108035, throughput 2.86199K wps
[Epoch 112 Batch 480/1540] avg loss 0.00090775, throughput 2.87005K wps
[Epoch 112 Batch 510/1540] avg loss 0.00102126, throughput 2.84023K wps
[Epoch 112 Batch 540/1540] avg loss 0.00105231, throughput 2.79763K wps
[Epoch 112 Batch 570/1540] avg loss 0.000990252, throughput 2.80565K wps
[Epoch 112 Batch 600/1540] avg loss 0.000982312, throughput 2.81383K wps
[Epoch 112 Batch 630/1540] avg loss 0.00115622, throughput 2.85321K wps
[Epoch 112 Batch 660/1540] avg loss 0.000963002, throughput 2.85429K wps
[Epoch 112 Batch 690/1540] avg loss 0.000870918, throughput 2.82087K wps
[Epoch 112 Batch 720/1540] avg loss 0.0009685, throughput 2.8505K wps
[Epoch 112 Batch 750/1540] avg loss 0.000969121, throughput 2.86029K wps
[Epoch 112 Batch 780/1540] avg loss 0.0010148, throughput 2.85881K wps
[Epoch 112 Batch 810/1540] avg loss 0.000865331, throughput 2.85564K wps
[Epoch 112 Batch 840/1540] avg loss 0.000951368, throughput 2.83206K wps
[Epoch 112 Batch 870/1540] avg loss 0.00076775, throughput 2.80522K wps
[Epoch 112 Batch 900/1540] avg loss 0.000951577, throughput 2.87897K wps
[Epoch 112 Batch 930/1540] avg loss 0.000877573, throughput 2.8531K wps
[Epoch 112 Batch 960/1540] avg loss 0.000798914, throughput 2.87245K wps
[Epoch 112 Batch 990/1540] avg loss 0.00118966, throughput 2.88003K wps
[Epoch 112 Batch 1020/1540] avg loss 0.000954818, throughput 2.80593K wps
[Epoch 112 Batch 1050/1540] avg loss 0.000881102, throughput 2.83566K wps
[Epoch 112 Batch 1080/1540] avg loss 0.000996705, throughput 2.82335K wps
[Epoch 112 Batch 1110/1540] avg loss 0.000929862, throughput 2.83001K wps
[Epoch 112 Batch 1140/1540] avg loss 0.00116021, throughput 2.86497K wps
[Epoch 112 Batch 1170/1540] avg loss 0.00106802, throughput 2.8125K wps
[Epoch 112 Batch 1200/1540] avg loss 0.00103914, throughput 2.81815K wps
[Epoch 112 Batch 1230/1540] avg loss 0.00116715, throughput 2.80268K wps
[Epoch 112 Batch 1260/1540] avg loss 0.00109851, throughput 2.81484K wps
[Epoch 112 Batch 1290/1540] avg loss 0.0013155, throughput 2.80801K wps
[Epoch 112 Batch 1320/1540] avg loss 0.00107292, throughput 2.86125K wps
[Epoch 112 Batch 1350/1540] avg loss 0.00114759, throughput 2.88303K wps
[Epoch 112 Batch 1380/1540] avg loss 0.000929635, throughput 2.83453K wps
[Epoch 112 Batch 1410/1540] avg loss 0.000837435, throughput 2.8541K wps
[Epoch 112 Batch 1440/1540] avg loss 0.000803167, throughput 2.83514K wps
[Epoch 112 Batch 1470/1540] avg loss 0.000929133, throughput 2.84968K wps
[Epoch 112 Batch 1500/1540] avg loss 0.000950953, throughput 2.84588K wps
[Epoch 112 Batch 1530/1540] avg loss 0.00112106, throughput 2.86747K wps
Begin Testing...
[Epoch 112] train avg loss 0.000976578, dev acc 0.7924, dev avg loss 0.822393, throughput 2.84192K wps
[Epoch 113 Batch 30/1540] avg loss 0.000751608, throughput 2.9111K wps
[Epoch 113 Batch 60/1540] avg loss 0.000987599, throughput 2.85535K wps
[Epoch 113 Batch 90/1540] avg loss 0.000955463, throughput 2.84656K wps
[Epoch 113 Batch 120/1540] avg loss 0.000830709, throughput 2.82699K wps
[Epoch 113 Batch 150/1540] avg loss 0.00108165, throughput 2.85481K wps
[Epoch 113 Batch 180/1540] avg loss 0.000857476, throughput 2.85296K wps
[Epoch 113 Batch 210/1540] avg loss 0.000972855, throughput 2.8144K wps
[Epoch 113 Batch 240/1540] avg loss 0.000781856, throughput 2.83153K wps
[Epoch 113 Batch 270/1540] avg loss 0.00108321, throughput 2.84826K wps
[Epoch 113 Batch 300/1540] avg loss 0.00102372, throughput 2.85675K wps
[Epoch 113 Batch 330/1540] avg loss 0.000944794, throughput 2.78579K wps
[Epoch 113 Batch 360/1540] avg loss 0.000849673, throughput 2.84821K wps
[Epoch 113 Batch 390/1540] avg loss 0.0012734, throughput 2.87778K wps
[Epoch 113 Batch 420/1540] avg loss 0.000768882, throughput 2.87083K wps
[Epoch 113 Batch 450/1540] avg loss 0.000765813, throughput 2.85143K wps
[Epoch 113 Batch 480/1540] avg loss 0.00088928, throughput 2.85408K wps
[Epoch 113 Batch 510/1540] avg loss 0.000892823, throughput 2.82227K wps
[Epoch 113 Batch 540/1540] avg loss 0.000953757, throughput 2.81617K wps
[Epoch 113 Batch 570/1540] avg loss 0.000901158, throughput 2.85686K wps
[Epoch 113 Batch 600/1540] avg loss 0.00110856, throughput 2.86573K wps
[Epoch 113 Batch 630/1540] avg loss 0.00117382, throughput 2.87602K wps
[Epoch 113 Batch 660/1540] avg loss 0.00108764, throughput 2.87336K wps
[Epoch 113 Batch 690/1540] avg loss 0.000784175, throughput 2.87664K wps
[Epoch 113 Batch 720/1540] avg loss 0.000990336, throughput 2.8657K wps
[Epoch 113 Batch 750/1540] avg loss 0.000918839, throughput 2.77732K wps
[Epoch 113 Batch 780/1540] avg loss 0.00103244, throughput 2.84575K wps
[Epoch 113 Batch 810/1540] avg loss 0.00113492, throughput 2.86361K wps
[Epoch 113 Batch 840/1540] avg loss 0.000873366, throughput 2.81905K wps
[Epoch 113 Batch 870/1540] avg loss 0.000792718, throughput 2.86501K wps
[Epoch 113 Batch 900/1540] avg loss 0.000923317, throughput 2.87599K wps
[Epoch 113 Batch 930/1540] avg loss 0.000952624, throughput 2.87147K wps
[Epoch 113 Batch 960/1540] avg loss 0.000935814, throughput 2.85522K wps
[Epoch 113 Batch 990/1540] avg loss 0.000918454, throughput 2.77893K wps
[Epoch 113 Batch 1020/1540] avg loss 0.000941121, throughput 2.82685K wps
[Epoch 113 Batch 1050/1540] avg loss 0.000941382, throughput 2.86262K wps
[Epoch 113 Batch 1080/1540] avg loss 0.00118309, throughput 2.85628K wps
[Epoch 113 Batch 1110/1540] avg loss 0.00109439, throughput 2.81853K wps
[Epoch 113 Batch 1140/1540] avg loss 0.000798606, throughput 2.86269K wps
[Epoch 113 Batch 1170/1540] avg loss 0.00103372, throughput 2.87163K wps
[Epoch 113 Batch 1200/1540] avg loss 0.000800784, throughput 2.87023K wps
[Epoch 113 Batch 1230/1540] avg loss 0.00114707, throughput 2.87552K wps
[Epoch 113 Batch 1260/1540] avg loss 0.00101595, throughput 2.87781K wps
[Epoch 113 Batch 1290/1540] avg loss 0.00120862, throughput 2.88164K wps
[Epoch 113 Batch 1320/1540] avg loss 0.00107732, throughput 2.81502K wps
[Epoch 113 Batch 1350/1540] avg loss 0.000926093, throughput 2.80841K wps
[Epoch 113 Batch 1380/1540] avg loss 0.00102343, throughput 2.87056K wps
[Epoch 113 Batch 1410/1540] avg loss 0.000937267, throughput 2.85193K wps
[Epoch 113 Batch 1440/1540] avg loss 0.00121978, throughput 2.8151K wps
[Epoch 113 Batch 1470/1540] avg loss 0.00111089, throughput 2.85014K wps
[Epoch 113 Batch 1500/1540] avg loss 0.00109688, throughput 2.85451K wps
[Epoch 113 Batch 1530/1540] avg loss 0.00121513, throughput 2.87176K wps
Begin Testing...
[Epoch 113] train avg loss 0.000980187, dev acc 0.7959, dev avg loss 0.838681, throughput 2.84925K wps
[Epoch 114 Batch 30/1540] avg loss 0.000815659, throughput 2.86831K wps
[Epoch 114 Batch 60/1540] avg loss 0.000790282, throughput 2.84909K wps
[Epoch 114 Batch 90/1540] avg loss 0.00079662, throughput 2.87526K wps
[Epoch 114 Batch 120/1540] avg loss 0.00107004, throughput 2.85369K wps
[Epoch 114 Batch 150/1540] avg loss 0.000968462, throughput 2.86762K wps
[Epoch 114 Batch 180/1540] avg loss 0.00100799, throughput 2.84097K wps
[Epoch 114 Batch 210/1540] avg loss 0.000987232, throughput 2.85785K wps
[Epoch 114 Batch 240/1540] avg loss 0.00102048, throughput 2.80351K wps
[Epoch 114 Batch 270/1540] avg loss 0.000830678, throughput 2.84302K wps
[Epoch 114 Batch 300/1540] avg loss 0.000762031, throughput 2.80626K wps
[Epoch 114 Batch 330/1540] avg loss 0.00106866, throughput 2.83344K wps
[Epoch 114 Batch 360/1540] avg loss 0.00100673, throughput 2.80043K wps
[Epoch 114 Batch 390/1540] avg loss 0.000890037, throughput 2.79083K wps
[Epoch 114 Batch 420/1540] avg loss 0.00101843, throughput 2.83716K wps
[Epoch 114 Batch 450/1540] avg loss 0.000790019, throughput 2.83034K wps
[Epoch 114 Batch 480/1540] avg loss 0.00085711, throughput 2.86461K wps
[Epoch 114 Batch 510/1540] avg loss 0.00112403, throughput 2.8643K wps
[Epoch 114 Batch 540/1540] avg loss 0.00086479, throughput 2.81207K wps
[Epoch 114 Batch 570/1540] avg loss 0.000987605, throughput 2.86162K wps
[Epoch 114 Batch 600/1540] avg loss 0.00101007, throughput 2.8723K wps
[Epoch 114 Batch 630/1540] avg loss 0.000991638, throughput 2.85838K wps
[Epoch 114 Batch 660/1540] avg loss 0.000929361, throughput 2.86601K wps
[Epoch 114 Batch 690/1540] avg loss 0.00102492, throughput 2.87367K wps
[Epoch 114 Batch 720/1540] avg loss 0.00074458, throughput 2.83204K wps
[Epoch 114 Batch 750/1540] avg loss 0.000918434, throughput 2.80555K wps
[Epoch 114 Batch 780/1540] avg loss 0.00077981, throughput 2.85204K wps
[Epoch 114 Batch 810/1540] avg loss 0.00107973, throughput 2.86206K wps
[Epoch 114 Batch 840/1540] avg loss 0.0009978, throughput 2.79635K wps
[Epoch 114 Batch 870/1540] avg loss 0.000981417, throughput 2.80878K wps
[Epoch 114 Batch 900/1540] avg loss 0.00103978, throughput 2.87389K wps
[Epoch 114 Batch 930/1540] avg loss 0.000968024, throughput 2.86792K wps
[Epoch 114 Batch 960/1540] avg loss 0.000791715, throughput 2.87486K wps
[Epoch 114 Batch 990/1540] avg loss 0.000988056, throughput 2.87153K wps
[Epoch 114 Batch 1020/1540] avg loss 0.000860572, throughput 2.81355K wps
[Epoch 114 Batch 1050/1540] avg loss 0.000925458, throughput 2.81188K wps
[Epoch 114 Batch 1080/1540] avg loss 0.000972818, throughput 2.84004K wps
[Epoch 114 Batch 1110/1540] avg loss 0.000935953, throughput 2.86226K wps
[Epoch 114 Batch 1140/1540] avg loss 0.000950647, throughput 2.81557K wps
[Epoch 114 Batch 1170/1540] avg loss 0.00110771, throughput 2.84963K wps
[Epoch 114 Batch 1200/1540] avg loss 0.00119023, throughput 2.83184K wps
[Epoch 114 Batch 1230/1540] avg loss 0.000828232, throughput 2.83033K wps
[Epoch 114 Batch 1260/1540] avg loss 0.000946907, throughput 2.84727K wps
[Epoch 114 Batch 1290/1540] avg loss 0.00126708, throughput 2.86467K wps
[Epoch 114 Batch 1320/1540] avg loss 0.00100941, throughput 2.8125K wps
[Epoch 114 Batch 1350/1540] avg loss 0.00102635, throughput 2.79315K wps
[Epoch 114 Batch 1380/1540] avg loss 0.0011307, throughput 2.84136K wps
[Epoch 114 Batch 1410/1540] avg loss 0.000754488, throughput 2.80882K wps
[Epoch 114 Batch 1440/1540] avg loss 0.00109798, throughput 2.8649K wps
[Epoch 114 Batch 1470/1540] avg loss 0.000936977, throughput 2.83908K wps
[Epoch 114 Batch 1500/1540] avg loss 0.00102231, throughput 2.84333K wps
[Epoch 114 Batch 1530/1540] avg loss 0.00132754, throughput 2.86547K wps
Begin Testing...
[Epoch 114] train avg loss 0.000971698, dev acc 0.7878, dev avg loss 0.834885, throughput 2.84137K wps
[Epoch 115 Batch 30/1540] avg loss 0.000796816, throughput 2.8674K wps
[Epoch 115 Batch 60/1540] avg loss 0.001015, throughput 2.8119K wps
[Epoch 115 Batch 90/1540] avg loss 0.000783302, throughput 2.84071K wps
[Epoch 115 Batch 120/1540] avg loss 0.000818826, throughput 2.8369K wps
[Epoch 115 Batch 150/1540] avg loss 0.000857661, throughput 2.87196K wps
[Epoch 115 Batch 180/1540] avg loss 0.0009628, throughput 2.85113K wps
[Epoch 115 Batch 210/1540] avg loss 0.000828211, throughput 2.83063K wps
[Epoch 115 Batch 240/1540] avg loss 0.000935393, throughput 2.86264K wps
[Epoch 115 Batch 270/1540] avg loss 0.00096064, throughput 2.82518K wps
[Epoch 115 Batch 300/1540] avg loss 0.000877064, throughput 2.85403K wps
[Epoch 115 Batch 330/1540] avg loss 0.00103137, throughput 2.8052K wps
[Epoch 115 Batch 360/1540] avg loss 0.000957121, throughput 2.83969K wps
[Epoch 115 Batch 390/1540] avg loss 0.000958327, throughput 2.87985K wps
[Epoch 115 Batch 420/1540] avg loss 0.000938827, throughput 2.87322K wps
[Epoch 115 Batch 450/1540] avg loss 0.00111991, throughput 2.81791K wps
[Epoch 115 Batch 480/1540] avg loss 0.000612839, throughput 2.88047K wps
[Epoch 115 Batch 510/1540] avg loss 0.000955125, throughput 2.83923K wps
[Epoch 115 Batch 540/1540] avg loss 0.000843923, throughput 2.86709K wps
[Epoch 115 Batch 570/1540] avg loss 0.000938216, throughput 2.8475K wps
[Epoch 115 Batch 600/1540] avg loss 0.000975918, throughput 2.85729K wps
[Epoch 115 Batch 630/1540] avg loss 0.0010074, throughput 2.8285K wps
[Epoch 115 Batch 660/1540] avg loss 0.00108532, throughput 2.81894K wps
[Epoch 115 Batch 690/1540] avg loss 0.000838612, throughput 2.85224K wps
[Epoch 115 Batch 720/1540] avg loss 0.00092879, throughput 2.8436K wps
[Epoch 115 Batch 750/1540] avg loss 0.000768192, throughput 2.84003K wps
[Epoch 115 Batch 780/1540] avg loss 0.000955647, throughput 2.85619K wps
[Epoch 115 Batch 810/1540] avg loss 0.000913788, throughput 2.86747K wps
[Epoch 115 Batch 840/1540] avg loss 0.00104544, throughput 2.83025K wps
[Epoch 115 Batch 870/1540] avg loss 0.00103596, throughput 2.85753K wps
[Epoch 115 Batch 900/1540] avg loss 0.00102726, throughput 2.84976K wps
[Epoch 115 Batch 930/1540] avg loss 0.000895006, throughput 2.85188K wps
[Epoch 115 Batch 960/1540] avg loss 0.00129137, throughput 2.84861K wps
[Epoch 115 Batch 990/1540] avg loss 0.000785783, throughput 2.8517K wps
[Epoch 115 Batch 1020/1540] avg loss 0.000787748, throughput 2.8501K wps
[Epoch 115 Batch 1050/1540] avg loss 0.00106194, throughput 2.86128K wps
[Epoch 115 Batch 1080/1540] avg loss 0.000922267, throughput 2.85264K wps
[Epoch 115 Batch 1110/1540] avg loss 0.000806777, throughput 2.84188K wps
[Epoch 115 Batch 1140/1540] avg loss 0.00118901, throughput 2.85196K wps
[Epoch 115 Batch 1170/1540] avg loss 0.000686267, throughput 2.85615K wps
[Epoch 115 Batch 1200/1540] avg loss 0.000836611, throughput 2.84681K wps
[Epoch 115 Batch 1230/1540] avg loss 0.000866126, throughput 2.86526K wps
[Epoch 115 Batch 1260/1540] avg loss 0.000929986, throughput 2.78577K wps
[Epoch 115 Batch 1290/1540] avg loss 0.00107598, throughput 2.7758K wps
[Epoch 115 Batch 1320/1540] avg loss 0.000893636, throughput 2.81783K wps
[Epoch 115 Batch 1350/1540] avg loss 0.000951241, throughput 2.84459K wps
[Epoch 115 Batch 1380/1540] avg loss 0.00091253, throughput 2.86455K wps
[Epoch 115 Batch 1410/1540] avg loss 0.00108599, throughput 2.87517K wps
[Epoch 115 Batch 1440/1540] avg loss 0.00102177, throughput 2.82676K wps
[Epoch 115 Batch 1470/1540] avg loss 0.00088803, throughput 2.87162K wps
[Epoch 115 Batch 1500/1540] avg loss 0.00088371, throughput 2.86672K wps
[Epoch 115 Batch 1530/1540] avg loss 0.00110429, throughput 2.83009K wps
Begin Testing...
[Epoch 115] train avg loss 0.000936386, dev acc 0.7970, dev avg loss 0.825779, throughput 2.84589K wps
[Epoch 116 Batch 30/1540] avg loss 0.00128592, throughput 2.91279K wps
[Epoch 116 Batch 60/1540] avg loss 0.000903204, throughput 2.84896K wps
[Epoch 116 Batch 90/1540] avg loss 0.00103617, throughput 2.81365K wps
[Epoch 116 Batch 120/1540] avg loss 0.000786959, throughput 2.81478K wps
[Epoch 116 Batch 150/1540] avg loss 0.000855198, throughput 2.87092K wps
[Epoch 116 Batch 180/1540] avg loss 0.000809984, throughput 2.84597K wps
[Epoch 116 Batch 210/1540] avg loss 0.00101074, throughput 2.84439K wps
[Epoch 116 Batch 240/1540] avg loss 0.000939915, throughput 2.8205K wps
[Epoch 116 Batch 270/1540] avg loss 0.00091047, throughput 2.86218K wps
[Epoch 116 Batch 300/1540] avg loss 0.000831431, throughput 2.87787K wps
[Epoch 116 Batch 330/1540] avg loss 0.000840457, throughput 2.86149K wps
[Epoch 116 Batch 360/1540] avg loss 0.00104272, throughput 2.82766K wps
[Epoch 116 Batch 390/1540] avg loss 0.000951087, throughput 2.81034K wps
[Epoch 116 Batch 420/1540] avg loss 0.000829361, throughput 2.85921K wps
[Epoch 116 Batch 450/1540] avg loss 0.000893074, throughput 2.86095K wps
[Epoch 116 Batch 480/1540] avg loss 0.000953297, throughput 2.84583K wps
[Epoch 116 Batch 510/1540] avg loss 0.000784271, throughput 2.8023K wps
[Epoch 116 Batch 540/1540] avg loss 0.000930956, throughput 2.84911K wps
[Epoch 116 Batch 570/1540] avg loss 0.000910519, throughput 2.86779K wps
[Epoch 116 Batch 600/1540] avg loss 0.000700298, throughput 2.84188K wps
[Epoch 116 Batch 630/1540] avg loss 0.00085171, throughput 2.87536K wps
[Epoch 116 Batch 660/1540] avg loss 0.000787151, throughput 2.84186K wps
[Epoch 116 Batch 690/1540] avg loss 0.00104114, throughput 2.82076K wps
[Epoch 116 Batch 720/1540] avg loss 0.000888257, throughput 2.83715K wps
[Epoch 116 Batch 750/1540] avg loss 0.000991077, throughput 2.84622K wps
[Epoch 116 Batch 780/1540] avg loss 0.00103311, throughput 2.8365K wps
[Epoch 116 Batch 810/1540] avg loss 0.000792613, throughput 2.79376K wps
[Epoch 116 Batch 840/1540] avg loss 0.00100173, throughput 2.82305K wps
[Epoch 116 Batch 870/1540] avg loss 0.0012246, throughput 2.87004K wps
[Epoch 116 Batch 900/1540] avg loss 0.000861724, throughput 2.86009K wps
[Epoch 116 Batch 930/1540] avg loss 0.00113154, throughput 2.84951K wps
[Epoch 116 Batch 960/1540] avg loss 0.00117467, throughput 2.86156K wps
[Epoch 116 Batch 990/1540] avg loss 0.00110666, throughput 2.47242K wps
[Epoch 116 Batch 1020/1540] avg loss 0.000752258, throughput 2.85996K wps
[Epoch 116 Batch 1050/1540] avg loss 0.00102049, throughput 2.87256K wps
[Epoch 116 Batch 1080/1540] avg loss 0.000817699, throughput 2.86143K wps
[Epoch 116 Batch 1110/1540] avg loss 0.00104076, throughput 2.85926K wps
[Epoch 116 Batch 1140/1540] avg loss 0.000806849, throughput 2.85798K wps
[Epoch 116 Batch 1170/1540] avg loss 0.00102171, throughput 2.87453K wps
[Epoch 116 Batch 1200/1540] avg loss 0.00114141, throughput 2.87889K wps
[Epoch 116 Batch 1230/1540] avg loss 0.000936896, throughput 2.84594K wps
[Epoch 116 Batch 1260/1540] avg loss 0.000888012, throughput 2.78752K wps
[Epoch 116 Batch 1290/1540] avg loss 0.000928489, throughput 2.82041K wps
[Epoch 116 Batch 1320/1540] avg loss 0.00103396, throughput 2.85733K wps
[Epoch 116 Batch 1350/1540] avg loss 0.00103592, throughput 2.85049K wps
[Epoch 116 Batch 1380/1540] avg loss 0.00134631, throughput 2.8522K wps
[Epoch 116 Batch 1410/1540] avg loss 0.00099242, throughput 2.79813K wps
[Epoch 116 Batch 1440/1540] avg loss 0.000964362, throughput 2.8376K wps
[Epoch 116 Batch 1470/1540] avg loss 0.00111166, throughput 2.83687K wps
[Epoch 116 Batch 1500/1540] avg loss 0.00111902, throughput 2.85412K wps
[Epoch 116 Batch 1530/1540] avg loss 0.00108829, throughput 2.79027K wps
Begin Testing...
[Epoch 116] train avg loss 0.00096451, dev acc 0.8016, dev avg loss 0.840039, throughput 2.83655K wps
[Epoch 117 Batch 30/1540] avg loss 0.000687141, throughput 2.85253K wps
[Epoch 117 Batch 60/1540] avg loss 0.000711188, throughput 2.86642K wps
[Epoch 117 Batch 90/1540] avg loss 0.000931063, throughput 2.83116K wps
[Epoch 117 Batch 120/1540] avg loss 0.000768664, throughput 2.85063K wps
[Epoch 117 Batch 150/1540] avg loss 0.00106107, throughput 2.84563K wps
[Epoch 117 Batch 180/1540] avg loss 0.000726072, throughput 2.83523K wps
[Epoch 117 Batch 210/1540] avg loss 0.000881877, throughput 2.8252K wps
[Epoch 117 Batch 240/1540] avg loss 0.000871719, throughput 2.80968K wps
[Epoch 117 Batch 270/1540] avg loss 0.000698088, throughput 2.86143K wps
[Epoch 117 Batch 300/1540] avg loss 0.000797901, throughput 2.81699K wps
[Epoch 117 Batch 330/1540] avg loss 0.000983117, throughput 2.84674K wps
[Epoch 117 Batch 360/1540] avg loss 0.00112542, throughput 2.84983K wps
[Epoch 117 Batch 390/1540] avg loss 0.000779543, throughput 2.85625K wps
[Epoch 117 Batch 420/1540] avg loss 0.00103818, throughput 2.82212K wps
[Epoch 117 Batch 450/1540] avg loss 0.000934845, throughput 2.85012K wps
[Epoch 117 Batch 480/1540] avg loss 0.0011739, throughput 2.86544K wps
[Epoch 117 Batch 510/1540] avg loss 0.000923809, throughput 2.87581K wps
[Epoch 117 Batch 540/1540] avg loss 0.000817093, throughput 2.87113K wps
[Epoch 117 Batch 570/1540] avg loss 0.00102543, throughput 2.85765K wps
[Epoch 117 Batch 600/1540] avg loss 0.0012639, throughput 2.85366K wps
[Epoch 117 Batch 630/1540] avg loss 0.00102647, throughput 2.87457K wps
[Epoch 117 Batch 660/1540] avg loss 0.00101867, throughput 2.86888K wps
[Epoch 117 Batch 690/1540] avg loss 0.00112865, throughput 2.82485K wps
[Epoch 117 Batch 720/1540] avg loss 0.00127526, throughput 2.85262K wps
[Epoch 117 Batch 750/1540] avg loss 0.00089661, throughput 2.83954K wps
[Epoch 117 Batch 780/1540] avg loss 0.0011314, throughput 2.84664K wps
[Epoch 117 Batch 810/1540] avg loss 0.00119092, throughput 2.85683K wps
[Epoch 117 Batch 840/1540] avg loss 0.000683114, throughput 2.77603K wps
[Epoch 117 Batch 870/1540] avg loss 0.000982703, throughput 2.76747K wps
[Epoch 117 Batch 900/1540] avg loss 0.0010302, throughput 2.78218K wps
[Epoch 117 Batch 930/1540] avg loss 0.000810388, throughput 2.85443K wps
[Epoch 117 Batch 960/1540] avg loss 0.000726871, throughput 2.86394K wps
[Epoch 117 Batch 990/1540] avg loss 0.0010601, throughput 2.84678K wps
[Epoch 117 Batch 1020/1540] avg loss 0.000994409, throughput 2.86823K wps
[Epoch 117 Batch 1050/1540] avg loss 0.000882557, throughput 2.87201K wps
[Epoch 117 Batch 1080/1540] avg loss 0.00105211, throughput 2.87038K wps
[Epoch 117 Batch 1110/1540] avg loss 0.00110364, throughput 2.79383K wps
[Epoch 117 Batch 1140/1540] avg loss 0.00112068, throughput 2.85345K wps
[Epoch 117 Batch 1170/1540] avg loss 0.000973539, throughput 2.86956K wps
[Epoch 117 Batch 1200/1540] avg loss 0.000964252, throughput 2.8699K wps
[Epoch 117 Batch 1230/1540] avg loss 0.000798517, throughput 2.8614K wps
[Epoch 117 Batch 1260/1540] avg loss 0.000949999, throughput 2.85315K wps
[Epoch 117 Batch 1290/1540] avg loss 0.000976276, throughput 2.83027K wps
[Epoch 117 Batch 1320/1540] avg loss 0.000966444, throughput 2.82804K wps
[Epoch 117 Batch 1350/1540] avg loss 0.000928289, throughput 2.85702K wps
[Epoch 117 Batch 1380/1540] avg loss 0.000983719, throughput 2.84742K wps
[Epoch 117 Batch 1410/1540] avg loss 0.00115118, throughput 2.81423K wps
[Epoch 117 Batch 1440/1540] avg loss 0.000883782, throughput 2.87215K wps
[Epoch 117 Batch 1470/1540] avg loss 0.000979625, throughput 2.82227K wps
[Epoch 117 Batch 1500/1540] avg loss 0.0010419, throughput 2.86429K wps
[Epoch 117 Batch 1530/1540] avg loss 0.000765796, throughput 2.83044K wps
Begin Testing...
[Epoch 117] train avg loss 0.000953304, dev acc 0.7924, dev avg loss 0.84174, throughput 2.84395K wps
[Epoch 118 Batch 30/1540] avg loss 0.00083662, throughput 2.88953K wps
[Epoch 118 Batch 60/1540] avg loss 0.000928671, throughput 2.82075K wps
[Epoch 118 Batch 90/1540] avg loss 0.0010305, throughput 2.86775K wps
[Epoch 118 Batch 120/1540] avg loss 0.000788042, throughput 2.88049K wps
[Epoch 118 Batch 150/1540] avg loss 0.00077565, throughput 2.87337K wps
[Epoch 118 Batch 180/1540] avg loss 0.000775599, throughput 2.87483K wps
[Epoch 118 Batch 210/1540] avg loss 0.000867413, throughput 2.86621K wps
[Epoch 118 Batch 240/1540] avg loss 0.000874277, throughput 2.86999K wps
[Epoch 118 Batch 270/1540] avg loss 0.000957909, throughput 2.81022K wps
[Epoch 118 Batch 300/1540] avg loss 0.00068078, throughput 2.83001K wps
[Epoch 118 Batch 330/1540] avg loss 0.000865998, throughput 2.84562K wps
[Epoch 118 Batch 360/1540] avg loss 0.000919916, throughput 2.85213K wps
[Epoch 118 Batch 390/1540] avg loss 0.000949313, throughput 2.87061K wps
[Epoch 118 Batch 420/1540] avg loss 0.000809727, throughput 2.83938K wps
[Epoch 118 Batch 450/1540] avg loss 0.00108172, throughput 2.7908K wps
[Epoch 118 Batch 480/1540] avg loss 0.000886716, throughput 2.85765K wps
[Epoch 118 Batch 510/1540] avg loss 0.00111482, throughput 2.8151K wps
[Epoch 118 Batch 540/1540] avg loss 0.00082471, throughput 2.86257K wps
[Epoch 118 Batch 570/1540] avg loss 0.0011158, throughput 2.85112K wps
[Epoch 118 Batch 600/1540] avg loss 0.000891687, throughput 2.84825K wps
[Epoch 118 Batch 630/1540] avg loss 0.000831188, throughput 2.85586K wps
[Epoch 118 Batch 660/1540] avg loss 0.0010715, throughput 2.85478K wps
[Epoch 118 Batch 690/1540] avg loss 0.000837806, throughput 2.86026K wps
[Epoch 118 Batch 720/1540] avg loss 0.00100514, throughput 2.81764K wps
[Epoch 118 Batch 750/1540] avg loss 0.000714693, throughput 2.84913K wps
[Epoch 118 Batch 780/1540] avg loss 0.000755237, throughput 2.85387K wps
[Epoch 118 Batch 810/1540] avg loss 0.000973264, throughput 2.83978K wps
[Epoch 118 Batch 840/1540] avg loss 0.00117888, throughput 2.83739K wps
[Epoch 118 Batch 870/1540] avg loss 0.000789327, throughput 2.82656K wps
[Epoch 118 Batch 900/1540] avg loss 0.000839934, throughput 2.82257K wps
[Epoch 118 Batch 930/1540] avg loss 0.00124708, throughput 2.84975K wps
[Epoch 118 Batch 960/1540] avg loss 0.000699368, throughput 2.8744K wps
[Epoch 118 Batch 990/1540] avg loss 0.000854221, throughput 2.87871K wps
[Epoch 118 Batch 1020/1540] avg loss 0.0012108, throughput 2.85961K wps
[Epoch 118 Batch 1050/1540] avg loss 0.00144616, throughput 2.79265K wps
[Epoch 118 Batch 1080/1540] avg loss 0.00102365, throughput 2.85486K wps
[Epoch 118 Batch 1110/1540] avg loss 0.000925709, throughput 2.87289K wps
[Epoch 118 Batch 1140/1540] avg loss 0.000923684, throughput 2.86116K wps
[Epoch 118 Batch 1170/1540] avg loss 0.00100872, throughput 2.86144K wps
[Epoch 118 Batch 1200/1540] avg loss 0.00098135, throughput 2.8651K wps
[Epoch 118 Batch 1230/1540] avg loss 0.000872423, throughput 2.87296K wps
[Epoch 118 Batch 1260/1540] avg loss 0.00105883, throughput 2.83008K wps
[Epoch 118 Batch 1290/1540] avg loss 0.000942436, throughput 2.8239K wps
[Epoch 118 Batch 1320/1540] avg loss 0.00117314, throughput 2.82249K wps
[Epoch 118 Batch 1350/1540] avg loss 0.000999994, throughput 2.79895K wps
[Epoch 118 Batch 1380/1540] avg loss 0.000887585, throughput 2.87115K wps
[Epoch 118 Batch 1410/1540] avg loss 0.0009, throughput 2.85502K wps
[Epoch 118 Batch 1440/1540] avg loss 0.000956136, throughput 2.8609K wps
[Epoch 118 Batch 1470/1540] avg loss 0.00103894, throughput 2.84468K wps
[Epoch 118 Batch 1500/1540] avg loss 0.00099618, throughput 2.87625K wps
[Epoch 118 Batch 1530/1540] avg loss 0.000805816, throughput 2.87554K wps
Begin Testing...
[Epoch 118] train avg loss 0.000942273, dev acc 0.7924, dev avg loss 0.875045, throughput 2.84971K wps
[Epoch 119 Batch 30/1540] avg loss 0.000801665, throughput 2.89822K wps
[Epoch 119 Batch 60/1540] avg loss 0.000793456, throughput 2.85036K wps
[Epoch 119 Batch 90/1540] avg loss 0.0009917, throughput 2.85629K wps
[Epoch 119 Batch 120/1540] avg loss 0.000751634, throughput 2.87162K wps
[Epoch 119 Batch 150/1540] avg loss 0.000701242, throughput 2.83109K wps
[Epoch 119 Batch 180/1540] avg loss 0.000739859, throughput 2.85356K wps
[Epoch 119 Batch 210/1540] avg loss 0.00086755, throughput 2.79449K wps
[Epoch 119 Batch 240/1540] avg loss 0.000728512, throughput 2.85291K wps
[Epoch 119 Batch 270/1540] avg loss 0.000833544, throughput 2.87415K wps
[Epoch 119 Batch 300/1540] avg loss 0.000982814, throughput 2.86108K wps
[Epoch 119 Batch 330/1540] avg loss 0.00102794, throughput 2.84965K wps
[Epoch 119 Batch 360/1540] avg loss 0.00101909, throughput 2.81564K wps
[Epoch 119 Batch 390/1540] avg loss 0.0008296, throughput 2.86231K wps
[Epoch 119 Batch 420/1540] avg loss 0.000863851, throughput 2.87727K wps
[Epoch 119 Batch 450/1540] avg loss 0.000898588, throughput 2.8828K wps
[Epoch 119 Batch 480/1540] avg loss 0.00081774, throughput 2.82863K wps
[Epoch 119 Batch 510/1540] avg loss 0.000917054, throughput 2.84087K wps
[Epoch 119 Batch 540/1540] avg loss 0.000983733, throughput 2.84251K wps
[Epoch 119 Batch 570/1540] avg loss 0.000807676, throughput 2.81708K wps
[Epoch 119 Batch 600/1540] avg loss 0.000926721, throughput 2.8684K wps
[Epoch 119 Batch 630/1540] avg loss 0.000838003, throughput 2.87837K wps
[Epoch 119 Batch 660/1540] avg loss 0.000737584, throughput 2.86923K wps
[Epoch 119 Batch 690/1540] avg loss 0.00103393, throughput 2.86618K wps
[Epoch 119 Batch 720/1540] avg loss 0.00100835, throughput 2.83175K wps
[Epoch 119 Batch 750/1540] avg loss 0.000979047, throughput 2.86612K wps
[Epoch 119 Batch 780/1540] avg loss 0.00104312, throughput 2.86518K wps
[Epoch 119 Batch 810/1540] avg loss 0.000832955, throughput 2.85236K wps
[Epoch 119 Batch 840/1540] avg loss 0.00084164, throughput 2.87125K wps
[Epoch 119 Batch 870/1540] avg loss 0.000981959, throughput 2.86556K wps
[Epoch 119 Batch 900/1540] avg loss 0.00127882, throughput 2.86968K wps
[Epoch 119 Batch 930/1540] avg loss 0.00084667, throughput 2.85927K wps
[Epoch 119 Batch 960/1540] avg loss 0.000984498, throughput 2.84486K wps
[Epoch 119 Batch 990/1540] avg loss 0.000927207, throughput 2.84915K wps
[Epoch 119 Batch 1020/1540] avg loss 0.000896782, throughput 2.87042K wps
[Epoch 119 Batch 1050/1540] avg loss 0.00106007, throughput 2.86255K wps
[Epoch 119 Batch 1080/1540] avg loss 0.000976697, throughput 2.79482K wps
[Epoch 119 Batch 1110/1540] avg loss 0.00106919, throughput 2.87852K wps
[Epoch 119 Batch 1140/1540] avg loss 0.000908671, throughput 2.8596K wps
[Epoch 119 Batch 1170/1540] avg loss 0.000939177, throughput 2.8313K wps
[Epoch 119 Batch 1200/1540] avg loss 0.000776569, throughput 2.86312K wps
[Epoch 119 Batch 1230/1540] avg loss 0.000834122, throughput 2.86489K wps
[Epoch 119 Batch 1260/1540] avg loss 0.00104504, throughput 2.86041K wps
[Epoch 119 Batch 1290/1540] avg loss 0.00112256, throughput 2.84592K wps
[Epoch 119 Batch 1320/1540] avg loss 0.000991539, throughput 2.85356K wps
[Epoch 119 Batch 1350/1540] avg loss 0.000876881, throughput 2.80939K wps
[Epoch 119 Batch 1380/1540] avg loss 0.00112791, throughput 2.86749K wps
[Epoch 119 Batch 1410/1540] avg loss 0.000918108, throughput 2.86789K wps
[Epoch 119 Batch 1440/1540] avg loss 0.00092994, throughput 2.82132K wps
[Epoch 119 Batch 1470/1540] avg loss 0.00103173, throughput 2.86063K wps
[Epoch 119 Batch 1500/1540] avg loss 0.00116184, throughput 2.8649K wps
[Epoch 119 Batch 1530/1540] avg loss 0.00102765, throughput 2.85432K wps
Begin Testing...
[Epoch 119] train avg loss 0.000927016, dev acc 0.7959, dev avg loss 0.865053, throughput 2.85366K wps
[Epoch 120 Batch 30/1540] avg loss 0.000832014, throughput 2.90733K wps
[Epoch 120 Batch 60/1540] avg loss 0.000753233, throughput 2.8781K wps
[Epoch 120 Batch 90/1540] avg loss 0.000771601, throughput 2.85912K wps
[Epoch 120 Batch 120/1540] avg loss 0.000733661, throughput 2.85505K wps
[Epoch 120 Batch 150/1540] avg loss 0.000709824, throughput 2.82209K wps
[Epoch 120 Batch 180/1540] avg loss 0.00100951, throughput 2.82253K wps
[Epoch 120 Batch 210/1540] avg loss 0.000782425, throughput 2.87432K wps
[Epoch 120 Batch 240/1540] avg loss 0.000917192, throughput 2.82985K wps
[Epoch 120 Batch 270/1540] avg loss 0.000775473, throughput 2.85805K wps
[Epoch 120 Batch 300/1540] avg loss 0.00114134, throughput 2.87149K wps
[Epoch 120 Batch 330/1540] avg loss 0.000818803, throughput 2.86235K wps
[Epoch 120 Batch 360/1540] avg loss 0.00104395, throughput 2.87058K wps
[Epoch 120 Batch 390/1540] avg loss 0.000871605, throughput 2.87418K wps
[Epoch 120 Batch 420/1540] avg loss 0.00078676, throughput 2.85853K wps
[Epoch 120 Batch 450/1540] avg loss 0.000745257, throughput 2.854K wps
[Epoch 120 Batch 480/1540] avg loss 0.000902279, throughput 2.87201K wps
[Epoch 120 Batch 510/1540] avg loss 0.000915302, throughput 2.83746K wps
[Epoch 120 Batch 540/1540] avg loss 0.000665351, throughput 2.86334K wps
[Epoch 120 Batch 570/1540] avg loss 0.000970926, throughput 2.87888K wps
[Epoch 120 Batch 600/1540] avg loss 0.000779332, throughput 2.87796K wps
[Epoch 120 Batch 630/1540] avg loss 0.000833171, throughput 2.84572K wps
[Epoch 120 Batch 660/1540] avg loss 0.000983479, throughput 2.8358K wps
[Epoch 120 Batch 690/1540] avg loss 0.000872572, throughput 2.85505K wps
[Epoch 120 Batch 720/1540] avg loss 0.000753525, throughput 2.85426K wps
[Epoch 120 Batch 750/1540] avg loss 0.000870484, throughput 2.82837K wps
[Epoch 120 Batch 780/1540] avg loss 0.000699989, throughput 2.86646K wps
[Epoch 120 Batch 810/1540] avg loss 0.00107669, throughput 2.84965K wps
[Epoch 120 Batch 840/1540] avg loss 0.000696065, throughput 2.83638K wps
[Epoch 120 Batch 870/1540] avg loss 0.00113832, throughput 2.84889K wps
[Epoch 120 Batch 900/1540] avg loss 0.000932028, throughput 2.86851K wps
[Epoch 120 Batch 930/1540] avg loss 0.000785562, throughput 2.84841K wps
[Epoch 120 Batch 960/1540] avg loss 0.0010562, throughput 2.82281K wps
[Epoch 120 Batch 990/1540] avg loss 0.0010269, throughput 2.79486K wps
[Epoch 120 Batch 1020/1540] avg loss 0.000982219, throughput 2.85776K wps
[Epoch 120 Batch 1050/1540] avg loss 0.000646173, throughput 2.85611K wps
[Epoch 120 Batch 1080/1540] avg loss 0.00114813, throughput 2.8733K wps
[Epoch 120 Batch 1110/1540] avg loss 0.000781384, throughput 2.85002K wps
[Epoch 120 Batch 1140/1540] avg loss 0.000948736, throughput 2.82106K wps
[Epoch 120 Batch 1170/1540] avg loss 0.000902647, throughput 2.87231K wps
[Epoch 120 Batch 1200/1540] avg loss 0.000932111, throughput 2.87597K wps
[Epoch 120 Batch 1230/1540] avg loss 0.00115304, throughput 2.84882K wps
[Epoch 120 Batch 1260/1540] avg loss 0.00128813, throughput 2.81399K wps
[Epoch 120 Batch 1290/1540] avg loss 0.000965766, throughput 2.83805K wps
[Epoch 120 Batch 1320/1540] avg loss 0.00111342, throughput 2.88036K wps
[Epoch 120 Batch 1350/1540] avg loss 0.00103171, throughput 2.86799K wps
[Epoch 120 Batch 1380/1540] avg loss 0.000954944, throughput 2.86986K wps
[Epoch 120 Batch 1410/1540] avg loss 0.00149893, throughput 2.85466K wps
[Epoch 120 Batch 1440/1540] avg loss 0.00108279, throughput 2.85481K wps
[Epoch 120 Batch 1470/1540] avg loss 0.000979167, throughput 2.83601K wps
[Epoch 120 Batch 1500/1540] avg loss 0.00112472, throughput 2.82274K wps
[Epoch 120 Batch 1530/1540] avg loss 0.000900539, throughput 2.82363K wps
Begin Testing...
[Epoch 120] train avg loss 0.000923675, dev acc 0.7936, dev avg loss 0.847376, throughput 2.85295K wps
[Epoch 121 Batch 30/1540] avg loss 0.000788461, throughput 2.85083K wps
[Epoch 121 Batch 60/1540] avg loss 0.000847202, throughput 2.87173K wps
[Epoch 121 Batch 90/1540] avg loss 0.000760969, throughput 2.87442K wps
[Epoch 121 Batch 120/1540] avg loss 0.000866457, throughput 2.87721K wps
[Epoch 121 Batch 150/1540] avg loss 0.000591533, throughput 2.87327K wps
[Epoch 121 Batch 180/1540] avg loss 0.00084266, throughput 2.86523K wps
[Epoch 121 Batch 210/1540] avg loss 0.000741423, throughput 2.83904K wps
[Epoch 121 Batch 240/1540] avg loss 0.000827802, throughput 2.85828K wps
[Epoch 121 Batch 270/1540] avg loss 0.00116335, throughput 2.84907K wps
[Epoch 121 Batch 300/1540] avg loss 0.000889112, throughput 2.86376K wps
[Epoch 121 Batch 330/1540] avg loss 0.000925225, throughput 2.81672K wps
[Epoch 121 Batch 360/1540] avg loss 0.000852476, throughput 2.86868K wps
[Epoch 121 Batch 390/1540] avg loss 0.00110635, throughput 2.87869K wps
[Epoch 121 Batch 420/1540] avg loss 0.00085265, throughput 2.87018K wps
[Epoch 121 Batch 450/1540] avg loss 0.000912458, throughput 2.8792K wps
[Epoch 121 Batch 480/1540] avg loss 0.000719749, throughput 2.85281K wps
[Epoch 121 Batch 510/1540] avg loss 0.000970384, throughput 2.86193K wps
[Epoch 121 Batch 540/1540] avg loss 0.000872954, throughput 2.8717K wps
[Epoch 121 Batch 570/1540] avg loss 0.000909323, throughput 2.87989K wps
[Epoch 121 Batch 600/1540] avg loss 0.000874161, throughput 2.87297K wps
[Epoch 121 Batch 630/1540] avg loss 0.000914247, throughput 2.87192K wps
[Epoch 121 Batch 660/1540] avg loss 0.000848098, throughput 2.81546K wps
[Epoch 121 Batch 690/1540] avg loss 0.000667794, throughput 2.8767K wps
[Epoch 121 Batch 720/1540] avg loss 0.00112169, throughput 2.86862K wps
[Epoch 121 Batch 750/1540] avg loss 0.000815445, throughput 2.87482K wps
[Epoch 121 Batch 780/1540] avg loss 0.00125666, throughput 2.82397K wps
[Epoch 121 Batch 810/1540] avg loss 0.000935402, throughput 2.82656K wps
[Epoch 121 Batch 840/1540] avg loss 0.00088961, throughput 2.87749K wps
[Epoch 121 Batch 870/1540] avg loss 0.000879845, throughput 2.86478K wps
[Epoch 121 Batch 900/1540] avg loss 0.000932858, throughput 2.87432K wps
[Epoch 121 Batch 930/1540] avg loss 0.000864509, throughput 2.85137K wps
[Epoch 121 Batch 960/1540] avg loss 0.000913552, throughput 2.85003K wps
[Epoch 121 Batch 990/1540] avg loss 0.00097825, throughput 2.87471K wps
[Epoch 121 Batch 1020/1540] avg loss 0.000961343, throughput 2.8404K wps
[Epoch 121 Batch 1050/1540] avg loss 0.000813316, throughput 2.85419K wps
[Epoch 121 Batch 1080/1540] avg loss 0.000871799, throughput 2.867K wps
[Epoch 121 Batch 1110/1540] avg loss 0.00111933, throughput 2.82079K wps
[Epoch 121 Batch 1140/1540] avg loss 0.000992266, throughput 2.80524K wps
[Epoch 121 Batch 1170/1540] avg loss 0.000888816, throughput 2.86266K wps
[Epoch 121 Batch 1200/1540] avg loss 0.00103682, throughput 2.8691K wps
[Epoch 121 Batch 1230/1540] avg loss 0.000841009, throughput 2.8705K wps
[Epoch 121 Batch 1260/1540] avg loss 0.000956898, throughput 2.8674K wps
[Epoch 121 Batch 1290/1540] avg loss 0.000989952, throughput 2.86867K wps
[Epoch 121 Batch 1320/1540] avg loss 0.00116271, throughput 2.86803K wps
[Epoch 121 Batch 1350/1540] avg loss 0.00129328, throughput 2.86416K wps
[Epoch 121 Batch 1380/1540] avg loss 0.000864989, throughput 2.86055K wps
[Epoch 121 Batch 1410/1540] avg loss 0.00135273, throughput 2.85774K wps
[Epoch 121 Batch 1440/1540] avg loss 0.000974489, throughput 2.87895K wps
[Epoch 121 Batch 1470/1540] avg loss 0.000975669, throughput 2.85156K wps
[Epoch 121 Batch 1500/1540] avg loss 0.000994318, throughput 2.80549K wps
[Epoch 121 Batch 1530/1540] avg loss 0.00107449, throughput 2.86334K wps
Begin Testing...
[Epoch 121] train avg loss 0.000930645, dev acc 0.7959, dev avg loss 0.845342, throughput 2.85865K wps
[Epoch 122 Batch 30/1540] avg loss 0.000995377, throughput 2.91669K wps
[Epoch 122 Batch 60/1540] avg loss 0.000630618, throughput 2.87098K wps
[Epoch 122 Batch 90/1540] avg loss 0.000762871, throughput 2.87205K wps
[Epoch 122 Batch 120/1540] avg loss 0.000997244, throughput 2.83684K wps
[Epoch 122 Batch 150/1540] avg loss 0.000793908, throughput 2.80618K wps
[Epoch 122 Batch 180/1540] avg loss 0.000930379, throughput 2.81602K wps
[Epoch 122 Batch 210/1540] avg loss 0.000940941, throughput 2.82833K wps
[Epoch 122 Batch 240/1540] avg loss 0.000644167, throughput 2.78502K wps
[Epoch 122 Batch 270/1540] avg loss 0.000959745, throughput 2.86448K wps
[Epoch 122 Batch 300/1540] avg loss 0.000776591, throughput 2.84241K wps
[Epoch 122 Batch 330/1540] avg loss 0.000896157, throughput 2.85232K wps
[Epoch 122 Batch 360/1540] avg loss 0.000792558, throughput 2.87898K wps
[Epoch 122 Batch 390/1540] avg loss 0.000637461, throughput 2.83431K wps
[Epoch 122 Batch 420/1540] avg loss 0.00100819, throughput 2.85771K wps
[Epoch 122 Batch 450/1540] avg loss 0.00117394, throughput 2.84655K wps
[Epoch 122 Batch 480/1540] avg loss 0.000776232, throughput 2.77722K wps
[Epoch 122 Batch 510/1540] avg loss 0.000829686, throughput 2.78634K wps
[Epoch 122 Batch 540/1540] avg loss 0.000807911, throughput 2.84996K wps
[Epoch 122 Batch 570/1540] avg loss 0.00100608, throughput 2.86545K wps
[Epoch 122 Batch 600/1540] avg loss 0.000879031, throughput 2.85214K wps
[Epoch 122 Batch 630/1540] avg loss 0.000747789, throughput 2.85149K wps
[Epoch 122 Batch 660/1540] avg loss 0.000765915, throughput 2.82542K wps
[Epoch 122 Batch 690/1540] avg loss 0.000958896, throughput 2.79515K wps
[Epoch 122 Batch 720/1540] avg loss 0.00102493, throughput 2.85458K wps
[Epoch 122 Batch 750/1540] avg loss 0.00107871, throughput 2.86508K wps
[Epoch 122 Batch 780/1540] avg loss 0.000917245, throughput 2.87488K wps
[Epoch 122 Batch 810/1540] avg loss 0.00095324, throughput 2.87536K wps
[Epoch 122 Batch 840/1540] avg loss 0.000842581, throughput 2.85701K wps
[Epoch 122 Batch 870/1540] avg loss 0.00084879, throughput 2.81856K wps
[Epoch 122 Batch 900/1540] avg loss 0.000666625, throughput 2.83428K wps
[Epoch 122 Batch 930/1540] avg loss 0.00110945, throughput 2.84751K wps
[Epoch 122 Batch 960/1540] avg loss 0.000951711, throughput 2.85966K wps
[Epoch 122 Batch 990/1540] avg loss 0.00114896, throughput 2.85397K wps
[Epoch 122 Batch 1020/1540] avg loss 0.00102553, throughput 2.86477K wps
[Epoch 122 Batch 1050/1540] avg loss 0.00111739, throughput 2.8655K wps
[Epoch 122 Batch 1080/1540] avg loss 0.000953352, throughput 2.86656K wps
[Epoch 122 Batch 1110/1540] avg loss 0.000801451, throughput 2.86859K wps
[Epoch 122 Batch 1140/1540] avg loss 0.000864573, throughput 2.80785K wps
[Epoch 122 Batch 1170/1540] avg loss 0.000901886, throughput 2.87894K wps
[Epoch 122 Batch 1200/1540] avg loss 0.00101629, throughput 2.88356K wps
[Epoch 122 Batch 1230/1540] avg loss 0.000880145, throughput 2.8735K wps
[Epoch 122 Batch 1260/1540] avg loss 0.00098421, throughput 2.87699K wps
[Epoch 122 Batch 1290/1540] avg loss 0.00101822, throughput 2.86244K wps
[Epoch 122 Batch 1320/1540] avg loss 0.00115773, throughput 2.86953K wps
[Epoch 122 Batch 1350/1540] avg loss 0.00109169, throughput 2.86044K wps
[Epoch 122 Batch 1380/1540] avg loss 0.000838649, throughput 2.85529K wps
[Epoch 122 Batch 1410/1540] avg loss 0.0010079, throughput 2.84973K wps
[Epoch 122 Batch 1440/1540] avg loss 0.00123549, throughput 2.87083K wps
[Epoch 122 Batch 1470/1540] avg loss 0.000778899, throughput 2.87929K wps
[Epoch 122 Batch 1500/1540] avg loss 0.000888503, throughput 2.87419K wps
[Epoch 122 Batch 1530/1540] avg loss 0.00128931, throughput 2.86559K wps
Begin Testing...
[Epoch 122] train avg loss 0.000925634, dev acc 0.8039, dev avg loss 0.85059, throughput 2.85104K wps
[Epoch 123 Batch 30/1540] avg loss 0.000726681, throughput 2.92162K wps
[Epoch 123 Batch 60/1540] avg loss 0.000880811, throughput 2.87013K wps
[Epoch 123 Batch 90/1540] avg loss 0.000936864, throughput 2.87627K wps
[Epoch 123 Batch 120/1540] avg loss 0.000630364, throughput 2.87K wps
[Epoch 123 Batch 150/1540] avg loss 0.000841874, throughput 2.81306K wps
[Epoch 123 Batch 180/1540] avg loss 0.000705241, throughput 2.85266K wps
[Epoch 123 Batch 210/1540] avg loss 0.00103564, throughput 2.87438K wps
[Epoch 123 Batch 240/1540] avg loss 0.00101806, throughput 2.87672K wps
[Epoch 123 Batch 270/1540] avg loss 0.000718639, throughput 2.8119K wps
[Epoch 123 Batch 300/1540] avg loss 0.00103368, throughput 2.83328K wps
[Epoch 123 Batch 330/1540] avg loss 0.00116207, throughput 2.83225K wps
[Epoch 123 Batch 360/1540] avg loss 0.000624779, throughput 2.87522K wps
[Epoch 123 Batch 390/1540] avg loss 0.000680737, throughput 2.7995K wps
[Epoch 123 Batch 420/1540] avg loss 0.00107905, throughput 2.8662K wps
[Epoch 123 Batch 450/1540] avg loss 0.000831361, throughput 2.87351K wps
[Epoch 123 Batch 480/1540] avg loss 0.000731066, throughput 2.85938K wps
[Epoch 123 Batch 510/1540] avg loss 0.00076562, throughput 2.87827K wps
[Epoch 123 Batch 540/1540] avg loss 0.00104159, throughput 2.80627K wps
[Epoch 123 Batch 570/1540] avg loss 0.00113319, throughput 2.78597K wps
[Epoch 123 Batch 600/1540] avg loss 0.000862882, throughput 2.8507K wps
[Epoch 123 Batch 630/1540] avg loss 0.000952123, throughput 2.81759K wps
[Epoch 123 Batch 660/1540] avg loss 0.00100585, throughput 2.83662K wps
[Epoch 123 Batch 690/1540] avg loss 0.00105436, throughput 2.8566K wps
[Epoch 123 Batch 720/1540] avg loss 0.000740472, throughput 2.7864K wps
[Epoch 123 Batch 750/1540] avg loss 0.00116666, throughput 2.781K wps
[Epoch 123 Batch 780/1540] avg loss 0.000816461, throughput 2.86049K wps
[Epoch 123 Batch 810/1540] avg loss 0.000739403, throughput 2.86138K wps
[Epoch 123 Batch 840/1540] avg loss 0.00117809, throughput 2.81353K wps
[Epoch 123 Batch 870/1540] avg loss 0.00100434, throughput 2.88298K wps
[Epoch 123 Batch 900/1540] avg loss 0.00100609, throughput 2.86745K wps
[Epoch 123 Batch 930/1540] avg loss 0.000857588, throughput 2.81195K wps
[Epoch 123 Batch 960/1540] avg loss 0.000933906, throughput 2.84816K wps
[Epoch 123 Batch 990/1540] avg loss 0.000928119, throughput 2.84178K wps
[Epoch 123 Batch 1020/1540] avg loss 0.00073279, throughput 2.86748K wps
[Epoch 123 Batch 1050/1540] avg loss 0.000867031, throughput 2.86533K wps
[Epoch 123 Batch 1080/1540] avg loss 0.000926059, throughput 2.86033K wps
[Epoch 123 Batch 1110/1540] avg loss 0.000958343, throughput 2.84132K wps
[Epoch 123 Batch 1140/1540] avg loss 0.000792689, throughput 2.8512K wps
[Epoch 123 Batch 1170/1540] avg loss 0.000860976, throughput 2.88001K wps
[Epoch 123 Batch 1200/1540] avg loss 0.000789947, throughput 2.86842K wps
[Epoch 123 Batch 1230/1540] avg loss 0.00117422, throughput 2.85713K wps
[Epoch 123 Batch 1260/1540] avg loss 0.000932527, throughput 2.8614K wps
[Epoch 123 Batch 1290/1540] avg loss 0.000792002, throughput 2.7989K wps
[Epoch 123 Batch 1320/1540] avg loss 0.000972183, throughput 2.8441K wps
[Epoch 123 Batch 1350/1540] avg loss 0.000931082, throughput 2.87357K wps
[Epoch 123 Batch 1380/1540] avg loss 0.000923819, throughput 2.85283K wps
[Epoch 123 Batch 1410/1540] avg loss 0.000935471, throughput 2.86167K wps
[Epoch 123 Batch 1440/1540] avg loss 0.000925932, throughput 2.85484K wps
[Epoch 123 Batch 1470/1540] avg loss 0.00119181, throughput 2.87815K wps
[Epoch 123 Batch 1500/1540] avg loss 0.0010243, throughput 2.86294K wps
[Epoch 123 Batch 1530/1540] avg loss 0.00108476, throughput 2.86719K wps
Begin Testing...
[Epoch 123] train avg loss 0.00091631, dev acc 0.8005, dev avg loss 0.853892, throughput 2.84953K wps
[Epoch 124 Batch 30/1540] avg loss 0.000677681, throughput 2.9302K wps
[Epoch 124 Batch 60/1540] avg loss 0.000615798, throughput 2.86313K wps
[Epoch 124 Batch 90/1540] avg loss 0.000737575, throughput 2.86284K wps
[Epoch 124 Batch 120/1540] avg loss 0.000788836, throughput 2.85135K wps
[Epoch 124 Batch 150/1540] avg loss 0.000846575, throughput 2.81914K wps
[Epoch 124 Batch 180/1540] avg loss 0.000772867, throughput 2.8633K wps
[Epoch 124 Batch 210/1540] avg loss 0.000673263, throughput 2.77201K wps
[Epoch 124 Batch 240/1540] avg loss 0.000703898, throughput 2.81324K wps
[Epoch 124 Batch 270/1540] avg loss 0.00107361, throughput 2.85923K wps
[Epoch 124 Batch 300/1540] avg loss 0.00107592, throughput 2.86943K wps
[Epoch 124 Batch 330/1540] avg loss 0.00101437, throughput 2.86387K wps
[Epoch 124 Batch 360/1540] avg loss 0.000944334, throughput 2.8373K wps
[Epoch 124 Batch 390/1540] avg loss 0.00102597, throughput 2.85487K wps
[Epoch 124 Batch 420/1540] avg loss 0.000752929, throughput 2.83348K wps
[Epoch 124 Batch 450/1540] avg loss 0.00101314, throughput 2.84762K wps
[Epoch 124 Batch 480/1540] avg loss 0.00074684, throughput 2.8393K wps
[Epoch 124 Batch 510/1540] avg loss 0.000812394, throughput 2.85263K wps
[Epoch 124 Batch 540/1540] avg loss 0.000852252, throughput 2.86075K wps
[Epoch 124 Batch 570/1540] avg loss 0.000893164, throughput 2.80674K wps
[Epoch 124 Batch 600/1540] avg loss 0.000984915, throughput 2.77488K wps
[Epoch 124 Batch 630/1540] avg loss 0.00102171, throughput 2.85139K wps
[Epoch 124 Batch 660/1540] avg loss 0.00093052, throughput 2.83906K wps
[Epoch 124 Batch 690/1540] avg loss 0.000916095, throughput 2.8582K wps
[Epoch 124 Batch 720/1540] avg loss 0.00071082, throughput 2.86398K wps
[Epoch 124 Batch 750/1540] avg loss 0.000817639, throughput 2.813K wps
[Epoch 124 Batch 780/1540] avg loss 0.000834043, throughput 2.80173K wps
[Epoch 124 Batch 810/1540] avg loss 0.000962239, throughput 2.77474K wps
[Epoch 124 Batch 840/1540] avg loss 0.00089709, throughput 2.80049K wps
[Epoch 124 Batch 870/1540] avg loss 0.000929039, throughput 2.87255K wps
[Epoch 124 Batch 900/1540] avg loss 0.000873883, throughput 2.85983K wps
[Epoch 124 Batch 930/1540] avg loss 0.000995806, throughput 2.86402K wps
[Epoch 124 Batch 960/1540] avg loss 0.000889773, throughput 2.84499K wps
[Epoch 124 Batch 990/1540] avg loss 0.00110299, throughput 2.84744K wps
[Epoch 124 Batch 1020/1540] avg loss 0.000894244, throughput 2.86922K wps
[Epoch 124 Batch 1050/1540] avg loss 0.000938036, throughput 2.84168K wps
[Epoch 124 Batch 1080/1540] avg loss 0.000862178, throughput 2.86139K wps
[Epoch 124 Batch 1110/1540] avg loss 0.00109389, throughput 2.86385K wps
[Epoch 124 Batch 1140/1540] avg loss 0.000988976, throughput 2.85801K wps
[Epoch 124 Batch 1170/1540] avg loss 0.00108078, throughput 2.86167K wps
[Epoch 124 Batch 1200/1540] avg loss 0.00093417, throughput 2.8653K wps
[Epoch 124 Batch 1230/1540] avg loss 0.000913772, throughput 2.86829K wps
[Epoch 124 Batch 1260/1540] avg loss 0.000772254, throughput 2.86767K wps
[Epoch 124 Batch 1290/1540] avg loss 0.000976793, throughput 2.87326K wps
[Epoch 124 Batch 1320/1540] avg loss 0.000871791, throughput 2.88168K wps
[Epoch 124 Batch 1350/1540] avg loss 0.000858891, throughput 2.87339K wps
[Epoch 124 Batch 1380/1540] avg loss 0.000968619, throughput 2.8614K wps
[Epoch 124 Batch 1410/1540] avg loss 0.000963976, throughput 2.87446K wps
[Epoch 124 Batch 1440/1540] avg loss 0.00114917, throughput 2.87065K wps
[Epoch 124 Batch 1470/1540] avg loss 0.000810138, throughput 2.85648K wps
[Epoch 124 Batch 1500/1540] avg loss 0.00104781, throughput 2.85228K wps
[Epoch 124 Batch 1530/1540] avg loss 0.000968394, throughput 2.85536K wps
Begin Testing...
[Epoch 124] train avg loss 0.000899909, dev acc 0.7959, dev avg loss 0.862629, throughput 2.84925K wps
[Epoch 125 Batch 30/1540] avg loss 0.000731491, throughput 2.87072K wps
[Epoch 125 Batch 60/1540] avg loss 0.00095706, throughput 2.84011K wps
[Epoch 125 Batch 90/1540] avg loss 0.00078888, throughput 2.85032K wps
[Epoch 125 Batch 120/1540] avg loss 0.000761242, throughput 2.88208K wps
[Epoch 125 Batch 150/1540] avg loss 0.000913236, throughput 2.85954K wps
[Epoch 125 Batch 180/1540] avg loss 0.000726951, throughput 2.87289K wps
[Epoch 125 Batch 210/1540] avg loss 0.00103925, throughput 2.87513K wps
[Epoch 125 Batch 240/1540] avg loss 0.000694511, throughput 2.85783K wps
[Epoch 125 Batch 270/1540] avg loss 0.00104221, throughput 2.85928K wps
[Epoch 125 Batch 300/1540] avg loss 0.00061921, throughput 2.85335K wps
[Epoch 125 Batch 330/1540] avg loss 0.000792814, throughput 2.86379K wps
[Epoch 125 Batch 360/1540] avg loss 0.000921522, throughput 2.82632K wps
[Epoch 125 Batch 390/1540] avg loss 0.000790975, throughput 2.87084K wps
[Epoch 125 Batch 420/1540] avg loss 0.000727296, throughput 2.8643K wps
[Epoch 125 Batch 450/1540] avg loss 0.000829674, throughput 2.84033K wps
[Epoch 125 Batch 480/1540] avg loss 0.00102391, throughput 2.82098K wps
[Epoch 125 Batch 510/1540] avg loss 0.000734445, throughput 2.8525K wps
[Epoch 125 Batch 540/1540] avg loss 0.000804506, throughput 2.83514K wps
[Epoch 125 Batch 570/1540] avg loss 0.000902498, throughput 2.85196K wps
[Epoch 125 Batch 600/1540] avg loss 0.000816326, throughput 2.86211K wps
[Epoch 125 Batch 630/1540] avg loss 0.000819464, throughput 2.8639K wps
[Epoch 125 Batch 660/1540] avg loss 0.000779351, throughput 2.83196K wps
[Epoch 125 Batch 690/1540] avg loss 0.000848122, throughput 2.82389K wps
[Epoch 125 Batch 720/1540] avg loss 0.000919204, throughput 2.85034K wps
[Epoch 125 Batch 750/1540] avg loss 0.00089539, throughput 2.8264K wps
[Epoch 125 Batch 780/1540] avg loss 0.000886012, throughput 2.87794K wps
[Epoch 125 Batch 810/1540] avg loss 0.000817724, throughput 2.8629K wps
[Epoch 125 Batch 840/1540] avg loss 0.0008553, throughput 2.85632K wps
[Epoch 125 Batch 870/1540] avg loss 0.000796762, throughput 2.82327K wps
[Epoch 125 Batch 900/1540] avg loss 0.000868184, throughput 2.88295K wps
[Epoch 125 Batch 930/1540] avg loss 0.000815301, throughput 2.87732K wps
[Epoch 125 Batch 960/1540] avg loss 0.000866233, throughput 2.87736K wps
[Epoch 125 Batch 990/1540] avg loss 0.000847101, throughput 2.8801K wps
[Epoch 125 Batch 1020/1540] avg loss 0.000853118, throughput 2.86601K wps
[Epoch 125 Batch 1050/1540] avg loss 0.00110128, throughput 2.88085K wps
[Epoch 125 Batch 1080/1540] avg loss 0.000950944, throughput 2.85406K wps
[Epoch 125 Batch 1110/1540] avg loss 0.000968648, throughput 2.83962K wps
[Epoch 125 Batch 1140/1540] avg loss 0.00102838, throughput 2.83055K wps
[Epoch 125 Batch 1170/1540] avg loss 0.000973951, throughput 2.81552K wps
[Epoch 125 Batch 1200/1540] avg loss 0.00111428, throughput 2.85255K wps
[Epoch 125 Batch 1230/1540] avg loss 0.00101821, throughput 2.86443K wps
[Epoch 125 Batch 1260/1540] avg loss 0.000956679, throughput 2.81197K wps
[Epoch 125 Batch 1290/1540] avg loss 0.00070619, throughput 2.84045K wps
[Epoch 125 Batch 1320/1540] avg loss 0.00110669, throughput 2.82224K wps
[Epoch 125 Batch 1350/1540] avg loss 0.000892143, throughput 2.87127K wps
[Epoch 125 Batch 1380/1540] avg loss 0.000877686, throughput 2.86042K wps
[Epoch 125 Batch 1410/1540] avg loss 0.000862858, throughput 2.87085K wps
[Epoch 125 Batch 1440/1540] avg loss 0.00112116, throughput 2.85128K wps
[Epoch 125 Batch 1470/1540] avg loss 0.00101694, throughput 2.83881K wps
[Epoch 125 Batch 1500/1540] avg loss 0.0010018, throughput 2.85433K wps
[Epoch 125 Batch 1530/1540] avg loss 0.000982197, throughput 2.8737K wps
Begin Testing...
[Epoch 125] train avg loss 0.000886298, dev acc 0.7959, dev avg loss 0.882988, throughput 2.8534K wps
[Epoch 126 Batch 30/1540] avg loss 0.000797847, throughput 2.91877K wps
[Epoch 126 Batch 60/1540] avg loss 0.000692699, throughput 2.86609K wps
[Epoch 126 Batch 90/1540] avg loss 0.000605404, throughput 2.86829K wps
[Epoch 126 Batch 120/1540] avg loss 0.000780699, throughput 2.8337K wps
[Epoch 126 Batch 150/1540] avg loss 0.000820899, throughput 2.8629K wps
[Epoch 126 Batch 180/1540] avg loss 0.00088612, throughput 2.81356K wps
[Epoch 126 Batch 210/1540] avg loss 0.00073473, throughput 2.82961K wps
[Epoch 126 Batch 240/1540] avg loss 0.000754872, throughput 2.86084K wps
[Epoch 126 Batch 270/1540] avg loss 0.00095605, throughput 2.85396K wps
[Epoch 126 Batch 300/1540] avg loss 0.0010429, throughput 2.85319K wps
[Epoch 126 Batch 330/1540] avg loss 0.00114653, throughput 2.85978K wps
[Epoch 126 Batch 360/1540] avg loss 0.000971815, throughput 2.85403K wps
[Epoch 126 Batch 390/1540] avg loss 0.000978666, throughput 2.86733K wps
[Epoch 126 Batch 420/1540] avg loss 0.000869997, throughput 2.79634K wps
[Epoch 126 Batch 450/1540] avg loss 0.000929174, throughput 2.85761K wps
[Epoch 126 Batch 480/1540] avg loss 0.00100509, throughput 2.8476K wps
[Epoch 126 Batch 510/1540] avg loss 0.000890833, throughput 2.83711K wps
[Epoch 126 Batch 540/1540] avg loss 0.000915154, throughput 2.85265K wps
[Epoch 126 Batch 570/1540] avg loss 0.00092131, throughput 2.85825K wps
[Epoch 126 Batch 600/1540] avg loss 0.000810872, throughput 2.85928K wps
[Epoch 126 Batch 630/1540] avg loss 0.000713285, throughput 2.8542K wps
[Epoch 126 Batch 660/1540] avg loss 0.000726393, throughput 2.87882K wps
[Epoch 126 Batch 690/1540] avg loss 0.000785554, throughput 2.86723K wps
[Epoch 126 Batch 720/1540] avg loss 0.000750906, throughput 2.86169K wps
[Epoch 126 Batch 750/1540] avg loss 0.000957979, throughput 2.85568K wps
[Epoch 126 Batch 780/1540] avg loss 0.000973025, throughput 2.86959K wps
[Epoch 126 Batch 810/1540] avg loss 0.000924651, throughput 2.8712K wps
[Epoch 126 Batch 840/1540] avg loss 0.00101644, throughput 2.85367K wps
[Epoch 126 Batch 870/1540] avg loss 0.000649748, throughput 2.83733K wps
[Epoch 126 Batch 900/1540] avg loss 0.00106882, throughput 2.85275K wps
[Epoch 126 Batch 930/1540] avg loss 0.000884058, throughput 2.86093K wps
[Epoch 126 Batch 960/1540] avg loss 0.000851689, throughput 2.8263K wps
[Epoch 126 Batch 990/1540] avg loss 0.000938304, throughput 2.79859K wps
[Epoch 126 Batch 1020/1540] avg loss 0.000749125, throughput 2.86339K wps
[Epoch 126 Batch 1050/1540] avg loss 0.00104057, throughput 2.86772K wps
[Epoch 126 Batch 1080/1540] avg loss 0.000954031, throughput 2.85693K wps
[Epoch 126 Batch 1110/1540] avg loss 0.00103094, throughput 2.77999K wps
[Epoch 126 Batch 1140/1540] avg loss 0.000891447, throughput 2.8172K wps
[Epoch 126 Batch 1170/1540] avg loss 0.00103368, throughput 2.83851K wps
[Epoch 126 Batch 1200/1540] avg loss 0.000719705, throughput 2.85654K wps
[Epoch 126 Batch 1230/1540] avg loss 0.000842267, throughput 2.81344K wps
[Epoch 126 Batch 1260/1540] avg loss 0.000870969, throughput 2.80123K wps
[Epoch 126 Batch 1290/1540] avg loss 0.000727578, throughput 2.86508K wps
[Epoch 126 Batch 1320/1540] avg loss 0.000841155, throughput 2.85547K wps
[Epoch 126 Batch 1350/1540] avg loss 0.00131171, throughput 2.85638K wps
[Epoch 126 Batch 1380/1540] avg loss 0.00105482, throughput 2.84556K wps
[Epoch 126 Batch 1410/1540] avg loss 0.000906044, throughput 2.80087K wps
[Epoch 126 Batch 1440/1540] avg loss 0.00122277, throughput 2.81745K wps
[Epoch 126 Batch 1470/1540] avg loss 0.000787584, throughput 2.82788K wps
[Epoch 126 Batch 1500/1540] avg loss 0.000804202, throughput 2.8283K wps
[Epoch 126 Batch 1530/1540] avg loss 0.000834944, throughput 2.87681K wps
Begin Testing...
[Epoch 126] train avg loss 0.000891637, dev acc 0.7959, dev avg loss 0.863837, throughput 2.84707K wps
[Epoch 127 Batch 30/1540] avg loss 0.000832402, throughput 2.85435K wps
[Epoch 127 Batch 60/1540] avg loss 0.000928066, throughput 2.85506K wps
[Epoch 127 Batch 90/1540] avg loss 0.000785092, throughput 2.83978K wps
[Epoch 127 Batch 120/1540] avg loss 0.000672212, throughput 2.85351K wps
[Epoch 127 Batch 150/1540] avg loss 0.00088549, throughput 2.87419K wps
[Epoch 127 Batch 180/1540] avg loss 0.000976847, throughput 2.87372K wps
[Epoch 127 Batch 210/1540] avg loss 0.000705661, throughput 2.84157K wps
[Epoch 127 Batch 240/1540] avg loss 0.000812922, throughput 2.79383K wps
[Epoch 127 Batch 270/1540] avg loss 0.000684756, throughput 2.83387K wps
[Epoch 127 Batch 300/1540] avg loss 0.000699201, throughput 2.87779K wps
[Epoch 127 Batch 330/1540] avg loss 0.000939438, throughput 2.81616K wps
[Epoch 127 Batch 360/1540] avg loss 0.00081182, throughput 2.85785K wps
[Epoch 127 Batch 390/1540] avg loss 0.000903025, throughput 2.82768K wps
[Epoch 127 Batch 420/1540] avg loss 0.000789634, throughput 2.87374K wps
[Epoch 127 Batch 450/1540] avg loss 0.00062408, throughput 2.87317K wps
[Epoch 127 Batch 480/1540] avg loss 0.000585887, throughput 2.82663K wps
[Epoch 127 Batch 510/1540] avg loss 0.00112672, throughput 2.81676K wps
[Epoch 127 Batch 540/1540] avg loss 0.00106921, throughput 2.87748K wps
[Epoch 127 Batch 570/1540] avg loss 0.00101919, throughput 2.86818K wps
[Epoch 127 Batch 600/1540] avg loss 0.00084147, throughput 2.87036K wps
[Epoch 127 Batch 630/1540] avg loss 0.000871048, throughput 2.80203K wps
[Epoch 127 Batch 660/1540] avg loss 0.000955556, throughput 2.86895K wps
[Epoch 127 Batch 690/1540] avg loss 0.000800811, throughput 2.87025K wps
[Epoch 127 Batch 720/1540] avg loss 0.000961377, throughput 2.86255K wps
[Epoch 127 Batch 750/1540] avg loss 0.00100173, throughput 2.8561K wps
[Epoch 127 Batch 780/1540] avg loss 0.000843139, throughput 2.871K wps
[Epoch 127 Batch 810/1540] avg loss 0.000738168, throughput 2.86752K wps
[Epoch 127 Batch 840/1540] avg loss 0.000758684, throughput 2.80877K wps
[Epoch 127 Batch 870/1540] avg loss 0.000915786, throughput 2.8415K wps
[Epoch 127 Batch 900/1540] avg loss 0.000869025, throughput 2.86254K wps
[Epoch 127 Batch 930/1540] avg loss 0.00096407, throughput 2.80419K wps
[Epoch 127 Batch 960/1540] avg loss 0.000791979, throughput 2.82964K wps
[Epoch 127 Batch 990/1540] avg loss 0.000737528, throughput 2.82394K wps
[Epoch 127 Batch 1020/1540] avg loss 0.00106451, throughput 2.85392K wps
[Epoch 127 Batch 1050/1540] avg loss 0.000720555, throughput 2.85218K wps
[Epoch 127 Batch 1080/1540] avg loss 0.00115459, throughput 2.84707K wps
[Epoch 127 Batch 1110/1540] avg loss 0.000883392, throughput 2.83837K wps
[Epoch 127 Batch 1140/1540] avg loss 0.0010142, throughput 2.85743K wps
[Epoch 127 Batch 1170/1540] avg loss 0.000773349, throughput 2.86365K wps
[Epoch 127 Batch 1200/1540] avg loss 0.00115801, throughput 2.87329K wps
[Epoch 127 Batch 1230/1540] avg loss 0.000966023, throughput 2.86844K wps
[Epoch 127 Batch 1260/1540] avg loss 0.000994064, throughput 2.85945K wps
[Epoch 127 Batch 1290/1540] avg loss 0.000703848, throughput 2.85771K wps
[Epoch 127 Batch 1320/1540] avg loss 0.00114086, throughput 2.77607K wps
[Epoch 127 Batch 1350/1540] avg loss 0.000963323, throughput 2.8206K wps
[Epoch 127 Batch 1380/1540] avg loss 0.000829485, throughput 2.86814K wps
[Epoch 127 Batch 1410/1540] avg loss 0.000844177, throughput 2.87893K wps
[Epoch 127 Batch 1440/1540] avg loss 0.000785564, throughput 2.87616K wps
[Epoch 127 Batch 1470/1540] avg loss 0.000734215, throughput 2.86675K wps
[Epoch 127 Batch 1500/1540] avg loss 0.00105131, throughput 2.8599K wps
[Epoch 127 Batch 1530/1540] avg loss 0.000960385, throughput 2.8191K wps
Begin Testing...
[Epoch 127] train avg loss 0.000878079, dev acc 0.8028, dev avg loss 0.853175, throughput 2.84889K wps
[Epoch 128 Batch 30/1540] avg loss 0.000843863, throughput 2.91818K wps
[Epoch 128 Batch 60/1540] avg loss 0.000731399, throughput 2.8728K wps
[Epoch 128 Batch 90/1540] avg loss 0.000804501, throughput 2.86344K wps
[Epoch 128 Batch 120/1540] avg loss 0.00110542, throughput 2.82798K wps
[Epoch 128 Batch 150/1540] avg loss 0.000811748, throughput 2.80195K wps
[Epoch 128 Batch 180/1540] avg loss 0.00065433, throughput 2.84329K wps
[Epoch 128 Batch 210/1540] avg loss 0.000880156, throughput 2.83017K wps
[Epoch 128 Batch 240/1540] avg loss 0.000942175, throughput 2.84307K wps
[Epoch 128 Batch 270/1540] avg loss 0.000839468, throughput 2.87937K wps
[Epoch 128 Batch 300/1540] avg loss 0.000844068, throughput 2.87396K wps
[Epoch 128 Batch 330/1540] avg loss 0.000726874, throughput 2.87302K wps
[Epoch 128 Batch 360/1540] avg loss 0.000822192, throughput 2.85602K wps
[Epoch 128 Batch 390/1540] avg loss 0.000938495, throughput 2.81297K wps
[Epoch 128 Batch 420/1540] avg loss 0.000691157, throughput 2.81529K wps
[Epoch 128 Batch 450/1540] avg loss 0.000797242, throughput 2.83288K wps
[Epoch 128 Batch 480/1540] avg loss 0.000869604, throughput 2.84937K wps
[Epoch 128 Batch 510/1540] avg loss 0.000636395, throughput 2.86046K wps
[Epoch 128 Batch 540/1540] avg loss 0.000905479, throughput 2.86845K wps
[Epoch 128 Batch 570/1540] avg loss 0.000829136, throughput 2.85123K wps
[Epoch 128 Batch 600/1540] avg loss 0.000987536, throughput 2.83222K wps
[Epoch 128 Batch 630/1540] avg loss 0.000841762, throughput 2.8509K wps
[Epoch 128 Batch 660/1540] avg loss 0.000797374, throughput 2.86008K wps
[Epoch 128 Batch 690/1540] avg loss 0.00076917, throughput 2.81094K wps
[Epoch 128 Batch 720/1540] avg loss 0.00126782, throughput 2.79503K wps
[Epoch 128 Batch 750/1540] avg loss 0.000802944, throughput 2.83914K wps
[Epoch 128 Batch 780/1540] avg loss 0.000847757, throughput 2.86267K wps
[Epoch 128 Batch 810/1540] avg loss 0.000815571, throughput 2.84749K wps
[Epoch 128 Batch 840/1540] avg loss 0.000860036, throughput 2.81704K wps
[Epoch 128 Batch 870/1540] avg loss 0.000890916, throughput 2.85253K wps
[Epoch 128 Batch 900/1540] avg loss 0.000916966, throughput 2.87271K wps
[Epoch 128 Batch 930/1540] avg loss 0.000820389, throughput 2.8789K wps
[Epoch 128 Batch 960/1540] avg loss 0.00101412, throughput 2.88113K wps
[Epoch 128 Batch 990/1540] avg loss 0.000823827, throughput 2.84997K wps
[Epoch 128 Batch 1020/1540] avg loss 0.000887613, throughput 2.86375K wps
[Epoch 128 Batch 1050/1540] avg loss 0.000909297, throughput 2.86009K wps
[Epoch 128 Batch 1080/1540] avg loss 0.000931894, throughput 2.85152K wps
[Epoch 128 Batch 1110/1540] avg loss 0.00084546, throughput 2.76947K wps
[Epoch 128 Batch 1140/1540] avg loss 0.00116325, throughput 2.79983K wps
[Epoch 128 Batch 1170/1540] avg loss 0.00065066, throughput 2.85964K wps
[Epoch 128 Batch 1200/1540] avg loss 0.000727864, throughput 2.85681K wps
[Epoch 128 Batch 1230/1540] avg loss 0.000924857, throughput 2.85351K wps
[Epoch 128 Batch 1260/1540] avg loss 0.00104157, throughput 2.85768K wps
[Epoch 128 Batch 1290/1540] avg loss 0.000718442, throughput 2.81787K wps
[Epoch 128 Batch 1320/1540] avg loss 0.00103468, throughput 2.81122K wps
[Epoch 128 Batch 1350/1540] avg loss 0.000997652, throughput 2.87907K wps
[Epoch 128 Batch 1380/1540] avg loss 0.000913687, throughput 2.87877K wps
[Epoch 128 Batch 1410/1540] avg loss 0.00104042, throughput 2.85921K wps
[Epoch 128 Batch 1440/1540] avg loss 0.000707914, throughput 2.85947K wps
[Epoch 128 Batch 1470/1540] avg loss 0.000744158, throughput 2.86891K wps
[Epoch 128 Batch 1500/1540] avg loss 0.00125335, throughput 2.84308K wps
[Epoch 128 Batch 1530/1540] avg loss 0.000572246, throughput 2.84916K wps
Begin Testing...
[Epoch 128] train avg loss 0.0008671, dev acc 0.8016, dev avg loss 0.863741, throughput 2.84826K wps
[Epoch 129 Batch 30/1540] avg loss 0.000759693, throughput 2.87212K wps
[Epoch 129 Batch 60/1540] avg loss 0.000882826, throughput 2.82701K wps
[Epoch 129 Batch 90/1540] avg loss 0.000775223, throughput 2.86377K wps
[Epoch 129 Batch 120/1540] avg loss 0.000705055, throughput 2.81728K wps
[Epoch 129 Batch 150/1540] avg loss 0.000911451, throughput 2.87647K wps
[Epoch 129 Batch 180/1540] avg loss 0.000941746, throughput 2.85502K wps
[Epoch 129 Batch 210/1540] avg loss 0.000529366, throughput 2.86088K wps
[Epoch 129 Batch 240/1540] avg loss 0.000807446, throughput 2.85334K wps
[Epoch 129 Batch 270/1540] avg loss 0.000690627, throughput 2.87869K wps
[Epoch 129 Batch 300/1540] avg loss 0.000855594, throughput 2.82184K wps
[Epoch 129 Batch 330/1540] avg loss 0.000842026, throughput 2.86784K wps
[Epoch 129 Batch 360/1540] avg loss 0.000732802, throughput 2.86117K wps
[Epoch 129 Batch 390/1540] avg loss 0.000850703, throughput 2.88217K wps
[Epoch 129 Batch 420/1540] avg loss 0.000704483, throughput 2.87131K wps
[Epoch 129 Batch 450/1540] avg loss 0.000833108, throughput 2.8716K wps
[Epoch 129 Batch 480/1540] avg loss 0.000917627, throughput 2.86137K wps
[Epoch 129 Batch 510/1540] avg loss 0.00102261, throughput 2.84224K wps
[Epoch 129 Batch 540/1540] avg loss 0.000814754, throughput 2.84517K wps
[Epoch 129 Batch 570/1540] avg loss 0.000791772, throughput 2.85292K wps
[Epoch 129 Batch 600/1540] avg loss 0.000803559, throughput 2.7944K wps
[Epoch 129 Batch 630/1540] avg loss 0.000999443, throughput 2.85835K wps
[Epoch 129 Batch 660/1540] avg loss 0.000984202, throughput 2.80512K wps
[Epoch 129 Batch 690/1540] avg loss 0.000859455, throughput 2.84369K wps
[Epoch 129 Batch 720/1540] avg loss 0.000844041, throughput 2.8546K wps
[Epoch 129 Batch 750/1540] avg loss 0.00102896, throughput 2.85676K wps
[Epoch 129 Batch 780/1540] avg loss 0.000804356, throughput 2.87686K wps
[Epoch 129 Batch 810/1540] avg loss 0.000920173, throughput 2.87343K wps
[Epoch 129 Batch 840/1540] avg loss 0.00107013, throughput 2.83866K wps
[Epoch 129 Batch 870/1540] avg loss 0.000827591, throughput 2.84364K wps
[Epoch 129 Batch 900/1540] avg loss 0.000920954, throughput 2.87405K wps
[Epoch 129 Batch 930/1540] avg loss 0.000726466, throughput 2.86548K wps
[Epoch 129 Batch 960/1540] avg loss 0.000978035, throughput 2.85641K wps
[Epoch 129 Batch 990/1540] avg loss 0.000872748, throughput 2.79233K wps
[Epoch 129 Batch 1020/1540] avg loss 0.00109367, throughput 2.86252K wps
[Epoch 129 Batch 1050/1540] avg loss 0.000737098, throughput 2.84607K wps
[Epoch 129 Batch 1080/1540] avg loss 0.00100069, throughput 2.77799K wps
[Epoch 129 Batch 1110/1540] avg loss 0.000746711, throughput 2.79349K wps
[Epoch 129 Batch 1140/1540] avg loss 0.00102649, throughput 2.86302K wps
[Epoch 129 Batch 1170/1540] avg loss 0.00107394, throughput 2.86512K wps
[Epoch 129 Batch 1200/1540] avg loss 0.000997202, throughput 2.78099K wps
[Epoch 129 Batch 1230/1540] avg loss 0.00083426, throughput 2.84535K wps
[Epoch 129 Batch 1260/1540] avg loss 0.000889736, throughput 2.8637K wps
[Epoch 129 Batch 1290/1540] avg loss 0.000916812, throughput 2.86118K wps
[Epoch 129 Batch 1320/1540] avg loss 0.000960699, throughput 2.84371K wps
[Epoch 129 Batch 1350/1540] avg loss 0.0010838, throughput 2.8697K wps
[Epoch 129 Batch 1380/1540] avg loss 0.00103082, throughput 2.81143K wps
[Epoch 129 Batch 1410/1540] avg loss 0.00110624, throughput 2.79444K wps
[Epoch 129 Batch 1440/1540] avg loss 0.000959592, throughput 2.84865K wps
[Epoch 129 Batch 1470/1540] avg loss 0.000807773, throughput 2.87685K wps
[Epoch 129 Batch 1500/1540] avg loss 0.000775224, throughput 2.83792K wps
[Epoch 129 Batch 1530/1540] avg loss 0.00101812, throughput 2.81591K wps
Begin Testing...
[Epoch 129] train avg loss 0.000882452, dev acc 0.7993, dev avg loss 0.880761, throughput 2.84617K wps
[Epoch 130 Batch 30/1540] avg loss 0.00082079, throughput 2.93225K wps
[Epoch 130 Batch 60/1540] avg loss 0.000895388, throughput 2.86824K wps
[Epoch 130 Batch 90/1540] avg loss 0.00100489, throughput 2.86594K wps
[Epoch 130 Batch 120/1540] avg loss 0.000908375, throughput 2.84017K wps
[Epoch 130 Batch 150/1540] avg loss 0.00089367, throughput 2.86497K wps
[Epoch 130 Batch 180/1540] avg loss 0.000774804, throughput 2.78329K wps
[Epoch 130 Batch 210/1540] avg loss 0.000772976, throughput 2.86309K wps
[Epoch 130 Batch 240/1540] avg loss 0.000734765, throughput 2.87901K wps
[Epoch 130 Batch 270/1540] avg loss 0.000790681, throughput 2.8704K wps
[Epoch 130 Batch 300/1540] avg loss 0.000929214, throughput 2.87314K wps
[Epoch 130 Batch 330/1540] avg loss 0.000872945, throughput 2.86271K wps
[Epoch 130 Batch 360/1540] avg loss 0.000527893, throughput 2.86732K wps
[Epoch 130 Batch 390/1540] avg loss 0.000868432, throughput 2.84357K wps
[Epoch 130 Batch 420/1540] avg loss 0.000803099, throughput 2.84548K wps
[Epoch 130 Batch 450/1540] avg loss 0.00102323, throughput 2.85278K wps
[Epoch 130 Batch 480/1540] avg loss 0.000691172, throughput 2.84175K wps
[Epoch 130 Batch 510/1540] avg loss 0.000714441, throughput 2.8016K wps
[Epoch 130 Batch 540/1540] avg loss 0.000751778, throughput 2.84141K wps
[Epoch 130 Batch 570/1540] avg loss 0.000864918, throughput 2.82151K wps
[Epoch 130 Batch 600/1540] avg loss 0.000840999, throughput 2.84893K wps
[Epoch 130 Batch 630/1540] avg loss 0.000999529, throughput 2.87856K wps
[Epoch 130 Batch 660/1540] avg loss 0.000742419, throughput 2.86084K wps
[Epoch 130 Batch 690/1540] avg loss 0.000812906, throughput 2.85893K wps
[Epoch 130 Batch 720/1540] avg loss 0.00090968, throughput 2.85168K wps
[Epoch 130 Batch 750/1540] avg loss 0.000739352, throughput 2.81532K wps
[Epoch 130 Batch 780/1540] avg loss 0.00104178, throughput 2.8111K wps
[Epoch 130 Batch 810/1540] avg loss 0.000855372, throughput 2.8131K wps
[Epoch 130 Batch 840/1540] avg loss 0.000866514, throughput 2.81446K wps
[Epoch 130 Batch 870/1540] avg loss 0.00109855, throughput 2.86206K wps
[Epoch 130 Batch 900/1540] avg loss 0.000877627, throughput 2.88105K wps
[Epoch 130 Batch 930/1540] avg loss 0.000854463, throughput 2.87612K wps
[Epoch 130 Batch 960/1540] avg loss 0.000788075, throughput 2.86871K wps
[Epoch 130 Batch 990/1540] avg loss 0.000979115, throughput 2.846K wps
[Epoch 130 Batch 1020/1540] avg loss 0.000781614, throughput 2.86313K wps
[Epoch 130 Batch 1050/1540] avg loss 0.00070897, throughput 2.87043K wps
[Epoch 130 Batch 1080/1540] avg loss 0.000822807, throughput 2.87081K wps
[Epoch 130 Batch 1110/1540] avg loss 0.000817698, throughput 2.8717K wps
[Epoch 130 Batch 1140/1540] avg loss 0.000739857, throughput 2.82986K wps
[Epoch 130 Batch 1170/1540] avg loss 0.000678029, throughput 2.83232K wps
[Epoch 130 Batch 1200/1540] avg loss 0.000863959, throughput 2.83285K wps
[Epoch 130 Batch 1230/1540] avg loss 0.000828423, throughput 2.84687K wps
[Epoch 130 Batch 1260/1540] avg loss 0.000927748, throughput 2.85153K wps
[Epoch 130 Batch 1290/1540] avg loss 0.000824012, throughput 2.81577K wps
[Epoch 130 Batch 1320/1540] avg loss 0.000989027, throughput 2.85889K wps
[Epoch 130 Batch 1350/1540] avg loss 0.000994435, throughput 2.7823K wps
[Epoch 130 Batch 1380/1540] avg loss 0.00129916, throughput 2.85634K wps
[Epoch 130 Batch 1410/1540] avg loss 0.00119785, throughput 2.85469K wps
[Epoch 130 Batch 1440/1540] avg loss 0.001085, throughput 2.83768K wps
[Epoch 130 Batch 1470/1540] avg loss 0.000946273, throughput 2.86935K wps
[Epoch 130 Batch 1500/1540] avg loss 0.00102409, throughput 2.87746K wps
[Epoch 130 Batch 1530/1540] avg loss 0.000779618, throughput 2.88429K wps
Begin Testing...
[Epoch 130] train avg loss 0.000869415, dev acc 0.8016, dev avg loss 0.859563, throughput 2.85105K wps
[Epoch 131 Batch 30/1540] avg loss 0.000859538, throughput 2.8519K wps
[Epoch 131 Batch 60/1540] avg loss 0.000792167, throughput 2.87105K wps
[Epoch 131 Batch 90/1540] avg loss 0.000614349, throughput 2.8539K wps
[Epoch 131 Batch 120/1540] avg loss 0.000684123, throughput 2.87711K wps
[Epoch 131 Batch 150/1540] avg loss 0.000933459, throughput 2.86501K wps
[Epoch 131 Batch 180/1540] avg loss 0.000867563, throughput 2.84914K wps
[Epoch 131 Batch 210/1540] avg loss 0.000788024, throughput 2.85824K wps
[Epoch 131 Batch 240/1540] avg loss 0.000728852, throughput 2.86356K wps
[Epoch 131 Batch 270/1540] avg loss 0.00119386, throughput 2.86392K wps
[Epoch 131 Batch 300/1540] avg loss 0.000932339, throughput 2.83168K wps
[Epoch 131 Batch 330/1540] avg loss 0.000645423, throughput 2.83567K wps
[Epoch 131 Batch 360/1540] avg loss 0.000759775, throughput 2.82024K wps
[Epoch 131 Batch 390/1540] avg loss 0.000950123, throughput 2.86859K wps
[Epoch 131 Batch 420/1540] avg loss 0.00088165, throughput 2.85371K wps
[Epoch 131 Batch 450/1540] avg loss 0.000914006, throughput 2.8532K wps
[Epoch 131 Batch 480/1540] avg loss 0.00092678, throughput 2.88478K wps
[Epoch 131 Batch 510/1540] avg loss 0.000765656, throughput 2.8427K wps
[Epoch 131 Batch 540/1540] avg loss 0.000940875, throughput 2.83907K wps
[Epoch 131 Batch 570/1540] avg loss 0.000916851, throughput 2.86362K wps
[Epoch 131 Batch 600/1540] avg loss 0.00106682, throughput 2.85197K wps
[Epoch 131 Batch 630/1540] avg loss 0.000978167, throughput 2.86009K wps
[Epoch 131 Batch 660/1540] avg loss 0.000866204, throughput 2.7752K wps
[Epoch 131 Batch 690/1540] avg loss 0.000995607, throughput 2.85249K wps
[Epoch 131 Batch 720/1540] avg loss 0.000769209, throughput 2.85728K wps
[Epoch 131 Batch 750/1540] avg loss 0.000964369, throughput 2.78729K wps
[Epoch 131 Batch 780/1540] avg loss 0.000901474, throughput 2.81756K wps
[Epoch 131 Batch 810/1540] avg loss 0.000969524, throughput 2.8558K wps
[Epoch 131 Batch 840/1540] avg loss 0.00078055, throughput 2.85408K wps
[Epoch 131 Batch 870/1540] avg loss 0.000812214, throughput 2.81937K wps
[Epoch 131 Batch 900/1540] avg loss 0.000932927, throughput 2.85061K wps
[Epoch 131 Batch 930/1540] avg loss 0.000859934, throughput 2.86688K wps
[Epoch 131 Batch 960/1540] avg loss 0.00111507, throughput 2.87622K wps
[Epoch 131 Batch 990/1540] avg loss 0.000772275, throughput 2.86845K wps
[Epoch 131 Batch 1020/1540] avg loss 0.0010235, throughput 2.82265K wps
[Epoch 131 Batch 1050/1540] avg loss 0.0007271, throughput 2.8751K wps
[Epoch 131 Batch 1080/1540] avg loss 0.00105804, throughput 2.83844K wps
[Epoch 131 Batch 1110/1540] avg loss 0.00067507, throughput 2.85222K wps
[Epoch 131 Batch 1140/1540] avg loss 0.000777496, throughput 2.83706K wps
[Epoch 131 Batch 1170/1540] avg loss 0.000876951, throughput 2.84667K wps
[Epoch 131 Batch 1200/1540] avg loss 0.000729547, throughput 2.84641K wps
[Epoch 131 Batch 1230/1540] avg loss 0.000959033, throughput 2.85451K wps
[Epoch 131 Batch 1260/1540] avg loss 0.000894945, throughput 2.85516K wps
[Epoch 131 Batch 1290/1540] avg loss 0.000992764, throughput 2.8598K wps
[Epoch 131 Batch 1320/1540] avg loss 0.000908155, throughput 2.81333K wps
[Epoch 131 Batch 1350/1540] avg loss 0.0008405, throughput 2.8429K wps
[Epoch 131 Batch 1380/1540] avg loss 0.000806577, throughput 2.87009K wps
[Epoch 131 Batch 1410/1540] avg loss 0.000648662, throughput 2.86032K wps
[Epoch 131 Batch 1440/1540] avg loss 0.00117115, throughput 2.84833K wps
[Epoch 131 Batch 1470/1540] avg loss 0.00103294, throughput 2.79997K wps
[Epoch 131 Batch 1500/1540] avg loss 0.000808099, throughput 2.87424K wps
[Epoch 131 Batch 1530/1540] avg loss 0.000846786, throughput 2.87198K wps
Begin Testing...
[Epoch 131] train avg loss 0.000875376, dev acc 0.8005, dev avg loss 0.887114, throughput 2.84909K wps
[Epoch 132 Batch 30/1540] avg loss 0.000778569, throughput 2.91996K wps
[Epoch 132 Batch 60/1540] avg loss 0.000873976, throughput 2.82408K wps
[Epoch 132 Batch 90/1540] avg loss 0.000910863, throughput 2.8633K wps
[Epoch 132 Batch 120/1540] avg loss 0.000725096, throughput 2.8775K wps
[Epoch 132 Batch 150/1540] avg loss 0.000991374, throughput 2.83159K wps
[Epoch 132 Batch 180/1540] avg loss 0.000649314, throughput 2.80987K wps
[Epoch 132 Batch 210/1540] avg loss 0.000717204, throughput 2.85825K wps
[Epoch 132 Batch 240/1540] avg loss 0.000776738, throughput 2.86889K wps
[Epoch 132 Batch 270/1540] avg loss 0.000851588, throughput 2.82676K wps
[Epoch 132 Batch 300/1540] avg loss 0.00063207, throughput 2.87286K wps
[Epoch 132 Batch 330/1540] avg loss 0.000907665, throughput 2.85545K wps
[Epoch 132 Batch 360/1540] avg loss 0.00072265, throughput 2.88069K wps
[Epoch 132 Batch 390/1540] avg loss 0.000823152, throughput 2.84233K wps
[Epoch 132 Batch 420/1540] avg loss 0.000923503, throughput 2.87182K wps
[Epoch 132 Batch 450/1540] avg loss 0.00079405, throughput 2.86844K wps
[Epoch 132 Batch 480/1540] avg loss 0.000697891, throughput 2.8686K wps
[Epoch 132 Batch 510/1540] avg loss 0.000821823, throughput 2.8154K wps
[Epoch 132 Batch 540/1540] avg loss 0.00104302, throughput 2.85201K wps
[Epoch 132 Batch 570/1540] avg loss 0.000699377, throughput 2.88308K wps
[Epoch 132 Batch 600/1540] avg loss 0.000858611, throughput 2.83291K wps
[Epoch 132 Batch 630/1540] avg loss 0.000957877, throughput 2.86656K wps
[Epoch 132 Batch 660/1540] avg loss 0.000756838, throughput 2.8462K wps
[Epoch 132 Batch 690/1540] avg loss 0.000920679, throughput 2.86882K wps
[Epoch 132 Batch 720/1540] avg loss 0.000873833, throughput 2.82891K wps
[Epoch 132 Batch 750/1540] avg loss 0.000981084, throughput 2.88107K wps
[Epoch 132 Batch 780/1540] avg loss 0.000816205, throughput 2.87859K wps
[Epoch 132 Batch 810/1540] avg loss 0.000740345, throughput 2.84737K wps
[Epoch 132 Batch 840/1540] avg loss 0.00106761, throughput 2.85952K wps
[Epoch 132 Batch 870/1540] avg loss 0.000954397, throughput 2.87516K wps
[Epoch 132 Batch 900/1540] avg loss 0.000725477, throughput 2.87078K wps
[Epoch 132 Batch 930/1540] avg loss 0.000786506, throughput 2.84345K wps
[Epoch 132 Batch 960/1540] avg loss 0.000814882, throughput 2.83015K wps
[Epoch 132 Batch 990/1540] avg loss 0.000901751, throughput 2.86235K wps
[Epoch 132 Batch 1020/1540] avg loss 0.000935503, throughput 2.8714K wps
[Epoch 132 Batch 1050/1540] avg loss 0.000967674, throughput 2.8697K wps
[Epoch 132 Batch 1080/1540] avg loss 0.000970629, throughput 2.86316K wps
[Epoch 132 Batch 1110/1540] avg loss 0.00103628, throughput 2.85074K wps
[Epoch 132 Batch 1140/1540] avg loss 0.00124408, throughput 2.84758K wps
[Epoch 132 Batch 1170/1540] avg loss 0.000806777, throughput 2.80178K wps
[Epoch 132 Batch 1200/1540] avg loss 0.000799046, throughput 2.87837K wps
[Epoch 132 Batch 1230/1540] avg loss 0.000863977, throughput 2.87834K wps
[Epoch 132 Batch 1260/1540] avg loss 0.000904557, throughput 2.86931K wps
[Epoch 132 Batch 1290/1540] avg loss 0.000823875, throughput 2.87427K wps
[Epoch 132 Batch 1320/1540] avg loss 0.000996669, throughput 2.80544K wps
[Epoch 132 Batch 1350/1540] avg loss 0.000858897, throughput 2.87022K wps
[Epoch 132 Batch 1380/1540] avg loss 0.00101716, throughput 2.84005K wps
[Epoch 132 Batch 1410/1540] avg loss 0.000823745, throughput 2.83613K wps
[Epoch 132 Batch 1440/1540] avg loss 0.00108712, throughput 2.85613K wps
[Epoch 132 Batch 1470/1540] avg loss 0.00073723, throughput 2.87932K wps
[Epoch 132 Batch 1500/1540] avg loss 0.000864325, throughput 2.88544K wps
[Epoch 132 Batch 1530/1540] avg loss 0.00104121, throughput 2.86644K wps
Begin Testing...
[Epoch 132] train avg loss 0.000868574, dev acc 0.7970, dev avg loss 0.872894, throughput 2.85721K wps
[Epoch 133 Batch 30/1540] avg loss 0.000638869, throughput 2.87052K wps
[Epoch 133 Batch 60/1540] avg loss 0.000681995, throughput 2.87519K wps
[Epoch 133 Batch 90/1540] avg loss 0.00087101, throughput 2.79755K wps
[Epoch 133 Batch 120/1540] avg loss 0.00086694, throughput 2.8006K wps
[Epoch 133 Batch 150/1540] avg loss 0.000877848, throughput 2.87662K wps
[Epoch 133 Batch 180/1540] avg loss 0.000885623, throughput 2.87435K wps
[Epoch 133 Batch 210/1540] avg loss 0.00077946, throughput 2.87126K wps
[Epoch 133 Batch 240/1540] avg loss 0.000833483, throughput 2.84168K wps
[Epoch 133 Batch 270/1540] avg loss 0.000786481, throughput 2.86893K wps
[Epoch 133 Batch 300/1540] avg loss 0.000853926, throughput 2.87469K wps
[Epoch 133 Batch 330/1540] avg loss 0.000869988, throughput 2.87128K wps
[Epoch 133 Batch 360/1540] avg loss 0.000831486, throughput 2.84933K wps
[Epoch 133 Batch 390/1540] avg loss 0.000786894, throughput 2.85313K wps
[Epoch 133 Batch 420/1540] avg loss 0.000774348, throughput 2.83401K wps
[Epoch 133 Batch 450/1540] avg loss 0.000996632, throughput 2.85609K wps
[Epoch 133 Batch 480/1540] avg loss 0.000848153, throughput 2.85605K wps
[Epoch 133 Batch 510/1540] avg loss 0.000772885, throughput 2.8665K wps
[Epoch 133 Batch 540/1540] avg loss 0.000946514, throughput 2.86599K wps
[Epoch 133 Batch 570/1540] avg loss 0.00100281, throughput 2.87704K wps
[Epoch 133 Batch 600/1540] avg loss 0.00101029, throughput 2.81479K wps
[Epoch 133 Batch 630/1540] avg loss 0.00111978, throughput 2.83004K wps
[Epoch 133 Batch 660/1540] avg loss 0.000846066, throughput 2.84779K wps
[Epoch 133 Batch 690/1540] avg loss 0.000875084, throughput 2.84108K wps
[Epoch 133 Batch 720/1540] avg loss 0.00095323, throughput 2.79773K wps
[Epoch 133 Batch 750/1540] avg loss 0.000857836, throughput 2.87451K wps
[Epoch 133 Batch 780/1540] avg loss 0.00104553, throughput 2.83148K wps
[Epoch 133 Batch 810/1540] avg loss 0.00081954, throughput 2.83542K wps
[Epoch 133 Batch 840/1540] avg loss 0.000631507, throughput 2.88055K wps
[Epoch 133 Batch 870/1540] avg loss 0.000859124, throughput 2.87507K wps
[Epoch 133 Batch 900/1540] avg loss 0.000859511, throughput 2.85175K wps
[Epoch 133 Batch 930/1540] avg loss 0.000947836, throughput 2.82939K wps
[Epoch 133 Batch 960/1540] avg loss 0.00105207, throughput 2.86848K wps
[Epoch 133 Batch 990/1540] avg loss 0.000727433, throughput 2.86483K wps
[Epoch 133 Batch 1020/1540] avg loss 0.000808684, throughput 2.87286K wps
[Epoch 133 Batch 1050/1540] avg loss 0.000804507, throughput 2.82593K wps
[Epoch 133 Batch 1080/1540] avg loss 0.000837301, throughput 2.87824K wps
[Epoch 133 Batch 1110/1540] avg loss 0.00105652, throughput 2.84595K wps
[Epoch 133 Batch 1140/1540] avg loss 0.000965662, throughput 2.80585K wps
[Epoch 133 Batch 1170/1540] avg loss 0.000727379, throughput 2.87223K wps
[Epoch 133 Batch 1200/1540] avg loss 0.000722371, throughput 2.87K wps
[Epoch 133 Batch 1230/1540] avg loss 0.000810216, throughput 2.83743K wps
[Epoch 133 Batch 1260/1540] avg loss 0.000902602, throughput 2.85205K wps
[Epoch 133 Batch 1290/1540] avg loss 0.000835278, throughput 2.83828K wps
[Epoch 133 Batch 1320/1540] avg loss 0.00110373, throughput 2.81166K wps
[Epoch 133 Batch 1350/1540] avg loss 0.000753378, throughput 2.87357K wps
[Epoch 133 Batch 1380/1540] avg loss 0.000940595, throughput 2.86355K wps
[Epoch 133 Batch 1410/1540] avg loss 0.00109579, throughput 2.87934K wps
[Epoch 133 Batch 1440/1540] avg loss 0.000911024, throughput 2.87725K wps
[Epoch 133 Batch 1470/1540] avg loss 0.000750829, throughput 2.87619K wps
[Epoch 133 Batch 1500/1540] avg loss 0.00112239, throughput 2.87165K wps
[Epoch 133 Batch 1530/1540] avg loss 0.000996557, throughput 2.8834K wps
Begin Testing...
[Epoch 133] train avg loss 0.000875729, dev acc 0.7982, dev avg loss 0.872445, throughput 2.85411K wps
[Epoch 134 Batch 30/1540] avg loss 0.000676745, throughput 2.91435K wps
[Epoch 134 Batch 60/1540] avg loss 0.000733708, throughput 2.85389K wps
[Epoch 134 Batch 90/1540] avg loss 0.000961597, throughput 2.86848K wps
[Epoch 134 Batch 120/1540] avg loss 0.00071311, throughput 2.8619K wps
[Epoch 134 Batch 150/1540] avg loss 0.00082469, throughput 2.8686K wps
[Epoch 134 Batch 180/1540] avg loss 0.000678782, throughput 2.87345K wps
[Epoch 134 Batch 210/1540] avg loss 0.000659671, throughput 2.86661K wps
[Epoch 134 Batch 240/1540] avg loss 0.000792367, throughput 2.86805K wps
[Epoch 134 Batch 270/1540] avg loss 0.000777327, throughput 2.8573K wps
[Epoch 134 Batch 300/1540] avg loss 0.000699859, throughput 2.87254K wps
[Epoch 134 Batch 330/1540] avg loss 0.000690521, throughput 2.86846K wps
[Epoch 134 Batch 360/1540] avg loss 0.00105226, throughput 2.78632K wps
[Epoch 134 Batch 390/1540] avg loss 0.000947032, throughput 2.82703K wps
[Epoch 134 Batch 420/1540] avg loss 0.000804726, throughput 2.87251K wps
[Epoch 134 Batch 450/1540] avg loss 0.000919571, throughput 2.87427K wps
[Epoch 134 Batch 480/1540] avg loss 0.000863973, throughput 2.87405K wps
[Epoch 134 Batch 510/1540] avg loss 0.000825597, throughput 2.88158K wps
[Epoch 134 Batch 540/1540] avg loss 0.000990164, throughput 2.87182K wps
[Epoch 134 Batch 570/1540] avg loss 0.000872461, throughput 2.86223K wps
[Epoch 134 Batch 600/1540] avg loss 0.000938685, throughput 2.83258K wps
[Epoch 134 Batch 630/1540] avg loss 0.000842913, throughput 2.82422K wps
[Epoch 134 Batch 660/1540] avg loss 0.00076364, throughput 2.80864K wps
[Epoch 134 Batch 690/1540] avg loss 0.000999266, throughput 2.79968K wps
[Epoch 134 Batch 720/1540] avg loss 0.000744579, throughput 2.77276K wps
[Epoch 134 Batch 750/1540] avg loss 0.000776108, throughput 2.84055K wps
[Epoch 134 Batch 780/1540] avg loss 0.000938584, throughput 2.81159K wps
[Epoch 134 Batch 810/1540] avg loss 0.000918005, throughput 2.86654K wps
[Epoch 134 Batch 840/1540] avg loss 0.00077731, throughput 2.87467K wps
[Epoch 134 Batch 870/1540] avg loss 0.00102169, throughput 2.83482K wps
[Epoch 134 Batch 900/1540] avg loss 0.00100667, throughput 2.82538K wps
[Epoch 134 Batch 930/1540] avg loss 0.00104312, throughput 2.87706K wps
[Epoch 134 Batch 960/1540] avg loss 0.000787563, throughput 2.88087K wps
[Epoch 134 Batch 990/1540] avg loss 0.000848696, throughput 2.85298K wps
[Epoch 134 Batch 1020/1540] avg loss 0.000940635, throughput 2.8344K wps
[Epoch 134 Batch 1050/1540] avg loss 0.000924179, throughput 2.87385K wps
[Epoch 134 Batch 1080/1540] avg loss 0.000990904, throughput 2.8676K wps
[Epoch 134 Batch 1110/1540] avg loss 0.000802631, throughput 2.86253K wps
[Epoch 134 Batch 1140/1540] avg loss 0.000772087, throughput 2.87078K wps
[Epoch 134 Batch 1170/1540] avg loss 0.000766686, throughput 2.87806K wps
[Epoch 134 Batch 1200/1540] avg loss 0.000802724, throughput 2.87585K wps
[Epoch 134 Batch 1230/1540] avg loss 0.000819118, throughput 2.87588K wps
[Epoch 134 Batch 1260/1540] avg loss 0.000599167, throughput 2.87658K wps
[Epoch 134 Batch 1290/1540] avg loss 0.00111449, throughput 2.88366K wps
[Epoch 134 Batch 1320/1540] avg loss 0.00100088, throughput 2.87414K wps
[Epoch 134 Batch 1350/1540] avg loss 0.000890224, throughput 2.8743K wps
[Epoch 134 Batch 1380/1540] avg loss 0.000747916, throughput 2.85761K wps
[Epoch 134 Batch 1410/1540] avg loss 0.000951154, throughput 2.85722K wps
[Epoch 134 Batch 1440/1540] avg loss 0.0011645, throughput 2.87246K wps
[Epoch 134 Batch 1470/1540] avg loss 0.000821551, throughput 2.87498K wps
[Epoch 134 Batch 1500/1540] avg loss 0.000925191, throughput 2.84039K wps
[Epoch 134 Batch 1530/1540] avg loss 0.00108922, throughput 2.86444K wps
Begin Testing...
[Epoch 134] train avg loss 0.000862068, dev acc 0.8039, dev avg loss 0.886796, throughput 2.85745K wps
[Epoch 135 Batch 30/1540] avg loss 0.000676018, throughput 2.92073K wps
[Epoch 135 Batch 60/1540] avg loss 0.000702475, throughput 2.84092K wps
[Epoch 135 Batch 90/1540] avg loss 0.000758743, throughput 2.86137K wps
[Epoch 135 Batch 120/1540] avg loss 0.000862628, throughput 2.85398K wps
[Epoch 135 Batch 150/1540] avg loss 0.000596374, throughput 2.85025K wps
[Epoch 135 Batch 180/1540] avg loss 0.000769084, throughput 2.88346K wps
[Epoch 135 Batch 210/1540] avg loss 0.000770824, throughput 2.8057K wps
[Epoch 135 Batch 240/1540] avg loss 0.000898104, throughput 2.86191K wps
[Epoch 135 Batch 270/1540] avg loss 0.00101134, throughput 2.8687K wps
[Epoch 135 Batch 300/1540] avg loss 0.000780996, throughput 2.84247K wps
[Epoch 135 Batch 330/1540] avg loss 0.000606415, throughput 2.8638K wps
[Epoch 135 Batch 360/1540] avg loss 0.000920588, throughput 2.86764K wps
[Epoch 135 Batch 390/1540] avg loss 0.000683366, throughput 2.84767K wps
[Epoch 135 Batch 420/1540] avg loss 0.000717107, throughput 2.80819K wps
[Epoch 135 Batch 450/1540] avg loss 0.000641173, throughput 2.86461K wps
[Epoch 135 Batch 480/1540] avg loss 0.000685066, throughput 2.83685K wps
[Epoch 135 Batch 510/1540] avg loss 0.000970166, throughput 2.84337K wps
[Epoch 135 Batch 540/1540] avg loss 0.000852414, throughput 2.83287K wps
[Epoch 135 Batch 570/1540] avg loss 0.000941226, throughput 2.85179K wps
[Epoch 135 Batch 600/1540] avg loss 0.000967266, throughput 2.85795K wps
[Epoch 135 Batch 630/1540] avg loss 0.000661854, throughput 2.78873K wps
[Epoch 135 Batch 660/1540] avg loss 0.000979134, throughput 2.85014K wps
[Epoch 135 Batch 690/1540] avg loss 0.00105589, throughput 2.87209K wps
[Epoch 135 Batch 720/1540] avg loss 0.000792454, throughput 2.88279K wps
[Epoch 135 Batch 750/1540] avg loss 0.000764679, throughput 2.87757K wps
[Epoch 135 Batch 780/1540] avg loss 0.000892036, throughput 2.88686K wps
[Epoch 135 Batch 810/1540] avg loss 0.000893385, throughput 2.83005K wps
[Epoch 135 Batch 840/1540] avg loss 0.000818526, throughput 2.80673K wps
[Epoch 135 Batch 870/1540] avg loss 0.000679199, throughput 2.82759K wps
[Epoch 135 Batch 900/1540] avg loss 0.000949482, throughput 2.80376K wps
[Epoch 135 Batch 930/1540] avg loss 0.000571214, throughput 2.87934K wps
[Epoch 135 Batch 960/1540] avg loss 0.00103615, throughput 2.86528K wps
[Epoch 135 Batch 990/1540] avg loss 0.000850307, throughput 2.79861K wps
[Epoch 135 Batch 1020/1540] avg loss 0.000987301, throughput 2.85345K wps
[Epoch 135 Batch 1050/1540] avg loss 0.000920322, throughput 2.79628K wps
[Epoch 135 Batch 1080/1540] avg loss 0.001099, throughput 2.83244K wps
[Epoch 135 Batch 1110/1540] avg loss 0.00071272, throughput 2.86039K wps
[Epoch 135 Batch 1140/1540] avg loss 0.000892531, throughput 2.82291K wps
[Epoch 135 Batch 1170/1540] avg loss 0.00102372, throughput 2.8736K wps
[Epoch 135 Batch 1200/1540] avg loss 0.000927555, throughput 2.8781K wps
[Epoch 135 Batch 1230/1540] avg loss 0.000758797, throughput 2.87552K wps
[Epoch 135 Batch 1260/1540] avg loss 0.000962005, throughput 2.82435K wps
[Epoch 135 Batch 1290/1540] avg loss 0.00093588, throughput 2.84785K wps
[Epoch 135 Batch 1320/1540] avg loss 0.00114972, throughput 2.84567K wps
[Epoch 135 Batch 1350/1540] avg loss 0.000770912, throughput 2.78585K wps
[Epoch 135 Batch 1380/1540] avg loss 0.000912821, throughput 2.8568K wps
[Epoch 135 Batch 1410/1540] avg loss 0.0013634, throughput 2.87746K wps
[Epoch 135 Batch 1440/1540] avg loss 0.000910435, throughput 2.8785K wps
[Epoch 135 Batch 1470/1540] avg loss 0.00078483, throughput 2.84035K wps
[Epoch 135 Batch 1500/1540] avg loss 0.0011219, throughput 2.79097K wps
[Epoch 135 Batch 1530/1540] avg loss 0.00125534, throughput 2.87535K wps
Begin Testing...
[Epoch 135] train avg loss 0.000866899, dev acc 0.7936, dev avg loss 0.878487, throughput 2.84791K wps
[Epoch 136 Batch 30/1540] avg loss 0.000671187, throughput 2.93322K wps
[Epoch 136 Batch 60/1540] avg loss 0.000684442, throughput 2.86058K wps
[Epoch 136 Batch 90/1540] avg loss 0.000658106, throughput 2.8683K wps
[Epoch 136 Batch 120/1540] avg loss 0.000651849, throughput 2.87929K wps
[Epoch 136 Batch 150/1540] avg loss 0.000673054, throughput 2.87551K wps
[Epoch 136 Batch 180/1540] avg loss 0.000737529, throughput 2.82981K wps
[Epoch 136 Batch 210/1540] avg loss 0.000679437, throughput 2.85578K wps
[Epoch 136 Batch 240/1540] avg loss 0.00094709, throughput 2.88497K wps
[Epoch 136 Batch 270/1540] avg loss 0.000745608, throughput 2.81077K wps
[Epoch 136 Batch 300/1540] avg loss 0.000928888, throughput 2.87449K wps
[Epoch 136 Batch 330/1540] avg loss 0.000750866, throughput 2.87761K wps
[Epoch 136 Batch 360/1540] avg loss 0.000704354, throughput 2.86999K wps
[Epoch 136 Batch 390/1540] avg loss 0.000758287, throughput 2.87498K wps
[Epoch 136 Batch 420/1540] avg loss 0.000812673, throughput 2.87249K wps
[Epoch 136 Batch 450/1540] avg loss 0.00102396, throughput 2.86764K wps
[Epoch 136 Batch 480/1540] avg loss 0.00109965, throughput 2.81892K wps
[Epoch 136 Batch 510/1540] avg loss 0.000723044, throughput 2.79192K wps
[Epoch 136 Batch 540/1540] avg loss 0.000911031, throughput 2.86542K wps
[Epoch 136 Batch 570/1540] avg loss 0.000787405, throughput 2.83067K wps
[Epoch 136 Batch 600/1540] avg loss 0.00101866, throughput 2.84216K wps
[Epoch 136 Batch 630/1540] avg loss 0.000892807, throughput 2.87087K wps
[Epoch 136 Batch 660/1540] avg loss 0.000874601, throughput 2.87419K wps
[Epoch 136 Batch 690/1540] avg loss 0.000728543, throughput 2.84278K wps
[Epoch 136 Batch 720/1540] avg loss 0.000622801, throughput 2.82188K wps
[Epoch 136 Batch 750/1540] avg loss 0.00069242, throughput 2.87961K wps
[Epoch 136 Batch 780/1540] avg loss 0.000886905, throughput 2.84128K wps
[Epoch 136 Batch 810/1540] avg loss 0.000921336, throughput 2.87456K wps
[Epoch 136 Batch 840/1540] avg loss 0.000905466, throughput 2.87837K wps
[Epoch 136 Batch 870/1540] avg loss 0.00103898, throughput 2.87742K wps
[Epoch 136 Batch 900/1540] avg loss 0.00102913, throughput 2.80773K wps
[Epoch 136 Batch 930/1540] avg loss 0.000840539, throughput 2.88189K wps
[Epoch 136 Batch 960/1540] avg loss 0.000738415, throughput 2.8781K wps
[Epoch 136 Batch 990/1540] avg loss 0.000783747, throughput 2.84651K wps
[Epoch 136 Batch 1020/1540] avg loss 0.000697221, throughput 2.86512K wps
[Epoch 136 Batch 1050/1540] avg loss 0.000949634, throughput 2.86787K wps
[Epoch 136 Batch 1080/1540] avg loss 0.000953771, throughput 2.88273K wps
[Epoch 136 Batch 1110/1540] avg loss 0.000856957, throughput 2.85626K wps
[Epoch 136 Batch 1140/1540] avg loss 0.000806065, throughput 2.82213K wps
[Epoch 136 Batch 1170/1540] avg loss 0.000783723, throughput 2.83036K wps
[Epoch 136 Batch 1200/1540] avg loss 0.000869698, throughput 2.85619K wps
[Epoch 136 Batch 1230/1540] avg loss 0.000792887, throughput 2.86066K wps
[Epoch 136 Batch 1260/1540] avg loss 0.00111283, throughput 2.86973K wps
[Epoch 136 Batch 1290/1540] avg loss 0.000981535, throughput 2.84733K wps
[Epoch 136 Batch 1320/1540] avg loss 0.000714845, throughput 2.86583K wps
[Epoch 136 Batch 1350/1540] avg loss 0.00109438, throughput 2.85483K wps
[Epoch 136 Batch 1380/1540] avg loss 0.000949807, throughput 2.85983K wps
[Epoch 136 Batch 1410/1540] avg loss 0.000782064, throughput 2.88272K wps
[Epoch 136 Batch 1440/1540] avg loss 0.000975806, throughput 2.85999K wps
[Epoch 136 Batch 1470/1540] avg loss 0.000937976, throughput 2.85874K wps
[Epoch 136 Batch 1500/1540] avg loss 0.000886483, throughput 2.84799K wps
[Epoch 136 Batch 1530/1540] avg loss 0.00089295, throughput 2.82852K wps
Begin Testing...
[Epoch 136] train avg loss 0.000843104, dev acc 0.7890, dev avg loss 0.904139, throughput 2.85825K wps
[Epoch 137 Batch 30/1540] avg loss 0.000873135, throughput 2.92841K wps
[Epoch 137 Batch 60/1540] avg loss 0.000896187, throughput 2.87172K wps
[Epoch 137 Batch 90/1540] avg loss 0.000760678, throughput 2.82457K wps
[Epoch 137 Batch 120/1540] avg loss 0.000721657, throughput 2.82807K wps
[Epoch 137 Batch 150/1540] avg loss 0.000745812, throughput 2.85185K wps
[Epoch 137 Batch 180/1540] avg loss 0.000878112, throughput 2.88501K wps
[Epoch 137 Batch 210/1540] avg loss 0.000736686, throughput 2.86282K wps
[Epoch 137 Batch 240/1540] avg loss 0.000825646, throughput 2.79786K wps
[Epoch 137 Batch 270/1540] avg loss 0.000603613, throughput 2.85741K wps
[Epoch 137 Batch 300/1540] avg loss 0.000566578, throughput 2.87398K wps
[Epoch 137 Batch 330/1540] avg loss 0.000843381, throughput 2.82687K wps
[Epoch 137 Batch 360/1540] avg loss 0.00076863, throughput 2.87591K wps
[Epoch 137 Batch 390/1540] avg loss 0.000861387, throughput 2.84625K wps
[Epoch 137 Batch 420/1540] avg loss 0.00101584, throughput 2.82411K wps
[Epoch 137 Batch 450/1540] avg loss 0.000820676, throughput 2.87946K wps
[Epoch 137 Batch 480/1540] avg loss 0.000674676, throughput 2.86669K wps
[Epoch 137 Batch 510/1540] avg loss 0.000751869, throughput 2.87896K wps
[Epoch 137 Batch 540/1540] avg loss 0.000915258, throughput 2.86971K wps
[Epoch 137 Batch 570/1540] avg loss 0.000978713, throughput 2.87043K wps
[Epoch 137 Batch 600/1540] avg loss 0.00104003, throughput 2.87818K wps
[Epoch 137 Batch 630/1540] avg loss 0.000852918, throughput 2.86108K wps
[Epoch 137 Batch 660/1540] avg loss 0.000915876, throughput 2.84828K wps
[Epoch 137 Batch 690/1540] avg loss 0.000557152, throughput 2.87005K wps
[Epoch 137 Batch 720/1540] avg loss 0.00071814, throughput 2.88316K wps
[Epoch 137 Batch 750/1540] avg loss 0.000882454, throughput 2.87902K wps
[Epoch 137 Batch 780/1540] avg loss 0.000769721, throughput 2.88043K wps
[Epoch 137 Batch 810/1540] avg loss 0.000714546, throughput 2.87915K wps
[Epoch 137 Batch 840/1540] avg loss 0.0010967, throughput 2.82544K wps
[Epoch 137 Batch 870/1540] avg loss 0.000721893, throughput 2.87758K wps
[Epoch 137 Batch 900/1540] avg loss 0.000861544, throughput 2.84799K wps
[Epoch 137 Batch 930/1540] avg loss 0.000838813, throughput 2.87848K wps
[Epoch 137 Batch 960/1540] avg loss 0.000830365, throughput 2.85782K wps
[Epoch 137 Batch 990/1540] avg loss 0.000857948, throughput 2.87868K wps
[Epoch 137 Batch 1020/1540] avg loss 0.000934051, throughput 2.87619K wps
[Epoch 137 Batch 1050/1540] avg loss 0.000998507, throughput 2.88072K wps
[Epoch 137 Batch 1080/1540] avg loss 0.00103532, throughput 2.877K wps
[Epoch 137 Batch 1110/1540] avg loss 0.000813235, throughput 2.87477K wps
[Epoch 137 Batch 1140/1540] avg loss 0.000957395, throughput 2.87245K wps
[Epoch 137 Batch 1170/1540] avg loss 0.000734647, throughput 2.82528K wps
[Epoch 137 Batch 1200/1540] avg loss 0.000868956, throughput 2.8445K wps
[Epoch 137 Batch 1230/1540] avg loss 0.000903929, throughput 2.78997K wps
[Epoch 137 Batch 1260/1540] avg loss 0.00084798, throughput 2.77994K wps
[Epoch 137 Batch 1290/1540] avg loss 0.000843105, throughput 2.86335K wps
[Epoch 137 Batch 1320/1540] avg loss 0.00076227, throughput 2.80173K wps
[Epoch 137 Batch 1350/1540] avg loss 0.000833309, throughput 2.87272K wps
[Epoch 137 Batch 1380/1540] avg loss 0.0008881, throughput 2.82192K wps
[Epoch 137 Batch 1410/1540] avg loss 0.000678093, throughput 2.79773K wps
[Epoch 137 Batch 1440/1540] avg loss 0.000852156, throughput 2.83129K wps
[Epoch 137 Batch 1470/1540] avg loss 0.00113788, throughput 2.84115K wps
[Epoch 137 Batch 1500/1540] avg loss 0.00105671, throughput 2.84346K wps
[Epoch 137 Batch 1530/1540] avg loss 0.000863958, throughput 2.84187K wps
Begin Testing...
[Epoch 137] train avg loss 0.000842247, dev acc 0.7924, dev avg loss 0.898726, throughput 2.85477K wps
[Epoch 138 Batch 30/1540] avg loss 0.000788778, throughput 2.92813K wps
[Epoch 138 Batch 60/1540] avg loss 0.000771769, throughput 2.84198K wps
[Epoch 138 Batch 90/1540] avg loss 0.000818972, throughput 2.80453K wps
[Epoch 138 Batch 120/1540] avg loss 0.000877667, throughput 2.79288K wps
[Epoch 138 Batch 150/1540] avg loss 0.00086373, throughput 2.86443K wps
[Epoch 138 Batch 180/1540] avg loss 0.000718106, throughput 2.80178K wps
[Epoch 138 Batch 210/1540] avg loss 0.000441343, throughput 2.78966K wps
[Epoch 138 Batch 240/1540] avg loss 0.000728502, throughput 2.84399K wps
[Epoch 138 Batch 270/1540] avg loss 0.000769393, throughput 2.7951K wps
[Epoch 138 Batch 300/1540] avg loss 0.000738063, throughput 2.84658K wps
[Epoch 138 Batch 330/1540] avg loss 0.000846513, throughput 2.87655K wps
[Epoch 138 Batch 360/1540] avg loss 0.000732886, throughput 2.87317K wps
[Epoch 138 Batch 390/1540] avg loss 0.000699054, throughput 2.86374K wps
[Epoch 138 Batch 420/1540] avg loss 0.000900403, throughput 2.83133K wps
[Epoch 138 Batch 450/1540] avg loss 0.000769258, throughput 2.79399K wps
[Epoch 138 Batch 480/1540] avg loss 0.000808404, throughput 2.8726K wps
[Epoch 138 Batch 510/1540] avg loss 0.000926136, throughput 2.86604K wps
[Epoch 138 Batch 540/1540] avg loss 0.000778899, throughput 2.83635K wps
[Epoch 138 Batch 570/1540] avg loss 0.000672387, throughput 2.82227K wps
[Epoch 138 Batch 600/1540] avg loss 0.000869032, throughput 2.86061K wps
[Epoch 138 Batch 630/1540] avg loss 0.000644461, throughput 2.82702K wps
[Epoch 138 Batch 660/1540] avg loss 0.000659506, throughput 2.86313K wps
[Epoch 138 Batch 690/1540] avg loss 0.00101502, throughput 2.79724K wps
[Epoch 138 Batch 720/1540] avg loss 0.000811493, throughput 2.8339K wps
[Epoch 138 Batch 750/1540] avg loss 0.000910354, throughput 2.86679K wps
[Epoch 138 Batch 780/1540] avg loss 0.000677996, throughput 2.82525K wps
[Epoch 138 Batch 810/1540] avg loss 0.000893603, throughput 2.83327K wps
[Epoch 138 Batch 840/1540] avg loss 0.00105106, throughput 2.87058K wps
[Epoch 138 Batch 870/1540] avg loss 0.000720934, throughput 2.85581K wps
[Epoch 138 Batch 900/1540] avg loss 0.000707744, throughput 2.85931K wps
[Epoch 138 Batch 930/1540] avg loss 0.000879039, throughput 2.88072K wps
[Epoch 138 Batch 960/1540] avg loss 0.000990397, throughput 2.8724K wps
[Epoch 138 Batch 990/1540] avg loss 0.000878195, throughput 2.87911K wps
[Epoch 138 Batch 1020/1540] avg loss 0.000853979, throughput 2.87703K wps
[Epoch 138 Batch 1050/1540] avg loss 0.000910001, throughput 2.85628K wps
[Epoch 138 Batch 1080/1540] avg loss 0.00113865, throughput 2.8744K wps
[Epoch 138 Batch 1110/1540] avg loss 0.000964244, throughput 2.87206K wps
[Epoch 138 Batch 1140/1540] avg loss 0.000755702, throughput 2.86671K wps
[Epoch 138 Batch 1170/1540] avg loss 0.000821182, throughput 2.82438K wps
[Epoch 138 Batch 1200/1540] avg loss 0.0008849, throughput 2.87999K wps
[Epoch 138 Batch 1230/1540] avg loss 0.000821442, throughput 2.82121K wps
[Epoch 138 Batch 1260/1540] avg loss 0.000846516, throughput 2.79541K wps
[Epoch 138 Batch 1290/1540] avg loss 0.000704292, throughput 2.87359K wps
[Epoch 138 Batch 1320/1540] avg loss 0.000765416, throughput 2.83377K wps
[Epoch 138 Batch 1350/1540] avg loss 0.000789711, throughput 2.8215K wps
[Epoch 138 Batch 1380/1540] avg loss 0.000737607, throughput 2.87936K wps
[Epoch 138 Batch 1410/1540] avg loss 0.000978229, throughput 2.86624K wps
[Epoch 138 Batch 1440/1540] avg loss 0.000676992, throughput 2.86248K wps
[Epoch 138 Batch 1470/1540] avg loss 0.000841663, throughput 2.87183K wps
[Epoch 138 Batch 1500/1540] avg loss 0.00083058, throughput 2.8649K wps
[Epoch 138 Batch 1530/1540] avg loss 0.000871482, throughput 2.85043K wps
Begin Testing...
[Epoch 138] train avg loss 0.000814481, dev acc 0.7947, dev avg loss 0.897719, throughput 2.8478K wps
[Epoch 139 Batch 30/1540] avg loss 0.000686275, throughput 2.85671K wps
[Epoch 139 Batch 60/1540] avg loss 0.000807936, throughput 2.79476K wps
[Epoch 139 Batch 90/1540] avg loss 0.000816005, throughput 2.81334K wps
[Epoch 139 Batch 120/1540] avg loss 0.000670964, throughput 2.83005K wps
[Epoch 139 Batch 150/1540] avg loss 0.000782241, throughput 2.81785K wps
[Epoch 139 Batch 180/1540] avg loss 0.000719578, throughput 2.85971K wps
[Epoch 139 Batch 210/1540] avg loss 0.000739056, throughput 2.85298K wps
[Epoch 139 Batch 240/1540] avg loss 0.00074265, throughput 2.78576K wps
[Epoch 139 Batch 270/1540] avg loss 0.000879466, throughput 2.82712K wps
[Epoch 139 Batch 300/1540] avg loss 0.000705901, throughput 2.8287K wps
[Epoch 139 Batch 330/1540] avg loss 0.000681687, throughput 2.82862K wps
[Epoch 139 Batch 360/1540] avg loss 0.000816004, throughput 2.81595K wps
[Epoch 139 Batch 390/1540] avg loss 0.000691157, throughput 2.79961K wps
[Epoch 139 Batch 420/1540] avg loss 0.00079212, throughput 2.85455K wps
[Epoch 139 Batch 450/1540] avg loss 0.000690176, throughput 2.86198K wps
[Epoch 139 Batch 480/1540] avg loss 0.00083238, throughput 2.8477K wps
[Epoch 139 Batch 510/1540] avg loss 0.000835954, throughput 2.86799K wps
[Epoch 139 Batch 540/1540] avg loss 0.000986585, throughput 2.8774K wps
[Epoch 139 Batch 570/1540] avg loss 0.000602752, throughput 2.87158K wps
[Epoch 139 Batch 600/1540] avg loss 0.000621338, throughput 2.86722K wps
[Epoch 139 Batch 630/1540] avg loss 0.000929919, throughput 2.8587K wps
[Epoch 139 Batch 660/1540] avg loss 0.000806566, throughput 2.85017K wps
[Epoch 139 Batch 690/1540] avg loss 0.000843305, throughput 2.86676K wps
[Epoch 139 Batch 720/1540] avg loss 0.000882192, throughput 2.8293K wps
[Epoch 139 Batch 750/1540] avg loss 0.000648671, throughput 2.83674K wps
[Epoch 139 Batch 780/1540] avg loss 0.000989491, throughput 2.85833K wps
[Epoch 139 Batch 810/1540] avg loss 0.000736912, throughput 2.86956K wps
[Epoch 139 Batch 840/1540] avg loss 0.000886654, throughput 2.88089K wps
[Epoch 139 Batch 870/1540] avg loss 0.000740472, throughput 2.86188K wps
[Epoch 139 Batch 900/1540] avg loss 0.00123097, throughput 2.83267K wps
[Epoch 139 Batch 930/1540] avg loss 0.00086807, throughput 2.87814K wps
[Epoch 139 Batch 960/1540] avg loss 0.000765469, throughput 2.85937K wps
[Epoch 139 Batch 990/1540] avg loss 0.000753946, throughput 2.85969K wps
[Epoch 139 Batch 1020/1540] avg loss 0.000785893, throughput 2.8688K wps
[Epoch 139 Batch 1050/1540] avg loss 0.000797252, throughput 2.86105K wps
[Epoch 139 Batch 1080/1540] avg loss 0.000971779, throughput 2.85428K wps
[Epoch 139 Batch 1110/1540] avg loss 0.00063747, throughput 2.85407K wps
[Epoch 139 Batch 1140/1540] avg loss 0.000746772, throughput 2.86197K wps
[Epoch 139 Batch 1170/1540] avg loss 0.000737836, throughput 2.87396K wps
[Epoch 139 Batch 1200/1540] avg loss 0.000931607, throughput 2.88159K wps
[Epoch 139 Batch 1230/1540] avg loss 0.000955617, throughput 2.86987K wps
[Epoch 139 Batch 1260/1540] avg loss 0.000773117, throughput 2.86085K wps
[Epoch 139 Batch 1290/1540] avg loss 0.00101886, throughput 2.86245K wps
[Epoch 139 Batch 1320/1540] avg loss 0.000670752, throughput 2.82666K wps
[Epoch 139 Batch 1350/1540] avg loss 0.00123981, throughput 2.85473K wps
[Epoch 139 Batch 1380/1540] avg loss 0.000851574, throughput 2.85835K wps
[Epoch 139 Batch 1410/1540] avg loss 0.00103209, throughput 2.87114K wps
[Epoch 139 Batch 1440/1540] avg loss 0.000919455, throughput 2.87835K wps
[Epoch 139 Batch 1470/1540] avg loss 0.000849897, throughput 2.86113K wps
[Epoch 139 Batch 1500/1540] avg loss 0.00113354, throughput 2.85489K wps
[Epoch 139 Batch 1530/1540] avg loss 0.000941055, throughput 2.86942K wps
Begin Testing...
[Epoch 139] train avg loss 0.000828662, dev acc 0.7993, dev avg loss 0.898957, throughput 2.85142K wps
[Epoch 140 Batch 30/1540] avg loss 0.000664795, throughput 2.90876K wps
[Epoch 140 Batch 60/1540] avg loss 0.000713518, throughput 2.87352K wps
[Epoch 140 Batch 90/1540] avg loss 0.000713694, throughput 2.83765K wps
[Epoch 140 Batch 120/1540] avg loss 0.000715024, throughput 2.87979K wps
[Epoch 140 Batch 150/1540] avg loss 0.000816981, throughput 2.8744K wps
[Epoch 140 Batch 180/1540] avg loss 0.000750843, throughput 2.8424K wps
[Epoch 140 Batch 210/1540] avg loss 0.000826886, throughput 2.8549K wps
[Epoch 140 Batch 240/1540] avg loss 0.000759291, throughput 2.82606K wps
[Epoch 140 Batch 270/1540] avg loss 0.000820452, throughput 2.81417K wps
[Epoch 140 Batch 300/1540] avg loss 0.000832028, throughput 2.87692K wps
[Epoch 140 Batch 330/1540] avg loss 0.000736142, throughput 2.88071K wps
[Epoch 140 Batch 360/1540] avg loss 0.000807243, throughput 2.88074K wps
[Epoch 140 Batch 390/1540] avg loss 0.000798799, throughput 2.81511K wps
[Epoch 140 Batch 420/1540] avg loss 0.000921937, throughput 2.79023K wps
[Epoch 140 Batch 450/1540] avg loss 0.000861634, throughput 2.83542K wps
[Epoch 140 Batch 480/1540] avg loss 0.000888874, throughput 2.83868K wps
[Epoch 140 Batch 510/1540] avg loss 0.000878255, throughput 2.87087K wps
[Epoch 140 Batch 540/1540] avg loss 0.00070987, throughput 2.87272K wps
[Epoch 140 Batch 570/1540] avg loss 0.000802284, throughput 2.87195K wps
[Epoch 140 Batch 600/1540] avg loss 0.000634352, throughput 2.86302K wps
[Epoch 140 Batch 630/1540] avg loss 0.000998922, throughput 2.79311K wps
[Epoch 140 Batch 660/1540] avg loss 0.000928301, throughput 2.80922K wps
[Epoch 140 Batch 690/1540] avg loss 0.000767314, throughput 2.86901K wps
[Epoch 140 Batch 720/1540] avg loss 0.00070209, throughput 2.87079K wps
[Epoch 140 Batch 750/1540] avg loss 0.000749719, throughput 2.85266K wps
[Epoch 140 Batch 780/1540] avg loss 0.000800189, throughput 2.85099K wps
[Epoch 140 Batch 810/1540] avg loss 0.00113057, throughput 2.86442K wps
[Epoch 140 Batch 840/1540] avg loss 0.000666168, throughput 2.85839K wps
[Epoch 140 Batch 870/1540] avg loss 0.000590488, throughput 2.848K wps
[Epoch 140 Batch 900/1540] avg loss 0.000935785, throughput 2.78489K wps
[Epoch 140 Batch 930/1540] avg loss 0.000769256, throughput 2.85417K wps
[Epoch 140 Batch 960/1540] avg loss 0.000760164, throughput 2.85974K wps
[Epoch 140 Batch 990/1540] avg loss 0.00090178, throughput 2.81969K wps
[Epoch 140 Batch 1020/1540] avg loss 0.000870255, throughput 2.87431K wps
[Epoch 140 Batch 1050/1540] avg loss 0.00109744, throughput 2.8524K wps
[Epoch 140 Batch 1080/1540] avg loss 0.000918925, throughput 2.86089K wps
[Epoch 140 Batch 1110/1540] avg loss 0.000830372, throughput 2.81735K wps
[Epoch 140 Batch 1140/1540] avg loss 0.000926513, throughput 2.86413K wps
[Epoch 140 Batch 1170/1540] avg loss 0.000580961, throughput 2.87003K wps
[Epoch 140 Batch 1200/1540] avg loss 0.000684794, throughput 2.85251K wps
[Epoch 140 Batch 1230/1540] avg loss 0.000998151, throughput 2.87993K wps
[Epoch 140 Batch 1260/1540] avg loss 0.00117088, throughput 2.86397K wps
[Epoch 140 Batch 1290/1540] avg loss 0.0010918, throughput 2.84387K wps
[Epoch 140 Batch 1320/1540] avg loss 0.00102847, throughput 2.85622K wps
[Epoch 140 Batch 1350/1540] avg loss 0.000733332, throughput 2.85992K wps
[Epoch 140 Batch 1380/1540] avg loss 0.000732904, throughput 2.86427K wps
[Epoch 140 Batch 1410/1540] avg loss 0.000748438, throughput 2.86349K wps
[Epoch 140 Batch 1440/1540] avg loss 0.000917335, throughput 2.87851K wps
[Epoch 140 Batch 1470/1540] avg loss 0.000969238, throughput 2.86027K wps
[Epoch 140 Batch 1500/1540] avg loss 0.000734663, throughput 2.8129K wps
[Epoch 140 Batch 1530/1540] avg loss 0.000940664, throughput 2.82973K wps
Begin Testing...
[Epoch 140] train avg loss 0.000831652, dev acc 0.7924, dev avg loss 0.895587, throughput 2.85162K wps
[Epoch 141 Batch 30/1540] avg loss 0.000662074, throughput 2.91465K wps
[Epoch 141 Batch 60/1540] avg loss 0.000708777, throughput 2.86406K wps
[Epoch 141 Batch 90/1540] avg loss 0.000675048, throughput 2.87138K wps
[Epoch 141 Batch 120/1540] avg loss 0.000767152, throughput 2.82392K wps
[Epoch 141 Batch 150/1540] avg loss 0.000785092, throughput 2.82973K wps
[Epoch 141 Batch 180/1540] avg loss 0.000684045, throughput 2.85681K wps
[Epoch 141 Batch 210/1540] avg loss 0.000536918, throughput 2.79689K wps
[Epoch 141 Batch 240/1540] avg loss 0.000759834, throughput 2.78866K wps
[Epoch 141 Batch 270/1540] avg loss 0.000666642, throughput 2.84326K wps
[Epoch 141 Batch 300/1540] avg loss 0.000973726, throughput 2.87474K wps
[Epoch 141 Batch 330/1540] avg loss 0.000744453, throughput 2.86441K wps
[Epoch 141 Batch 360/1540] avg loss 0.000867787, throughput 2.84092K wps
[Epoch 141 Batch 390/1540] avg loss 0.000669369, throughput 2.87205K wps
[Epoch 141 Batch 420/1540] avg loss 0.00074107, throughput 2.85119K wps
[Epoch 141 Batch 450/1540] avg loss 0.00073827, throughput 2.87258K wps
[Epoch 141 Batch 480/1540] avg loss 0.000705352, throughput 2.87366K wps
[Epoch 141 Batch 510/1540] avg loss 0.000804551, throughput 2.87563K wps
[Epoch 141 Batch 540/1540] avg loss 0.000836784, throughput 2.87683K wps
[Epoch 141 Batch 570/1540] avg loss 0.000965984, throughput 2.87543K wps
[Epoch 141 Batch 600/1540] avg loss 0.000602149, throughput 2.88269K wps
[Epoch 141 Batch 630/1540] avg loss 0.000518382, throughput 2.85917K wps
[Epoch 141 Batch 660/1540] avg loss 0.000749447, throughput 2.81823K wps
[Epoch 141 Batch 690/1540] avg loss 0.000673335, throughput 2.87911K wps
[Epoch 141 Batch 720/1540] avg loss 0.000949442, throughput 2.86789K wps
[Epoch 141 Batch 750/1540] avg loss 0.000963541, throughput 2.86843K wps
[Epoch 141 Batch 780/1540] avg loss 0.000948833, throughput 2.86431K wps
[Epoch 141 Batch 810/1540] avg loss 0.000708975, throughput 2.85738K wps
[Epoch 141 Batch 840/1540] avg loss 0.000753204, throughput 2.87819K wps
[Epoch 141 Batch 870/1540] avg loss 0.00108858, throughput 2.88443K wps
[Epoch 141 Batch 900/1540] avg loss 0.000992327, throughput 2.87614K wps
[Epoch 141 Batch 930/1540] avg loss 0.000831054, throughput 2.85551K wps
[Epoch 141 Batch 960/1540] avg loss 0.000833637, throughput 2.79662K wps
[Epoch 141 Batch 990/1540] avg loss 0.000973989, throughput 2.84511K wps
[Epoch 141 Batch 1020/1540] avg loss 0.000901892, throughput 2.83381K wps
[Epoch 141 Batch 1050/1540] avg loss 0.000705415, throughput 2.79772K wps
[Epoch 141 Batch 1080/1540] avg loss 0.000895086, throughput 2.84781K wps
[Epoch 141 Batch 1110/1540] avg loss 0.00099763, throughput 2.87763K wps
[Epoch 141 Batch 1140/1540] avg loss 0.000768886, throughput 2.82366K wps
[Epoch 141 Batch 1170/1540] avg loss 0.000919061, throughput 2.82418K wps
[Epoch 141 Batch 1200/1540] avg loss 0.000852168, throughput 2.86284K wps
[Epoch 141 Batch 1230/1540] avg loss 0.000885135, throughput 2.87324K wps
[Epoch 141 Batch 1260/1540] avg loss 0.00109078, throughput 2.83561K wps
[Epoch 141 Batch 1290/1540] avg loss 0.00100896, throughput 2.86857K wps
[Epoch 141 Batch 1320/1540] avg loss 0.0009509, throughput 2.85195K wps
[Epoch 141 Batch 1350/1540] avg loss 0.000781582, throughput 2.87701K wps
[Epoch 141 Batch 1380/1540] avg loss 0.000760721, throughput 2.84622K wps
[Epoch 141 Batch 1410/1540] avg loss 0.000876756, throughput 2.85048K wps
[Epoch 141 Batch 1440/1540] avg loss 0.000923634, throughput 2.84942K wps
[Epoch 141 Batch 1470/1540] avg loss 0.00094939, throughput 2.79265K wps
[Epoch 141 Batch 1500/1540] avg loss 0.000864569, throughput 2.8094K wps
[Epoch 141 Batch 1530/1540] avg loss 0.000949031, throughput 2.87677K wps
Begin Testing...
[Epoch 141] train avg loss 0.000827544, dev acc 0.7959, dev avg loss 0.899919, throughput 2.85282K wps
[Epoch 142 Batch 30/1540] avg loss 0.000763946, throughput 2.91759K wps
[Epoch 142 Batch 60/1540] avg loss 0.000643745, throughput 2.87129K wps
[Epoch 142 Batch 90/1540] avg loss 0.000657119, throughput 2.8781K wps
[Epoch 142 Batch 120/1540] avg loss 0.00100891, throughput 2.79672K wps
[Epoch 142 Batch 150/1540] avg loss 0.000851363, throughput 2.83291K wps
[Epoch 142 Batch 180/1540] avg loss 0.000774997, throughput 2.84336K wps
[Epoch 142 Batch 210/1540] avg loss 0.000788454, throughput 2.85024K wps
[Epoch 142 Batch 240/1540] avg loss 0.000837599, throughput 2.87738K wps
[Epoch 142 Batch 270/1540] avg loss 0.00105667, throughput 2.84971K wps
[Epoch 142 Batch 300/1540] avg loss 0.000638941, throughput 2.85794K wps
[Epoch 142 Batch 330/1540] avg loss 0.000559339, throughput 2.83733K wps
[Epoch 142 Batch 360/1540] avg loss 0.000752177, throughput 2.83155K wps
[Epoch 142 Batch 390/1540] avg loss 0.000883105, throughput 2.86333K wps
[Epoch 142 Batch 420/1540] avg loss 0.000940202, throughput 2.85876K wps
[Epoch 142 Batch 450/1540] avg loss 0.000940126, throughput 2.85082K wps
[Epoch 142 Batch 480/1540] avg loss 0.000798121, throughput 2.86214K wps
[Epoch 142 Batch 510/1540] avg loss 0.000682316, throughput 2.82719K wps
[Epoch 142 Batch 540/1540] avg loss 0.000817689, throughput 2.86794K wps
[Epoch 142 Batch 570/1540] avg loss 0.000612845, throughput 2.86952K wps
[Epoch 142 Batch 600/1540] avg loss 0.000681788, throughput 2.87405K wps
[Epoch 142 Batch 630/1540] avg loss 0.000834336, throughput 2.85009K wps
[Epoch 142 Batch 660/1540] avg loss 0.000759458, throughput 2.81253K wps
[Epoch 142 Batch 690/1540] avg loss 0.000763149, throughput 2.85803K wps
[Epoch 142 Batch 720/1540] avg loss 0.000815072, throughput 2.8643K wps
[Epoch 142 Batch 750/1540] avg loss 0.00100306, throughput 2.87259K wps
[Epoch 142 Batch 780/1540] avg loss 0.00105867, throughput 2.87514K wps
[Epoch 142 Batch 810/1540] avg loss 0.000743539, throughput 2.87737K wps
[Epoch 142 Batch 840/1540] avg loss 0.000741796, throughput 2.86888K wps
[Epoch 142 Batch 870/1540] avg loss 0.00075348, throughput 2.87934K wps
[Epoch 142 Batch 900/1540] avg loss 0.000810474, throughput 2.86708K wps
[Epoch 142 Batch 930/1540] avg loss 0.000713749, throughput 2.85305K wps
[Epoch 142 Batch 960/1540] avg loss 0.000896152, throughput 2.85292K wps
[Epoch 142 Batch 990/1540] avg loss 0.000904169, throughput 2.85661K wps
[Epoch 142 Batch 1020/1540] avg loss 0.000651159, throughput 2.8687K wps
[Epoch 142 Batch 1050/1540] avg loss 0.000631524, throughput 2.83688K wps
[Epoch 142 Batch 1080/1540] avg loss 0.000795114, throughput 2.81998K wps
[Epoch 142 Batch 1110/1540] avg loss 0.000839102, throughput 2.84167K wps
[Epoch 142 Batch 1140/1540] avg loss 0.000663269, throughput 2.78133K wps
[Epoch 142 Batch 1170/1540] avg loss 0.000959306, throughput 2.80164K wps
[Epoch 142 Batch 1200/1540] avg loss 0.000853703, throughput 2.87568K wps
[Epoch 142 Batch 1230/1540] avg loss 0.000894834, throughput 2.87321K wps
[Epoch 142 Batch 1260/1540] avg loss 0.000926929, throughput 2.84702K wps
[Epoch 142 Batch 1290/1540] avg loss 0.000831219, throughput 2.79752K wps
[Epoch 142 Batch 1320/1540] avg loss 0.000898842, throughput 2.86388K wps
[Epoch 142 Batch 1350/1540] avg loss 0.00103021, throughput 2.84078K wps
[Epoch 142 Batch 1380/1540] avg loss 0.000806543, throughput 2.83329K wps
[Epoch 142 Batch 1410/1540] avg loss 0.000851221, throughput 2.81577K wps
[Epoch 142 Batch 1440/1540] avg loss 0.000932179, throughput 2.80521K wps
[Epoch 142 Batch 1470/1540] avg loss 0.000801116, throughput 2.78685K wps
[Epoch 142 Batch 1500/1540] avg loss 0.000811863, throughput 2.86893K wps
[Epoch 142 Batch 1530/1540] avg loss 0.00101961, throughput 2.85817K wps
Begin Testing...
[Epoch 142] train avg loss 0.000816394, dev acc 0.8005, dev avg loss 0.890178, throughput 2.84934K wps
[Epoch 143 Batch 30/1540] avg loss 0.000823676, throughput 2.8606K wps
[Epoch 143 Batch 60/1540] avg loss 0.000676918, throughput 2.85906K wps
[Epoch 143 Batch 90/1540] avg loss 0.000679226, throughput 2.85972K wps
[Epoch 143 Batch 120/1540] avg loss 0.000645957, throughput 2.86412K wps
[Epoch 143 Batch 150/1540] avg loss 0.000601518, throughput 2.86935K wps
[Epoch 143 Batch 180/1540] avg loss 0.00078366, throughput 2.80231K wps
[Epoch 143 Batch 210/1540] avg loss 0.000848361, throughput 2.8777K wps
[Epoch 143 Batch 240/1540] avg loss 0.000689139, throughput 2.8761K wps
[Epoch 143 Batch 270/1540] avg loss 0.000737169, throughput 2.86203K wps
[Epoch 143 Batch 300/1540] avg loss 0.000904233, throughput 2.86804K wps
[Epoch 143 Batch 330/1540] avg loss 0.000694371, throughput 2.8687K wps
[Epoch 143 Batch 360/1540] avg loss 0.000647665, throughput 2.84754K wps
[Epoch 143 Batch 390/1540] avg loss 0.000920199, throughput 2.87638K wps
[Epoch 143 Batch 420/1540] avg loss 0.000890904, throughput 2.84809K wps
[Epoch 143 Batch 450/1540] avg loss 0.000822022, throughput 2.82705K wps
[Epoch 143 Batch 480/1540] avg loss 0.000763184, throughput 2.82845K wps
[Epoch 143 Batch 510/1540] avg loss 0.000805405, throughput 2.8396K wps
[Epoch 143 Batch 540/1540] avg loss 0.000956755, throughput 2.79653K wps
[Epoch 143 Batch 570/1540] avg loss 0.000698979, throughput 2.87164K wps
[Epoch 143 Batch 600/1540] avg loss 0.000810329, throughput 2.86171K wps
[Epoch 143 Batch 630/1540] avg loss 0.000730024, throughput 2.84335K wps
[Epoch 143 Batch 660/1540] avg loss 0.000765177, throughput 2.80259K wps
[Epoch 143 Batch 690/1540] avg loss 0.00059444, throughput 2.84556K wps
[Epoch 143 Batch 720/1540] avg loss 0.000788173, throughput 2.82148K wps
[Epoch 143 Batch 750/1540] avg loss 0.000751486, throughput 2.85148K wps
[Epoch 143 Batch 780/1540] avg loss 0.000936644, throughput 2.87259K wps
[Epoch 143 Batch 810/1540] avg loss 0.000788707, throughput 2.88343K wps
[Epoch 143 Batch 840/1540] avg loss 0.00112241, throughput 2.86171K wps
[Epoch 143 Batch 870/1540] avg loss 0.000853053, throughput 2.88062K wps
[Epoch 143 Batch 900/1540] avg loss 0.000800397, throughput 2.83903K wps
[Epoch 143 Batch 930/1540] avg loss 0.000804696, throughput 2.82828K wps
[Epoch 143 Batch 960/1540] avg loss 0.000894967, throughput 2.84244K wps
[Epoch 143 Batch 990/1540] avg loss 0.000928554, throughput 2.83336K wps
[Epoch 143 Batch 1020/1540] avg loss 0.000738307, throughput 2.87022K wps
[Epoch 143 Batch 1050/1540] avg loss 0.000844418, throughput 2.8376K wps
[Epoch 143 Batch 1080/1540] avg loss 0.000769133, throughput 2.8396K wps
[Epoch 143 Batch 1110/1540] avg loss 0.000844766, throughput 2.85247K wps
[Epoch 143 Batch 1140/1540] avg loss 0.000966319, throughput 2.86135K wps
[Epoch 143 Batch 1170/1540] avg loss 0.00102733, throughput 2.86626K wps
[Epoch 143 Batch 1200/1540] avg loss 0.000987793, throughput 2.86746K wps
[Epoch 143 Batch 1230/1540] avg loss 0.000921545, throughput 2.86982K wps
[Epoch 143 Batch 1260/1540] avg loss 0.000801353, throughput 2.87491K wps
[Epoch 143 Batch 1290/1540] avg loss 0.000907921, throughput 2.8707K wps
[Epoch 143 Batch 1320/1540] avg loss 0.000796329, throughput 2.85941K wps
[Epoch 143 Batch 1350/1540] avg loss 0.000771827, throughput 2.87388K wps
[Epoch 143 Batch 1380/1540] avg loss 0.000781789, throughput 2.87569K wps
[Epoch 143 Batch 1410/1540] avg loss 0.000916652, throughput 2.88313K wps
[Epoch 143 Batch 1440/1540] avg loss 0.00100326, throughput 2.88038K wps
[Epoch 143 Batch 1470/1540] avg loss 0.000795599, throughput 2.8838K wps
[Epoch 143 Batch 1500/1540] avg loss 0.000831089, throughput 2.87382K wps
[Epoch 143 Batch 1530/1540] avg loss 0.000880236, throughput 2.86805K wps
Begin Testing...
[Epoch 143] train avg loss 0.000819714, dev acc 0.7993, dev avg loss 0.887159, throughput 2.85636K wps
[Epoch 144 Batch 30/1540] avg loss 0.000744158, throughput 2.93366K wps
[Epoch 144 Batch 60/1540] avg loss 0.000825238, throughput 2.88333K wps
[Epoch 144 Batch 90/1540] avg loss 0.000496986, throughput 2.87804K wps
[Epoch 144 Batch 120/1540] avg loss 0.000689972, throughput 2.8815K wps
[Epoch 144 Batch 150/1540] avg loss 0.00079559, throughput 2.86294K wps
[Epoch 144 Batch 180/1540] avg loss 0.0008374, throughput 2.86924K wps
[Epoch 144 Batch 210/1540] avg loss 0.000865418, throughput 2.84995K wps
[Epoch 144 Batch 240/1540] avg loss 0.000861227, throughput 2.88339K wps
[Epoch 144 Batch 270/1540] avg loss 0.000855592, throughput 2.84253K wps
[Epoch 144 Batch 300/1540] avg loss 0.000868566, throughput 2.85621K wps
[Epoch 144 Batch 330/1540] avg loss 0.000853784, throughput 2.83921K wps
[Epoch 144 Batch 360/1540] avg loss 0.000796431, throughput 2.83392K wps
[Epoch 144 Batch 390/1540] avg loss 0.000602413, throughput 2.87148K wps
[Epoch 144 Batch 420/1540] avg loss 0.000568458, throughput 2.84183K wps
[Epoch 144 Batch 450/1540] avg loss 0.000822962, throughput 2.86594K wps
[Epoch 144 Batch 480/1540] avg loss 0.00092733, throughput 2.8496K wps
[Epoch 144 Batch 510/1540] avg loss 0.000757512, throughput 2.78952K wps
[Epoch 144 Batch 540/1540] avg loss 0.000802959, throughput 2.81572K wps
[Epoch 144 Batch 570/1540] avg loss 0.000908553, throughput 2.86716K wps
[Epoch 144 Batch 600/1540] avg loss 0.000629054, throughput 2.84814K wps
[Epoch 144 Batch 630/1540] avg loss 0.000687134, throughput 2.86462K wps
[Epoch 144 Batch 660/1540] avg loss 0.000721844, throughput 2.85368K wps
[Epoch 144 Batch 690/1540] avg loss 0.000679223, throughput 2.86711K wps
[Epoch 144 Batch 720/1540] avg loss 0.000777099, throughput 2.87038K wps
[Epoch 144 Batch 750/1540] avg loss 0.00058051, throughput 2.85759K wps
[Epoch 144 Batch 780/1540] avg loss 0.000851802, throughput 2.85909K wps
[Epoch 144 Batch 810/1540] avg loss 0.000730976, throughput 2.85815K wps
[Epoch 144 Batch 840/1540] avg loss 0.000656789, throughput 2.87071K wps
[Epoch 144 Batch 870/1540] avg loss 0.00071906, throughput 2.81155K wps
[Epoch 144 Batch 900/1540] avg loss 0.000836594, throughput 2.88196K wps
[Epoch 144 Batch 930/1540] avg loss 0.000755069, throughput 2.88166K wps
[Epoch 144 Batch 960/1540] avg loss 0.000690257, throughput 2.79865K wps
[Epoch 144 Batch 990/1540] avg loss 0.000864223, throughput 2.84288K wps
[Epoch 144 Batch 1020/1540] avg loss 0.00089731, throughput 2.86704K wps
[Epoch 144 Batch 1050/1540] avg loss 0.000866731, throughput 2.8525K wps
[Epoch 144 Batch 1080/1540] avg loss 0.000754399, throughput 2.82661K wps
[Epoch 144 Batch 1110/1540] avg loss 0.00084159, throughput 2.86477K wps
[Epoch 144 Batch 1140/1540] avg loss 0.000809359, throughput 2.87803K wps
[Epoch 144 Batch 1170/1540] avg loss 0.000676908, throughput 2.86453K wps
[Epoch 144 Batch 1200/1540] avg loss 0.000940406, throughput 2.8545K wps
[Epoch 144 Batch 1230/1540] avg loss 0.000656162, throughput 2.85736K wps
[Epoch 144 Batch 1260/1540] avg loss 0.000727187, throughput 2.85181K wps
[Epoch 144 Batch 1290/1540] avg loss 0.000983934, throughput 2.86453K wps
[Epoch 144 Batch 1320/1540] avg loss 0.000789986, throughput 2.83359K wps
[Epoch 144 Batch 1350/1540] avg loss 0.000705856, throughput 2.86057K wps
[Epoch 144 Batch 1380/1540] avg loss 0.00102824, throughput 2.86492K wps
[Epoch 144 Batch 1410/1540] avg loss 0.000943546, throughput 2.8812K wps
[Epoch 144 Batch 1440/1540] avg loss 0.000615274, throughput 2.87693K wps
[Epoch 144 Batch 1470/1540] avg loss 0.000921251, throughput 2.8285K wps
[Epoch 144 Batch 1500/1540] avg loss 0.000842741, throughput 2.8846K wps
[Epoch 144 Batch 1530/1540] avg loss 0.000705814, throughput 2.8771K wps
Begin Testing...
[Epoch 144] train avg loss 0.000781251, dev acc 0.7901, dev avg loss 0.888106, throughput 2.8582K wps
[Epoch 145 Batch 30/1540] avg loss 0.000781571, throughput 2.93398K wps
[Epoch 145 Batch 60/1540] avg loss 0.000621427, throughput 2.88295K wps
[Epoch 145 Batch 90/1540] avg loss 0.000806835, throughput 2.88286K wps
[Epoch 145 Batch 120/1540] avg loss 0.000707481, throughput 2.86011K wps
[Epoch 145 Batch 150/1540] avg loss 0.000803775, throughput 2.87593K wps
[Epoch 145 Batch 180/1540] avg loss 0.00100969, throughput 2.88176K wps
[Epoch 145 Batch 210/1540] avg loss 0.000784326, throughput 2.78448K wps
[Epoch 145 Batch 240/1540] avg loss 0.000837677, throughput 2.86806K wps
[Epoch 145 Batch 270/1540] avg loss 0.000749164, throughput 2.84047K wps
[Epoch 145 Batch 300/1540] avg loss 0.000834169, throughput 2.88119K wps
[Epoch 145 Batch 330/1540] avg loss 0.000567508, throughput 2.87889K wps
[Epoch 145 Batch 360/1540] avg loss 0.000681824, throughput 2.88059K wps
[Epoch 145 Batch 390/1540] avg loss 0.000573111, throughput 2.87855K wps
[Epoch 145 Batch 420/1540] avg loss 0.00064533, throughput 2.83162K wps
[Epoch 145 Batch 450/1540] avg loss 0.000789675, throughput 2.80497K wps
[Epoch 145 Batch 480/1540] avg loss 0.000857176, throughput 2.80344K wps
[Epoch 145 Batch 510/1540] avg loss 0.000835829, throughput 2.81545K wps
[Epoch 145 Batch 540/1540] avg loss 0.000830613, throughput 2.88433K wps
[Epoch 145 Batch 570/1540] avg loss 0.000717523, throughput 2.87529K wps
[Epoch 145 Batch 600/1540] avg loss 0.000746269, throughput 2.83764K wps
[Epoch 145 Batch 630/1540] avg loss 0.000788421, throughput 2.85191K wps
[Epoch 145 Batch 660/1540] avg loss 0.000843911, throughput 2.82183K wps
[Epoch 145 Batch 690/1540] avg loss 0.000932414, throughput 2.84961K wps
[Epoch 145 Batch 720/1540] avg loss 0.000788571, throughput 2.86707K wps
[Epoch 145 Batch 750/1540] avg loss 0.000794886, throughput 2.853K wps
[Epoch 145 Batch 780/1540] avg loss 0.000703003, throughput 2.83456K wps
[Epoch 145 Batch 810/1540] avg loss 0.000707872, throughput 2.87747K wps
[Epoch 145 Batch 840/1540] avg loss 0.00080554, throughput 2.86322K wps
[Epoch 145 Batch 870/1540] avg loss 0.000871628, throughput 2.87827K wps
[Epoch 145 Batch 900/1540] avg loss 0.000944114, throughput 2.87525K wps
[Epoch 145 Batch 930/1540] avg loss 0.00090691, throughput 2.87873K wps
[Epoch 145 Batch 960/1540] avg loss 0.000669073, throughput 2.87593K wps
[Epoch 145 Batch 990/1540] avg loss 0.000947447, throughput 2.85982K wps
[Epoch 145 Batch 1020/1540] avg loss 0.00104922, throughput 2.84844K wps
[Epoch 145 Batch 1050/1540] avg loss 0.000881888, throughput 2.85875K wps
[Epoch 145 Batch 1080/1540] avg loss 0.000730754, throughput 2.87265K wps
[Epoch 145 Batch 1110/1540] avg loss 0.000973892, throughput 2.86541K wps
[Epoch 145 Batch 1140/1540] avg loss 0.000788111, throughput 2.87059K wps
[Epoch 145 Batch 1170/1540] avg loss 0.000868503, throughput 2.86976K wps
[Epoch 145 Batch 1200/1540] avg loss 0.000909836, throughput 2.79388K wps
[Epoch 145 Batch 1230/1540] avg loss 0.000892977, throughput 2.82376K wps
[Epoch 145 Batch 1260/1540] avg loss 0.00089217, throughput 2.84799K wps
[Epoch 145 Batch 1290/1540] avg loss 0.000939663, throughput 2.84386K wps
[Epoch 145 Batch 1320/1540] avg loss 0.000870367, throughput 2.82005K wps
[Epoch 145 Batch 1350/1540] avg loss 0.000827899, throughput 2.86911K wps
[Epoch 145 Batch 1380/1540] avg loss 0.000825537, throughput 2.87563K wps
[Epoch 145 Batch 1410/1540] avg loss 0.000910056, throughput 2.88229K wps
[Epoch 145 Batch 1440/1540] avg loss 0.000791103, throughput 2.874K wps
[Epoch 145 Batch 1470/1540] avg loss 0.000892427, throughput 2.87574K wps
[Epoch 145 Batch 1500/1540] avg loss 0.000953743, throughput 2.86835K wps
[Epoch 145 Batch 1530/1540] avg loss 0.000770237, throughput 2.86542K wps
Begin Testing...
[Epoch 145] train avg loss 0.000818072, dev acc 0.7924, dev avg loss 0.913136, throughput 2.85847K wps
[Epoch 146 Batch 30/1540] avg loss 0.000449928, throughput 2.93489K wps
[Epoch 146 Batch 60/1540] avg loss 0.000929609, throughput 2.86912K wps
[Epoch 146 Batch 90/1540] avg loss 0.000970297, throughput 2.84052K wps
[Epoch 146 Batch 120/1540] avg loss 0.000643419, throughput 2.80311K wps
[Epoch 146 Batch 150/1540] avg loss 0.000844969, throughput 2.87558K wps
[Epoch 146 Batch 180/1540] avg loss 0.000724839, throughput 2.83498K wps
[Epoch 146 Batch 210/1540] avg loss 0.000940596, throughput 2.88423K wps
[Epoch 146 Batch 240/1540] avg loss 0.000659932, throughput 2.88067K wps
[Epoch 146 Batch 270/1540] avg loss 0.000597107, throughput 2.88267K wps
[Epoch 146 Batch 300/1540] avg loss 0.000588653, throughput 2.88165K wps
[Epoch 146 Batch 330/1540] avg loss 0.000649657, throughput 2.88059K wps
[Epoch 146 Batch 360/1540] avg loss 0.000644067, throughput 2.87882K wps
[Epoch 146 Batch 390/1540] avg loss 0.000866332, throughput 2.88065K wps
[Epoch 146 Batch 420/1540] avg loss 0.000891519, throughput 2.87635K wps
[Epoch 146 Batch 450/1540] avg loss 0.000919996, throughput 2.86217K wps
[Epoch 146 Batch 480/1540] avg loss 0.000881663, throughput 2.87952K wps
[Epoch 146 Batch 510/1540] avg loss 0.000626861, throughput 2.87354K wps
[Epoch 146 Batch 540/1540] avg loss 0.000870926, throughput 2.81769K wps
[Epoch 146 Batch 570/1540] avg loss 0.000829362, throughput 2.87428K wps
[Epoch 146 Batch 600/1540] avg loss 0.000746643, throughput 2.87395K wps
[Epoch 146 Batch 630/1540] avg loss 0.000814823, throughput 2.87605K wps
[Epoch 146 Batch 660/1540] avg loss 0.00077266, throughput 2.87401K wps
[Epoch 146 Batch 690/1540] avg loss 0.000766326, throughput 2.79686K wps
[Epoch 146 Batch 720/1540] avg loss 0.000814968, throughput 2.83801K wps
[Epoch 146 Batch 750/1540] avg loss 0.000756217, throughput 2.86674K wps
[Epoch 146 Batch 780/1540] avg loss 0.000629894, throughput 2.87327K wps
[Epoch 146 Batch 810/1540] avg loss 0.000974117, throughput 2.87725K wps
[Epoch 146 Batch 840/1540] avg loss 0.00092282, throughput 2.8683K wps
[Epoch 146 Batch 870/1540] avg loss 0.000736182, throughput 2.81816K wps
[Epoch 146 Batch 900/1540] avg loss 0.000646448, throughput 2.8705K wps
[Epoch 146 Batch 930/1540] avg loss 0.00079244, throughput 2.82956K wps
[Epoch 146 Batch 960/1540] avg loss 0.000810786, throughput 2.85723K wps
[Epoch 146 Batch 990/1540] avg loss 0.000819348, throughput 2.86228K wps
[Epoch 146 Batch 1020/1540] avg loss 0.000891282, throughput 2.86557K wps
[Epoch 146 Batch 1050/1540] avg loss 0.000853332, throughput 2.82141K wps
[Epoch 146 Batch 1080/1540] avg loss 0.000669942, throughput 2.87633K wps
[Epoch 146 Batch 1110/1540] avg loss 0.000858565, throughput 2.87603K wps
[Epoch 146 Batch 1140/1540] avg loss 0.00088401, throughput 2.87254K wps
[Epoch 146 Batch 1170/1540] avg loss 0.000611903, throughput 2.87302K wps
[Epoch 146 Batch 1200/1540] avg loss 0.00104819, throughput 2.86105K wps
[Epoch 146 Batch 1230/1540] avg loss 0.000819243, throughput 2.86938K wps
[Epoch 146 Batch 1260/1540] avg loss 0.00090551, throughput 2.82834K wps
[Epoch 146 Batch 1290/1540] avg loss 0.000774748, throughput 2.86041K wps
[Epoch 146 Batch 1320/1540] avg loss 0.000708128, throughput 2.86394K wps
[Epoch 146 Batch 1350/1540] avg loss 0.000783311, throughput 2.84441K wps
[Epoch 146 Batch 1380/1540] avg loss 0.000893346, throughput 2.86359K wps
[Epoch 146 Batch 1410/1540] avg loss 0.000722864, throughput 2.81577K wps
[Epoch 146 Batch 1440/1540] avg loss 0.000823093, throughput 2.84128K wps
[Epoch 146 Batch 1470/1540] avg loss 0.000986506, throughput 2.83123K wps
[Epoch 146 Batch 1500/1540] avg loss 0.00081077, throughput 2.86411K wps
[Epoch 146 Batch 1530/1540] avg loss 0.000599282, throughput 2.85178K wps
Begin Testing...
[Epoch 146] train avg loss 0.000788664, dev acc 0.7982, dev avg loss 0.907251, throughput 2.86009K wps
[Epoch 147 Batch 30/1540] avg loss 0.000820453, throughput 2.85435K wps
[Epoch 147 Batch 60/1540] avg loss 0.000852828, throughput 2.81865K wps
[Epoch 147 Batch 90/1540] avg loss 0.000610324, throughput 2.87646K wps
[Epoch 147 Batch 120/1540] avg loss 0.000873594, throughput 2.86896K wps
[Epoch 147 Batch 150/1540] avg loss 0.00071648, throughput 2.86345K wps
[Epoch 147 Batch 180/1540] avg loss 0.000714241, throughput 2.86357K wps
[Epoch 147 Batch 210/1540] avg loss 0.000793638, throughput 2.87089K wps
[Epoch 147 Batch 240/1540] avg loss 0.000871552, throughput 2.87003K wps
[Epoch 147 Batch 270/1540] avg loss 0.000984905, throughput 2.87436K wps
[Epoch 147 Batch 300/1540] avg loss 0.000837057, throughput 2.8651K wps
[Epoch 147 Batch 330/1540] avg loss 0.000620084, throughput 2.85528K wps
[Epoch 147 Batch 360/1540] avg loss 0.000739193, throughput 2.82365K wps
[Epoch 147 Batch 390/1540] avg loss 0.000782069, throughput 2.86743K wps
[Epoch 147 Batch 420/1540] avg loss 0.000820819, throughput 2.85683K wps
[Epoch 147 Batch 450/1540] avg loss 0.000831335, throughput 2.80853K wps
[Epoch 147 Batch 480/1540] avg loss 0.000750743, throughput 2.87219K wps
[Epoch 147 Batch 510/1540] avg loss 0.000544641, throughput 2.86227K wps
[Epoch 147 Batch 540/1540] avg loss 0.000782274, throughput 2.87515K wps
[Epoch 147 Batch 570/1540] avg loss 0.000710512, throughput 2.86741K wps
[Epoch 147 Batch 600/1540] avg loss 0.000767325, throughput 2.88334K wps
[Epoch 147 Batch 630/1540] avg loss 0.000963875, throughput 2.8723K wps
[Epoch 147 Batch 660/1540] avg loss 0.000708209, throughput 2.87361K wps
[Epoch 147 Batch 690/1540] avg loss 0.000734708, throughput 2.81783K wps
[Epoch 147 Batch 720/1540] avg loss 0.000952119, throughput 2.8661K wps
[Epoch 147 Batch 750/1540] avg loss 0.000705322, throughput 2.86783K wps
[Epoch 147 Batch 780/1540] avg loss 0.000467196, throughput 2.85037K wps
[Epoch 147 Batch 810/1540] avg loss 0.00090996, throughput 2.77984K wps
[Epoch 147 Batch 840/1540] avg loss 0.000684642, throughput 2.84686K wps
[Epoch 147 Batch 870/1540] avg loss 0.000839457, throughput 2.87112K wps
[Epoch 147 Batch 900/1540] avg loss 0.00072236, throughput 2.86476K wps
[Epoch 147 Batch 930/1540] avg loss 0.000983098, throughput 2.84011K wps
[Epoch 147 Batch 960/1540] avg loss 0.000853827, throughput 2.86743K wps
[Epoch 147 Batch 990/1540] avg loss 0.000759496, throughput 2.8197K wps
[Epoch 147 Batch 1020/1540] avg loss 0.000616446, throughput 2.8744K wps
[Epoch 147 Batch 1050/1540] avg loss 0.000750191, throughput 2.86466K wps
[Epoch 147 Batch 1080/1540] avg loss 0.000664651, throughput 2.87965K wps
[Epoch 147 Batch 1110/1540] avg loss 0.000809601, throughput 2.87478K wps
[Epoch 147 Batch 1140/1540] avg loss 0.000700799, throughput 2.82916K wps
[Epoch 147 Batch 1170/1540] avg loss 0.000829963, throughput 2.86143K wps
[Epoch 147 Batch 1200/1540] avg loss 0.000943179, throughput 2.88476K wps
[Epoch 147 Batch 1230/1540] avg loss 0.000800182, throughput 2.87794K wps
[Epoch 147 Batch 1260/1540] avg loss 0.000621975, throughput 2.87932K wps
[Epoch 147 Batch 1290/1540] avg loss 0.000808955, throughput 2.87192K wps
[Epoch 147 Batch 1320/1540] avg loss 0.000654316, throughput 2.86724K wps
[Epoch 147 Batch 1350/1540] avg loss 0.000955108, throughput 2.85963K wps
[Epoch 147 Batch 1380/1540] avg loss 0.000785624, throughput 2.85589K wps
[Epoch 147 Batch 1410/1540] avg loss 0.000715777, throughput 2.86908K wps
[Epoch 147 Batch 1440/1540] avg loss 0.000733748, throughput 2.85419K wps
[Epoch 147 Batch 1470/1540] avg loss 0.000775074, throughput 2.86425K wps
[Epoch 147 Batch 1500/1540] avg loss 0.00080022, throughput 2.88086K wps
[Epoch 147 Batch 1530/1540] avg loss 0.000883721, throughput 2.87004K wps
Begin Testing...
[Epoch 147] train avg loss 0.000777572, dev acc 0.7982, dev avg loss 0.894339, throughput 2.85963K wps
[Epoch 148 Batch 30/1540] avg loss 0.000666184, throughput 2.93137K wps
[Epoch 148 Batch 60/1540] avg loss 0.000648367, throughput 2.84948K wps
[Epoch 148 Batch 90/1540] avg loss 0.000797255, throughput 2.82371K wps
[Epoch 148 Batch 120/1540] avg loss 0.000634495, throughput 2.86336K wps
[Epoch 148 Batch 150/1540] avg loss 0.000790517, throughput 2.87104K wps
[Epoch 148 Batch 180/1540] avg loss 0.000704568, throughput 2.88302K wps
[Epoch 148 Batch 210/1540] avg loss 0.000549, throughput 2.87879K wps
[Epoch 148 Batch 240/1540] avg loss 0.000811753, throughput 2.86014K wps
[Epoch 148 Batch 270/1540] avg loss 0.000710518, throughput 2.84802K wps
[Epoch 148 Batch 300/1540] avg loss 0.000664586, throughput 2.87956K wps
[Epoch 148 Batch 330/1540] avg loss 0.000681033, throughput 2.87573K wps
[Epoch 148 Batch 360/1540] avg loss 0.000695834, throughput 2.87964K wps
[Epoch 148 Batch 390/1540] avg loss 0.000685916, throughput 2.84263K wps
[Epoch 148 Batch 420/1540] avg loss 0.000611342, throughput 2.85947K wps
[Epoch 148 Batch 450/1540] avg loss 0.000727975, throughput 2.86358K wps
[Epoch 148 Batch 480/1540] avg loss 0.000835556, throughput 2.86704K wps
[Epoch 148 Batch 510/1540] avg loss 0.000824695, throughput 2.87591K wps
[Epoch 148 Batch 540/1540] avg loss 0.00092343, throughput 2.85907K wps
[Epoch 148 Batch 570/1540] avg loss 0.000790353, throughput 2.86279K wps
[Epoch 148 Batch 600/1540] avg loss 0.000843095, throughput 2.8576K wps
[Epoch 148 Batch 630/1540] avg loss 0.000779115, throughput 2.80271K wps
[Epoch 148 Batch 660/1540] avg loss 0.000604447, throughput 2.80295K wps
[Epoch 148 Batch 690/1540] avg loss 0.00078712, throughput 2.82308K wps
[Epoch 148 Batch 720/1540] avg loss 0.000728493, throughput 2.8407K wps
[Epoch 148 Batch 750/1540] avg loss 0.000874389, throughput 2.87855K wps
[Epoch 148 Batch 780/1540] avg loss 0.0007498, throughput 2.88175K wps
[Epoch 148 Batch 810/1540] avg loss 0.000695465, throughput 2.83633K wps
[Epoch 148 Batch 840/1540] avg loss 0.000797041, throughput 2.87924K wps
[Epoch 148 Batch 870/1540] avg loss 0.000762957, throughput 2.87867K wps
[Epoch 148 Batch 900/1540] avg loss 0.000600536, throughput 2.86463K wps
[Epoch 148 Batch 930/1540] avg loss 0.000764005, throughput 2.86067K wps
[Epoch 148 Batch 960/1540] avg loss 0.000949788, throughput 2.84804K wps
[Epoch 148 Batch 990/1540] avg loss 0.00095037, throughput 2.87989K wps
[Epoch 148 Batch 1020/1540] avg loss 0.000922258, throughput 2.87387K wps
[Epoch 148 Batch 1050/1540] avg loss 0.000666804, throughput 2.87912K wps
[Epoch 148 Batch 1080/1540] avg loss 0.00117496, throughput 2.87439K wps
[Epoch 148 Batch 1110/1540] avg loss 0.000945736, throughput 2.87111K wps
[Epoch 148 Batch 1140/1540] avg loss 0.00097394, throughput 2.86801K wps
[Epoch 148 Batch 1170/1540] avg loss 0.000829765, throughput 2.85671K wps
[Epoch 148 Batch 1200/1540] avg loss 0.00073757, throughput 2.86549K wps
[Epoch 148 Batch 1230/1540] avg loss 0.00069551, throughput 2.88237K wps
[Epoch 148 Batch 1260/1540] avg loss 0.000656446, throughput 2.81725K wps
[Epoch 148 Batch 1290/1540] avg loss 0.000827554, throughput 2.87885K wps
[Epoch 148 Batch 1320/1540] avg loss 0.000726994, throughput 2.88603K wps
[Epoch 148 Batch 1350/1540] avg loss 0.000863107, throughput 2.87424K wps
[Epoch 148 Batch 1380/1540] avg loss 0.00123623, throughput 2.82722K wps
[Epoch 148 Batch 1410/1540] avg loss 0.000685941, throughput 2.86578K wps
[Epoch 148 Batch 1440/1540] avg loss 0.00101126, throughput 2.79949K wps
[Epoch 148 Batch 1470/1540] avg loss 0.000975661, throughput 2.86345K wps
[Epoch 148 Batch 1500/1540] avg loss 0.000909907, throughput 2.80967K wps
[Epoch 148 Batch 1530/1540] avg loss 0.000594406, throughput 2.84937K wps
Begin Testing...
[Epoch 148] train avg loss 0.000786848, dev acc 0.7913, dev avg loss 0.915772, throughput 2.85921K wps
[Epoch 149 Batch 30/1540] avg loss 0.000750822, throughput 2.85541K wps
[Epoch 149 Batch 60/1540] avg loss 0.000511401, throughput 2.86014K wps
[Epoch 149 Batch 90/1540] avg loss 0.000597729, throughput 2.80417K wps
[Epoch 149 Batch 120/1540] avg loss 0.000981305, throughput 2.85747K wps
[Epoch 149 Batch 150/1540] avg loss 0.000749485, throughput 2.88268K wps
[Epoch 149 Batch 180/1540] avg loss 0.000754139, throughput 2.8734K wps
[Epoch 149 Batch 210/1540] avg loss 0.000834829, throughput 2.83338K wps
[Epoch 149 Batch 240/1540] avg loss 0.000848124, throughput 2.8396K wps
[Epoch 149 Batch 270/1540] avg loss 0.000983982, throughput 2.87439K wps
[Epoch 149 Batch 300/1540] avg loss 0.000788289, throughput 2.84318K wps
[Epoch 149 Batch 330/1540] avg loss 0.000750436, throughput 2.86542K wps
[Epoch 149 Batch 360/1540] avg loss 0.000730546, throughput 2.88118K wps
[Epoch 149 Batch 390/1540] avg loss 0.000765499, throughput 2.87726K wps
[Epoch 149 Batch 420/1540] avg loss 0.000682724, throughput 2.88399K wps
[Epoch 149 Batch 450/1540] avg loss 0.000792867, throughput 2.87926K wps
[Epoch 149 Batch 480/1540] avg loss 0.000788382, throughput 2.86887K wps
[Epoch 149 Batch 510/1540] avg loss 0.000877526, throughput 2.8738K wps
[Epoch 149 Batch 540/1540] avg loss 0.00071176, throughput 2.85977K wps
[Epoch 149 Batch 570/1540] avg loss 0.000776173, throughput 2.8701K wps
[Epoch 149 Batch 600/1540] avg loss 0.00103223, throughput 2.87969K wps
[Epoch 149 Batch 630/1540] avg loss 0.000782608, throughput 2.87164K wps
[Epoch 149 Batch 660/1540] avg loss 0.000974432, throughput 2.86153K wps
[Epoch 149 Batch 690/1540] avg loss 0.000861827, throughput 2.87924K wps
[Epoch 149 Batch 720/1540] avg loss 0.000827032, throughput 2.87962K wps
[Epoch 149 Batch 750/1540] avg loss 0.0010175, throughput 2.88007K wps
[Epoch 149 Batch 780/1540] avg loss 0.000693223, throughput 2.81649K wps
[Epoch 149 Batch 810/1540] avg loss 0.000644661, throughput 2.81739K wps
[Epoch 149 Batch 840/1540] avg loss 0.000742121, throughput 2.82069K wps
[Epoch 149 Batch 870/1540] avg loss 0.000788184, throughput 2.81451K wps
[Epoch 149 Batch 900/1540] avg loss 0.000561508, throughput 2.84763K wps
[Epoch 149 Batch 930/1540] avg loss 0.000658874, throughput 2.83713K wps
[Epoch 149 Batch 960/1540] avg loss 0.000893893, throughput 2.85321K wps
[Epoch 149 Batch 990/1540] avg loss 0.000802134, throughput 2.86095K wps
[Epoch 149 Batch 1020/1540] avg loss 0.000803897, throughput 2.86875K wps
[Epoch 149 Batch 1050/1540] avg loss 0.000926478, throughput 2.86327K wps
[Epoch 149 Batch 1080/1540] avg loss 0.000868051, throughput 2.87338K wps
[Epoch 149 Batch 1110/1540] avg loss 0.00062859, throughput 2.86029K wps
[Epoch 149 Batch 1140/1540] avg loss 0.000806097, throughput 2.87144K wps
[Epoch 149 Batch 1170/1540] avg loss 0.000529654, throughput 2.87577K wps
[Epoch 149 Batch 1200/1540] avg loss 0.000691292, throughput 2.87018K wps
[Epoch 149 Batch 1230/1540] avg loss 0.000867323, throughput 2.85116K wps
[Epoch 149 Batch 1260/1540] avg loss 0.000940928, throughput 2.88214K wps
[Epoch 149 Batch 1290/1540] avg loss 0.000760818, throughput 2.87274K wps
[Epoch 149 Batch 1320/1540] avg loss 0.000866738, throughput 2.85905K wps
[Epoch 149 Batch 1350/1540] avg loss 0.000610239, throughput 2.8726K wps
[Epoch 149 Batch 1380/1540] avg loss 0.000973457, throughput 2.88048K wps
[Epoch 149 Batch 1410/1540] avg loss 0.000860994, throughput 2.87158K wps
[Epoch 149 Batch 1440/1540] avg loss 0.000661651, throughput 2.79816K wps
[Epoch 149 Batch 1470/1540] avg loss 0.00073005, throughput 2.87634K wps
[Epoch 149 Batch 1500/1540] avg loss 0.000806261, throughput 2.87424K wps
[Epoch 149 Batch 1530/1540] avg loss 0.00107767, throughput 2.88006K wps
Begin Testing...
[Epoch 149] train avg loss 0.000795971, dev acc 0.7936, dev avg loss 0.96852, throughput 2.86086K wps
[Epoch 150 Batch 30/1540] avg loss 0.000761548, throughput 2.92604K wps
[Epoch 150 Batch 60/1540] avg loss 0.000788334, throughput 2.81008K wps
[Epoch 150 Batch 90/1540] avg loss 0.00080043, throughput 2.87166K wps
[Epoch 150 Batch 120/1540] avg loss 0.000868468, throughput 2.878K wps
[Epoch 150 Batch 150/1540] avg loss 0.000699661, throughput 2.87089K wps
[Epoch 150 Batch 180/1540] avg loss 0.000694176, throughput 2.86304K wps
[Epoch 150 Batch 210/1540] avg loss 0.000644861, throughput 2.83435K wps
[Epoch 150 Batch 240/1540] avg loss 0.000625969, throughput 2.85509K wps
[Epoch 150 Batch 270/1540] avg loss 0.000696401, throughput 2.80223K wps
[Epoch 150 Batch 300/1540] avg loss 0.000881916, throughput 2.86502K wps
[Epoch 150 Batch 330/1540] avg loss 0.000592705, throughput 2.87804K wps
[Epoch 150 Batch 360/1540] avg loss 0.000624209, throughput 2.8762K wps
[Epoch 150 Batch 390/1540] avg loss 0.00071866, throughput 2.84852K wps
[Epoch 150 Batch 420/1540] avg loss 0.000801393, throughput 2.88554K wps
[Epoch 150 Batch 450/1540] avg loss 0.000860081, throughput 2.87616K wps
[Epoch 150 Batch 480/1540] avg loss 0.000981142, throughput 2.88006K wps
[Epoch 150 Batch 510/1540] avg loss 0.000785441, throughput 2.82065K wps
[Epoch 150 Batch 540/1540] avg loss 0.000947265, throughput 2.82944K wps
[Epoch 150 Batch 570/1540] avg loss 0.000800643, throughput 2.85783K wps
[Epoch 150 Batch 600/1540] avg loss 0.000972477, throughput 2.79709K wps
[Epoch 150 Batch 630/1540] avg loss 0.000663795, throughput 2.8151K wps
[Epoch 150 Batch 660/1540] avg loss 0.000812347, throughput 2.85616K wps
[Epoch 150 Batch 690/1540] avg loss 0.000663307, throughput 2.80131K wps
[Epoch 150 Batch 720/1540] avg loss 0.000767681, throughput 2.87541K wps
[Epoch 150 Batch 750/1540] avg loss 0.000738516, throughput 2.87917K wps
[Epoch 150 Batch 780/1540] avg loss 0.000828211, throughput 2.8643K wps
[Epoch 150 Batch 810/1540] avg loss 0.000730721, throughput 2.8505K wps
[Epoch 150 Batch 840/1540] avg loss 0.000951865, throughput 2.85647K wps
[Epoch 150 Batch 870/1540] avg loss 0.000703237, throughput 2.85705K wps
[Epoch 150 Batch 900/1540] avg loss 0.000895725, throughput 2.87308K wps
[Epoch 150 Batch 930/1540] avg loss 0.00097419, throughput 2.87736K wps
[Epoch 150 Batch 960/1540] avg loss 0.00106766, throughput 2.87328K wps
[Epoch 150 Batch 990/1540] avg loss 0.00071558, throughput 2.86603K wps
[Epoch 150 Batch 1020/1540] avg loss 0.000702389, throughput 2.86899K wps
[Epoch 150 Batch 1050/1540] avg loss 0.000694674, throughput 2.86611K wps
[Epoch 150 Batch 1080/1540] avg loss 0.000677521, throughput 2.79041K wps
[Epoch 150 Batch 1110/1540] avg loss 0.000999221, throughput 2.85523K wps
[Epoch 150 Batch 1140/1540] avg loss 0.000609428, throughput 2.86184K wps
[Epoch 150 Batch 1170/1540] avg loss 0.000872325, throughput 2.86914K wps
[Epoch 150 Batch 1200/1540] avg loss 0.000737503, throughput 2.86792K wps
[Epoch 150 Batch 1230/1540] avg loss 0.000844188, throughput 2.84953K wps
[Epoch 150 Batch 1260/1540] avg loss 0.000875578, throughput 2.84025K wps
[Epoch 150 Batch 1290/1540] avg loss 0.000877655, throughput 2.86907K wps
[Epoch 150 Batch 1320/1540] avg loss 0.000715604, throughput 2.85848K wps
[Epoch 150 Batch 1350/1540] avg loss 0.000873699, throughput 2.882K wps
[Epoch 150 Batch 1380/1540] avg loss 0.000806755, throughput 2.87494K wps
[Epoch 150 Batch 1410/1540] avg loss 0.000967592, throughput 2.86655K wps
[Epoch 150 Batch 1440/1540] avg loss 0.000937755, throughput 2.84305K wps
[Epoch 150 Batch 1470/1540] avg loss 0.000830027, throughput 2.84258K wps
[Epoch 150 Batch 1500/1540] avg loss 0.00062444, throughput 2.87188K wps
[Epoch 150 Batch 1530/1540] avg loss 0.000621484, throughput 2.88395K wps
Begin Testing...
[Epoch 150] train avg loss 0.000790055, dev acc 0.7982, dev avg loss 0.919524, throughput 2.8573K wps
[Epoch 151 Batch 30/1540] avg loss 0.000634121, throughput 2.90847K wps
[Epoch 151 Batch 60/1540] avg loss 0.000597192, throughput 2.85388K wps
[Epoch 151 Batch 90/1540] avg loss 0.000654807, throughput 2.79554K wps
[Epoch 151 Batch 120/1540] avg loss 0.000811028, throughput 2.86728K wps
[Epoch 151 Batch 150/1540] avg loss 0.000763039, throughput 2.82565K wps
[Epoch 151 Batch 180/1540] avg loss 0.000657005, throughput 2.78941K wps
[Epoch 151 Batch 210/1540] avg loss 0.000835461, throughput 2.79882K wps
[Epoch 151 Batch 240/1540] avg loss 0.000680289, throughput 2.82691K wps
[Epoch 151 Batch 270/1540] avg loss 0.000683696, throughput 2.87906K wps
[Epoch 151 Batch 300/1540] avg loss 0.000691914, throughput 2.88133K wps
[Epoch 151 Batch 330/1540] avg loss 0.000682685, throughput 2.87464K wps
[Epoch 151 Batch 360/1540] avg loss 0.000844376, throughput 2.87689K wps
[Epoch 151 Batch 390/1540] avg loss 0.000835812, throughput 2.86604K wps
[Epoch 151 Batch 420/1540] avg loss 0.00101671, throughput 2.85657K wps
[Epoch 151 Batch 450/1540] avg loss 0.000690232, throughput 2.81323K wps
[Epoch 151 Batch 480/1540] avg loss 0.000645951, throughput 2.87966K wps
[Epoch 151 Batch 510/1540] avg loss 0.000773584, throughput 2.87381K wps
[Epoch 151 Batch 540/1540] avg loss 0.000766525, throughput 2.87059K wps
[Epoch 151 Batch 570/1540] avg loss 0.000774775, throughput 2.87496K wps
[Epoch 151 Batch 600/1540] avg loss 0.000767573, throughput 2.88484K wps
[Epoch 151 Batch 630/1540] avg loss 0.000754232, throughput 2.88368K wps
[Epoch 151 Batch 660/1540] avg loss 0.000882953, throughput 2.85182K wps
[Epoch 151 Batch 690/1540] avg loss 0.000823961, throughput 2.84971K wps
[Epoch 151 Batch 720/1540] avg loss 0.00101378, throughput 2.82571K wps
[Epoch 151 Batch 750/1540] avg loss 0.000699171, throughput 2.83759K wps
[Epoch 151 Batch 780/1540] avg loss 0.000854993, throughput 2.87606K wps
[Epoch 151 Batch 810/1540] avg loss 0.000896508, throughput 2.88094K wps
[Epoch 151 Batch 840/1540] avg loss 0.000750514, throughput 2.85075K wps
[Epoch 151 Batch 870/1540] avg loss 0.000610583, throughput 2.82904K wps
[Epoch 151 Batch 900/1540] avg loss 0.000688611, throughput 2.86303K wps
[Epoch 151 Batch 930/1540] avg loss 0.00112699, throughput 2.87277K wps
[Epoch 151 Batch 960/1540] avg loss 0.000983969, throughput 2.87339K wps
[Epoch 151 Batch 990/1540] avg loss 0.00059686, throughput 2.82334K wps
[Epoch 151 Batch 1020/1540] avg loss 0.000772805, throughput 2.85827K wps
[Epoch 151 Batch 1050/1540] avg loss 0.00103348, throughput 2.87175K wps
[Epoch 151 Batch 1080/1540] avg loss 0.000697568, throughput 2.86171K wps
[Epoch 151 Batch 1110/1540] avg loss 0.000632162, throughput 2.83854K wps
[Epoch 151 Batch 1140/1540] avg loss 0.000875556, throughput 2.81438K wps
[Epoch 151 Batch 1170/1540] avg loss 0.00083585, throughput 2.85798K wps
[Epoch 151 Batch 1200/1540] avg loss 0.000992817, throughput 2.86597K wps
[Epoch 151 Batch 1230/1540] avg loss 0.000514936, throughput 2.84183K wps
[Epoch 151 Batch 1260/1540] avg loss 0.00111924, throughput 2.83596K wps
[Epoch 151 Batch 1290/1540] avg loss 0.000919825, throughput 2.88112K wps
[Epoch 151 Batch 1320/1540] avg loss 0.000853982, throughput 2.86818K wps
[Epoch 151 Batch 1350/1540] avg loss 0.000862543, throughput 2.81404K wps
[Epoch 151 Batch 1380/1540] avg loss 0.000789601, throughput 2.86243K wps
[Epoch 151 Batch 1410/1540] avg loss 0.000895161, throughput 2.8377K wps
[Epoch 151 Batch 1440/1540] avg loss 0.00081952, throughput 2.85445K wps
[Epoch 151 Batch 1470/1540] avg loss 0.00059836, throughput 2.82855K wps
[Epoch 151 Batch 1500/1540] avg loss 0.000573295, throughput 2.88034K wps
[Epoch 151 Batch 1530/1540] avg loss 0.000511375, throughput 2.87932K wps
Begin Testing...
[Epoch 151] train avg loss 0.000781, dev acc 0.7970, dev avg loss 0.913602, throughput 2.85416K wps
[Epoch 152 Batch 30/1540] avg loss 0.000887521, throughput 2.90852K wps
[Epoch 152 Batch 60/1540] avg loss 0.000649676, throughput 2.85638K wps
[Epoch 152 Batch 90/1540] avg loss 0.000643012, throughput 2.87912K wps
[Epoch 152 Batch 120/1540] avg loss 0.000761156, throughput 2.87463K wps
[Epoch 152 Batch 150/1540] avg loss 0.0008479, throughput 2.87879K wps
[Epoch 152 Batch 180/1540] avg loss 0.000717825, throughput 2.85469K wps
[Epoch 152 Batch 210/1540] avg loss 0.000607915, throughput 2.87587K wps
[Epoch 152 Batch 240/1540] avg loss 0.000803736, throughput 2.84919K wps
[Epoch 152 Batch 270/1540] avg loss 0.000568946, throughput 2.86899K wps
[Epoch 152 Batch 300/1540] avg loss 0.000643032, throughput 2.85506K wps
[Epoch 152 Batch 330/1540] avg loss 0.000740162, throughput 2.80035K wps
[Epoch 152 Batch 360/1540] avg loss 0.000656605, throughput 2.78321K wps
[Epoch 152 Batch 390/1540] avg loss 0.00080788, throughput 2.86729K wps
[Epoch 152 Batch 420/1540] avg loss 0.000801177, throughput 2.81252K wps
[Epoch 152 Batch 450/1540] avg loss 0.000873239, throughput 2.85059K wps
[Epoch 152 Batch 480/1540] avg loss 0.000901948, throughput 2.8505K wps
[Epoch 152 Batch 510/1540] avg loss 0.000933891, throughput 2.86663K wps
[Epoch 152 Batch 540/1540] avg loss 0.000842925, throughput 2.85783K wps
[Epoch 152 Batch 570/1540] avg loss 0.00055561, throughput 2.86811K wps
[Epoch 152 Batch 600/1540] avg loss 0.000808627, throughput 2.8374K wps
[Epoch 152 Batch 630/1540] avg loss 0.000885888, throughput 2.79925K wps
[Epoch 152 Batch 660/1540] avg loss 0.00058031, throughput 2.84251K wps
[Epoch 152 Batch 690/1540] avg loss 0.000961077, throughput 2.86962K wps
[Epoch 152 Batch 720/1540] avg loss 0.000874779, throughput 2.87323K wps
[Epoch 152 Batch 750/1540] avg loss 0.000695887, throughput 2.8745K wps
[Epoch 152 Batch 780/1540] avg loss 0.000561714, throughput 2.87251K wps
[Epoch 152 Batch 810/1540] avg loss 0.000854664, throughput 2.81132K wps
[Epoch 152 Batch 840/1540] avg loss 0.000873631, throughput 2.86071K wps
[Epoch 152 Batch 870/1540] avg loss 0.000899711, throughput 2.86844K wps
[Epoch 152 Batch 900/1540] avg loss 0.000775329, throughput 2.85109K wps
[Epoch 152 Batch 930/1540] avg loss 0.000949089, throughput 2.87164K wps
[Epoch 152 Batch 960/1540] avg loss 0.000697655, throughput 2.87385K wps
[Epoch 152 Batch 990/1540] avg loss 0.000877369, throughput 2.86976K wps
[Epoch 152 Batch 1020/1540] avg loss 0.000861388, throughput 2.86242K wps
[Epoch 152 Batch 1050/1540] avg loss 0.00101324, throughput 2.8397K wps
[Epoch 152 Batch 1080/1540] avg loss 0.000811808, throughput 2.86272K wps
[Epoch 152 Batch 1110/1540] avg loss 0.000728745, throughput 2.86397K wps
[Epoch 152 Batch 1140/1540] avg loss 0.000949241, throughput 2.84594K wps
[Epoch 152 Batch 1170/1540] avg loss 0.000949647, throughput 2.86525K wps
[Epoch 152 Batch 1200/1540] avg loss 0.000759851, throughput 2.86798K wps
[Epoch 152 Batch 1230/1540] avg loss 0.000814055, throughput 2.87502K wps
[Epoch 152 Batch 1260/1540] avg loss 0.00066756, throughput 2.84309K wps
[Epoch 152 Batch 1290/1540] avg loss 0.00102267, throughput 2.87207K wps
[Epoch 152 Batch 1320/1540] avg loss 0.000699441, throughput 2.83358K wps
[Epoch 152 Batch 1350/1540] avg loss 0.00090591, throughput 2.8589K wps
[Epoch 152 Batch 1380/1540] avg loss 0.000564773, throughput 2.8765K wps
[Epoch 152 Batch 1410/1540] avg loss 0.0009522, throughput 2.80181K wps
[Epoch 152 Batch 1440/1540] avg loss 0.000887064, throughput 2.78424K wps
[Epoch 152 Batch 1470/1540] avg loss 0.000770448, throughput 2.85698K wps
[Epoch 152 Batch 1500/1540] avg loss 0.000685527, throughput 2.87503K wps
[Epoch 152 Batch 1530/1540] avg loss 0.000833183, throughput 2.84979K wps
Begin Testing...
[Epoch 152] train avg loss 0.000795475, dev acc 0.7982, dev avg loss 0.90433, throughput 2.85414K wps
[Epoch 153 Batch 30/1540] avg loss 0.000591432, throughput 2.93494K wps
[Epoch 153 Batch 60/1540] avg loss 0.000827442, throughput 2.8446K wps
[Epoch 153 Batch 90/1540] avg loss 0.000814789, throughput 2.86892K wps
[Epoch 153 Batch 120/1540] avg loss 0.000754369, throughput 2.80889K wps
[Epoch 153 Batch 150/1540] avg loss 0.000818201, throughput 2.81504K wps
[Epoch 153 Batch 180/1540] avg loss 0.000657077, throughput 2.85638K wps
[Epoch 153 Batch 210/1540] avg loss 0.000702419, throughput 2.8674K wps
[Epoch 153 Batch 240/1540] avg loss 0.000859074, throughput 2.88325K wps
[Epoch 153 Batch 270/1540] avg loss 0.000570309, throughput 2.87357K wps
[Epoch 153 Batch 300/1540] avg loss 0.000813758, throughput 2.8595K wps
[Epoch 153 Batch 330/1540] avg loss 0.000867257, throughput 2.81464K wps
[Epoch 153 Batch 360/1540] avg loss 0.000719808, throughput 2.86645K wps
[Epoch 153 Batch 390/1540] avg loss 0.000841934, throughput 2.86737K wps
[Epoch 153 Batch 420/1540] avg loss 0.000659691, throughput 2.84669K wps
[Epoch 153 Batch 450/1540] avg loss 0.000705494, throughput 2.79489K wps
[Epoch 153 Batch 480/1540] avg loss 0.000650403, throughput 2.83144K wps
[Epoch 153 Batch 510/1540] avg loss 0.000764593, throughput 2.84112K wps
[Epoch 153 Batch 540/1540] avg loss 0.000726747, throughput 2.80598K wps
[Epoch 153 Batch 570/1540] avg loss 0.00075975, throughput 2.78958K wps
[Epoch 153 Batch 600/1540] avg loss 0.000954432, throughput 2.83627K wps
[Epoch 153 Batch 630/1540] avg loss 0.000828265, throughput 2.86398K wps
[Epoch 153 Batch 660/1540] avg loss 0.000659033, throughput 2.85206K wps
[Epoch 153 Batch 690/1540] avg loss 0.000787526, throughput 2.88229K wps
[Epoch 153 Batch 720/1540] avg loss 0.000888629, throughput 2.86997K wps
[Epoch 153 Batch 750/1540] avg loss 0.000638316, throughput 2.86853K wps
[Epoch 153 Batch 780/1540] avg loss 0.000754612, throughput 2.86337K wps
[Epoch 153 Batch 810/1540] avg loss 0.000918333, throughput 2.84995K wps
[Epoch 153 Batch 840/1540] avg loss 0.000831411, throughput 2.81017K wps
[Epoch 153 Batch 870/1540] avg loss 0.00118441, throughput 2.85316K wps
[Epoch 153 Batch 900/1540] avg loss 0.000644293, throughput 2.86923K wps
[Epoch 153 Batch 930/1540] avg loss 0.000774913, throughput 2.8837K wps
[Epoch 153 Batch 960/1540] avg loss 0.000708873, throughput 2.87116K wps
[Epoch 153 Batch 990/1540] avg loss 0.000708676, throughput 2.87293K wps
[Epoch 153 Batch 1020/1540] avg loss 0.000834958, throughput 2.85011K wps
[Epoch 153 Batch 1050/1540] avg loss 0.000804979, throughput 2.87226K wps
[Epoch 153 Batch 1080/1540] avg loss 0.000883627, throughput 2.83752K wps
[Epoch 153 Batch 1110/1540] avg loss 0.000725394, throughput 2.86299K wps
[Epoch 153 Batch 1140/1540] avg loss 0.000750091, throughput 2.86265K wps
[Epoch 153 Batch 1170/1540] avg loss 0.000776148, throughput 2.87293K wps
[Epoch 153 Batch 1200/1540] avg loss 0.000656691, throughput 2.87474K wps
[Epoch 153 Batch 1230/1540] avg loss 0.00108635, throughput 2.83159K wps
[Epoch 153 Batch 1260/1540] avg loss 0.00056721, throughput 2.87296K wps
[Epoch 153 Batch 1290/1540] avg loss 0.000711559, throughput 2.87309K wps
[Epoch 153 Batch 1320/1540] avg loss 0.00052007, throughput 2.87594K wps
[Epoch 153 Batch 1350/1540] avg loss 0.00065125, throughput 2.82039K wps
[Epoch 153 Batch 1380/1540] avg loss 0.000995404, throughput 2.83468K wps
[Epoch 153 Batch 1410/1540] avg loss 0.000624945, throughput 2.84387K wps
[Epoch 153 Batch 1440/1540] avg loss 0.000884884, throughput 2.84113K wps
[Epoch 153 Batch 1470/1540] avg loss 0.000805277, throughput 2.88301K wps
[Epoch 153 Batch 1500/1540] avg loss 0.000784674, throughput 2.85471K wps
[Epoch 153 Batch 1530/1540] avg loss 0.00101193, throughput 2.85352K wps
Begin Testing...
[Epoch 153] train avg loss 0.000774854, dev acc 0.7913, dev avg loss 0.911579, throughput 2.8536K wps
[Epoch 154 Batch 30/1540] avg loss 0.000855146, throughput 2.86918K wps
[Epoch 154 Batch 60/1540] avg loss 0.000759801, throughput 2.87218K wps
[Epoch 154 Batch 90/1540] avg loss 0.000701551, throughput 2.85949K wps
[Epoch 154 Batch 120/1540] avg loss 0.000783158, throughput 2.87562K wps
[Epoch 154 Batch 150/1540] avg loss 0.000575348, throughput 2.8118K wps
[Epoch 154 Batch 180/1540] avg loss 0.000671706, throughput 2.83273K wps
[Epoch 154 Batch 210/1540] avg loss 0.000885478, throughput 2.86469K wps
[Epoch 154 Batch 240/1540] avg loss 0.000753729, throughput 2.87598K wps
[Epoch 154 Batch 270/1540] avg loss 0.0005103, throughput 2.86807K wps
[Epoch 154 Batch 300/1540] avg loss 0.000676384, throughput 2.86948K wps
[Epoch 154 Batch 330/1540] avg loss 0.000716894, throughput 2.87448K wps
[Epoch 154 Batch 360/1540] avg loss 0.000751219, throughput 2.86302K wps
[Epoch 154 Batch 390/1540] avg loss 0.000886376, throughput 2.82979K wps
[Epoch 154 Batch 420/1540] avg loss 0.000637053, throughput 2.83086K wps
[Epoch 154 Batch 450/1540] avg loss 0.000680244, throughput 2.85656K wps
[Epoch 154 Batch 480/1540] avg loss 0.00114367, throughput 2.8741K wps
[Epoch 154 Batch 510/1540] avg loss 0.000602819, throughput 2.81828K wps
[Epoch 154 Batch 540/1540] avg loss 0.000859596, throughput 2.87794K wps
[Epoch 154 Batch 570/1540] avg loss 0.000680896, throughput 2.78747K wps
[Epoch 154 Batch 600/1540] avg loss 0.000699745, throughput 2.81341K wps
[Epoch 154 Batch 630/1540] avg loss 0.000649746, throughput 2.84845K wps
[Epoch 154 Batch 660/1540] avg loss 0.000742143, throughput 2.85505K wps
[Epoch 154 Batch 690/1540] avg loss 0.000649649, throughput 2.8443K wps
[Epoch 154 Batch 720/1540] avg loss 0.000779677, throughput 2.812K wps
[Epoch 154 Batch 750/1540] avg loss 0.000731537, throughput 2.87529K wps
[Epoch 154 Batch 780/1540] avg loss 0.000640104, throughput 2.85847K wps
[Epoch 154 Batch 810/1540] avg loss 0.000811723, throughput 2.86562K wps
[Epoch 154 Batch 840/1540] avg loss 0.00064256, throughput 2.85413K wps
[Epoch 154 Batch 870/1540] avg loss 0.000791337, throughput 2.8697K wps
[Epoch 154 Batch 900/1540] avg loss 0.000921825, throughput 2.86204K wps
[Epoch 154 Batch 930/1540] avg loss 0.000967896, throughput 2.86255K wps
[Epoch 154 Batch 960/1540] avg loss 0.000844667, throughput 2.81601K wps
[Epoch 154 Batch 990/1540] avg loss 0.000704524, throughput 2.86809K wps
[Epoch 154 Batch 1020/1540] avg loss 0.000760675, throughput 2.85964K wps
[Epoch 154 Batch 1050/1540] avg loss 0.000881198, throughput 2.85842K wps
[Epoch 154 Batch 1080/1540] avg loss 0.00111479, throughput 2.87381K wps
[Epoch 154 Batch 1110/1540] avg loss 0.000889369, throughput 2.85584K wps
[Epoch 154 Batch 1140/1540] avg loss 0.000654791, throughput 2.85439K wps
[Epoch 154 Batch 1170/1540] avg loss 0.000769979, throughput 2.82566K wps
[Epoch 154 Batch 1200/1540] avg loss 0.000743926, throughput 2.86341K wps
[Epoch 154 Batch 1230/1540] avg loss 0.000707616, throughput 2.85235K wps
[Epoch 154 Batch 1260/1540] avg loss 0.000769402, throughput 2.87076K wps
[Epoch 154 Batch 1290/1540] avg loss 0.000855682, throughput 2.86039K wps
[Epoch 154 Batch 1320/1540] avg loss 0.000751144, throughput 2.85073K wps
[Epoch 154 Batch 1350/1540] avg loss 0.000875476, throughput 2.88423K wps
[Epoch 154 Batch 1380/1540] avg loss 0.000785915, throughput 2.87713K wps
[Epoch 154 Batch 1410/1540] avg loss 0.000976929, throughput 2.86938K wps
[Epoch 154 Batch 1440/1540] avg loss 0.000773115, throughput 2.8643K wps
[Epoch 154 Batch 1470/1540] avg loss 0.00048648, throughput 2.87476K wps
[Epoch 154 Batch 1500/1540] avg loss 0.000842965, throughput 2.83114K wps
[Epoch 154 Batch 1530/1540] avg loss 0.000940117, throughput 2.86635K wps
Begin Testing...
[Epoch 154] train avg loss 0.000771789, dev acc 0.7947, dev avg loss 0.935494, throughput 2.85505K wps
[Epoch 155 Batch 30/1540] avg loss 0.000704658, throughput 2.91011K wps
[Epoch 155 Batch 60/1540] avg loss 0.000721352, throughput 2.79281K wps
[Epoch 155 Batch 90/1540] avg loss 0.000610472, throughput 2.80162K wps
[Epoch 155 Batch 120/1540] avg loss 0.000801379, throughput 2.84738K wps
[Epoch 155 Batch 150/1540] avg loss 0.000800867, throughput 2.84606K wps
[Epoch 155 Batch 180/1540] avg loss 0.000659066, throughput 2.8124K wps
[Epoch 155 Batch 210/1540] avg loss 0.000649204, throughput 2.84002K wps
[Epoch 155 Batch 240/1540] avg loss 0.000555005, throughput 2.80571K wps
[Epoch 155 Batch 270/1540] avg loss 0.00083389, throughput 2.85406K wps
[Epoch 155 Batch 300/1540] avg loss 0.000680559, throughput 2.86926K wps
[Epoch 155 Batch 330/1540] avg loss 0.000597356, throughput 2.86435K wps
[Epoch 155 Batch 360/1540] avg loss 0.000493636, throughput 2.81256K wps
[Epoch 155 Batch 390/1540] avg loss 0.000510881, throughput 2.8844K wps
[Epoch 155 Batch 420/1540] avg loss 0.000585038, throughput 2.8347K wps
[Epoch 155 Batch 450/1540] avg loss 0.000676671, throughput 2.87763K wps
[Epoch 155 Batch 480/1540] avg loss 0.000781561, throughput 2.84149K wps
[Epoch 155 Batch 510/1540] avg loss 0.00099609, throughput 2.82355K wps
[Epoch 155 Batch 540/1540] avg loss 0.000685456, throughput 2.87746K wps
[Epoch 155 Batch 570/1540] avg loss 0.000804091, throughput 2.87689K wps
[Epoch 155 Batch 600/1540] avg loss 0.000717145, throughput 2.88315K wps
[Epoch 155 Batch 630/1540] avg loss 0.000776683, throughput 2.83497K wps
[Epoch 155 Batch 660/1540] avg loss 0.000693855, throughput 2.78679K wps
[Epoch 155 Batch 690/1540] avg loss 0.000710134, throughput 2.86805K wps
[Epoch 155 Batch 720/1540] avg loss 0.000791106, throughput 2.87196K wps
[Epoch 155 Batch 750/1540] avg loss 0.000740505, throughput 2.82709K wps
[Epoch 155 Batch 780/1540] avg loss 0.00086379, throughput 2.83883K wps
[Epoch 155 Batch 810/1540] avg loss 0.000797995, throughput 2.86548K wps
[Epoch 155 Batch 840/1540] avg loss 0.00068041, throughput 2.86276K wps
[Epoch 155 Batch 870/1540] avg loss 0.000576585, throughput 2.78301K wps
[Epoch 155 Batch 900/1540] avg loss 0.000882603, throughput 2.82525K wps
[Epoch 155 Batch 930/1540] avg loss 0.000864005, throughput 2.8612K wps
[Epoch 155 Batch 960/1540] avg loss 0.000718467, throughput 2.86973K wps
[Epoch 155 Batch 990/1540] avg loss 0.000904143, throughput 2.8808K wps
[Epoch 155 Batch 1020/1540] avg loss 0.000802729, throughput 2.83807K wps
[Epoch 155 Batch 1050/1540] avg loss 0.000773031, throughput 2.87194K wps
[Epoch 155 Batch 1080/1540] avg loss 0.000557161, throughput 2.8739K wps
[Epoch 155 Batch 1110/1540] avg loss 0.000907718, throughput 2.82711K wps
[Epoch 155 Batch 1140/1540] avg loss 0.000821543, throughput 2.86205K wps
[Epoch 155 Batch 1170/1540] avg loss 0.000894021, throughput 2.83545K wps
[Epoch 155 Batch 1200/1540] avg loss 0.000579375, throughput 2.80282K wps
[Epoch 155 Batch 1230/1540] avg loss 0.000676005, throughput 2.87751K wps
[Epoch 155 Batch 1260/1540] avg loss 0.000941388, throughput 2.87563K wps
[Epoch 155 Batch 1290/1540] avg loss 0.000855152, throughput 2.84403K wps
[Epoch 155 Batch 1320/1540] avg loss 0.000764047, throughput 2.7927K wps
[Epoch 155 Batch 1350/1540] avg loss 0.000838493, throughput 2.86902K wps
[Epoch 155 Batch 1380/1540] avg loss 0.000600243, throughput 2.86223K wps
[Epoch 155 Batch 1410/1540] avg loss 0.000805749, throughput 2.86727K wps
[Epoch 155 Batch 1440/1540] avg loss 0.000670599, throughput 2.86434K wps
[Epoch 155 Batch 1470/1540] avg loss 0.000852126, throughput 2.86606K wps
[Epoch 155 Batch 1500/1540] avg loss 0.00103741, throughput 2.84791K wps
[Epoch 155 Batch 1530/1540] avg loss 0.00111653, throughput 2.87824K wps
Begin Testing...
[Epoch 155] train avg loss 0.000750163, dev acc 0.8016, dev avg loss 0.904987, throughput 2.84857K wps
[Epoch 156 Batch 30/1540] avg loss 0.000656508, throughput 2.88195K wps
[Epoch 156 Batch 60/1540] avg loss 0.000573855, throughput 2.83908K wps
[Epoch 156 Batch 90/1540] avg loss 0.000630153, throughput 2.79624K wps
[Epoch 156 Batch 120/1540] avg loss 0.000717216, throughput 2.87435K wps
[Epoch 156 Batch 150/1540] avg loss 0.000833221, throughput 2.84449K wps
[Epoch 156 Batch 180/1540] avg loss 0.000673307, throughput 2.85743K wps
[Epoch 156 Batch 210/1540] avg loss 0.000517959, throughput 2.88402K wps
[Epoch 156 Batch 240/1540] avg loss 0.00076629, throughput 2.8801K wps
[Epoch 156 Batch 270/1540] avg loss 0.0011472, throughput 2.83344K wps
[Epoch 156 Batch 300/1540] avg loss 0.000642229, throughput 2.83697K wps
[Epoch 156 Batch 330/1540] avg loss 0.000729032, throughput 2.84152K wps
[Epoch 156 Batch 360/1540] avg loss 0.000854953, throughput 2.84695K wps
[Epoch 156 Batch 390/1540] avg loss 0.000993621, throughput 2.84284K wps
[Epoch 156 Batch 420/1540] avg loss 0.000721413, throughput 2.88075K wps
[Epoch 156 Batch 450/1540] avg loss 0.000774975, throughput 2.8688K wps
[Epoch 156 Batch 480/1540] avg loss 0.000619559, throughput 2.85258K wps
[Epoch 156 Batch 510/1540] avg loss 0.00098803, throughput 2.85624K wps
[Epoch 156 Batch 540/1540] avg loss 0.000683372, throughput 2.86616K wps
[Epoch 156 Batch 570/1540] avg loss 0.00071537, throughput 2.872K wps
[Epoch 156 Batch 600/1540] avg loss 0.000637944, throughput 2.84822K wps
[Epoch 156 Batch 630/1540] avg loss 0.000568211, throughput 2.85126K wps
[Epoch 156 Batch 660/1540] avg loss 0.00062114, throughput 2.86655K wps
[Epoch 156 Batch 690/1540] avg loss 0.00107841, throughput 2.85519K wps
[Epoch 156 Batch 720/1540] avg loss 0.000730594, throughput 2.85929K wps
[Epoch 156 Batch 750/1540] avg loss 0.000760097, throughput 2.85999K wps
[Epoch 156 Batch 780/1540] avg loss 0.000739585, throughput 2.82663K wps
[Epoch 156 Batch 810/1540] avg loss 0.000891144, throughput 2.84035K wps
[Epoch 156 Batch 840/1540] avg loss 0.000693894, throughput 2.84409K wps
[Epoch 156 Batch 870/1540] avg loss 0.000954918, throughput 2.85334K wps
[Epoch 156 Batch 900/1540] avg loss 0.000760731, throughput 2.82059K wps
[Epoch 156 Batch 930/1540] avg loss 0.000786871, throughput 2.87141K wps
[Epoch 156 Batch 960/1540] avg loss 0.000788611, throughput 2.8327K wps
[Epoch 156 Batch 990/1540] avg loss 0.000718761, throughput 2.83406K wps
[Epoch 156 Batch 1020/1540] avg loss 0.000719298, throughput 2.83022K wps
[Epoch 156 Batch 1050/1540] avg loss 0.000728508, throughput 2.84773K wps
[Epoch 156 Batch 1080/1540] avg loss 0.000702042, throughput 2.85688K wps
[Epoch 156 Batch 1110/1540] avg loss 0.000906206, throughput 2.87136K wps
[Epoch 156 Batch 1140/1540] avg loss 0.00108926, throughput 2.87019K wps
[Epoch 156 Batch 1170/1540] avg loss 0.000882773, throughput 2.85141K wps
[Epoch 156 Batch 1200/1540] avg loss 0.000798549, throughput 2.85164K wps
[Epoch 156 Batch 1230/1540] avg loss 0.00064728, throughput 2.87274K wps
[Epoch 156 Batch 1260/1540] avg loss 0.00102992, throughput 2.84725K wps
[Epoch 156 Batch 1290/1540] avg loss 0.000908057, throughput 2.83772K wps
[Epoch 156 Batch 1320/1540] avg loss 0.000693115, throughput 2.8641K wps
[Epoch 156 Batch 1350/1540] avg loss 0.000662935, throughput 2.83621K wps
[Epoch 156 Batch 1380/1540] avg loss 0.00100896, throughput 2.84481K wps
[Epoch 156 Batch 1410/1540] avg loss 0.000617505, throughput 2.85621K wps
[Epoch 156 Batch 1440/1540] avg loss 0.000648819, throughput 2.80594K wps
[Epoch 156 Batch 1470/1540] avg loss 0.000657959, throughput 2.86533K wps
[Epoch 156 Batch 1500/1540] avg loss 0.000667644, throughput 2.86387K wps
[Epoch 156 Batch 1530/1540] avg loss 0.000722824, throughput 2.84051K wps
Begin Testing...
[Epoch 156] train avg loss 0.000765322, dev acc 0.8050, dev avg loss 0.916157, throughput 2.85165K wps
[Epoch 157 Batch 30/1540] avg loss 0.000889291, throughput 2.935K wps
[Epoch 157 Batch 60/1540] avg loss 0.00077595, throughput 2.79873K wps
[Epoch 157 Batch 90/1540] avg loss 0.000713495, throughput 2.83987K wps
[Epoch 157 Batch 120/1540] avg loss 0.000576966, throughput 2.87601K wps
[Epoch 157 Batch 150/1540] avg loss 0.000777086, throughput 2.87715K wps
[Epoch 157 Batch 180/1540] avg loss 0.000626935, throughput 2.84668K wps
[Epoch 157 Batch 210/1540] avg loss 0.00062917, throughput 2.87079K wps
[Epoch 157 Batch 240/1540] avg loss 0.000620024, throughput 2.83241K wps
[Epoch 157 Batch 270/1540] avg loss 0.000665013, throughput 2.86627K wps
[Epoch 157 Batch 300/1540] avg loss 0.000844078, throughput 2.87593K wps
[Epoch 157 Batch 330/1540] avg loss 0.000763962, throughput 2.81681K wps
[Epoch 157 Batch 360/1540] avg loss 0.000602307, throughput 2.85567K wps
[Epoch 157 Batch 390/1540] avg loss 0.000762179, throughput 2.8833K wps
[Epoch 157 Batch 420/1540] avg loss 0.000799657, throughput 2.87638K wps
[Epoch 157 Batch 450/1540] avg loss 0.000557698, throughput 2.84952K wps
[Epoch 157 Batch 480/1540] avg loss 0.000728815, throughput 2.83784K wps
[Epoch 157 Batch 510/1540] avg loss 0.000828593, throughput 2.85894K wps
[Epoch 157 Batch 540/1540] avg loss 0.000672527, throughput 2.87393K wps
[Epoch 157 Batch 570/1540] avg loss 0.000952484, throughput 2.87114K wps
[Epoch 157 Batch 600/1540] avg loss 0.000719926, throughput 2.86741K wps
[Epoch 157 Batch 630/1540] avg loss 0.000703015, throughput 2.82648K wps
[Epoch 157 Batch 660/1540] avg loss 0.000836561, throughput 2.83662K wps
[Epoch 157 Batch 690/1540] avg loss 0.000719518, throughput 2.88159K wps
[Epoch 157 Batch 720/1540] avg loss 0.00068124, throughput 2.81412K wps
[Epoch 157 Batch 750/1540] avg loss 0.000807195, throughput 2.87971K wps
[Epoch 157 Batch 780/1540] avg loss 0.000701738, throughput 2.88038K wps
[Epoch 157 Batch 810/1540] avg loss 0.000622315, throughput 2.86885K wps
[Epoch 157 Batch 840/1540] avg loss 0.000792546, throughput 2.84982K wps
[Epoch 157 Batch 870/1540] avg loss 0.000803996, throughput 2.87554K wps
[Epoch 157 Batch 900/1540] avg loss 0.000669098, throughput 2.86173K wps
[Epoch 157 Batch 930/1540] avg loss 0.000672794, throughput 2.86508K wps
[Epoch 157 Batch 960/1540] avg loss 0.000932053, throughput 2.87158K wps
[Epoch 157 Batch 990/1540] avg loss 0.000838375, throughput 2.87179K wps
[Epoch 157 Batch 1020/1540] avg loss 0.000598476, throughput 2.8562K wps
[Epoch 157 Batch 1050/1540] avg loss 0.000929885, throughput 2.87058K wps
[Epoch 157 Batch 1080/1540] avg loss 0.00089107, throughput 2.86365K wps
[Epoch 157 Batch 1110/1540] avg loss 0.000636732, throughput 2.87371K wps
[Epoch 157 Batch 1140/1540] avg loss 0.000932942, throughput 2.83956K wps
[Epoch 157 Batch 1170/1540] avg loss 0.000783111, throughput 2.8333K wps
[Epoch 157 Batch 1200/1540] avg loss 0.000914947, throughput 2.87775K wps
[Epoch 157 Batch 1230/1540] avg loss 0.000848237, throughput 2.88069K wps
[Epoch 157 Batch 1260/1540] avg loss 0.000916856, throughput 2.8361K wps
[Epoch 157 Batch 1290/1540] avg loss 0.000565504, throughput 2.80032K wps
[Epoch 157 Batch 1320/1540] avg loss 0.000714683, throughput 2.82643K wps
[Epoch 157 Batch 1350/1540] avg loss 0.00079181, throughput 2.8636K wps
[Epoch 157 Batch 1380/1540] avg loss 0.000735989, throughput 2.85262K wps
[Epoch 157 Batch 1410/1540] avg loss 0.000793769, throughput 2.87685K wps
[Epoch 157 Batch 1440/1540] avg loss 0.000906657, throughput 2.85062K wps
[Epoch 157 Batch 1470/1540] avg loss 0.000758314, throughput 2.82266K wps
[Epoch 157 Batch 1500/1540] avg loss 0.000823289, throughput 2.86758K wps
[Epoch 157 Batch 1530/1540] avg loss 0.0009084, throughput 2.84508K wps
Begin Testing...
[Epoch 157] train avg loss 0.000761291, dev acc 0.7947, dev avg loss 0.959339, throughput 2.85724K wps
[Epoch 158 Batch 30/1540] avg loss 0.000762546, throughput 2.8836K wps
[Epoch 158 Batch 60/1540] avg loss 0.000904584, throughput 2.8644K wps
[Epoch 158 Batch 90/1540] avg loss 0.000695016, throughput 2.82728K wps
[Epoch 158 Batch 120/1540] avg loss 0.000620111, throughput 2.78169K wps
[Epoch 158 Batch 150/1540] avg loss 0.000825268, throughput 2.84847K wps
[Epoch 158 Batch 180/1540] avg loss 0.000435437, throughput 2.84075K wps
[Epoch 158 Batch 210/1540] avg loss 0.000548209, throughput 2.87844K wps
[Epoch 158 Batch 240/1540] avg loss 0.000872862, throughput 2.87726K wps
[Epoch 158 Batch 270/1540] avg loss 0.000817983, throughput 2.84667K wps
[Epoch 158 Batch 300/1540] avg loss 0.000783737, throughput 2.8714K wps
[Epoch 158 Batch 330/1540] avg loss 0.000635215, throughput 2.88042K wps
[Epoch 158 Batch 360/1540] avg loss 0.00107627, throughput 2.86451K wps
[Epoch 158 Batch 390/1540] avg loss 0.000531582, throughput 2.87042K wps
[Epoch 158 Batch 420/1540] avg loss 0.000592495, throughput 2.83112K wps
[Epoch 158 Batch 450/1540] avg loss 0.000827297, throughput 2.87857K wps
[Epoch 158 Batch 480/1540] avg loss 0.000638442, throughput 2.87111K wps
[Epoch 158 Batch 510/1540] avg loss 0.000659751, throughput 2.87824K wps
[Epoch 158 Batch 540/1540] avg loss 0.000748518, throughput 2.85277K wps
[Epoch 158 Batch 570/1540] avg loss 0.000672302, throughput 2.87159K wps
[Epoch 158 Batch 600/1540] avg loss 0.000731466, throughput 2.87276K wps
[Epoch 158 Batch 630/1540] avg loss 0.000696667, throughput 2.88139K wps
[Epoch 158 Batch 660/1540] avg loss 0.000578409, throughput 2.86957K wps
[Epoch 158 Batch 690/1540] avg loss 0.000893392, throughput 2.86132K wps
[Epoch 158 Batch 720/1540] avg loss 0.000707805, throughput 2.87459K wps
[Epoch 158 Batch 750/1540] avg loss 0.000719561, throughput 2.86022K wps
[Epoch 158 Batch 780/1540] avg loss 0.000668357, throughput 2.86716K wps
[Epoch 158 Batch 810/1540] avg loss 0.00104245, throughput 2.87011K wps
[Epoch 158 Batch 840/1540] avg loss 0.00083223, throughput 2.87304K wps
[Epoch 158 Batch 870/1540] avg loss 0.000644276, throughput 2.81707K wps
[Epoch 158 Batch 900/1540] avg loss 0.000696883, throughput 2.82806K wps
[Epoch 158 Batch 930/1540] avg loss 0.000616988, throughput 2.84092K wps
[Epoch 158 Batch 960/1540] avg loss 0.000819965, throughput 2.87552K wps
[Epoch 158 Batch 990/1540] avg loss 0.000689675, throughput 2.88014K wps
[Epoch 158 Batch 1020/1540] avg loss 0.000879387, throughput 2.86461K wps
[Epoch 158 Batch 1050/1540] avg loss 0.000996469, throughput 2.88314K wps
[Epoch 158 Batch 1080/1540] avg loss 0.000755323, throughput 2.8486K wps
[Epoch 158 Batch 1110/1540] avg loss 0.000709438, throughput 2.87563K wps
[Epoch 158 Batch 1140/1540] avg loss 0.000731047, throughput 2.87155K wps
[Epoch 158 Batch 1170/1540] avg loss 0.000695073, throughput 2.85026K wps
[Epoch 158 Batch 1200/1540] avg loss 0.000780072, throughput 2.86142K wps
[Epoch 158 Batch 1230/1540] avg loss 0.000739803, throughput 2.86625K wps
[Epoch 158 Batch 1260/1540] avg loss 0.00084118, throughput 2.82763K wps
[Epoch 158 Batch 1290/1540] avg loss 0.000671399, throughput 2.87734K wps
[Epoch 158 Batch 1320/1540] avg loss 0.000881076, throughput 2.84785K wps
[Epoch 158 Batch 1350/1540] avg loss 0.000980206, throughput 2.87717K wps
[Epoch 158 Batch 1380/1540] avg loss 0.000797365, throughput 2.86869K wps
[Epoch 158 Batch 1410/1540] avg loss 0.000822689, throughput 2.85175K wps
[Epoch 158 Batch 1440/1540] avg loss 0.00100938, throughput 2.87751K wps
[Epoch 158 Batch 1470/1540] avg loss 0.000915259, throughput 2.85971K wps
[Epoch 158 Batch 1500/1540] avg loss 0.00086411, throughput 2.78565K wps
[Epoch 158 Batch 1530/1540] avg loss 0.000947087, throughput 2.81892K wps
Begin Testing...
[Epoch 158] train avg loss 0.0007663, dev acc 0.8050, dev avg loss 0.932425, throughput 2.85879K wps
[Epoch 159 Batch 30/1540] avg loss 0.000768026, throughput 2.92273K wps
[Epoch 159 Batch 60/1540] avg loss 0.000635329, throughput 2.85758K wps
[Epoch 159 Batch 90/1540] avg loss 0.00092142, throughput 2.8201K wps
[Epoch 159 Batch 120/1540] avg loss 0.000567541, throughput 2.86423K wps
[Epoch 159 Batch 150/1540] avg loss 0.00067334, throughput 2.81751K wps
[Epoch 159 Batch 180/1540] avg loss 0.000771275, throughput 2.86567K wps
[Epoch 159 Batch 210/1540] avg loss 0.000796429, throughput 2.873K wps
[Epoch 159 Batch 240/1540] avg loss 0.000656356, throughput 2.85404K wps
[Epoch 159 Batch 270/1540] avg loss 0.000824602, throughput 2.87309K wps
[Epoch 159 Batch 300/1540] avg loss 0.000726635, throughput 2.84687K wps
[Epoch 159 Batch 330/1540] avg loss 0.000685637, throughput 2.87627K wps
[Epoch 159 Batch 360/1540] avg loss 0.000739266, throughput 2.84778K wps
[Epoch 159 Batch 390/1540] avg loss 0.000769579, throughput 2.84129K wps
[Epoch 159 Batch 420/1540] avg loss 0.00073739, throughput 2.87546K wps
[Epoch 159 Batch 450/1540] avg loss 0.00071444, throughput 2.86182K wps
[Epoch 159 Batch 480/1540] avg loss 0.0006523, throughput 2.79781K wps
[Epoch 159 Batch 510/1540] avg loss 0.000626219, throughput 2.86176K wps
[Epoch 159 Batch 540/1540] avg loss 0.000603212, throughput 2.82442K wps
[Epoch 159 Batch 570/1540] avg loss 0.000708661, throughput 2.86381K wps
[Epoch 159 Batch 600/1540] avg loss 0.000772582, throughput 2.84976K wps
[Epoch 159 Batch 630/1540] avg loss 0.000655947, throughput 2.87109K wps
[Epoch 159 Batch 660/1540] avg loss 0.0007054, throughput 2.84902K wps
[Epoch 159 Batch 690/1540] avg loss 0.000740079, throughput 2.84211K wps
[Epoch 159 Batch 720/1540] avg loss 0.000615483, throughput 2.82308K wps
[Epoch 159 Batch 750/1540] avg loss 0.000867054, throughput 2.87129K wps
[Epoch 159 Batch 780/1540] avg loss 0.00102204, throughput 2.87526K wps
[Epoch 159 Batch 810/1540] avg loss 0.000673028, throughput 2.8592K wps
[Epoch 159 Batch 840/1540] avg loss 0.000984368, throughput 2.86058K wps
[Epoch 159 Batch 870/1540] avg loss 0.000801876, throughput 2.86738K wps
[Epoch 159 Batch 900/1540] avg loss 0.000688773, throughput 2.85063K wps
[Epoch 159 Batch 930/1540] avg loss 0.000790409, throughput 2.82573K wps
[Epoch 159 Batch 960/1540] avg loss 0.000818249, throughput 2.87169K wps
[Epoch 159 Batch 990/1540] avg loss 0.000852929, throughput 2.84591K wps
[Epoch 159 Batch 1020/1540] avg loss 0.000818509, throughput 2.80056K wps
[Epoch 159 Batch 1050/1540] avg loss 0.000767851, throughput 2.85372K wps
[Epoch 159 Batch 1080/1540] avg loss 0.000547947, throughput 2.86418K wps
[Epoch 159 Batch 1110/1540] avg loss 0.00083827, throughput 2.87069K wps
[Epoch 159 Batch 1140/1540] avg loss 0.000812205, throughput 2.82531K wps
[Epoch 159 Batch 1170/1540] avg loss 0.00103986, throughput 2.79252K wps
[Epoch 159 Batch 1200/1540] avg loss 0.000854304, throughput 2.86441K wps
[Epoch 159 Batch 1230/1540] avg loss 0.000745854, throughput 2.85611K wps
[Epoch 159 Batch 1260/1540] avg loss 0.000647654, throughput 2.85616K wps
[Epoch 159 Batch 1290/1540] avg loss 0.000807811, throughput 2.87413K wps
[Epoch 159 Batch 1320/1540] avg loss 0.000658533, throughput 2.85322K wps
[Epoch 159 Batch 1350/1540] avg loss 0.000756795, throughput 2.87457K wps
[Epoch 159 Batch 1380/1540] avg loss 0.000756142, throughput 2.87891K wps
[Epoch 159 Batch 1410/1540] avg loss 0.00111508, throughput 2.82398K wps
[Epoch 159 Batch 1440/1540] avg loss 0.000873502, throughput 2.83251K wps
[Epoch 159 Batch 1470/1540] avg loss 0.000903004, throughput 2.84169K wps
[Epoch 159 Batch 1500/1540] avg loss 0.00076451, throughput 2.78376K wps
[Epoch 159 Batch 1530/1540] avg loss 0.000832881, throughput 2.85974K wps
Begin Testing...
[Epoch 159] train avg loss 0.000766103, dev acc 0.7993, dev avg loss 0.929027, throughput 2.85103K wps
[Epoch 160 Batch 30/1540] avg loss 0.000685525, throughput 2.90839K wps
[Epoch 160 Batch 60/1540] avg loss 0.000663824, throughput 2.86992K wps
[Epoch 160 Batch 90/1540] avg loss 0.0005838, throughput 2.84916K wps
[Epoch 160 Batch 120/1540] avg loss 0.00077581, throughput 2.84077K wps
[Epoch 160 Batch 150/1540] avg loss 0.000532986, throughput 2.84633K wps
[Epoch 160 Batch 180/1540] avg loss 0.000601159, throughput 2.87216K wps
[Epoch 160 Batch 210/1540] avg loss 0.000725395, throughput 2.82594K wps
[Epoch 160 Batch 240/1540] avg loss 0.000599797, throughput 2.83202K wps
[Epoch 160 Batch 270/1540] avg loss 0.000689944, throughput 2.83722K wps
[Epoch 160 Batch 300/1540] avg loss 0.000673073, throughput 2.8261K wps
[Epoch 160 Batch 330/1540] avg loss 0.000770347, throughput 2.87314K wps
[Epoch 160 Batch 360/1540] avg loss 0.000590168, throughput 2.87044K wps
[Epoch 160 Batch 390/1540] avg loss 0.000787917, throughput 2.86794K wps
[Epoch 160 Batch 420/1540] avg loss 0.000650561, throughput 2.85485K wps
[Epoch 160 Batch 450/1540] avg loss 0.000578235, throughput 2.86855K wps
[Epoch 160 Batch 480/1540] avg loss 0.000782704, throughput 2.86097K wps
[Epoch 160 Batch 510/1540] avg loss 0.000641696, throughput 2.8761K wps
[Epoch 160 Batch 540/1540] avg loss 0.000724673, throughput 2.8555K wps
[Epoch 160 Batch 570/1540] avg loss 0.000687711, throughput 2.83085K wps
[Epoch 160 Batch 600/1540] avg loss 0.000720707, throughput 2.80981K wps
[Epoch 160 Batch 630/1540] avg loss 0.000517865, throughput 2.86414K wps
[Epoch 160 Batch 660/1540] avg loss 0.00074135, throughput 2.85832K wps
[Epoch 160 Batch 690/1540] avg loss 0.000691289, throughput 2.82196K wps
[Epoch 160 Batch 720/1540] avg loss 0.000613322, throughput 2.86283K wps
[Epoch 160 Batch 750/1540] avg loss 0.000863508, throughput 2.82193K wps
[Epoch 160 Batch 780/1540] avg loss 0.000727086, throughput 2.86188K wps
[Epoch 160 Batch 810/1540] avg loss 0.000915518, throughput 2.85248K wps
[Epoch 160 Batch 840/1540] avg loss 0.0007466, throughput 2.82825K wps
[Epoch 160 Batch 870/1540] avg loss 0.000668602, throughput 2.84695K wps
[Epoch 160 Batch 900/1540] avg loss 0.000736277, throughput 2.82778K wps
[Epoch 160 Batch 930/1540] avg loss 0.00068514, throughput 2.88076K wps
[Epoch 160 Batch 960/1540] avg loss 0.000751328, throughput 2.88228K wps
[Epoch 160 Batch 990/1540] avg loss 0.000934886, throughput 2.87765K wps
[Epoch 160 Batch 1020/1540] avg loss 0.00080933, throughput 2.84856K wps
[Epoch 160 Batch 1050/1540] avg loss 0.00068419, throughput 2.84034K wps
[Epoch 160 Batch 1080/1540] avg loss 0.000864004, throughput 2.86663K wps
[Epoch 160 Batch 1110/1540] avg loss 0.00084719, throughput 2.8666K wps
[Epoch 160 Batch 1140/1540] avg loss 0.00102087, throughput 2.8481K wps
[Epoch 160 Batch 1170/1540] avg loss 0.000741471, throughput 2.8153K wps
[Epoch 160 Batch 1200/1540] avg loss 0.000597072, throughput 2.81911K wps
[Epoch 160 Batch 1230/1540] avg loss 0.000855878, throughput 2.85896K wps
[Epoch 160 Batch 1260/1540] avg loss 0.000868957, throughput 2.86787K wps
[Epoch 160 Batch 1290/1540] avg loss 0.000820964, throughput 2.87338K wps
[Epoch 160 Batch 1320/1540] avg loss 0.000776149, throughput 2.87048K wps
[Epoch 160 Batch 1350/1540] avg loss 0.000781986, throughput 2.86466K wps
[Epoch 160 Batch 1380/1540] avg loss 0.000915907, throughput 2.88591K wps
[Epoch 160 Batch 1410/1540] avg loss 0.00102701, throughput 2.87665K wps
[Epoch 160 Batch 1440/1540] avg loss 0.00107468, throughput 2.87332K wps
[Epoch 160 Batch 1470/1540] avg loss 0.000819403, throughput 2.87157K wps
[Epoch 160 Batch 1500/1540] avg loss 0.000824814, throughput 2.88487K wps
[Epoch 160 Batch 1530/1540] avg loss 0.000961408, throughput 2.87645K wps
Begin Testing...
[Epoch 160] train avg loss 0.000750948, dev acc 0.7959, dev avg loss 0.904743, throughput 2.85625K wps
[Epoch 161 Batch 30/1540] avg loss 0.000537706, throughput 2.9045K wps
[Epoch 161 Batch 60/1540] avg loss 0.000699035, throughput 2.86194K wps
[Epoch 161 Batch 90/1540] avg loss 0.000549363, throughput 2.88543K wps
[Epoch 161 Batch 120/1540] avg loss 0.000560726, throughput 2.84327K wps
[Epoch 161 Batch 150/1540] avg loss 0.000739867, throughput 2.8269K wps
[Epoch 161 Batch 180/1540] avg loss 0.000572973, throughput 2.84225K wps
[Epoch 161 Batch 210/1540] avg loss 0.000692546, throughput 2.84586K wps
[Epoch 161 Batch 240/1540] avg loss 0.00070639, throughput 2.87248K wps
[Epoch 161 Batch 270/1540] avg loss 0.00058191, throughput 2.84931K wps
[Epoch 161 Batch 300/1540] avg loss 0.000657682, throughput 2.8769K wps
[Epoch 161 Batch 330/1540] avg loss 0.000763215, throughput 2.82171K wps
[Epoch 161 Batch 360/1540] avg loss 0.000797946, throughput 2.83432K wps
[Epoch 161 Batch 390/1540] avg loss 0.000525852, throughput 2.86853K wps
[Epoch 161 Batch 420/1540] avg loss 0.000716335, throughput 2.86461K wps
[Epoch 161 Batch 450/1540] avg loss 0.000678632, throughput 2.84339K wps
[Epoch 161 Batch 480/1540] avg loss 0.000703351, throughput 2.88192K wps
[Epoch 161 Batch 510/1540] avg loss 0.000582536, throughput 2.87801K wps
[Epoch 161 Batch 540/1540] avg loss 0.000776893, throughput 2.87661K wps
[Epoch 161 Batch 570/1540] avg loss 0.000706337, throughput 2.87505K wps
[Epoch 161 Batch 600/1540] avg loss 0.000777304, throughput 2.88287K wps
[Epoch 161 Batch 630/1540] avg loss 0.000896411, throughput 2.85789K wps
[Epoch 161 Batch 660/1540] avg loss 0.000898493, throughput 2.81145K wps
[Epoch 161 Batch 690/1540] avg loss 0.000742614, throughput 2.87937K wps
[Epoch 161 Batch 720/1540] avg loss 0.00090005, throughput 2.86589K wps
[Epoch 161 Batch 750/1540] avg loss 0.00077885, throughput 2.85608K wps
[Epoch 161 Batch 780/1540] avg loss 0.000795386, throughput 2.87347K wps
[Epoch 161 Batch 810/1540] avg loss 0.000745582, throughput 2.87232K wps
[Epoch 161 Batch 840/1540] avg loss 0.000622898, throughput 2.87599K wps
[Epoch 161 Batch 870/1540] avg loss 0.00072537, throughput 2.86311K wps
[Epoch 161 Batch 900/1540] avg loss 0.000781714, throughput 2.85535K wps
[Epoch 161 Batch 930/1540] avg loss 0.000867639, throughput 2.87167K wps
[Epoch 161 Batch 960/1540] avg loss 0.0006733, throughput 2.85896K wps
[Epoch 161 Batch 990/1540] avg loss 0.000756023, throughput 2.86311K wps
[Epoch 161 Batch 1020/1540] avg loss 0.00079903, throughput 2.8355K wps
[Epoch 161 Batch 1050/1540] avg loss 0.000809072, throughput 2.84684K wps
[Epoch 161 Batch 1080/1540] avg loss 0.00092027, throughput 2.86086K wps
[Epoch 161 Batch 1110/1540] avg loss 0.000753374, throughput 2.88213K wps
[Epoch 161 Batch 1140/1540] avg loss 0.00075742, throughput 2.88473K wps
[Epoch 161 Batch 1170/1540] avg loss 0.0006487, throughput 2.86229K wps
[Epoch 161 Batch 1200/1540] avg loss 0.000689256, throughput 2.84241K wps
[Epoch 161 Batch 1230/1540] avg loss 0.000810304, throughput 2.83973K wps
[Epoch 161 Batch 1260/1540] avg loss 0.00091513, throughput 2.87831K wps
[Epoch 161 Batch 1290/1540] avg loss 0.000703065, throughput 2.87181K wps
[Epoch 161 Batch 1320/1540] avg loss 0.000831131, throughput 2.85845K wps
[Epoch 161 Batch 1350/1540] avg loss 0.000714402, throughput 2.86096K wps
[Epoch 161 Batch 1380/1540] avg loss 0.00079273, throughput 2.84747K wps
[Epoch 161 Batch 1410/1540] avg loss 0.000689679, throughput 2.87726K wps
[Epoch 161 Batch 1440/1540] avg loss 0.00081522, throughput 2.87618K wps
[Epoch 161 Batch 1470/1540] avg loss 0.000940802, throughput 2.83282K wps
[Epoch 161 Batch 1500/1540] avg loss 0.000864304, throughput 2.87149K wps
[Epoch 161 Batch 1530/1540] avg loss 0.000784803, throughput 2.87341K wps
Begin Testing...
[Epoch 161] train avg loss 0.000740138, dev acc 0.7970, dev avg loss 0.926964, throughput 2.86127K wps
[Epoch 162 Batch 30/1540] avg loss 0.000694245, throughput 2.92991K wps
[Epoch 162 Batch 60/1540] avg loss 0.000818245, throughput 2.86419K wps
[Epoch 162 Batch 90/1540] avg loss 0.000578685, throughput 2.82554K wps
[Epoch 162 Batch 120/1540] avg loss 0.000725516, throughput 2.87287K wps
[Epoch 162 Batch 150/1540] avg loss 0.000528209, throughput 2.8749K wps
[Epoch 162 Batch 180/1540] avg loss 0.000688456, throughput 2.86182K wps
[Epoch 162 Batch 210/1540] avg loss 0.000686881, throughput 2.86007K wps
[Epoch 162 Batch 240/1540] avg loss 0.000740664, throughput 2.8323K wps
[Epoch 162 Batch 270/1540] avg loss 0.000763594, throughput 2.78389K wps
[Epoch 162 Batch 300/1540] avg loss 0.000725184, throughput 2.80151K wps
[Epoch 162 Batch 330/1540] avg loss 0.000673867, throughput 2.87113K wps
[Epoch 162 Batch 360/1540] avg loss 0.00077497, throughput 2.88113K wps
[Epoch 162 Batch 390/1540] avg loss 0.000569539, throughput 2.79513K wps
[Epoch 162 Batch 420/1540] avg loss 0.000652765, throughput 2.81918K wps
[Epoch 162 Batch 450/1540] avg loss 0.000663605, throughput 2.79603K wps
[Epoch 162 Batch 480/1540] avg loss 0.000739664, throughput 2.78299K wps
[Epoch 162 Batch 510/1540] avg loss 0.000695971, throughput 2.8812K wps
[Epoch 162 Batch 540/1540] avg loss 0.000708978, throughput 2.83003K wps
[Epoch 162 Batch 570/1540] avg loss 0.000673506, throughput 2.83751K wps
[Epoch 162 Batch 600/1540] avg loss 0.000807367, throughput 2.88179K wps
[Epoch 162 Batch 630/1540] avg loss 0.000662471, throughput 2.86235K wps
[Epoch 162 Batch 660/1540] avg loss 0.000720047, throughput 2.87682K wps
[Epoch 162 Batch 690/1540] avg loss 0.000659711, throughput 2.87779K wps
[Epoch 162 Batch 720/1540] avg loss 0.000819978, throughput 2.87731K wps
[Epoch 162 Batch 750/1540] avg loss 0.000846388, throughput 2.85923K wps
[Epoch 162 Batch 780/1540] avg loss 0.00080136, throughput 2.88405K wps
[Epoch 162 Batch 810/1540] avg loss 0.000895209, throughput 2.88119K wps
[Epoch 162 Batch 840/1540] avg loss 0.000824333, throughput 2.88057K wps
[Epoch 162 Batch 870/1540] avg loss 0.00091794, throughput 2.88483K wps
[Epoch 162 Batch 900/1540] avg loss 0.000638211, throughput 2.87719K wps
[Epoch 162 Batch 930/1540] avg loss 0.000841826, throughput 2.81096K wps
[Epoch 162 Batch 960/1540] avg loss 0.000734613, throughput 2.81293K wps
[Epoch 162 Batch 990/1540] avg loss 0.000723889, throughput 2.79585K wps
[Epoch 162 Batch 1020/1540] avg loss 0.000941453, throughput 2.82837K wps
[Epoch 162 Batch 1050/1540] avg loss 0.000953507, throughput 2.86765K wps
[Epoch 162 Batch 1080/1540] avg loss 0.000726079, throughput 2.81711K wps
[Epoch 162 Batch 1110/1540] avg loss 0.000626805, throughput 2.8532K wps
[Epoch 162 Batch 1140/1540] avg loss 0.000785638, throughput 2.85227K wps
[Epoch 162 Batch 1170/1540] avg loss 0.00072928, throughput 2.87255K wps
[Epoch 162 Batch 1200/1540] avg loss 0.00081597, throughput 2.8489K wps
[Epoch 162 Batch 1230/1540] avg loss 0.000681697, throughput 2.88089K wps
[Epoch 162 Batch 1260/1540] avg loss 0.000668001, throughput 2.8718K wps
[Epoch 162 Batch 1290/1540] avg loss 0.000749915, throughput 2.86102K wps
[Epoch 162 Batch 1320/1540] avg loss 0.000691626, throughput 2.87607K wps
[Epoch 162 Batch 1350/1540] avg loss 0.00084295, throughput 2.8749K wps
[Epoch 162 Batch 1380/1540] avg loss 0.00076465, throughput 2.87615K wps
[Epoch 162 Batch 1410/1540] avg loss 0.000661652, throughput 2.87428K wps
[Epoch 162 Batch 1440/1540] avg loss 0.000770856, throughput 2.87335K wps
[Epoch 162 Batch 1470/1540] avg loss 0.000711172, throughput 2.87429K wps
[Epoch 162 Batch 1500/1540] avg loss 0.000851884, throughput 2.87925K wps
[Epoch 162 Batch 1530/1540] avg loss 0.000980756, throughput 2.84846K wps
Begin Testing...
[Epoch 162] train avg loss 0.000743362, dev acc 0.8050, dev avg loss 0.92223, throughput 2.85443K wps
[Epoch 163 Batch 30/1540] avg loss 0.000810309, throughput 2.9214K wps
[Epoch 163 Batch 60/1540] avg loss 0.00064738, throughput 2.87786K wps
[Epoch 163 Batch 90/1540] avg loss 0.000525887, throughput 2.8408K wps
[Epoch 163 Batch 120/1540] avg loss 0.000635868, throughput 2.80792K wps
[Epoch 163 Batch 150/1540] avg loss 0.000620094, throughput 2.86702K wps
[Epoch 163 Batch 180/1540] avg loss 0.000477138, throughput 2.87505K wps
[Epoch 163 Batch 210/1540] avg loss 0.000688676, throughput 2.87691K wps
[Epoch 163 Batch 240/1540] avg loss 0.000526675, throughput 2.88134K wps
[Epoch 163 Batch 270/1540] avg loss 0.000574831, throughput 2.87348K wps
[Epoch 163 Batch 300/1540] avg loss 0.000809171, throughput 2.84589K wps
[Epoch 163 Batch 330/1540] avg loss 0.000906176, throughput 2.84235K wps
[Epoch 163 Batch 360/1540] avg loss 0.000764837, throughput 2.85783K wps
[Epoch 163 Batch 390/1540] avg loss 0.000808103, throughput 2.85453K wps
[Epoch 163 Batch 420/1540] avg loss 0.000727044, throughput 2.78675K wps
[Epoch 163 Batch 450/1540] avg loss 0.000631798, throughput 2.8819K wps
[Epoch 163 Batch 480/1540] avg loss 0.000517838, throughput 2.81684K wps
[Epoch 163 Batch 510/1540] avg loss 0.000678467, throughput 2.78676K wps
[Epoch 163 Batch 540/1540] avg loss 0.000713327, throughput 2.7966K wps
[Epoch 163 Batch 570/1540] avg loss 0.000691621, throughput 2.83146K wps
[Epoch 163 Batch 600/1540] avg loss 0.000560206, throughput 2.81007K wps
[Epoch 163 Batch 630/1540] avg loss 0.000918175, throughput 2.87897K wps
[Epoch 163 Batch 660/1540] avg loss 0.000525751, throughput 2.87933K wps
[Epoch 163 Batch 690/1540] avg loss 0.000604062, throughput 2.859K wps
[Epoch 163 Batch 720/1540] avg loss 0.000802587, throughput 2.85083K wps
[Epoch 163 Batch 750/1540] avg loss 0.000685477, throughput 2.83383K wps
[Epoch 163 Batch 780/1540] avg loss 0.000741829, throughput 2.87096K wps
[Epoch 163 Batch 810/1540] avg loss 0.000793547, throughput 2.8444K wps
[Epoch 163 Batch 840/1540] avg loss 0.000965265, throughput 2.86747K wps
[Epoch 163 Batch 870/1540] avg loss 0.000815036, throughput 2.79991K wps
[Epoch 163 Batch 900/1540] avg loss 0.000944479, throughput 2.85614K wps
[Epoch 163 Batch 930/1540] avg loss 0.000763714, throughput 2.88039K wps
[Epoch 163 Batch 960/1540] avg loss 0.000668229, throughput 2.87078K wps
[Epoch 163 Batch 990/1540] avg loss 0.000697363, throughput 2.82203K wps
[Epoch 163 Batch 1020/1540] avg loss 0.000647874, throughput 2.79499K wps
[Epoch 163 Batch 1050/1540] avg loss 0.000718347, throughput 2.81205K wps
[Epoch 163 Batch 1080/1540] avg loss 0.000861964, throughput 2.87891K wps
[Epoch 163 Batch 1110/1540] avg loss 0.000684522, throughput 2.84493K wps
[Epoch 163 Batch 1140/1540] avg loss 0.000869753, throughput 2.88245K wps
[Epoch 163 Batch 1170/1540] avg loss 0.000706716, throughput 2.88081K wps
[Epoch 163 Batch 1200/1540] avg loss 0.000666041, throughput 2.84646K wps
[Epoch 163 Batch 1230/1540] avg loss 0.000942251, throughput 2.87706K wps
[Epoch 163 Batch 1260/1540] avg loss 0.00070063, throughput 2.86711K wps
[Epoch 163 Batch 1290/1540] avg loss 0.00091511, throughput 2.8723K wps
[Epoch 163 Batch 1320/1540] avg loss 0.000653025, throughput 2.84247K wps
[Epoch 163 Batch 1350/1540] avg loss 0.000703885, throughput 2.84281K wps
[Epoch 163 Batch 1380/1540] avg loss 0.000925421, throughput 2.8755K wps
[Epoch 163 Batch 1410/1540] avg loss 0.00100508, throughput 2.86272K wps
[Epoch 163 Batch 1440/1540] avg loss 0.000684064, throughput 2.86826K wps
[Epoch 163 Batch 1470/1540] avg loss 0.000865599, throughput 2.87674K wps
[Epoch 163 Batch 1500/1540] avg loss 0.000796179, throughput 2.88202K wps
[Epoch 163 Batch 1530/1540] avg loss 0.000644469, throughput 2.8333K wps
Begin Testing...
[Epoch 163] train avg loss 0.000729775, dev acc 0.8050, dev avg loss 0.91199, throughput 2.85215K wps
[Epoch 164 Batch 30/1540] avg loss 0.000618611, throughput 2.84711K wps
[Epoch 164 Batch 60/1540] avg loss 0.000597004, throughput 2.86568K wps
[Epoch 164 Batch 90/1540] avg loss 0.000563466, throughput 2.85873K wps
[Epoch 164 Batch 120/1540] avg loss 0.000598317, throughput 2.85777K wps
[Epoch 164 Batch 150/1540] avg loss 0.000469148, throughput 2.8797K wps
[Epoch 164 Batch 180/1540] avg loss 0.000609782, throughput 2.88128K wps
[Epoch 164 Batch 210/1540] avg loss 0.000623615, throughput 2.86671K wps
[Epoch 164 Batch 240/1540] avg loss 0.000576171, throughput 2.86914K wps
[Epoch 164 Batch 270/1540] avg loss 0.000830936, throughput 2.88776K wps
[Epoch 164 Batch 300/1540] avg loss 0.000633004, throughput 2.87787K wps
[Epoch 164 Batch 330/1540] avg loss 0.0007266, throughput 2.87691K wps
[Epoch 164 Batch 360/1540] avg loss 0.000909057, throughput 2.87363K wps
[Epoch 164 Batch 390/1540] avg loss 0.000573522, throughput 2.8654K wps
[Epoch 164 Batch 420/1540] avg loss 0.000804787, throughput 2.87594K wps
[Epoch 164 Batch 450/1540] avg loss 0.000811571, throughput 2.87163K wps
[Epoch 164 Batch 480/1540] avg loss 0.000797167, throughput 2.86938K wps
[Epoch 164 Batch 510/1540] avg loss 0.000874328, throughput 2.87088K wps
[Epoch 164 Batch 540/1540] avg loss 0.000732948, throughput 2.88259K wps
[Epoch 164 Batch 570/1540] avg loss 0.000881088, throughput 2.8785K wps
[Epoch 164 Batch 600/1540] avg loss 0.000739687, throughput 2.87314K wps
[Epoch 164 Batch 630/1540] avg loss 0.000648325, throughput 2.86933K wps
[Epoch 164 Batch 660/1540] avg loss 0.000643078, throughput 2.84414K wps
[Epoch 164 Batch 690/1540] avg loss 0.000710041, throughput 2.86076K wps
[Epoch 164 Batch 720/1540] avg loss 0.00067039, throughput 2.85943K wps
[Epoch 164 Batch 750/1540] avg loss 0.000967145, throughput 2.85264K wps
[Epoch 164 Batch 780/1540] avg loss 0.000644297, throughput 2.83675K wps
[Epoch 164 Batch 810/1540] avg loss 0.000693866, throughput 2.8754K wps
[Epoch 164 Batch 840/1540] avg loss 0.000864004, throughput 2.8747K wps
[Epoch 164 Batch 870/1540] avg loss 0.000669665, throughput 2.87586K wps
[Epoch 164 Batch 900/1540] avg loss 0.00105058, throughput 2.87793K wps
[Epoch 164 Batch 930/1540] avg loss 0.000683855, throughput 2.81828K wps
[Epoch 164 Batch 960/1540] avg loss 0.000898577, throughput 2.81424K wps
[Epoch 164 Batch 990/1540] avg loss 0.000705999, throughput 2.88153K wps
[Epoch 164 Batch 1020/1540] avg loss 0.000859491, throughput 2.86037K wps
[Epoch 164 Batch 1050/1540] avg loss 0.000813932, throughput 2.826K wps
[Epoch 164 Batch 1080/1540] avg loss 0.000707788, throughput 2.87693K wps
[Epoch 164 Batch 1110/1540] avg loss 0.000800879, throughput 2.8754K wps
[Epoch 164 Batch 1140/1540] avg loss 0.000832983, throughput 2.87721K wps
[Epoch 164 Batch 1170/1540] avg loss 0.000603591, throughput 2.87769K wps
[Epoch 164 Batch 1200/1540] avg loss 0.000762116, throughput 2.87129K wps
[Epoch 164 Batch 1230/1540] avg loss 0.000753181, throughput 2.86225K wps
[Epoch 164 Batch 1260/1540] avg loss 0.000928165, throughput 2.87804K wps
[Epoch 164 Batch 1290/1540] avg loss 0.000740202, throughput 2.86483K wps
[Epoch 164 Batch 1320/1540] avg loss 0.000680553, throughput 2.8382K wps
[Epoch 164 Batch 1350/1540] avg loss 0.000823604, throughput 2.86694K wps
[Epoch 164 Batch 1380/1540] avg loss 0.000698042, throughput 2.84355K wps
[Epoch 164 Batch 1410/1540] avg loss 0.000717926, throughput 2.85699K wps
[Epoch 164 Batch 1440/1540] avg loss 0.000811611, throughput 2.87351K wps
[Epoch 164 Batch 1470/1540] avg loss 0.000871757, throughput 2.81131K wps
[Epoch 164 Batch 1500/1540] avg loss 0.000784482, throughput 2.88059K wps
[Epoch 164 Batch 1530/1540] avg loss 0.00082861, throughput 2.8684K wps
Begin Testing...
[Epoch 164] train avg loss 0.000741541, dev acc 0.7867, dev avg loss 0.941285, throughput 2.86428K wps
[Epoch 165 Batch 30/1540] avg loss 0.000543494, throughput 2.89738K wps
[Epoch 165 Batch 60/1540] avg loss 0.000853479, throughput 2.86408K wps
[Epoch 165 Batch 90/1540] avg loss 0.000611127, throughput 2.87599K wps
[Epoch 165 Batch 120/1540] avg loss 0.000578808, throughput 2.83567K wps
[Epoch 165 Batch 150/1540] avg loss 0.000549951, throughput 2.87615K wps
[Epoch 165 Batch 180/1540] avg loss 0.000500746, throughput 2.82145K wps
[Epoch 165 Batch 210/1540] avg loss 0.000612762, throughput 2.8636K wps
[Epoch 165 Batch 240/1540] avg loss 0.000536662, throughput 2.85156K wps
[Epoch 165 Batch 270/1540] avg loss 0.000710397, throughput 2.82133K wps
[Epoch 165 Batch 300/1540] avg loss 0.00086619, throughput 2.83732K wps
[Epoch 165 Batch 330/1540] avg loss 0.000594133, throughput 2.85956K wps
[Epoch 165 Batch 360/1540] avg loss 0.000572989, throughput 2.82156K wps
[Epoch 165 Batch 390/1540] avg loss 0.000545279, throughput 2.87493K wps
[Epoch 165 Batch 420/1540] avg loss 0.000736024, throughput 2.87428K wps
[Epoch 165 Batch 450/1540] avg loss 0.000642636, throughput 2.83679K wps
[Epoch 165 Batch 480/1540] avg loss 0.000853074, throughput 2.84146K wps
[Epoch 165 Batch 510/1540] avg loss 0.00056907, throughput 2.84714K wps
[Epoch 165 Batch 540/1540] avg loss 0.000682435, throughput 2.80316K wps
[Epoch 165 Batch 570/1540] avg loss 0.000748514, throughput 2.82838K wps
[Epoch 165 Batch 600/1540] avg loss 0.000820074, throughput 2.87052K wps
[Epoch 165 Batch 630/1540] avg loss 0.000914551, throughput 2.88053K wps
[Epoch 165 Batch 660/1540] avg loss 0.000546429, throughput 2.87311K wps
[Epoch 165 Batch 690/1540] avg loss 0.000482502, throughput 2.86824K wps
[Epoch 165 Batch 720/1540] avg loss 0.000900485, throughput 2.86941K wps
[Epoch 165 Batch 750/1540] avg loss 0.000926216, throughput 2.87293K wps
[Epoch 165 Batch 780/1540] avg loss 0.000841644, throughput 2.85574K wps
[Epoch 165 Batch 810/1540] avg loss 0.000647334, throughput 2.88437K wps
[Epoch 165 Batch 840/1540] avg loss 0.000684147, throughput 2.86002K wps
[Epoch 165 Batch 870/1540] avg loss 0.000803088, throughput 2.86148K wps
[Epoch 165 Batch 900/1540] avg loss 0.000694668, throughput 2.85733K wps
[Epoch 165 Batch 930/1540] avg loss 0.000652961, throughput 2.81868K wps
[Epoch 165 Batch 960/1540] avg loss 0.000858908, throughput 2.83238K wps
[Epoch 165 Batch 990/1540] avg loss 0.000624546, throughput 2.86293K wps
[Epoch 165 Batch 1020/1540] avg loss 0.000842001, throughput 2.86629K wps
[Epoch 165 Batch 1050/1540] avg loss 0.000901165, throughput 2.79711K wps
[Epoch 165 Batch 1080/1540] avg loss 0.000519307, throughput 2.80674K wps
[Epoch 165 Batch 1110/1540] avg loss 0.000626728, throughput 2.87491K wps
[Epoch 165 Batch 1140/1540] avg loss 0.000671073, throughput 2.87751K wps
[Epoch 165 Batch 1170/1540] avg loss 0.000892734, throughput 2.82649K wps
[Epoch 165 Batch 1200/1540] avg loss 0.000804201, throughput 2.86689K wps
[Epoch 165 Batch 1230/1540] avg loss 0.000634267, throughput 2.77248K wps
[Epoch 165 Batch 1260/1540] avg loss 0.000682628, throughput 2.83509K wps
[Epoch 165 Batch 1290/1540] avg loss 0.000870636, throughput 2.87133K wps
[Epoch 165 Batch 1320/1540] avg loss 0.000743806, throughput 2.80309K wps
[Epoch 165 Batch 1350/1540] avg loss 0.000872667, throughput 2.85831K wps
[Epoch 165 Batch 1380/1540] avg loss 0.000775066, throughput 2.87765K wps
[Epoch 165 Batch 1410/1540] avg loss 0.000731504, throughput 2.8723K wps
[Epoch 165 Batch 1440/1540] avg loss 0.000712477, throughput 2.84961K wps
[Epoch 165 Batch 1470/1540] avg loss 0.000759599, throughput 2.83204K wps
[Epoch 165 Batch 1500/1540] avg loss 0.000868691, throughput 2.87201K wps
[Epoch 165 Batch 1530/1540] avg loss 0.000786043, throughput 2.87783K wps
Begin Testing...
[Epoch 165] train avg loss 0.000714408, dev acc 0.8028, dev avg loss 0.931664, throughput 2.85122K wps
[Epoch 166 Batch 30/1540] avg loss 0.000522772, throughput 2.93047K wps
[Epoch 166 Batch 60/1540] avg loss 0.000662995, throughput 2.85501K wps
[Epoch 166 Batch 90/1540] avg loss 0.000656786, throughput 2.84667K wps
[Epoch 166 Batch 120/1540] avg loss 0.000701452, throughput 2.82058K wps
[Epoch 166 Batch 150/1540] avg loss 0.000838878, throughput 2.86116K wps
[Epoch 166 Batch 180/1540] avg loss 0.000458422, throughput 2.87872K wps
[Epoch 166 Batch 210/1540] avg loss 0.000832175, throughput 2.86018K wps
[Epoch 166 Batch 240/1540] avg loss 0.000648689, throughput 2.82037K wps
[Epoch 166 Batch 270/1540] avg loss 0.000548512, throughput 2.80303K wps
[Epoch 166 Batch 300/1540] avg loss 0.000621763, throughput 2.83464K wps
[Epoch 166 Batch 330/1540] avg loss 0.000692739, throughput 2.85663K wps
[Epoch 166 Batch 360/1540] avg loss 0.00067854, throughput 2.8546K wps
[Epoch 166 Batch 390/1540] avg loss 0.000658714, throughput 2.80415K wps
[Epoch 166 Batch 420/1540] avg loss 0.000663502, throughput 2.82038K wps
[Epoch 166 Batch 450/1540] avg loss 0.000505743, throughput 2.87912K wps
[Epoch 166 Batch 480/1540] avg loss 0.000727942, throughput 2.80977K wps
[Epoch 166 Batch 510/1540] avg loss 0.000663931, throughput 2.83724K wps
[Epoch 166 Batch 540/1540] avg loss 0.000810406, throughput 2.86036K wps
[Epoch 166 Batch 570/1540] avg loss 0.000825598, throughput 2.83973K wps
[Epoch 166 Batch 600/1540] avg loss 0.000690291, throughput 2.872K wps
[Epoch 166 Batch 630/1540] avg loss 0.000619094, throughput 2.8741K wps
[Epoch 166 Batch 660/1540] avg loss 0.000874071, throughput 2.87895K wps
[Epoch 166 Batch 690/1540] avg loss 0.000882537, throughput 2.87063K wps
[Epoch 166 Batch 720/1540] avg loss 0.000554559, throughput 2.87858K wps
[Epoch 166 Batch 750/1540] avg loss 0.000816532, throughput 2.82137K wps
[Epoch 166 Batch 780/1540] avg loss 0.000772365, throughput 2.79291K wps
[Epoch 166 Batch 810/1540] avg loss 0.00065626, throughput 2.822K wps
[Epoch 166 Batch 840/1540] avg loss 0.00065139, throughput 2.83734K wps
[Epoch 166 Batch 870/1540] avg loss 0.000602868, throughput 2.85279K wps
[Epoch 166 Batch 900/1540] avg loss 0.000605123, throughput 2.87192K wps
[Epoch 166 Batch 930/1540] avg loss 0.000706823, throughput 2.79221K wps
[Epoch 166 Batch 960/1540] avg loss 0.000783229, throughput 2.80676K wps
[Epoch 166 Batch 990/1540] avg loss 0.000514762, throughput 2.80292K wps
[Epoch 166 Batch 1020/1540] avg loss 0.000711707, throughput 2.86293K wps
[Epoch 166 Batch 1050/1540] avg loss 0.000437464, throughput 2.79747K wps
[Epoch 166 Batch 1080/1540] avg loss 0.000551341, throughput 2.84722K wps
[Epoch 166 Batch 1110/1540] avg loss 0.000746377, throughput 2.86649K wps
[Epoch 166 Batch 1140/1540] avg loss 0.000718412, throughput 2.8673K wps
[Epoch 166 Batch 1170/1540] avg loss 0.000772046, throughput 2.86826K wps
[Epoch 166 Batch 1200/1540] avg loss 0.000988746, throughput 2.87051K wps
[Epoch 166 Batch 1230/1540] avg loss 0.000864668, throughput 2.81341K wps
[Epoch 166 Batch 1260/1540] avg loss 0.000761025, throughput 2.83506K wps
[Epoch 166 Batch 1290/1540] avg loss 0.000862642, throughput 2.82613K wps
[Epoch 166 Batch 1320/1540] avg loss 0.000822724, throughput 2.83553K wps
[Epoch 166 Batch 1350/1540] avg loss 0.000910766, throughput 2.87412K wps
[Epoch 166 Batch 1380/1540] avg loss 0.000888855, throughput 2.82399K wps
[Epoch 166 Batch 1410/1540] avg loss 0.00076154, throughput 2.86133K wps
[Epoch 166 Batch 1440/1540] avg loss 0.000678952, throughput 2.82993K wps
[Epoch 166 Batch 1470/1540] avg loss 0.000832903, throughput 2.86643K wps
[Epoch 166 Batch 1500/1540] avg loss 0.000754347, throughput 2.87252K wps
[Epoch 166 Batch 1530/1540] avg loss 0.000711622, throughput 2.87071K wps
Begin Testing...
[Epoch 166] train avg loss 0.000712215, dev acc 0.7936, dev avg loss 0.934706, throughput 2.84573K wps
[Epoch 167 Batch 30/1540] avg loss 0.000622865, throughput 2.90745K wps
[Epoch 167 Batch 60/1540] avg loss 0.000548117, throughput 2.8761K wps
[Epoch 167 Batch 90/1540] avg loss 0.000616991, throughput 2.87634K wps
[Epoch 167 Batch 120/1540] avg loss 0.000731698, throughput 2.88121K wps
[Epoch 167 Batch 150/1540] avg loss 0.000799917, throughput 2.86586K wps
[Epoch 167 Batch 180/1540] avg loss 0.000652084, throughput 2.8576K wps
[Epoch 167 Batch 210/1540] avg loss 0.000808016, throughput 2.84665K wps
[Epoch 167 Batch 240/1540] avg loss 0.000665581, throughput 2.83898K wps
[Epoch 167 Batch 270/1540] avg loss 0.000734658, throughput 2.85295K wps
[Epoch 167 Batch 300/1540] avg loss 0.00061646, throughput 2.85384K wps
[Epoch 167 Batch 330/1540] avg loss 0.000700461, throughput 2.86994K wps
[Epoch 167 Batch 360/1540] avg loss 0.000678331, throughput 2.79701K wps
[Epoch 167 Batch 390/1540] avg loss 0.000605849, throughput 2.79507K wps
[Epoch 167 Batch 420/1540] avg loss 0.000638308, throughput 2.79962K wps
[Epoch 167 Batch 450/1540] avg loss 0.000669699, throughput 2.87938K wps
[Epoch 167 Batch 480/1540] avg loss 0.000664168, throughput 2.86967K wps
[Epoch 167 Batch 510/1540] avg loss 0.000841315, throughput 2.87428K wps
[Epoch 167 Batch 540/1540] avg loss 0.000925884, throughput 2.87094K wps
[Epoch 167 Batch 570/1540] avg loss 0.000629923, throughput 2.87956K wps
[Epoch 167 Batch 600/1540] avg loss 0.000711685, throughput 2.88629K wps
[Epoch 167 Batch 630/1540] avg loss 0.000663252, throughput 2.81043K wps
[Epoch 167 Batch 660/1540] avg loss 0.000679233, throughput 2.87314K wps
[Epoch 167 Batch 690/1540] avg loss 0.000780254, throughput 2.87473K wps
[Epoch 167 Batch 720/1540] avg loss 0.000504684, throughput 2.8797K wps
[Epoch 167 Batch 750/1540] avg loss 0.000816355, throughput 2.88284K wps
[Epoch 167 Batch 780/1540] avg loss 0.000850502, throughput 2.86587K wps
[Epoch 167 Batch 810/1540] avg loss 0.000529889, throughput 2.86004K wps
[Epoch 167 Batch 840/1540] avg loss 0.000587479, throughput 2.82761K wps
[Epoch 167 Batch 870/1540] avg loss 0.000652889, throughput 2.78965K wps
[Epoch 167 Batch 900/1540] avg loss 0.000916123, throughput 2.86387K wps
[Epoch 167 Batch 930/1540] avg loss 0.000713454, throughput 2.82196K wps
[Epoch 167 Batch 960/1540] avg loss 0.000793289, throughput 2.84954K wps
[Epoch 167 Batch 990/1540] avg loss 0.000622809, throughput 2.86876K wps
[Epoch 167 Batch 1020/1540] avg loss 0.000866739, throughput 2.87762K wps
[Epoch 167 Batch 1050/1540] avg loss 0.000534637, throughput 2.88119K wps
[Epoch 167 Batch 1080/1540] avg loss 0.00061233, throughput 2.87778K wps
[Epoch 167 Batch 1110/1540] avg loss 0.000742206, throughput 2.86311K wps
[Epoch 167 Batch 1140/1540] avg loss 0.000676322, throughput 2.8718K wps
[Epoch 167 Batch 1170/1540] avg loss 0.000847594, throughput 2.8093K wps
[Epoch 167 Batch 1200/1540] avg loss 0.000666937, throughput 2.84138K wps
[Epoch 167 Batch 1230/1540] avg loss 0.000776442, throughput 2.86877K wps
[Epoch 167 Batch 1260/1540] avg loss 0.000659409, throughput 2.86627K wps
[Epoch 167 Batch 1290/1540] avg loss 0.000825675, throughput 2.8805K wps
[Epoch 167 Batch 1320/1540] avg loss 0.000834467, throughput 2.87969K wps
[Epoch 167 Batch 1350/1540] avg loss 0.000767134, throughput 2.87803K wps
[Epoch 167 Batch 1380/1540] avg loss 0.000889162, throughput 2.87652K wps
[Epoch 167 Batch 1410/1540] avg loss 0.000816202, throughput 2.82566K wps
[Epoch 167 Batch 1440/1540] avg loss 0.000855284, throughput 2.86773K wps
[Epoch 167 Batch 1470/1540] avg loss 0.000767725, throughput 2.8433K wps
[Epoch 167 Batch 1500/1540] avg loss 0.000718918, throughput 2.87339K wps
[Epoch 167 Batch 1530/1540] avg loss 0.000725341, throughput 2.86996K wps
Begin Testing...
[Epoch 167] train avg loss 0.000715976, dev acc 0.8028, dev avg loss 0.949372, throughput 2.85862K wps
[Epoch 168 Batch 30/1540] avg loss 0.000710901, throughput 2.89341K wps
[Epoch 168 Batch 60/1540] avg loss 0.000527853, throughput 2.84863K wps
[Epoch 168 Batch 90/1540] avg loss 0.000650586, throughput 2.87052K wps
[Epoch 168 Batch 120/1540] avg loss 0.00071746, throughput 2.8473K wps
[Epoch 168 Batch 150/1540] avg loss 0.000755653, throughput 2.86473K wps
[Epoch 168 Batch 180/1540] avg loss 0.000668848, throughput 2.82317K wps
[Epoch 168 Batch 210/1540] avg loss 0.000808093, throughput 2.8771K wps
[Epoch 168 Batch 240/1540] avg loss 0.000622934, throughput 2.87838K wps
[Epoch 168 Batch 270/1540] avg loss 0.000620194, throughput 2.85741K wps
[Epoch 168 Batch 300/1540] avg loss 0.00113584, throughput 2.88001K wps
[Epoch 168 Batch 330/1540] avg loss 0.000662857, throughput 2.87841K wps
[Epoch 168 Batch 360/1540] avg loss 0.000747319, throughput 2.81711K wps
[Epoch 168 Batch 390/1540] avg loss 0.000582368, throughput 2.87932K wps
[Epoch 168 Batch 420/1540] avg loss 0.000659207, throughput 2.87152K wps
[Epoch 168 Batch 450/1540] avg loss 0.000591932, throughput 2.86407K wps
[Epoch 168 Batch 480/1540] avg loss 0.000700781, throughput 2.85969K wps
[Epoch 168 Batch 510/1540] avg loss 0.000630856, throughput 2.83292K wps
[Epoch 168 Batch 540/1540] avg loss 0.000714551, throughput 2.86948K wps
[Epoch 168 Batch 570/1540] avg loss 0.000693189, throughput 2.82726K wps
[Epoch 168 Batch 600/1540] avg loss 0.000761862, throughput 2.8517K wps
[Epoch 168 Batch 630/1540] avg loss 0.000877974, throughput 2.83653K wps
[Epoch 168 Batch 660/1540] avg loss 0.000547152, throughput 2.8283K wps
[Epoch 168 Batch 690/1540] avg loss 0.000721651, throughput 2.85964K wps
[Epoch 168 Batch 720/1540] avg loss 0.000498865, throughput 2.8761K wps
[Epoch 168 Batch 750/1540] avg loss 0.0005221, throughput 2.85817K wps
[Epoch 168 Batch 780/1540] avg loss 0.000676201, throughput 2.88247K wps
[Epoch 168 Batch 810/1540] avg loss 0.00073621, throughput 2.8836K wps
[Epoch 168 Batch 840/1540] avg loss 0.000775018, throughput 2.84617K wps
[Epoch 168 Batch 870/1540] avg loss 0.000760992, throughput 2.88331K wps
[Epoch 168 Batch 900/1540] avg loss 0.000844432, throughput 2.8724K wps
[Epoch 168 Batch 930/1540] avg loss 0.000661867, throughput 2.82072K wps
[Epoch 168 Batch 960/1540] avg loss 0.000803762, throughput 2.83957K wps
[Epoch 168 Batch 990/1540] avg loss 0.000708334, throughput 2.83292K wps
[Epoch 168 Batch 1020/1540] avg loss 0.000682781, throughput 2.87968K wps
[Epoch 168 Batch 1050/1540] avg loss 0.0004357, throughput 2.87184K wps
[Epoch 168 Batch 1080/1540] avg loss 0.000614995, throughput 2.8721K wps
[Epoch 168 Batch 1110/1540] avg loss 0.000946786, throughput 2.86237K wps
[Epoch 168 Batch 1140/1540] avg loss 0.000632973, throughput 2.85778K wps
[Epoch 168 Batch 1170/1540] avg loss 0.000627768, throughput 2.83179K wps
[Epoch 168 Batch 1200/1540] avg loss 0.000676388, throughput 2.85928K wps
[Epoch 168 Batch 1230/1540] avg loss 0.000733376, throughput 2.86533K wps
[Epoch 168 Batch 1260/1540] avg loss 0.000843027, throughput 2.86073K wps
[Epoch 168 Batch 1290/1540] avg loss 0.000709908, throughput 2.8693K wps
[Epoch 168 Batch 1320/1540] avg loss 0.000671026, throughput 2.83843K wps
[Epoch 168 Batch 1350/1540] avg loss 0.000819315, throughput 2.86326K wps
[Epoch 168 Batch 1380/1540] avg loss 0.000687158, throughput 2.82748K wps
[Epoch 168 Batch 1410/1540] avg loss 0.0008246, throughput 2.85816K wps
[Epoch 168 Batch 1440/1540] avg loss 0.000722339, throughput 2.86726K wps
[Epoch 168 Batch 1470/1540] avg loss 0.000928208, throughput 2.87223K wps
[Epoch 168 Batch 1500/1540] avg loss 0.000970168, throughput 2.86743K wps
[Epoch 168 Batch 1530/1540] avg loss 0.000806794, throughput 2.85324K wps
Begin Testing...
[Epoch 168] train avg loss 0.000715541, dev acc 0.8028, dev avg loss 0.949566, throughput 2.85821K wps
[Epoch 169 Batch 30/1540] avg loss 0.000736159, throughput 2.91807K wps
[Epoch 169 Batch 60/1540] avg loss 0.000727833, throughput 2.81541K wps
[Epoch 169 Batch 90/1540] avg loss 0.000729077, throughput 2.86328K wps
[Epoch 169 Batch 120/1540] avg loss 0.000518615, throughput 2.87658K wps
[Epoch 169 Batch 150/1540] avg loss 0.000461121, throughput 2.85198K wps
[Epoch 169 Batch 180/1540] avg loss 0.000662829, throughput 2.83735K wps
[Epoch 169 Batch 210/1540] avg loss 0.000620118, throughput 2.86285K wps
[Epoch 169 Batch 240/1540] avg loss 0.000751468, throughput 2.84483K wps
[Epoch 169 Batch 270/1540] avg loss 0.000770259, throughput 2.84576K wps
[Epoch 169 Batch 300/1540] avg loss 0.000520967, throughput 2.84197K wps
[Epoch 169 Batch 330/1540] avg loss 0.000585752, throughput 2.84507K wps
[Epoch 169 Batch 360/1540] avg loss 0.00060741, throughput 2.8702K wps
[Epoch 169 Batch 390/1540] avg loss 0.000675577, throughput 2.8557K wps
[Epoch 169 Batch 420/1540] avg loss 0.000693895, throughput 2.86699K wps
[Epoch 169 Batch 450/1540] avg loss 0.000631171, throughput 2.79949K wps
[Epoch 169 Batch 480/1540] avg loss 0.000567591, throughput 2.82401K wps
[Epoch 169 Batch 510/1540] avg loss 0.000791559, throughput 2.87712K wps
[Epoch 169 Batch 540/1540] avg loss 0.00074983, throughput 2.86311K wps
[Epoch 169 Batch 570/1540] avg loss 0.000847274, throughput 2.80069K wps
[Epoch 169 Batch 600/1540] avg loss 0.00101116, throughput 2.85974K wps
[Epoch 169 Batch 630/1540] avg loss 0.000772915, throughput 2.87733K wps
[Epoch 169 Batch 660/1540] avg loss 0.000566982, throughput 2.87426K wps
[Epoch 169 Batch 690/1540] avg loss 0.000660299, throughput 2.82055K wps
[Epoch 169 Batch 720/1540] avg loss 0.000574679, throughput 2.79184K wps
[Epoch 169 Batch 750/1540] avg loss 0.000635628, throughput 2.79781K wps
[Epoch 169 Batch 780/1540] avg loss 0.00100224, throughput 2.86986K wps
[Epoch 169 Batch 810/1540] avg loss 0.00066222, throughput 2.88096K wps
[Epoch 169 Batch 840/1540] avg loss 0.000743802, throughput 2.85735K wps
[Epoch 169 Batch 870/1540] avg loss 0.000807607, throughput 2.84876K wps
[Epoch 169 Batch 900/1540] avg loss 0.000848865, throughput 2.87641K wps
[Epoch 169 Batch 930/1540] avg loss 0.000746732, throughput 2.85938K wps
[Epoch 169 Batch 960/1540] avg loss 0.000698755, throughput 2.80876K wps
[Epoch 169 Batch 990/1540] avg loss 0.000870239, throughput 2.87927K wps
[Epoch 169 Batch 1020/1540] avg loss 0.000872944, throughput 2.87561K wps
[Epoch 169 Batch 1050/1540] avg loss 0.000732142, throughput 2.87569K wps
[Epoch 169 Batch 1080/1540] avg loss 0.000813658, throughput 2.84477K wps
[Epoch 169 Batch 1110/1540] avg loss 0.000677873, throughput 2.8804K wps
[Epoch 169 Batch 1140/1540] avg loss 0.00081928, throughput 2.83162K wps
[Epoch 169 Batch 1170/1540] avg loss 0.000587562, throughput 2.81003K wps
[Epoch 169 Batch 1200/1540] avg loss 0.000652243, throughput 2.84322K wps
[Epoch 169 Batch 1230/1540] avg loss 0.000885292, throughput 2.86055K wps
[Epoch 169 Batch 1260/1540] avg loss 0.000769488, throughput 2.87808K wps
[Epoch 169 Batch 1290/1540] avg loss 0.000867973, throughput 2.84888K wps
[Epoch 169 Batch 1320/1540] avg loss 0.000897693, throughput 2.84373K wps
[Epoch 169 Batch 1350/1540] avg loss 0.000717535, throughput 2.8414K wps
[Epoch 169 Batch 1380/1540] avg loss 0.000728922, throughput 2.84107K wps
[Epoch 169 Batch 1410/1540] avg loss 0.0008484, throughput 2.84131K wps
[Epoch 169 Batch 1440/1540] avg loss 0.000831216, throughput 2.88111K wps
[Epoch 169 Batch 1470/1540] avg loss 0.00108436, throughput 2.87971K wps
[Epoch 169 Batch 1500/1540] avg loss 0.000796743, throughput 2.85122K wps
[Epoch 169 Batch 1530/1540] avg loss 0.000570783, throughput 2.82446K wps
Begin Testing...
[Epoch 169] train avg loss 0.000733478, dev acc 0.7993, dev avg loss 0.930446, throughput 2.85107K wps
[Epoch 170 Batch 30/1540] avg loss 0.00061957, throughput 2.88432K wps
[Epoch 170 Batch 60/1540] avg loss 0.000704047, throughput 2.86717K wps
[Epoch 170 Batch 90/1540] avg loss 0.000444069, throughput 2.84853K wps
[Epoch 170 Batch 120/1540] avg loss 0.000744309, throughput 2.86028K wps
[Epoch 170 Batch 150/1540] avg loss 0.000619203, throughput 2.85548K wps
[Epoch 170 Batch 180/1540] avg loss 0.000798196, throughput 2.87586K wps
[Epoch 170 Batch 210/1540] avg loss 0.000662809, throughput 2.85827K wps
[Epoch 170 Batch 240/1540] avg loss 0.000657227, throughput 2.86175K wps
[Epoch 170 Batch 270/1540] avg loss 0.000479858, throughput 2.8372K wps
[Epoch 170 Batch 300/1540] avg loss 0.000793677, throughput 2.85613K wps
[Epoch 170 Batch 330/1540] avg loss 0.000717412, throughput 2.86732K wps
[Epoch 170 Batch 360/1540] avg loss 0.000702718, throughput 2.87847K wps
[Epoch 170 Batch 390/1540] avg loss 0.000650771, throughput 2.88374K wps
[Epoch 170 Batch 420/1540] avg loss 0.000573555, throughput 2.87617K wps
[Epoch 170 Batch 450/1540] avg loss 0.000889762, throughput 2.87192K wps
[Epoch 170 Batch 480/1540] avg loss 0.000684273, throughput 2.88256K wps
[Epoch 170 Batch 510/1540] avg loss 0.000794761, throughput 2.87115K wps
[Epoch 170 Batch 540/1540] avg loss 0.000685538, throughput 2.87093K wps
[Epoch 170 Batch 570/1540] avg loss 0.000642064, throughput 2.87608K wps
[Epoch 170 Batch 600/1540] avg loss 0.000574391, throughput 2.8749K wps
[Epoch 170 Batch 630/1540] avg loss 0.000921238, throughput 2.85735K wps
[Epoch 170 Batch 660/1540] avg loss 0.000834542, throughput 2.83443K wps
[Epoch 170 Batch 690/1540] avg loss 0.000607229, throughput 2.87225K wps
[Epoch 170 Batch 720/1540] avg loss 0.000889234, throughput 2.86944K wps
[Epoch 170 Batch 750/1540] avg loss 0.00062098, throughput 2.86267K wps
[Epoch 170 Batch 780/1540] avg loss 0.000735045, throughput 2.85935K wps
[Epoch 170 Batch 810/1540] avg loss 0.000680405, throughput 2.87467K wps
[Epoch 170 Batch 840/1540] avg loss 0.000786261, throughput 2.85717K wps
[Epoch 170 Batch 870/1540] avg loss 0.000776988, throughput 2.8603K wps
[Epoch 170 Batch 900/1540] avg loss 0.000608831, throughput 2.8661K wps
[Epoch 170 Batch 930/1540] avg loss 0.000663857, throughput 2.86308K wps
[Epoch 170 Batch 960/1540] avg loss 0.000912488, throughput 2.85419K wps
[Epoch 170 Batch 990/1540] avg loss 0.000820426, throughput 2.87748K wps
[Epoch 170 Batch 1020/1540] avg loss 0.000592793, throughput 2.8538K wps
[Epoch 170 Batch 1050/1540] avg loss 0.000765936, throughput 2.88085K wps
[Epoch 170 Batch 1080/1540] avg loss 0.000829212, throughput 2.86868K wps
[Epoch 170 Batch 1110/1540] avg loss 0.000626227, throughput 2.87123K wps
[Epoch 170 Batch 1140/1540] avg loss 0.000832468, throughput 2.78433K wps
[Epoch 170 Batch 1170/1540] avg loss 0.000852165, throughput 2.84863K wps
[Epoch 170 Batch 1200/1540] avg loss 0.000551511, throughput 2.86788K wps
[Epoch 170 Batch 1230/1540] avg loss 0.000665061, throughput 2.86923K wps
[Epoch 170 Batch 1260/1540] avg loss 0.000907941, throughput 2.87727K wps
[Epoch 170 Batch 1290/1540] avg loss 0.000779886, throughput 2.87963K wps
[Epoch 170 Batch 1320/1540] avg loss 0.000558797, throughput 2.87685K wps
[Epoch 170 Batch 1350/1540] avg loss 0.000830594, throughput 2.87434K wps
[Epoch 170 Batch 1380/1540] avg loss 0.000682353, throughput 2.86053K wps
[Epoch 170 Batch 1410/1540] avg loss 0.000803477, throughput 2.88028K wps
[Epoch 170 Batch 1440/1540] avg loss 0.000628327, throughput 2.88065K wps
[Epoch 170 Batch 1470/1540] avg loss 0.000605721, throughput 2.87555K wps
[Epoch 170 Batch 1500/1540] avg loss 0.000783104, throughput 2.86659K wps
[Epoch 170 Batch 1530/1540] avg loss 0.000588769, throughput 2.86903K wps
Begin Testing...
[Epoch 170] train avg loss 0.00071098, dev acc 0.8016, dev avg loss 0.921145, throughput 2.86568K wps
[Epoch 171 Batch 30/1540] avg loss 0.0007258, throughput 2.88091K wps
[Epoch 171 Batch 60/1540] avg loss 0.000588207, throughput 2.85094K wps
[Epoch 171 Batch 90/1540] avg loss 0.000482818, throughput 2.86822K wps
[Epoch 171 Batch 120/1540] avg loss 0.000603757, throughput 2.86128K wps
[Epoch 171 Batch 150/1540] avg loss 0.000775975, throughput 2.7796K wps
[Epoch 171 Batch 180/1540] avg loss 0.000577931, throughput 2.81843K wps
[Epoch 171 Batch 210/1540] avg loss 0.000680436, throughput 2.79156K wps
[Epoch 171 Batch 240/1540] avg loss 0.000521119, throughput 2.78365K wps
[Epoch 171 Batch 270/1540] avg loss 0.000586338, throughput 2.83067K wps
[Epoch 171 Batch 300/1540] avg loss 0.000664678, throughput 2.82664K wps
[Epoch 171 Batch 330/1540] avg loss 0.000855511, throughput 2.81257K wps
[Epoch 171 Batch 360/1540] avg loss 0.000595315, throughput 2.84007K wps
[Epoch 171 Batch 390/1540] avg loss 0.000604352, throughput 2.85866K wps
[Epoch 171 Batch 420/1540] avg loss 0.000618853, throughput 2.82799K wps
[Epoch 171 Batch 450/1540] avg loss 0.000722349, throughput 2.86826K wps
[Epoch 171 Batch 480/1540] avg loss 0.000651776, throughput 2.79844K wps
[Epoch 171 Batch 510/1540] avg loss 0.000588069, throughput 2.86768K wps
[Epoch 171 Batch 540/1540] avg loss 0.000738273, throughput 2.8613K wps
[Epoch 171 Batch 570/1540] avg loss 0.000707038, throughput 2.86433K wps
[Epoch 171 Batch 600/1540] avg loss 0.000519001, throughput 2.83277K wps
[Epoch 171 Batch 630/1540] avg loss 0.000573914, throughput 2.8798K wps
[Epoch 171 Batch 660/1540] avg loss 0.000462865, throughput 2.87375K wps
[Epoch 171 Batch 690/1540] avg loss 0.000574881, throughput 2.87303K wps
[Epoch 171 Batch 720/1540] avg loss 0.000709826, throughput 2.86291K wps
[Epoch 171 Batch 750/1540] avg loss 0.000722153, throughput 2.86015K wps
[Epoch 171 Batch 780/1540] avg loss 0.000749243, throughput 2.87523K wps
[Epoch 171 Batch 810/1540] avg loss 0.000633109, throughput 2.84515K wps
[Epoch 171 Batch 840/1540] avg loss 0.000861579, throughput 2.8839K wps
[Epoch 171 Batch 870/1540] avg loss 0.000827406, throughput 2.8396K wps
[Epoch 171 Batch 900/1540] avg loss 0.000680339, throughput 2.87005K wps
[Epoch 171 Batch 930/1540] avg loss 0.000633933, throughput 2.83072K wps
[Epoch 171 Batch 960/1540] avg loss 0.000605383, throughput 2.83275K wps
[Epoch 171 Batch 990/1540] avg loss 0.000627936, throughput 2.86354K wps
[Epoch 171 Batch 1020/1540] avg loss 0.000702523, throughput 2.86061K wps
[Epoch 171 Batch 1050/1540] avg loss 0.00102814, throughput 2.86203K wps
[Epoch 171 Batch 1080/1540] avg loss 0.00087437, throughput 2.86328K wps
[Epoch 171 Batch 1110/1540] avg loss 0.000755064, throughput 2.88083K wps
[Epoch 171 Batch 1140/1540] avg loss 0.000975066, throughput 2.82224K wps
[Epoch 171 Batch 1170/1540] avg loss 0.000716828, throughput 2.81789K wps
[Epoch 171 Batch 1200/1540] avg loss 0.000614718, throughput 2.86637K wps
[Epoch 171 Batch 1230/1540] avg loss 0.000645563, throughput 2.85023K wps
[Epoch 171 Batch 1260/1540] avg loss 0.000917196, throughput 2.87466K wps
[Epoch 171 Batch 1290/1540] avg loss 0.000743009, throughput 2.86758K wps
[Epoch 171 Batch 1320/1540] avg loss 0.000749772, throughput 2.87383K wps
[Epoch 171 Batch 1350/1540] avg loss 0.000850893, throughput 2.84903K wps
[Epoch 171 Batch 1380/1540] avg loss 0.000805336, throughput 2.85514K wps
[Epoch 171 Batch 1410/1540] avg loss 0.000829804, throughput 2.87715K wps
[Epoch 171 Batch 1440/1540] avg loss 0.00102395, throughput 2.85207K wps
[Epoch 171 Batch 1470/1540] avg loss 0.000717345, throughput 2.81277K wps
[Epoch 171 Batch 1500/1540] avg loss 0.000859569, throughput 2.79603K wps
[Epoch 171 Batch 1530/1540] avg loss 0.00094417, throughput 2.82612K wps
Begin Testing...
[Epoch 171] train avg loss 0.000710357, dev acc 0.7970, dev avg loss 0.945348, throughput 2.84748K wps
[Epoch 172 Batch 30/1540] avg loss 0.000542044, throughput 2.89541K wps
[Epoch 172 Batch 60/1540] avg loss 0.000708395, throughput 2.80158K wps
[Epoch 172 Batch 90/1540] avg loss 0.000592056, throughput 2.86799K wps
[Epoch 172 Batch 120/1540] avg loss 0.000760634, throughput 2.87467K wps
[Epoch 172 Batch 150/1540] avg loss 0.000474879, throughput 2.8473K wps
[Epoch 172 Batch 180/1540] avg loss 0.000748734, throughput 2.85066K wps
[Epoch 172 Batch 210/1540] avg loss 0.000702663, throughput 2.82477K wps
[Epoch 172 Batch 240/1540] avg loss 0.000536248, throughput 2.87647K wps
[Epoch 172 Batch 270/1540] avg loss 0.000824281, throughput 2.84473K wps
[Epoch 172 Batch 300/1540] avg loss 0.000842998, throughput 2.83764K wps
[Epoch 172 Batch 330/1540] avg loss 0.000766176, throughput 2.87198K wps
[Epoch 172 Batch 360/1540] avg loss 0.000744632, throughput 2.86906K wps
[Epoch 172 Batch 390/1540] avg loss 0.000837095, throughput 2.84697K wps
[Epoch 172 Batch 420/1540] avg loss 0.000718989, throughput 2.87004K wps
[Epoch 172 Batch 450/1540] avg loss 0.000884357, throughput 2.86766K wps
[Epoch 172 Batch 480/1540] avg loss 0.000803511, throughput 2.8544K wps
[Epoch 172 Batch 510/1540] avg loss 0.000692442, throughput 2.88082K wps
[Epoch 172 Batch 540/1540] avg loss 0.00065807, throughput 2.86374K wps
[Epoch 172 Batch 570/1540] avg loss 0.000621209, throughput 2.84616K wps
[Epoch 172 Batch 600/1540] avg loss 0.000881924, throughput 2.88249K wps
[Epoch 172 Batch 630/1540] avg loss 0.000598603, throughput 2.85051K wps
[Epoch 172 Batch 660/1540] avg loss 0.000575502, throughput 2.7959K wps
[Epoch 172 Batch 690/1540] avg loss 0.000526886, throughput 2.82767K wps
[Epoch 172 Batch 720/1540] avg loss 0.000728661, throughput 2.81018K wps
[Epoch 172 Batch 750/1540] avg loss 0.000627919, throughput 2.83812K wps
[Epoch 172 Batch 780/1540] avg loss 0.000688388, throughput 2.81071K wps
[Epoch 172 Batch 810/1540] avg loss 0.000630327, throughput 2.84802K wps
[Epoch 172 Batch 840/1540] avg loss 0.000911647, throughput 2.85382K wps
[Epoch 172 Batch 870/1540] avg loss 0.000509336, throughput 2.87277K wps
[Epoch 172 Batch 900/1540] avg loss 0.000756704, throughput 2.87356K wps
[Epoch 172 Batch 930/1540] avg loss 0.000616766, throughput 2.86833K wps
[Epoch 172 Batch 960/1540] avg loss 0.000645364, throughput 2.8659K wps
[Epoch 172 Batch 990/1540] avg loss 0.00090868, throughput 2.84974K wps
[Epoch 172 Batch 1020/1540] avg loss 0.00079669, throughput 2.8805K wps
[Epoch 172 Batch 1050/1540] avg loss 0.000685378, throughput 2.88159K wps
[Epoch 172 Batch 1080/1540] avg loss 0.000745711, throughput 2.881K wps
[Epoch 172 Batch 1110/1540] avg loss 0.000957254, throughput 2.84947K wps
[Epoch 172 Batch 1140/1540] avg loss 0.000570226, throughput 2.86555K wps
[Epoch 172 Batch 1170/1540] avg loss 0.000698297, throughput 2.88121K wps
[Epoch 172 Batch 1200/1540] avg loss 0.00073946, throughput 2.79734K wps
[Epoch 172 Batch 1230/1540] avg loss 0.000619308, throughput 2.84753K wps
[Epoch 172 Batch 1260/1540] avg loss 0.000670383, throughput 2.83782K wps
[Epoch 172 Batch 1290/1540] avg loss 0.000530761, throughput 2.85993K wps
[Epoch 172 Batch 1320/1540] avg loss 0.000786457, throughput 2.80951K wps
[Epoch 172 Batch 1350/1540] avg loss 0.000744686, throughput 2.86355K wps
[Epoch 172 Batch 1380/1540] avg loss 0.000568333, throughput 2.83228K wps
[Epoch 172 Batch 1410/1540] avg loss 0.000833342, throughput 2.87312K wps
[Epoch 172 Batch 1440/1540] avg loss 0.000692572, throughput 2.8383K wps
[Epoch 172 Batch 1470/1540] avg loss 0.000559228, throughput 2.8137K wps
[Epoch 172 Batch 1500/1540] avg loss 0.000910647, throughput 2.87717K wps
[Epoch 172 Batch 1530/1540] avg loss 0.000609798, throughput 2.87563K wps
Begin Testing...
[Epoch 172] train avg loss 0.000702783, dev acc 0.7924, dev avg loss 0.951948, throughput 2.85274K wps
[Epoch 173 Batch 30/1540] avg loss 0.000803716, throughput 2.85502K wps
[Epoch 173 Batch 60/1540] avg loss 0.000615488, throughput 2.79936K wps
[Epoch 173 Batch 90/1540] avg loss 0.000632367, throughput 2.78665K wps
[Epoch 173 Batch 120/1540] avg loss 0.000763795, throughput 2.81522K wps
[Epoch 173 Batch 150/1540] avg loss 0.000731956, throughput 2.87854K wps
[Epoch 173 Batch 180/1540] avg loss 0.00060324, throughput 2.83333K wps
[Epoch 173 Batch 210/1540] avg loss 0.000580413, throughput 2.86582K wps
[Epoch 173 Batch 240/1540] avg loss 0.000827478, throughput 2.84354K wps
[Epoch 173 Batch 270/1540] avg loss 0.000659173, throughput 2.82383K wps
[Epoch 173 Batch 300/1540] avg loss 0.000638285, throughput 2.87657K wps
[Epoch 173 Batch 330/1540] avg loss 0.000848621, throughput 2.85321K wps
[Epoch 173 Batch 360/1540] avg loss 0.000477273, throughput 2.82979K wps
[Epoch 173 Batch 390/1540] avg loss 0.000716588, throughput 2.83292K wps
[Epoch 173 Batch 420/1540] avg loss 0.000585245, throughput 2.82484K wps
[Epoch 173 Batch 450/1540] avg loss 0.00048523, throughput 2.87166K wps
[Epoch 173 Batch 480/1540] avg loss 0.000704905, throughput 2.86588K wps
[Epoch 173 Batch 510/1540] avg loss 0.000759523, throughput 2.8166K wps
[Epoch 173 Batch 540/1540] avg loss 0.00081793, throughput 2.83653K wps
[Epoch 173 Batch 570/1540] avg loss 0.000644204, throughput 2.87538K wps
[Epoch 173 Batch 600/1540] avg loss 0.000781304, throughput 2.83025K wps
[Epoch 173 Batch 630/1540] avg loss 0.000540301, throughput 2.79364K wps
[Epoch 173 Batch 660/1540] avg loss 0.000484754, throughput 2.8582K wps
[Epoch 173 Batch 690/1540] avg loss 0.000675945, throughput 2.80484K wps
[Epoch 173 Batch 720/1540] avg loss 0.000711282, throughput 2.81375K wps
[Epoch 173 Batch 750/1540] avg loss 0.000681772, throughput 2.87734K wps
[Epoch 173 Batch 780/1540] avg loss 0.000518028, throughput 2.87906K wps
[Epoch 173 Batch 810/1540] avg loss 0.000816065, throughput 2.87144K wps
[Epoch 173 Batch 840/1540] avg loss 0.000856907, throughput 2.83038K wps
[Epoch 173 Batch 870/1540] avg loss 0.000570516, throughput 2.81576K wps
[Epoch 173 Batch 900/1540] avg loss 0.000651774, throughput 2.8084K wps
[Epoch 173 Batch 930/1540] avg loss 0.0005173, throughput 2.799K wps
[Epoch 173 Batch 960/1540] avg loss 0.000760067, throughput 2.87713K wps
[Epoch 173 Batch 990/1540] avg loss 0.000769263, throughput 2.86814K wps
[Epoch 173 Batch 1020/1540] avg loss 0.000795587, throughput 2.8609K wps
[Epoch 173 Batch 1050/1540] avg loss 0.00069929, throughput 2.81959K wps
[Epoch 173 Batch 1080/1540] avg loss 0.000844992, throughput 2.83929K wps
[Epoch 173 Batch 1110/1540] avg loss 0.000638049, throughput 2.86741K wps
[Epoch 173 Batch 1140/1540] avg loss 0.000773168, throughput 2.85032K wps
[Epoch 173 Batch 1170/1540] avg loss 0.000672415, throughput 2.81018K wps
[Epoch 173 Batch 1200/1540] avg loss 0.000803332, throughput 2.83878K wps
[Epoch 173 Batch 1230/1540] avg loss 0.000887276, throughput 2.80342K wps
[Epoch 173 Batch 1260/1540] avg loss 0.00093184, throughput 2.87894K wps
[Epoch 173 Batch 1290/1540] avg loss 0.000784378, throughput 2.84339K wps
[Epoch 173 Batch 1320/1540] avg loss 0.000677617, throughput 2.86745K wps
[Epoch 173 Batch 1350/1540] avg loss 0.000785178, throughput 2.79087K wps
[Epoch 173 Batch 1380/1540] avg loss 0.000789922, throughput 2.82529K wps
[Epoch 173 Batch 1410/1540] avg loss 0.000632023, throughput 2.87224K wps
[Epoch 173 Batch 1440/1540] avg loss 0.000805385, throughput 2.86349K wps
[Epoch 173 Batch 1470/1540] avg loss 0.000931916, throughput 2.86592K wps
[Epoch 173 Batch 1500/1540] avg loss 0.000716454, throughput 2.84149K wps
[Epoch 173 Batch 1530/1540] avg loss 0.000606752, throughput 2.87774K wps
Begin Testing...
[Epoch 173] train avg loss 0.00070476, dev acc 0.7913, dev avg loss 0.965031, throughput 2.84151K wps
[Epoch 174 Batch 30/1540] avg loss 0.000638712, throughput 2.89326K wps
[Epoch 174 Batch 60/1540] avg loss 0.000631733, throughput 2.84563K wps
[Epoch 174 Batch 90/1540] avg loss 0.000609396, throughput 2.84904K wps
[Epoch 174 Batch 120/1540] avg loss 0.000605983, throughput 2.88111K wps
[Epoch 174 Batch 150/1540] avg loss 0.000525588, throughput 2.83877K wps
[Epoch 174 Batch 180/1540] avg loss 0.000522842, throughput 2.87654K wps
[Epoch 174 Batch 210/1540] avg loss 0.000557977, throughput 2.86879K wps
[Epoch 174 Batch 240/1540] avg loss 0.000614991, throughput 2.88286K wps
[Epoch 174 Batch 270/1540] avg loss 0.000700797, throughput 2.84188K wps
[Epoch 174 Batch 300/1540] avg loss 0.00053532, throughput 2.84211K wps
[Epoch 174 Batch 330/1540] avg loss 0.000625321, throughput 2.81864K wps
[Epoch 174 Batch 360/1540] avg loss 0.000681944, throughput 2.7997K wps
[Epoch 174 Batch 390/1540] avg loss 0.000773007, throughput 2.76747K wps
[Epoch 174 Batch 420/1540] avg loss 0.000859989, throughput 2.82744K wps
[Epoch 174 Batch 450/1540] avg loss 0.000545749, throughput 2.8219K wps
[Epoch 174 Batch 480/1540] avg loss 0.000557596, throughput 2.86793K wps
[Epoch 174 Batch 510/1540] avg loss 0.000820942, throughput 2.86466K wps
[Epoch 174 Batch 540/1540] avg loss 0.000656286, throughput 2.86664K wps
[Epoch 174 Batch 570/1540] avg loss 0.000693558, throughput 2.85335K wps
[Epoch 174 Batch 600/1540] avg loss 0.000591089, throughput 2.8515K wps
[Epoch 174 Batch 630/1540] avg loss 0.000599809, throughput 2.82083K wps
[Epoch 174 Batch 660/1540] avg loss 0.000905957, throughput 2.85994K wps
[Epoch 174 Batch 690/1540] avg loss 0.000755503, throughput 2.82706K wps
[Epoch 174 Batch 720/1540] avg loss 0.000824731, throughput 2.82958K wps
[Epoch 174 Batch 750/1540] avg loss 0.000691905, throughput 2.80625K wps
[Epoch 174 Batch 780/1540] avg loss 0.000802119, throughput 2.86406K wps
[Epoch 174 Batch 810/1540] avg loss 0.000656427, throughput 2.8746K wps
[Epoch 174 Batch 840/1540] avg loss 0.000732289, throughput 2.87066K wps
[Epoch 174 Batch 870/1540] avg loss 0.000814483, throughput 2.87151K wps
[Epoch 174 Batch 900/1540] avg loss 0.000757973, throughput 2.86558K wps
[Epoch 174 Batch 930/1540] avg loss 0.000807908, throughput 2.82432K wps
[Epoch 174 Batch 960/1540] avg loss 0.0005854, throughput 2.82196K wps
[Epoch 174 Batch 990/1540] avg loss 0.000681492, throughput 2.78166K wps
[Epoch 174 Batch 1020/1540] avg loss 0.000755222, throughput 2.87022K wps
[Epoch 174 Batch 1050/1540] avg loss 0.000694418, throughput 2.86128K wps
[Epoch 174 Batch 1080/1540] avg loss 0.000602495, throughput 2.86827K wps
[Epoch 174 Batch 1110/1540] avg loss 0.000546415, throughput 2.85259K wps
[Epoch 174 Batch 1140/1540] avg loss 0.000645988, throughput 2.88287K wps
[Epoch 174 Batch 1170/1540] avg loss 0.000579151, throughput 2.84766K wps
[Epoch 174 Batch 1200/1540] avg loss 0.000967943, throughput 2.86345K wps
[Epoch 174 Batch 1230/1540] avg loss 0.000693266, throughput 2.86206K wps
[Epoch 174 Batch 1260/1540] avg loss 0.000525197, throughput 2.82404K wps
[Epoch 174 Batch 1290/1540] avg loss 0.000828813, throughput 2.79697K wps
[Epoch 174 Batch 1320/1540] avg loss 0.000637555, throughput 2.82888K wps
[Epoch 174 Batch 1350/1540] avg loss 0.000688264, throughput 2.87425K wps
[Epoch 174 Batch 1380/1540] avg loss 0.000662548, throughput 2.88579K wps
[Epoch 174 Batch 1410/1540] avg loss 0.000873733, throughput 2.87669K wps
[Epoch 174 Batch 1440/1540] avg loss 0.000735888, throughput 2.82327K wps
[Epoch 174 Batch 1470/1540] avg loss 0.000846253, throughput 2.78443K wps
[Epoch 174 Batch 1500/1540] avg loss 0.000738728, throughput 2.86939K wps
[Epoch 174 Batch 1530/1540] avg loss 0.000708794, throughput 2.8464K wps
Begin Testing...
[Epoch 174] train avg loss 0.000689436, dev acc 0.7913, dev avg loss 1.01151, throughput 2.84679K wps
[Epoch 175 Batch 30/1540] avg loss 0.000696052, throughput 2.92425K wps
[Epoch 175 Batch 60/1540] avg loss 0.000616396, throughput 2.85372K wps
[Epoch 175 Batch 90/1540] avg loss 0.000488277, throughput 2.84529K wps
[Epoch 175 Batch 120/1540] avg loss 0.000702113, throughput 2.84244K wps
[Epoch 175 Batch 150/1540] avg loss 0.00048604, throughput 2.87191K wps
[Epoch 175 Batch 180/1540] avg loss 0.000781807, throughput 2.84334K wps
[Epoch 175 Batch 210/1540] avg loss 0.000715156, throughput 2.87071K wps
[Epoch 175 Batch 240/1540] avg loss 0.000570049, throughput 2.87029K wps
[Epoch 175 Batch 270/1540] avg loss 0.000728749, throughput 2.86945K wps
[Epoch 175 Batch 300/1540] avg loss 0.00057532, throughput 2.87539K wps
[Epoch 175 Batch 330/1540] avg loss 0.000713054, throughput 2.87931K wps
[Epoch 175 Batch 360/1540] avg loss 0.000682735, throughput 2.86616K wps
[Epoch 175 Batch 390/1540] avg loss 0.000661716, throughput 2.85352K wps
[Epoch 175 Batch 420/1540] avg loss 0.00072253, throughput 2.85255K wps
[Epoch 175 Batch 450/1540] avg loss 0.000666212, throughput 2.8848K wps
[Epoch 175 Batch 480/1540] avg loss 0.000720231, throughput 2.81718K wps
[Epoch 175 Batch 510/1540] avg loss 0.000614663, throughput 2.81893K wps
[Epoch 175 Batch 540/1540] avg loss 0.000733678, throughput 2.87561K wps
[Epoch 175 Batch 570/1540] avg loss 0.000622515, throughput 2.87066K wps
[Epoch 175 Batch 600/1540] avg loss 0.000570336, throughput 2.81785K wps
[Epoch 175 Batch 630/1540] avg loss 0.000724524, throughput 2.8806K wps
[Epoch 175 Batch 660/1540] avg loss 0.000697503, throughput 2.80272K wps
[Epoch 175 Batch 690/1540] avg loss 0.00085145, throughput 2.81996K wps
[Epoch 175 Batch 720/1540] avg loss 0.000808071, throughput 2.86584K wps
[Epoch 175 Batch 750/1540] avg loss 0.000708366, throughput 2.85218K wps
[Epoch 175 Batch 780/1540] avg loss 0.000662177, throughput 2.86394K wps
[Epoch 175 Batch 810/1540] avg loss 0.000708639, throughput 2.87514K wps
[Epoch 175 Batch 840/1540] avg loss 0.000734414, throughput 2.87084K wps
[Epoch 175 Batch 870/1540] avg loss 0.000846801, throughput 2.86435K wps
[Epoch 175 Batch 900/1540] avg loss 0.000761368, throughput 2.85584K wps
[Epoch 175 Batch 930/1540] avg loss 0.00073228, throughput 2.8332K wps
[Epoch 175 Batch 960/1540] avg loss 0.000714306, throughput 2.87912K wps
[Epoch 175 Batch 990/1540] avg loss 0.000814772, throughput 2.87406K wps
[Epoch 175 Batch 1020/1540] avg loss 0.000605997, throughput 2.87474K wps
[Epoch 175 Batch 1050/1540] avg loss 0.000638262, throughput 2.87192K wps
[Epoch 175 Batch 1080/1540] avg loss 0.000822494, throughput 2.85006K wps
[Epoch 175 Batch 1110/1540] avg loss 0.000744756, throughput 2.86514K wps
[Epoch 175 Batch 1140/1540] avg loss 0.000739063, throughput 2.82278K wps
[Epoch 175 Batch 1170/1540] avg loss 0.000730131, throughput 2.84826K wps
[Epoch 175 Batch 1200/1540] avg loss 0.000772756, throughput 2.81537K wps
[Epoch 175 Batch 1230/1540] avg loss 0.000762233, throughput 2.87012K wps
[Epoch 175 Batch 1260/1540] avg loss 0.000914268, throughput 2.86765K wps
[Epoch 175 Batch 1290/1540] avg loss 0.000648427, throughput 2.84686K wps
[Epoch 175 Batch 1320/1540] avg loss 0.000716863, throughput 2.84791K wps
[Epoch 175 Batch 1350/1540] avg loss 0.000670213, throughput 2.87468K wps
[Epoch 175 Batch 1380/1540] avg loss 0.000620262, throughput 2.87649K wps
[Epoch 175 Batch 1410/1540] avg loss 0.00102932, throughput 2.84171K wps
[Epoch 175 Batch 1440/1540] avg loss 0.000706455, throughput 2.80261K wps
[Epoch 175 Batch 1470/1540] avg loss 0.000840873, throughput 2.87629K wps
[Epoch 175 Batch 1500/1540] avg loss 0.000674473, throughput 2.85915K wps
[Epoch 175 Batch 1530/1540] avg loss 0.000554424, throughput 2.87813K wps
Begin Testing...
[Epoch 175] train avg loss 0.000704981, dev acc 0.7924, dev avg loss 0.981517, throughput 2.85735K wps
[Epoch 176 Batch 30/1540] avg loss 0.000696233, throughput 2.89056K wps
[Epoch 176 Batch 60/1540] avg loss 0.000574137, throughput 2.86719K wps
[Epoch 176 Batch 90/1540] avg loss 0.000578985, throughput 2.86683K wps
[Epoch 176 Batch 120/1540] avg loss 0.000732311, throughput 2.86772K wps
[Epoch 176 Batch 150/1540] avg loss 0.000613573, throughput 2.8274K wps
[Epoch 176 Batch 180/1540] avg loss 0.000608421, throughput 2.82971K wps
[Epoch 176 Batch 210/1540] avg loss 0.000548977, throughput 2.86579K wps
[Epoch 176 Batch 240/1540] avg loss 0.00063114, throughput 2.86193K wps
[Epoch 176 Batch 270/1540] avg loss 0.000615804, throughput 2.8788K wps
[Epoch 176 Batch 300/1540] avg loss 0.000617605, throughput 2.84665K wps
[Epoch 176 Batch 330/1540] avg loss 0.000588746, throughput 2.87236K wps
[Epoch 176 Batch 360/1540] avg loss 0.000671844, throughput 2.8174K wps
[Epoch 176 Batch 390/1540] avg loss 0.000623826, throughput 2.87542K wps
[Epoch 176 Batch 420/1540] avg loss 0.000759509, throughput 2.87598K wps
[Epoch 176 Batch 450/1540] avg loss 0.000623404, throughput 2.86962K wps
[Epoch 176 Batch 480/1540] avg loss 0.000652327, throughput 2.86614K wps
[Epoch 176 Batch 510/1540] avg loss 0.000690412, throughput 2.84998K wps
[Epoch 176 Batch 540/1540] avg loss 0.000537184, throughput 2.77093K wps
[Epoch 176 Batch 570/1540] avg loss 0.000694916, throughput 2.83353K wps
[Epoch 176 Batch 600/1540] avg loss 0.000860119, throughput 2.87463K wps
[Epoch 176 Batch 630/1540] avg loss 0.00079505, throughput 2.87433K wps
[Epoch 176 Batch 660/1540] avg loss 0.000849539, throughput 2.838K wps
[Epoch 176 Batch 690/1540] avg loss 0.000519179, throughput 2.82456K wps
[Epoch 176 Batch 720/1540] avg loss 0.000560598, throughput 2.87206K wps
[Epoch 176 Batch 750/1540] avg loss 0.000631743, throughput 2.85387K wps
[Epoch 176 Batch 780/1540] avg loss 0.000703948, throughput 2.83545K wps
[Epoch 176 Batch 810/1540] avg loss 0.000767556, throughput 2.87103K wps
[Epoch 176 Batch 840/1540] avg loss 0.000669386, throughput 2.87421K wps
[Epoch 176 Batch 870/1540] avg loss 0.000832603, throughput 2.83448K wps
[Epoch 176 Batch 900/1540] avg loss 0.000815539, throughput 2.82106K wps
[Epoch 176 Batch 930/1540] avg loss 0.000832753, throughput 2.84678K wps
[Epoch 176 Batch 960/1540] avg loss 0.000706129, throughput 2.85652K wps
[Epoch 176 Batch 990/1540] avg loss 0.000709781, throughput 2.82614K wps
[Epoch 176 Batch 1020/1540] avg loss 0.000626787, throughput 2.87461K wps
[Epoch 176 Batch 1050/1540] avg loss 0.000716132, throughput 2.82344K wps
[Epoch 176 Batch 1080/1540] avg loss 0.000762464, throughput 2.80557K wps
[Epoch 176 Batch 1110/1540] avg loss 0.000959032, throughput 2.77985K wps
[Epoch 176 Batch 1140/1540] avg loss 0.000698422, throughput 2.83499K wps
[Epoch 176 Batch 1170/1540] avg loss 0.000699595, throughput 2.83162K wps
[Epoch 176 Batch 1200/1540] avg loss 0.000639468, throughput 2.85569K wps
[Epoch 176 Batch 1230/1540] avg loss 0.000871834, throughput 2.85817K wps
[Epoch 176 Batch 1260/1540] avg loss 0.000792012, throughput 2.83738K wps
[Epoch 176 Batch 1290/1540] avg loss 0.00088212, throughput 2.84332K wps
[Epoch 176 Batch 1320/1540] avg loss 0.000716676, throughput 2.85084K wps
[Epoch 176 Batch 1350/1540] avg loss 0.000720177, throughput 2.79075K wps
[Epoch 176 Batch 1380/1540] avg loss 0.000835609, throughput 2.84939K wps
[Epoch 176 Batch 1410/1540] avg loss 0.000748199, throughput 2.8694K wps
[Epoch 176 Batch 1440/1540] avg loss 0.000610254, throughput 2.85798K wps
[Epoch 176 Batch 1470/1540] avg loss 0.000822169, throughput 2.86011K wps
[Epoch 176 Batch 1500/1540] avg loss 0.000654659, throughput 2.88195K wps
[Epoch 176 Batch 1530/1540] avg loss 0.000572449, throughput 2.86879K wps
Begin Testing...
[Epoch 176] train avg loss 0.000699782, dev acc 0.8028, dev avg loss 0.959779, throughput 2.84861K wps
[Epoch 177 Batch 30/1540] avg loss 0.000614486, throughput 2.927K wps
[Epoch 177 Batch 60/1540] avg loss 0.00052319, throughput 2.83092K wps
[Epoch 177 Batch 90/1540] avg loss 0.000631307, throughput 2.86987K wps
[Epoch 177 Batch 120/1540] avg loss 0.000627609, throughput 2.81874K wps
[Epoch 177 Batch 150/1540] avg loss 0.000376161, throughput 2.79386K wps
[Epoch 177 Batch 180/1540] avg loss 0.000754537, throughput 2.80015K wps
[Epoch 177 Batch 210/1540] avg loss 0.000416048, throughput 2.84165K wps
[Epoch 177 Batch 240/1540] avg loss 0.000825431, throughput 2.83562K wps
[Epoch 177 Batch 270/1540] avg loss 0.000908854, throughput 2.79423K wps
[Epoch 177 Batch 300/1540] avg loss 0.000652923, throughput 2.79707K wps
[Epoch 177 Batch 330/1540] avg loss 0.000640356, throughput 2.79466K wps
[Epoch 177 Batch 360/1540] avg loss 0.000546877, throughput 2.80949K wps
[Epoch 177 Batch 390/1540] avg loss 0.000595551, throughput 2.86364K wps
[Epoch 177 Batch 420/1540] avg loss 0.000632828, throughput 2.87758K wps
[Epoch 177 Batch 450/1540] avg loss 0.0007321, throughput 2.87156K wps
[Epoch 177 Batch 480/1540] avg loss 0.000582992, throughput 2.81883K wps
[Epoch 177 Batch 510/1540] avg loss 0.000666724, throughput 2.80119K wps
[Epoch 177 Batch 540/1540] avg loss 0.000704557, throughput 2.85572K wps
[Epoch 177 Batch 570/1540] avg loss 0.000745002, throughput 2.86212K wps
[Epoch 177 Batch 600/1540] avg loss 0.000636442, throughput 2.85229K wps
[Epoch 177 Batch 630/1540] avg loss 0.000663136, throughput 2.82337K wps
[Epoch 177 Batch 660/1540] avg loss 0.000570569, throughput 2.84836K wps
[Epoch 177 Batch 690/1540] avg loss 0.000759643, throughput 2.87084K wps
[Epoch 177 Batch 720/1540] avg loss 0.000673117, throughput 2.87587K wps
[Epoch 177 Batch 750/1540] avg loss 0.00066135, throughput 2.87545K wps
[Epoch 177 Batch 780/1540] avg loss 0.000785187, throughput 2.87586K wps
[Epoch 177 Batch 810/1540] avg loss 0.000595392, throughput 2.85767K wps
[Epoch 177 Batch 840/1540] avg loss 0.000563353, throughput 2.86588K wps
[Epoch 177 Batch 870/1540] avg loss 0.000764089, throughput 2.86118K wps
[Epoch 177 Batch 900/1540] avg loss 0.000711954, throughput 2.86108K wps
[Epoch 177 Batch 930/1540] avg loss 0.0010393, throughput 2.78397K wps
[Epoch 177 Batch 960/1540] avg loss 0.000477719, throughput 2.84645K wps
[Epoch 177 Batch 990/1540] avg loss 0.000764699, throughput 2.87724K wps
[Epoch 177 Batch 1020/1540] avg loss 0.000712714, throughput 2.86457K wps
[Epoch 177 Batch 1050/1540] avg loss 0.00082614, throughput 2.88546K wps
[Epoch 177 Batch 1080/1540] avg loss 0.000708121, throughput 2.85159K wps
[Epoch 177 Batch 1110/1540] avg loss 0.000669846, throughput 2.86405K wps
[Epoch 177 Batch 1140/1540] avg loss 0.000849024, throughput 2.87124K wps
[Epoch 177 Batch 1170/1540] avg loss 0.000529622, throughput 2.8566K wps
[Epoch 177 Batch 1200/1540] avg loss 0.000730537, throughput 2.83067K wps
[Epoch 177 Batch 1230/1540] avg loss 0.000659492, throughput 2.86656K wps
[Epoch 177 Batch 1260/1540] avg loss 0.000638648, throughput 2.86808K wps
[Epoch 177 Batch 1290/1540] avg loss 0.000824678, throughput 2.83694K wps
[Epoch 177 Batch 1320/1540] avg loss 0.000783618, throughput 2.86931K wps
[Epoch 177 Batch 1350/1540] avg loss 0.000783529, throughput 2.84513K wps
[Epoch 177 Batch 1380/1540] avg loss 0.000760684, throughput 2.87754K wps
[Epoch 177 Batch 1410/1540] avg loss 0.000833803, throughput 2.87082K wps
[Epoch 177 Batch 1440/1540] avg loss 0.000939478, throughput 2.87599K wps
[Epoch 177 Batch 1470/1540] avg loss 0.000502985, throughput 2.8763K wps
[Epoch 177 Batch 1500/1540] avg loss 0.000800583, throughput 2.86131K wps
[Epoch 177 Batch 1530/1540] avg loss 0.000699192, throughput 2.87668K wps
Begin Testing...
[Epoch 177] train avg loss 0.000687862, dev acc 0.7947, dev avg loss 0.956971, throughput 2.84999K wps
[Epoch 178 Batch 30/1540] avg loss 0.000642631, throughput 2.93491K wps
[Epoch 178 Batch 60/1540] avg loss 0.000807964, throughput 2.88004K wps
[Epoch 178 Batch 90/1540] avg loss 0.000663055, throughput 2.83674K wps
[Epoch 178 Batch 120/1540] avg loss 0.000605397, throughput 2.87586K wps
[Epoch 178 Batch 150/1540] avg loss 0.000725973, throughput 2.87224K wps
[Epoch 178 Batch 180/1540] avg loss 0.000593674, throughput 2.78518K wps
[Epoch 178 Batch 210/1540] avg loss 0.000633011, throughput 2.87092K wps
[Epoch 178 Batch 240/1540] avg loss 0.0005696, throughput 2.80745K wps
[Epoch 178 Batch 270/1540] avg loss 0.000448022, throughput 2.79548K wps
[Epoch 178 Batch 300/1540] avg loss 0.000532905, throughput 2.84129K wps
[Epoch 178 Batch 330/1540] avg loss 0.000570899, throughput 2.86292K wps
[Epoch 178 Batch 360/1540] avg loss 0.000849171, throughput 2.86517K wps
[Epoch 178 Batch 390/1540] avg loss 0.000669726, throughput 2.85979K wps
[Epoch 178 Batch 420/1540] avg loss 0.000829831, throughput 2.86468K wps
[Epoch 178 Batch 450/1540] avg loss 0.000703844, throughput 2.85405K wps
[Epoch 178 Batch 480/1540] avg loss 0.000550362, throughput 2.78169K wps
[Epoch 178 Batch 510/1540] avg loss 0.000546425, throughput 2.82186K wps
[Epoch 178 Batch 540/1540] avg loss 0.000533965, throughput 2.84003K wps
[Epoch 178 Batch 570/1540] avg loss 0.000718115, throughput 2.88099K wps
[Epoch 178 Batch 600/1540] avg loss 0.000635959, throughput 2.8728K wps
[Epoch 178 Batch 630/1540] avg loss 0.000603125, throughput 2.85725K wps
[Epoch 178 Batch 660/1540] avg loss 0.000462466, throughput 2.84732K wps
[Epoch 178 Batch 690/1540] avg loss 0.000518346, throughput 2.85496K wps
[Epoch 178 Batch 720/1540] avg loss 0.000582208, throughput 2.86836K wps
[Epoch 178 Batch 750/1540] avg loss 0.000720816, throughput 2.87485K wps
[Epoch 178 Batch 780/1540] avg loss 0.000859139, throughput 2.85159K wps
[Epoch 178 Batch 810/1540] avg loss 0.000727962, throughput 2.85264K wps
[Epoch 178 Batch 840/1540] avg loss 0.000726391, throughput 2.87067K wps
[Epoch 178 Batch 870/1540] avg loss 0.000765111, throughput 2.8242K wps
[Epoch 178 Batch 900/1540] avg loss 0.000966045, throughput 2.82843K wps
[Epoch 178 Batch 930/1540] avg loss 0.000481788, throughput 2.85567K wps
[Epoch 178 Batch 960/1540] avg loss 0.000831239, throughput 2.84125K wps
[Epoch 178 Batch 990/1540] avg loss 0.000762685, throughput 2.87372K wps
[Epoch 178 Batch 1020/1540] avg loss 0.000799782, throughput 2.85292K wps
[Epoch 178 Batch 1050/1540] avg loss 0.00078963, throughput 2.87473K wps
[Epoch 178 Batch 1080/1540] avg loss 0.000707037, throughput 2.87261K wps
[Epoch 178 Batch 1110/1540] avg loss 0.0007769, throughput 2.86156K wps
[Epoch 178 Batch 1140/1540] avg loss 0.000536732, throughput 2.80085K wps
[Epoch 178 Batch 1170/1540] avg loss 0.000615009, throughput 2.80758K wps
[Epoch 178 Batch 1200/1540] avg loss 0.000609808, throughput 2.87852K wps
[Epoch 178 Batch 1230/1540] avg loss 0.000771377, throughput 2.86335K wps
[Epoch 178 Batch 1260/1540] avg loss 0.000812776, throughput 2.86408K wps
[Epoch 178 Batch 1290/1540] avg loss 0.000747299, throughput 2.84221K wps
[Epoch 178 Batch 1320/1540] avg loss 0.000621927, throughput 2.84554K wps
[Epoch 178 Batch 1350/1540] avg loss 0.000760598, throughput 2.8849K wps
[Epoch 178 Batch 1380/1540] avg loss 0.000930933, throughput 2.85812K wps
[Epoch 178 Batch 1410/1540] avg loss 0.00078973, throughput 2.87051K wps
[Epoch 178 Batch 1440/1540] avg loss 0.000647285, throughput 2.86836K wps
[Epoch 178 Batch 1470/1540] avg loss 0.000542635, throughput 2.84826K wps
[Epoch 178 Batch 1500/1540] avg loss 0.000633018, throughput 2.87323K wps
[Epoch 178 Batch 1530/1540] avg loss 0.000795022, throughput 2.86281K wps
Begin Testing...
[Epoch 178] train avg loss 0.000680148, dev acc 0.8005, dev avg loss 0.949951, throughput 2.8534K wps
[Epoch 179 Batch 30/1540] avg loss 0.000541498, throughput 2.92543K wps
[Epoch 179 Batch 60/1540] avg loss 0.000509396, throughput 2.82335K wps
[Epoch 179 Batch 90/1540] avg loss 0.00058071, throughput 2.79022K wps
[Epoch 179 Batch 120/1540] avg loss 0.000644504, throughput 2.84063K wps
[Epoch 179 Batch 150/1540] avg loss 0.000485696, throughput 2.87206K wps
[Epoch 179 Batch 180/1540] avg loss 0.000660315, throughput 2.85884K wps
[Epoch 179 Batch 210/1540] avg loss 0.000543656, throughput 2.83563K wps
[Epoch 179 Batch 240/1540] avg loss 0.00063047, throughput 2.87454K wps
[Epoch 179 Batch 270/1540] avg loss 0.000724971, throughput 2.81321K wps
[Epoch 179 Batch 300/1540] avg loss 0.000503447, throughput 2.87535K wps
[Epoch 179 Batch 330/1540] avg loss 0.00083274, throughput 2.86833K wps
[Epoch 179 Batch 360/1540] avg loss 0.000802104, throughput 2.8821K wps
[Epoch 179 Batch 390/1540] avg loss 0.000975747, throughput 2.88439K wps
[Epoch 179 Batch 420/1540] avg loss 0.00073639, throughput 2.86797K wps
[Epoch 179 Batch 450/1540] avg loss 0.000537319, throughput 2.86817K wps
[Epoch 179 Batch 480/1540] avg loss 0.000575237, throughput 2.82615K wps
[Epoch 179 Batch 510/1540] avg loss 0.000601358, throughput 2.82132K wps
[Epoch 179 Batch 540/1540] avg loss 0.000456282, throughput 2.87571K wps
[Epoch 179 Batch 570/1540] avg loss 0.000613152, throughput 2.87897K wps
[Epoch 179 Batch 600/1540] avg loss 0.000674948, throughput 2.86496K wps
[Epoch 179 Batch 630/1540] avg loss 0.000601558, throughput 2.86383K wps
[Epoch 179 Batch 660/1540] avg loss 0.000423629, throughput 2.87233K wps
[Epoch 179 Batch 690/1540] avg loss 0.000721612, throughput 2.87986K wps
[Epoch 179 Batch 720/1540] avg loss 0.000573806, throughput 2.81482K wps
[Epoch 179 Batch 750/1540] avg loss 0.000635738, throughput 2.8799K wps
[Epoch 179 Batch 780/1540] avg loss 0.000923339, throughput 2.88174K wps
[Epoch 179 Batch 810/1540] avg loss 0.000700607, throughput 2.86128K wps
[Epoch 179 Batch 840/1540] avg loss 0.000668144, throughput 2.87109K wps
[Epoch 179 Batch 870/1540] avg loss 0.000650506, throughput 2.85604K wps
[Epoch 179 Batch 900/1540] avg loss 0.000700543, throughput 2.83946K wps
[Epoch 179 Batch 930/1540] avg loss 0.000733261, throughput 2.85155K wps
[Epoch 179 Batch 960/1540] avg loss 0.000650063, throughput 2.78441K wps
[Epoch 179 Batch 990/1540] avg loss 0.000842793, throughput 2.79087K wps
[Epoch 179 Batch 1020/1540] avg loss 0.000719155, throughput 2.85065K wps
[Epoch 179 Batch 1050/1540] avg loss 0.00069838, throughput 2.87272K wps
[Epoch 179 Batch 1080/1540] avg loss 0.000690066, throughput 2.83638K wps
[Epoch 179 Batch 1110/1540] avg loss 0.000768026, throughput 2.83065K wps
[Epoch 179 Batch 1140/1540] avg loss 0.000876154, throughput 2.87885K wps
[Epoch 179 Batch 1170/1540] avg loss 0.00110061, throughput 2.875K wps
[Epoch 179 Batch 1200/1540] avg loss 0.000724032, throughput 2.82874K wps
[Epoch 179 Batch 1230/1540] avg loss 0.000936745, throughput 2.85678K wps
[Epoch 179 Batch 1260/1540] avg loss 0.000658691, throughput 2.84167K wps
[Epoch 179 Batch 1290/1540] avg loss 0.000662948, throughput 2.8456K wps
[Epoch 179 Batch 1320/1540] avg loss 0.00053797, throughput 2.87473K wps
[Epoch 179 Batch 1350/1540] avg loss 0.000661107, throughput 2.80964K wps
[Epoch 179 Batch 1380/1540] avg loss 0.000764686, throughput 2.80074K wps
[Epoch 179 Batch 1410/1540] avg loss 0.000803219, throughput 2.84785K wps
[Epoch 179 Batch 1440/1540] avg loss 0.00070685, throughput 2.87026K wps
[Epoch 179 Batch 1470/1540] avg loss 0.000732651, throughput 2.8811K wps
[Epoch 179 Batch 1500/1540] avg loss 0.000736406, throughput 2.82317K wps
[Epoch 179 Batch 1530/1540] avg loss 0.000575851, throughput 2.84648K wps
Begin Testing...
[Epoch 179] train avg loss 0.000681616, dev acc 0.7924, dev avg loss 0.975772, throughput 2.85204K wps
[Epoch 180 Batch 30/1540] avg loss 0.000712525, throughput 2.8594K wps
[Epoch 180 Batch 60/1540] avg loss 0.000604911, throughput 2.78629K wps
[Epoch 180 Batch 90/1540] avg loss 0.000736036, throughput 2.79016K wps
[Epoch 180 Batch 120/1540] avg loss 0.000459715, throughput 2.79595K wps
[Epoch 180 Batch 150/1540] avg loss 0.000632847, throughput 2.8457K wps
[Epoch 180 Batch 180/1540] avg loss 0.000528828, throughput 2.86988K wps
[Epoch 180 Batch 210/1540] avg loss 0.000676984, throughput 2.86747K wps
[Epoch 180 Batch 240/1540] avg loss 0.000572832, throughput 2.82874K wps
[Epoch 180 Batch 270/1540] avg loss 0.000749586, throughput 2.86881K wps
[Epoch 180 Batch 300/1540] avg loss 0.000681485, throughput 2.87606K wps
[Epoch 180 Batch 330/1540] avg loss 0.000658581, throughput 2.86553K wps
[Epoch 180 Batch 360/1540] avg loss 0.000605108, throughput 2.86746K wps
[Epoch 180 Batch 390/1540] avg loss 0.000501079, throughput 2.85755K wps
[Epoch 180 Batch 420/1540] avg loss 0.000652281, throughput 2.86517K wps
[Epoch 180 Batch 450/1540] avg loss 0.000464922, throughput 2.83972K wps
[Epoch 180 Batch 480/1540] avg loss 0.000573896, throughput 2.77974K wps
[Epoch 180 Batch 510/1540] avg loss 0.000622521, throughput 2.85914K wps
[Epoch 180 Batch 540/1540] avg loss 0.000558053, throughput 2.83005K wps
[Epoch 180 Batch 570/1540] avg loss 0.000615562, throughput 2.87591K wps
[Epoch 180 Batch 600/1540] avg loss 0.000523466, throughput 2.83671K wps
[Epoch 180 Batch 630/1540] avg loss 0.000653722, throughput 2.87912K wps
[Epoch 180 Batch 660/1540] avg loss 0.00053352, throughput 2.86229K wps
[Epoch 180 Batch 690/1540] avg loss 0.000893572, throughput 2.8535K wps
[Epoch 180 Batch 720/1540] avg loss 0.000454547, throughput 2.84658K wps
[Epoch 180 Batch 750/1540] avg loss 0.000658103, throughput 2.8207K wps
[Epoch 180 Batch 780/1540] avg loss 0.000581411, throughput 2.87458K wps
[Epoch 180 Batch 810/1540] avg loss 0.000503869, throughput 2.87342K wps
[Epoch 180 Batch 840/1540] avg loss 0.00075982, throughput 2.82896K wps
[Epoch 180 Batch 870/1540] avg loss 0.000745094, throughput 2.84026K wps
[Epoch 180 Batch 900/1540] avg loss 0.000658738, throughput 2.79848K wps
[Epoch 180 Batch 930/1540] avg loss 0.000759412, throughput 2.84016K wps
[Epoch 180 Batch 960/1540] avg loss 0.000628194, throughput 2.81605K wps
[Epoch 180 Batch 990/1540] avg loss 0.000778827, throughput 2.87803K wps
[Epoch 180 Batch 1020/1540] avg loss 0.000590671, throughput 2.88003K wps
[Epoch 180 Batch 1050/1540] avg loss 0.000539959, throughput 2.86617K wps
[Epoch 180 Batch 1080/1540] avg loss 0.000704012, throughput 2.8346K wps
[Epoch 180 Batch 1110/1540] avg loss 0.000871506, throughput 2.80434K wps
[Epoch 180 Batch 1140/1540] avg loss 0.000755169, throughput 2.86437K wps
[Epoch 180 Batch 1170/1540] avg loss 0.000664055, throughput 2.85604K wps
[Epoch 180 Batch 1200/1540] avg loss 0.000986432, throughput 2.84506K wps
[Epoch 180 Batch 1230/1540] avg loss 0.000617404, throughput 2.86079K wps
[Epoch 180 Batch 1260/1540] avg loss 0.000605347, throughput 2.86264K wps
[Epoch 180 Batch 1290/1540] avg loss 0.000612738, throughput 2.87866K wps
[Epoch 180 Batch 1320/1540] avg loss 0.000963573, throughput 2.88106K wps
[Epoch 180 Batch 1350/1540] avg loss 0.00111492, throughput 2.86608K wps
[Epoch 180 Batch 1380/1540] avg loss 0.000771744, throughput 2.86949K wps
[Epoch 180 Batch 1410/1540] avg loss 0.000836714, throughput 2.8774K wps
[Epoch 180 Batch 1440/1540] avg loss 0.00096129, throughput 2.85235K wps
[Epoch 180 Batch 1470/1540] avg loss 0.000703234, throughput 2.87136K wps
[Epoch 180 Batch 1500/1540] avg loss 0.000862735, throughput 2.83112K wps
[Epoch 180 Batch 1530/1540] avg loss 0.00104525, throughput 2.86376K wps
Begin Testing...
[Epoch 180] train avg loss 0.000684777, dev acc 0.8016, dev avg loss 0.964696, throughput 2.84959K wps
[Epoch 181 Batch 30/1540] avg loss 0.000540638, throughput 2.92569K wps
[Epoch 181 Batch 60/1540] avg loss 0.000518815, throughput 2.86225K wps
[Epoch 181 Batch 90/1540] avg loss 0.000808143, throughput 2.8759K wps
[Epoch 181 Batch 120/1540] avg loss 0.000596625, throughput 2.88156K wps
[Epoch 181 Batch 150/1540] avg loss 0.000728413, throughput 2.86059K wps
[Epoch 181 Batch 180/1540] avg loss 0.000586424, throughput 2.81563K wps
[Epoch 181 Batch 210/1540] avg loss 0.000610348, throughput 2.84884K wps
[Epoch 181 Batch 240/1540] avg loss 0.000568802, throughput 2.87347K wps
[Epoch 181 Batch 270/1540] avg loss 0.000651346, throughput 2.85768K wps
[Epoch 181 Batch 300/1540] avg loss 0.000670133, throughput 2.86948K wps
[Epoch 181 Batch 330/1540] avg loss 0.000564391, throughput 2.85592K wps
[Epoch 181 Batch 360/1540] avg loss 0.000522337, throughput 2.83696K wps
[Epoch 181 Batch 390/1540] avg loss 0.000651571, throughput 2.85624K wps
[Epoch 181 Batch 420/1540] avg loss 0.000556594, throughput 2.78546K wps
[Epoch 181 Batch 450/1540] avg loss 0.000733509, throughput 2.83352K wps
[Epoch 181 Batch 480/1540] avg loss 0.00061794, throughput 2.87423K wps
[Epoch 181 Batch 510/1540] avg loss 0.000871593, throughput 2.86267K wps
[Epoch 181 Batch 540/1540] avg loss 0.000743909, throughput 2.83584K wps
[Epoch 181 Batch 570/1540] avg loss 0.000595574, throughput 2.87529K wps
[Epoch 181 Batch 600/1540] avg loss 0.000674252, throughput 2.87271K wps
[Epoch 181 Batch 630/1540] avg loss 0.000693878, throughput 2.83487K wps
[Epoch 181 Batch 660/1540] avg loss 0.000668275, throughput 2.79678K wps
[Epoch 181 Batch 690/1540] avg loss 0.000639788, throughput 2.82545K wps
[Epoch 181 Batch 720/1540] avg loss 0.000554125, throughput 2.84238K wps
[Epoch 181 Batch 750/1540] avg loss 0.000792073, throughput 2.87616K wps
[Epoch 181 Batch 780/1540] avg loss 0.000493768, throughput 2.8707K wps
[Epoch 181 Batch 810/1540] avg loss 0.000517779, throughput 2.87028K wps
[Epoch 181 Batch 840/1540] avg loss 0.000668022, throughput 2.86207K wps
[Epoch 181 Batch 870/1540] avg loss 0.00084563, throughput 2.86676K wps
[Epoch 181 Batch 900/1540] avg loss 0.000703312, throughput 2.8647K wps
[Epoch 181 Batch 930/1540] avg loss 0.000799734, throughput 2.85706K wps
[Epoch 181 Batch 960/1540] avg loss 0.000592778, throughput 2.88061K wps
[Epoch 181 Batch 990/1540] avg loss 0.000634706, throughput 2.85328K wps
[Epoch 181 Batch 1020/1540] avg loss 0.000658527, throughput 2.88572K wps
[Epoch 181 Batch 1050/1540] avg loss 0.000701064, throughput 2.86845K wps
[Epoch 181 Batch 1080/1540] avg loss 0.00056234, throughput 2.86098K wps
[Epoch 181 Batch 1110/1540] avg loss 0.000724858, throughput 2.86529K wps
[Epoch 181 Batch 1140/1540] avg loss 0.000614503, throughput 2.86839K wps
[Epoch 181 Batch 1170/1540] avg loss 0.00071878, throughput 2.87779K wps
[Epoch 181 Batch 1200/1540] avg loss 0.000899411, throughput 2.8628K wps
[Epoch 181 Batch 1230/1540] avg loss 0.000561759, throughput 2.85552K wps
[Epoch 181 Batch 1260/1540] avg loss 0.000802274, throughput 2.4794K wps
[Epoch 181 Batch 1290/1540] avg loss 0.000655007, throughput 2.7799K wps
[Epoch 181 Batch 1320/1540] avg loss 0.000641938, throughput 2.85474K wps
[Epoch 181 Batch 1350/1540] avg loss 0.000526694, throughput 2.78476K wps
[Epoch 181 Batch 1380/1540] avg loss 0.000613297, throughput 2.81556K wps
[Epoch 181 Batch 1410/1540] avg loss 0.000605742, throughput 2.84341K wps
[Epoch 181 Batch 1440/1540] avg loss 0.000629343, throughput 2.82805K wps
[Epoch 181 Batch 1470/1540] avg loss 0.000748492, throughput 2.83082K wps
[Epoch 181 Batch 1500/1540] avg loss 0.000858643, throughput 2.86227K wps
[Epoch 181 Batch 1530/1540] avg loss 0.000805974, throughput 2.81467K wps
Begin Testing...
[Epoch 181] train avg loss 0.000663742, dev acc 0.7993, dev avg loss 0.945236, throughput 2.84392K wps
[Epoch 182 Batch 30/1540] avg loss 0.000867682, throughput 2.86425K wps
[Epoch 182 Batch 60/1540] avg loss 0.000429554, throughput 2.80127K wps
[Epoch 182 Batch 90/1540] avg loss 0.000449644, throughput 2.87118K wps
[Epoch 182 Batch 120/1540] avg loss 0.000635826, throughput 2.78783K wps
[Epoch 182 Batch 150/1540] avg loss 0.000514131, throughput 2.86175K wps
[Epoch 182 Batch 180/1540] avg loss 0.000557757, throughput 2.87938K wps
[Epoch 182 Batch 210/1540] avg loss 0.000804839, throughput 2.88607K wps
[Epoch 182 Batch 240/1540] avg loss 0.000509512, throughput 2.86233K wps
[Epoch 182 Batch 270/1540] avg loss 0.000572016, throughput 2.86756K wps
[Epoch 182 Batch 300/1540] avg loss 0.000692623, throughput 2.86091K wps
[Epoch 182 Batch 330/1540] avg loss 0.000558619, throughput 2.85228K wps
[Epoch 182 Batch 360/1540] avg loss 0.000695423, throughput 2.835K wps
[Epoch 182 Batch 390/1540] avg loss 0.000717485, throughput 2.79439K wps
[Epoch 182 Batch 420/1540] avg loss 0.000765192, throughput 2.80229K wps
[Epoch 182 Batch 450/1540] avg loss 0.000414509, throughput 2.8586K wps
[Epoch 182 Batch 480/1540] avg loss 0.000560871, throughput 2.8163K wps
[Epoch 182 Batch 510/1540] avg loss 0.0005111, throughput 2.86511K wps
[Epoch 182 Batch 540/1540] avg loss 0.00061617, throughput 2.81529K wps
[Epoch 182 Batch 570/1540] avg loss 0.000619405, throughput 2.83621K wps
[Epoch 182 Batch 600/1540] avg loss 0.000673858, throughput 2.81297K wps
[Epoch 182 Batch 630/1540] avg loss 0.00070065, throughput 2.87911K wps
[Epoch 182 Batch 660/1540] avg loss 0.000833896, throughput 2.87985K wps
[Epoch 182 Batch 690/1540] avg loss 0.00048568, throughput 2.84996K wps
[Epoch 182 Batch 720/1540] avg loss 0.000702223, throughput 2.83124K wps
[Epoch 182 Batch 750/1540] avg loss 0.000606596, throughput 2.87686K wps
[Epoch 182 Batch 780/1540] avg loss 0.000699149, throughput 2.82415K wps
[Epoch 182 Batch 810/1540] avg loss 0.000623151, throughput 2.8682K wps
[Epoch 182 Batch 840/1540] avg loss 0.000840884, throughput 2.8778K wps
[Epoch 182 Batch 870/1540] avg loss 0.000760803, throughput 2.88012K wps
[Epoch 182 Batch 900/1540] avg loss 0.000786175, throughput 2.86426K wps
[Epoch 182 Batch 930/1540] avg loss 0.000814545, throughput 2.7993K wps
[Epoch 182 Batch 960/1540] avg loss 0.000612275, throughput 2.82522K wps
[Epoch 182 Batch 990/1540] avg loss 0.000776133, throughput 2.87984K wps
[Epoch 182 Batch 1020/1540] avg loss 0.000578189, throughput 2.84539K wps
[Epoch 182 Batch 1050/1540] avg loss 0.000869671, throughput 2.83481K wps
[Epoch 182 Batch 1080/1540] avg loss 0.000840922, throughput 2.84878K wps
[Epoch 182 Batch 1110/1540] avg loss 0.000607192, throughput 2.87112K wps
[Epoch 182 Batch 1140/1540] avg loss 0.000751181, throughput 2.86213K wps
[Epoch 182 Batch 1170/1540] avg loss 0.000746037, throughput 2.8703K wps
[Epoch 182 Batch 1200/1540] avg loss 0.000624775, throughput 2.87786K wps
[Epoch 182 Batch 1230/1540] avg loss 0.000490136, throughput 2.84177K wps
[Epoch 182 Batch 1260/1540] avg loss 0.000830959, throughput 2.8232K wps
[Epoch 182 Batch 1290/1540] avg loss 0.000673446, throughput 2.86042K wps
[Epoch 182 Batch 1320/1540] avg loss 0.000759979, throughput 2.85201K wps
[Epoch 182 Batch 1350/1540] avg loss 0.000769539, throughput 2.835K wps
[Epoch 182 Batch 1380/1540] avg loss 0.000675462, throughput 2.80238K wps
[Epoch 182 Batch 1410/1540] avg loss 0.000665989, throughput 2.84962K wps
[Epoch 182 Batch 1440/1540] avg loss 0.000541261, throughput 2.84949K wps
[Epoch 182 Batch 1470/1540] avg loss 0.000864475, throughput 2.79234K wps
[Epoch 182 Batch 1500/1540] avg loss 0.000942224, throughput 2.84804K wps
[Epoch 182 Batch 1530/1540] avg loss 0.000664556, throughput 2.87139K wps
Begin Testing...
[Epoch 182] train avg loss 0.000673906, dev acc 0.7947, dev avg loss 0.963298, throughput 2.84705K wps
[Epoch 183 Batch 30/1540] avg loss 0.000670029, throughput 2.90988K wps
[Epoch 183 Batch 60/1540] avg loss 0.000669619, throughput 2.8288K wps
[Epoch 183 Batch 90/1540] avg loss 0.000851281, throughput 2.86538K wps
[Epoch 183 Batch 120/1540] avg loss 0.000731452, throughput 2.83993K wps
[Epoch 183 Batch 150/1540] avg loss 0.000674733, throughput 2.87191K wps
[Epoch 183 Batch 180/1540] avg loss 0.000527587, throughput 2.82356K wps
[Epoch 183 Batch 210/1540] avg loss 0.000675803, throughput 2.84608K wps
[Epoch 183 Batch 240/1540] avg loss 0.000565123, throughput 2.8729K wps
[Epoch 183 Batch 270/1540] avg loss 0.000735347, throughput 2.87715K wps
[Epoch 183 Batch 300/1540] avg loss 0.000611082, throughput 2.80512K wps
[Epoch 183 Batch 330/1540] avg loss 0.00052222, throughput 2.83639K wps
[Epoch 183 Batch 360/1540] avg loss 0.000424457, throughput 2.86293K wps
[Epoch 183 Batch 390/1540] avg loss 0.000781997, throughput 2.86894K wps
[Epoch 183 Batch 420/1540] avg loss 0.000689883, throughput 2.87349K wps
[Epoch 183 Batch 450/1540] avg loss 0.000635144, throughput 2.86618K wps
[Epoch 183 Batch 480/1540] avg loss 0.000666126, throughput 2.87076K wps
[Epoch 183 Batch 510/1540] avg loss 0.000628464, throughput 2.88074K wps
[Epoch 183 Batch 540/1540] avg loss 0.000603181, throughput 2.88039K wps
[Epoch 183 Batch 570/1540] avg loss 0.000666976, throughput 2.86737K wps
[Epoch 183 Batch 600/1540] avg loss 0.000940285, throughput 2.87647K wps
[Epoch 183 Batch 630/1540] avg loss 0.000756458, throughput 2.81528K wps
[Epoch 183 Batch 660/1540] avg loss 0.000615058, throughput 2.82668K wps
[Epoch 183 Batch 690/1540] avg loss 0.000658832, throughput 2.87716K wps
[Epoch 183 Batch 720/1540] avg loss 0.000736609, throughput 2.87284K wps
[Epoch 183 Batch 750/1540] avg loss 0.000736207, throughput 2.86951K wps
[Epoch 183 Batch 780/1540] avg loss 0.000707874, throughput 2.86348K wps
[Epoch 183 Batch 810/1540] avg loss 0.000676107, throughput 2.86659K wps
[Epoch 183 Batch 840/1540] avg loss 0.000504717, throughput 2.86899K wps
[Epoch 183 Batch 870/1540] avg loss 0.000967942, throughput 2.87506K wps
[Epoch 183 Batch 900/1540] avg loss 0.000648465, throughput 2.8798K wps
[Epoch 183 Batch 930/1540] avg loss 0.000707699, throughput 2.81888K wps
[Epoch 183 Batch 960/1540] avg loss 0.000772228, throughput 2.87057K wps
[Epoch 183 Batch 990/1540] avg loss 0.000775654, throughput 2.87063K wps
[Epoch 183 Batch 1020/1540] avg loss 0.000531177, throughput 2.87685K wps
[Epoch 183 Batch 1050/1540] avg loss 0.000650481, throughput 2.81599K wps
[Epoch 183 Batch 1080/1540] avg loss 0.000523825, throughput 2.85138K wps
[Epoch 183 Batch 1110/1540] avg loss 0.000764203, throughput 2.87132K wps
[Epoch 183 Batch 1140/1540] avg loss 0.000753101, throughput 2.86578K wps
[Epoch 183 Batch 1170/1540] avg loss 0.000844227, throughput 2.87637K wps
[Epoch 183 Batch 1200/1540] avg loss 0.000678874, throughput 2.84022K wps
[Epoch 183 Batch 1230/1540] avg loss 0.000593727, throughput 2.84084K wps
[Epoch 183 Batch 1260/1540] avg loss 0.000782165, throughput 2.88241K wps
[Epoch 183 Batch 1290/1540] avg loss 0.000747949, throughput 2.86113K wps
[Epoch 183 Batch 1320/1540] avg loss 0.000618995, throughput 2.85293K wps
[Epoch 183 Batch 1350/1540] avg loss 0.000689382, throughput 2.84232K wps
[Epoch 183 Batch 1380/1540] avg loss 0.000761086, throughput 2.8667K wps
[Epoch 183 Batch 1410/1540] avg loss 0.000774494, throughput 2.82167K wps
[Epoch 183 Batch 1440/1540] avg loss 0.000728685, throughput 2.8665K wps
[Epoch 183 Batch 1470/1540] avg loss 0.000644668, throughput 2.86674K wps
[Epoch 183 Batch 1500/1540] avg loss 0.000646229, throughput 2.7941K wps
[Epoch 183 Batch 1530/1540] avg loss 0.000659954, throughput 2.83647K wps
Begin Testing...
[Epoch 183] train avg loss 0.000684726, dev acc 0.8028, dev avg loss 0.971325, throughput 2.85741K wps
[Epoch 184 Batch 30/1540] avg loss 0.000462619, throughput 2.88108K wps
[Epoch 184 Batch 60/1540] avg loss 0.000720642, throughput 2.81698K wps
[Epoch 184 Batch 90/1540] avg loss 0.000607369, throughput 2.83971K wps
[Epoch 184 Batch 120/1540] avg loss 0.000630971, throughput 2.87214K wps
[Epoch 184 Batch 150/1540] avg loss 0.00057086, throughput 2.87954K wps
[Epoch 184 Batch 180/1540] avg loss 0.000497729, throughput 2.83498K wps
[Epoch 184 Batch 210/1540] avg loss 0.000770726, throughput 2.80911K wps
[Epoch 184 Batch 240/1540] avg loss 0.000632902, throughput 2.84469K wps
[Epoch 184 Batch 270/1540] avg loss 0.000820224, throughput 2.87101K wps
[Epoch 184 Batch 300/1540] avg loss 0.000595724, throughput 2.82647K wps
[Epoch 184 Batch 330/1540] avg loss 0.000659733, throughput 2.88129K wps
[Epoch 184 Batch 360/1540] avg loss 0.000671987, throughput 2.87144K wps
[Epoch 184 Batch 390/1540] avg loss 0.000976626, throughput 2.84057K wps
[Epoch 184 Batch 420/1540] avg loss 0.00065907, throughput 2.87124K wps
[Epoch 184 Batch 450/1540] avg loss 0.00057191, throughput 2.87747K wps
[Epoch 184 Batch 480/1540] avg loss 0.000631792, throughput 2.88183K wps
[Epoch 184 Batch 510/1540] avg loss 0.00057155, throughput 2.87759K wps
[Epoch 184 Batch 540/1540] avg loss 0.00062965, throughput 2.86683K wps
[Epoch 184 Batch 570/1540] avg loss 0.000787679, throughput 2.86074K wps
[Epoch 184 Batch 600/1540] avg loss 0.000757634, throughput 2.87064K wps
[Epoch 184 Batch 630/1540] avg loss 0.00060707, throughput 2.80452K wps
[Epoch 184 Batch 660/1540] avg loss 0.000710334, throughput 2.8509K wps
[Epoch 184 Batch 690/1540] avg loss 0.000517821, throughput 2.86216K wps
[Epoch 184 Batch 720/1540] avg loss 0.000641349, throughput 2.86352K wps
[Epoch 184 Batch 750/1540] avg loss 0.000742073, throughput 2.84739K wps
[Epoch 184 Batch 780/1540] avg loss 0.000510499, throughput 2.84039K wps
[Epoch 184 Batch 810/1540] avg loss 0.000835024, throughput 2.84823K wps
[Epoch 184 Batch 840/1540] avg loss 0.000653649, throughput 2.85774K wps
[Epoch 184 Batch 870/1540] avg loss 0.000661003, throughput 2.84193K wps
[Epoch 184 Batch 900/1540] avg loss 0.000797009, throughput 2.87088K wps
[Epoch 184 Batch 930/1540] avg loss 0.000690295, throughput 2.86737K wps
[Epoch 184 Batch 960/1540] avg loss 0.000719081, throughput 2.85842K wps
[Epoch 184 Batch 990/1540] avg loss 0.000824136, throughput 2.7979K wps
[Epoch 184 Batch 1020/1540] avg loss 0.000710571, throughput 2.83326K wps
[Epoch 184 Batch 1050/1540] avg loss 0.000831998, throughput 2.8489K wps
[Epoch 184 Batch 1080/1540] avg loss 0.000684052, throughput 2.85903K wps
[Epoch 184 Batch 1110/1540] avg loss 0.000849703, throughput 2.85305K wps
[Epoch 184 Batch 1140/1540] avg loss 0.000596141, throughput 2.87166K wps
[Epoch 184 Batch 1170/1540] avg loss 0.000856098, throughput 2.86494K wps
[Epoch 184 Batch 1200/1540] avg loss 0.000686751, throughput 2.85372K wps
[Epoch 184 Batch 1230/1540] avg loss 0.000681306, throughput 2.85593K wps
[Epoch 184 Batch 1260/1540] avg loss 0.000755748, throughput 2.87001K wps
[Epoch 184 Batch 1290/1540] avg loss 0.000582546, throughput 2.87341K wps
[Epoch 184 Batch 1320/1540] avg loss 0.000859356, throughput 2.86893K wps
[Epoch 184 Batch 1350/1540] avg loss 0.000966286, throughput 2.83869K wps
[Epoch 184 Batch 1380/1540] avg loss 0.000799871, throughput 2.79717K wps
[Epoch 184 Batch 1410/1540] avg loss 0.000543848, throughput 2.87664K wps
[Epoch 184 Batch 1440/1540] avg loss 0.00055601, throughput 2.85417K wps
[Epoch 184 Batch 1470/1540] avg loss 0.000753831, throughput 2.86819K wps
[Epoch 184 Batch 1500/1540] avg loss 0.00065252, throughput 2.77845K wps
[Epoch 184 Batch 1530/1540] avg loss 0.000806959, throughput 2.80874K wps
Begin Testing...
[Epoch 184] train avg loss 0.000693471, dev acc 0.7970, dev avg loss 0.970293, throughput 2.85207K wps
[Epoch 185 Batch 30/1540] avg loss 0.000718219, throughput 2.91267K wps
[Epoch 185 Batch 60/1540] avg loss 0.000581173, throughput 2.85538K wps
[Epoch 185 Batch 90/1540] avg loss 0.000521048, throughput 2.86696K wps
[Epoch 185 Batch 120/1540] avg loss 0.000646896, throughput 2.87821K wps
[Epoch 185 Batch 150/1540] avg loss 0.0004822, throughput 2.87925K wps
[Epoch 185 Batch 180/1540] avg loss 0.000523579, throughput 2.84977K wps
[Epoch 185 Batch 210/1540] avg loss 0.000639813, throughput 2.87551K wps
[Epoch 185 Batch 240/1540] avg loss 0.000532187, throughput 2.87623K wps
[Epoch 185 Batch 270/1540] avg loss 0.000837026, throughput 2.85767K wps
[Epoch 185 Batch 300/1540] avg loss 0.000680525, throughput 2.86843K wps
[Epoch 185 Batch 330/1540] avg loss 0.000705436, throughput 2.86333K wps
[Epoch 185 Batch 360/1540] avg loss 0.000568509, throughput 2.87729K wps
[Epoch 185 Batch 390/1540] avg loss 0.000457957, throughput 2.85832K wps
[Epoch 185 Batch 420/1540] avg loss 0.000601869, throughput 2.85436K wps
[Epoch 185 Batch 450/1540] avg loss 0.00063264, throughput 2.86054K wps
[Epoch 185 Batch 480/1540] avg loss 0.000662514, throughput 2.83513K wps
[Epoch 185 Batch 510/1540] avg loss 0.000784124, throughput 2.86794K wps
[Epoch 185 Batch 540/1540] avg loss 0.000633706, throughput 2.84678K wps
[Epoch 185 Batch 570/1540] avg loss 0.00076784, throughput 2.86609K wps
[Epoch 185 Batch 600/1540] avg loss 0.000660721, throughput 2.84964K wps
[Epoch 185 Batch 630/1540] avg loss 0.000468174, throughput 2.87447K wps
[Epoch 185 Batch 660/1540] avg loss 0.000573582, throughput 2.87015K wps
[Epoch 185 Batch 690/1540] avg loss 0.000874051, throughput 2.83926K wps
[Epoch 185 Batch 720/1540] avg loss 0.000787254, throughput 2.86028K wps
[Epoch 185 Batch 750/1540] avg loss 0.00067673, throughput 2.86344K wps
[Epoch 185 Batch 780/1540] avg loss 0.000637638, throughput 2.87077K wps
[Epoch 185 Batch 810/1540] avg loss 0.00065341, throughput 2.87109K wps
[Epoch 185 Batch 840/1540] avg loss 0.0006674, throughput 2.85697K wps
[Epoch 185 Batch 870/1540] avg loss 0.00059658, throughput 2.85934K wps
[Epoch 185 Batch 900/1540] avg loss 0.000719886, throughput 2.86993K wps
[Epoch 185 Batch 930/1540] avg loss 0.000829916, throughput 2.86541K wps
[Epoch 185 Batch 960/1540] avg loss 0.000711158, throughput 2.87864K wps
[Epoch 185 Batch 990/1540] avg loss 0.000849596, throughput 2.87116K wps
[Epoch 185 Batch 1020/1540] avg loss 0.000748506, throughput 2.8354K wps
[Epoch 185 Batch 1050/1540] avg loss 0.000789767, throughput 2.85906K wps
[Epoch 185 Batch 1080/1540] avg loss 0.00100011, throughput 2.86058K wps
[Epoch 185 Batch 1110/1540] avg loss 0.000693363, throughput 2.86429K wps
[Epoch 185 Batch 1140/1540] avg loss 0.000790564, throughput 2.85811K wps
[Epoch 185 Batch 1170/1540] avg loss 0.0006619, throughput 2.84551K wps
[Epoch 185 Batch 1200/1540] avg loss 0.000693668, throughput 2.86044K wps
[Epoch 185 Batch 1230/1540] avg loss 0.000616238, throughput 2.81205K wps
[Epoch 185 Batch 1260/1540] avg loss 0.000628304, throughput 2.82387K wps
[Epoch 185 Batch 1290/1540] avg loss 0.00065249, throughput 2.85784K wps
[Epoch 185 Batch 1320/1540] avg loss 0.00069591, throughput 2.86993K wps
[Epoch 185 Batch 1350/1540] avg loss 0.0007948, throughput 2.82192K wps
[Epoch 185 Batch 1380/1540] avg loss 0.000742074, throughput 2.82359K wps
[Epoch 185 Batch 1410/1540] avg loss 0.000687449, throughput 2.81827K wps
[Epoch 185 Batch 1440/1540] avg loss 0.00062723, throughput 2.79884K wps
[Epoch 185 Batch 1470/1540] avg loss 0.00066701, throughput 2.86538K wps
[Epoch 185 Batch 1500/1540] avg loss 0.000771744, throughput 2.86898K wps
[Epoch 185 Batch 1530/1540] avg loss 0.000637752, throughput 2.86796K wps
Begin Testing...
[Epoch 185] train avg loss 0.000677191, dev acc 0.7959, dev avg loss 0.962115, throughput 2.85811K wps
[Epoch 186 Batch 30/1540] avg loss 0.000698039, throughput 2.90546K wps
[Epoch 186 Batch 60/1540] avg loss 0.000789197, throughput 2.87479K wps
[Epoch 186 Batch 90/1540] avg loss 0.000590196, throughput 2.86288K wps
[Epoch 186 Batch 120/1540] avg loss 0.000701861, throughput 2.85944K wps
[Epoch 186 Batch 150/1540] avg loss 0.000500073, throughput 2.86745K wps
[Epoch 186 Batch 180/1540] avg loss 0.000693569, throughput 2.87104K wps
[Epoch 186 Batch 210/1540] avg loss 0.000830844, throughput 2.80102K wps
[Epoch 186 Batch 240/1540] avg loss 0.000678953, throughput 2.84258K wps
[Epoch 186 Batch 270/1540] avg loss 0.000655962, throughput 2.85198K wps
[Epoch 186 Batch 300/1540] avg loss 0.000436794, throughput 2.81965K wps
[Epoch 186 Batch 330/1540] avg loss 0.000501074, throughput 2.82405K wps
[Epoch 186 Batch 360/1540] avg loss 0.000413458, throughput 2.86467K wps
[Epoch 186 Batch 390/1540] avg loss 0.000681571, throughput 2.87779K wps
[Epoch 186 Batch 420/1540] avg loss 0.000693585, throughput 2.87192K wps
[Epoch 186 Batch 450/1540] avg loss 0.000600214, throughput 2.86667K wps
[Epoch 186 Batch 480/1540] avg loss 0.000433896, throughput 2.87075K wps
[Epoch 186 Batch 510/1540] avg loss 0.000591135, throughput 2.87973K wps
[Epoch 186 Batch 540/1540] avg loss 0.000531921, throughput 2.85693K wps
[Epoch 186 Batch 570/1540] avg loss 0.000555218, throughput 2.79522K wps
[Epoch 186 Batch 600/1540] avg loss 0.000593689, throughput 2.881K wps
[Epoch 186 Batch 630/1540] avg loss 0.000782596, throughput 2.82676K wps
[Epoch 186 Batch 660/1540] avg loss 0.000534753, throughput 2.86449K wps
[Epoch 186 Batch 690/1540] avg loss 0.000649361, throughput 2.86393K wps
[Epoch 186 Batch 720/1540] avg loss 0.000768703, throughput 2.87091K wps
[Epoch 186 Batch 750/1540] avg loss 0.000747423, throughput 2.88619K wps
[Epoch 186 Batch 780/1540] avg loss 0.000679874, throughput 2.85906K wps
[Epoch 186 Batch 810/1540] avg loss 0.000630628, throughput 2.88368K wps
[Epoch 186 Batch 840/1540] avg loss 0.000502135, throughput 2.87231K wps
[Epoch 186 Batch 870/1540] avg loss 0.000722402, throughput 2.85025K wps
[Epoch 186 Batch 900/1540] avg loss 0.000979564, throughput 2.86916K wps
[Epoch 186 Batch 930/1540] avg loss 0.000751345, throughput 2.8188K wps
[Epoch 186 Batch 960/1540] avg loss 0.000783015, throughput 2.82432K wps
[Epoch 186 Batch 990/1540] avg loss 0.000644481, throughput 2.88174K wps
[Epoch 186 Batch 1020/1540] avg loss 0.000561593, throughput 2.88402K wps
[Epoch 186 Batch 1050/1540] avg loss 0.000599005, throughput 2.81449K wps
[Epoch 186 Batch 1080/1540] avg loss 0.000794145, throughput 2.8736K wps
[Epoch 186 Batch 1110/1540] avg loss 0.000862496, throughput 2.8494K wps
[Epoch 186 Batch 1140/1540] avg loss 0.000562423, throughput 2.8725K wps
[Epoch 186 Batch 1170/1540] avg loss 0.000522935, throughput 2.81939K wps
[Epoch 186 Batch 1200/1540] avg loss 0.0007679, throughput 2.81203K wps
[Epoch 186 Batch 1230/1540] avg loss 0.000714223, throughput 2.88047K wps
[Epoch 186 Batch 1260/1540] avg loss 0.000597369, throughput 2.86876K wps
[Epoch 186 Batch 1290/1540] avg loss 0.000664327, throughput 2.85999K wps
[Epoch 186 Batch 1320/1540] avg loss 0.000478939, throughput 2.86968K wps
[Epoch 186 Batch 1350/1540] avg loss 0.000875146, throughput 2.8684K wps
[Epoch 186 Batch 1380/1540] avg loss 0.000457449, throughput 2.85965K wps
[Epoch 186 Batch 1410/1540] avg loss 0.000659009, throughput 2.8752K wps
[Epoch 186 Batch 1440/1540] avg loss 0.000708125, throughput 2.8636K wps
[Epoch 186 Batch 1470/1540] avg loss 0.000687538, throughput 2.8099K wps
[Epoch 186 Batch 1500/1540] avg loss 0.000690286, throughput 2.86586K wps
[Epoch 186 Batch 1530/1540] avg loss 0.000655761, throughput 2.85949K wps
Begin Testing...
[Epoch 186] train avg loss 0.000651359, dev acc 0.8050, dev avg loss 0.963299, throughput 2.85655K wps
[Epoch 187 Batch 30/1540] avg loss 0.000609999, throughput 2.8516K wps
[Epoch 187 Batch 60/1540] avg loss 0.000576152, throughput 2.80888K wps
[Epoch 187 Batch 90/1540] avg loss 0.000588799, throughput 2.82665K wps
[Epoch 187 Batch 120/1540] avg loss 0.000419842, throughput 2.85442K wps
[Epoch 187 Batch 150/1540] avg loss 0.000681929, throughput 2.8768K wps
[Epoch 187 Batch 180/1540] avg loss 0.000684144, throughput 2.87751K wps
[Epoch 187 Batch 210/1540] avg loss 0.00048588, throughput 2.86632K wps
[Epoch 187 Batch 240/1540] avg loss 0.00063841, throughput 2.82919K wps
[Epoch 187 Batch 270/1540] avg loss 0.000664723, throughput 2.8385K wps
[Epoch 187 Batch 300/1540] avg loss 0.000713757, throughput 2.8092K wps
[Epoch 187 Batch 330/1540] avg loss 0.000641758, throughput 2.87708K wps
[Epoch 187 Batch 360/1540] avg loss 0.000633061, throughput 2.87453K wps
[Epoch 187 Batch 390/1540] avg loss 0.000719077, throughput 2.87969K wps
[Epoch 187 Batch 420/1540] avg loss 0.000625925, throughput 2.83202K wps
[Epoch 187 Batch 450/1540] avg loss 0.00059012, throughput 2.79713K wps
[Epoch 187 Batch 480/1540] avg loss 0.000583207, throughput 2.85096K wps
[Epoch 187 Batch 510/1540] avg loss 0.000669696, throughput 2.8498K wps
[Epoch 187 Batch 540/1540] avg loss 0.000583188, throughput 2.84804K wps
[Epoch 187 Batch 570/1540] avg loss 0.000688629, throughput 2.87059K wps
[Epoch 187 Batch 600/1540] avg loss 0.000644442, throughput 2.87973K wps
[Epoch 187 Batch 630/1540] avg loss 0.000479087, throughput 2.87909K wps
[Epoch 187 Batch 660/1540] avg loss 0.000691729, throughput 2.87267K wps
[Epoch 187 Batch 690/1540] avg loss 0.000773933, throughput 2.87608K wps
[Epoch 187 Batch 720/1540] avg loss 0.000513891, throughput 2.85414K wps
[Epoch 187 Batch 750/1540] avg loss 0.00077772, throughput 2.86502K wps
[Epoch 187 Batch 780/1540] avg loss 0.000590098, throughput 2.84147K wps
[Epoch 187 Batch 810/1540] avg loss 0.000513327, throughput 2.84445K wps
[Epoch 187 Batch 840/1540] avg loss 0.000747632, throughput 2.8695K wps
[Epoch 187 Batch 870/1540] avg loss 0.000636308, throughput 2.82036K wps
[Epoch 187 Batch 900/1540] avg loss 0.00047003, throughput 2.87812K wps
[Epoch 187 Batch 930/1540] avg loss 0.000653109, throughput 2.79928K wps
[Epoch 187 Batch 960/1540] avg loss 0.000543668, throughput 2.79099K wps
[Epoch 187 Batch 990/1540] avg loss 0.000725436, throughput 2.85699K wps
[Epoch 187 Batch 1020/1540] avg loss 0.000661642, throughput 2.86764K wps
[Epoch 187 Batch 1050/1540] avg loss 0.000635349, throughput 2.88068K wps
[Epoch 187 Batch 1080/1540] avg loss 0.000766111, throughput 2.88026K wps
[Epoch 187 Batch 1110/1540] avg loss 0.000536681, throughput 2.87689K wps
[Epoch 187 Batch 1140/1540] avg loss 0.000614944, throughput 2.87632K wps
[Epoch 187 Batch 1170/1540] avg loss 0.000716938, throughput 2.87711K wps
[Epoch 187 Batch 1200/1540] avg loss 0.000604014, throughput 2.85257K wps
[Epoch 187 Batch 1230/1540] avg loss 0.000597401, throughput 2.87205K wps
[Epoch 187 Batch 1260/1540] avg loss 0.00055509, throughput 2.87429K wps
[Epoch 187 Batch 1290/1540] avg loss 0.00072032, throughput 2.87267K wps
[Epoch 187 Batch 1320/1540] avg loss 0.000738896, throughput 2.87293K wps
[Epoch 187 Batch 1350/1540] avg loss 0.000796444, throughput 2.87469K wps
[Epoch 187 Batch 1380/1540] avg loss 0.000858729, throughput 2.88136K wps
[Epoch 187 Batch 1410/1540] avg loss 0.000622812, throughput 2.86019K wps
[Epoch 187 Batch 1440/1540] avg loss 0.000671498, throughput 2.83364K wps
[Epoch 187 Batch 1470/1540] avg loss 0.000660474, throughput 2.83566K wps
[Epoch 187 Batch 1500/1540] avg loss 0.00110129, throughput 2.83142K wps
[Epoch 187 Batch 1530/1540] avg loss 0.000644446, throughput 2.81635K wps
Begin Testing...
[Epoch 187] train avg loss 0.000649475, dev acc 0.7947, dev avg loss 1.01514, throughput 2.85438K wps
[Epoch 188 Batch 30/1540] avg loss 0.000629344, throughput 2.9112K wps
[Epoch 188 Batch 60/1540] avg loss 0.000466656, throughput 2.87564K wps
[Epoch 188 Batch 90/1540] avg loss 0.000539101, throughput 2.87242K wps
[Epoch 188 Batch 120/1540] avg loss 0.000572422, throughput 2.8715K wps
[Epoch 188 Batch 150/1540] avg loss 0.000662775, throughput 2.87146K wps
[Epoch 188 Batch 180/1540] avg loss 0.000592992, throughput 2.85778K wps
[Epoch 188 Batch 210/1540] avg loss 0.000501247, throughput 2.85362K wps
[Epoch 188 Batch 240/1540] avg loss 0.000408199, throughput 2.86628K wps
[Epoch 188 Batch 270/1540] avg loss 0.000694281, throughput 2.83666K wps
[Epoch 188 Batch 300/1540] avg loss 0.000677054, throughput 2.83819K wps
[Epoch 188 Batch 330/1540] avg loss 0.00079593, throughput 2.877K wps
[Epoch 188 Batch 360/1540] avg loss 0.000551227, throughput 2.86061K wps
[Epoch 188 Batch 390/1540] avg loss 0.000506574, throughput 2.87694K wps
[Epoch 188 Batch 420/1540] avg loss 0.00058482, throughput 2.86017K wps
[Epoch 188 Batch 450/1540] avg loss 0.000706233, throughput 2.87373K wps
[Epoch 188 Batch 480/1540] avg loss 0.000616572, throughput 2.85746K wps
[Epoch 188 Batch 510/1540] avg loss 0.000602975, throughput 2.82978K wps
[Epoch 188 Batch 540/1540] avg loss 0.000654908, throughput 2.86739K wps
[Epoch 188 Batch 570/1540] avg loss 0.000617571, throughput 2.85482K wps
[Epoch 188 Batch 600/1540] avg loss 0.000646767, throughput 2.8753K wps
[Epoch 188 Batch 630/1540] avg loss 0.000686558, throughput 2.86102K wps
[Epoch 188 Batch 660/1540] avg loss 0.00065764, throughput 2.87687K wps
[Epoch 188 Batch 690/1540] avg loss 0.000680927, throughput 2.87349K wps
[Epoch 188 Batch 720/1540] avg loss 0.000740439, throughput 2.87222K wps
[Epoch 188 Batch 750/1540] avg loss 0.000778903, throughput 2.8335K wps
[Epoch 188 Batch 780/1540] avg loss 0.000633262, throughput 2.84909K wps
[Epoch 188 Batch 810/1540] avg loss 0.000608957, throughput 2.87041K wps
[Epoch 188 Batch 840/1540] avg loss 0.000690926, throughput 2.87149K wps
[Epoch 188 Batch 870/1540] avg loss 0.000715136, throughput 2.86928K wps
[Epoch 188 Batch 900/1540] avg loss 0.000723337, throughput 2.86488K wps
[Epoch 188 Batch 930/1540] avg loss 0.000559017, throughput 2.7891K wps
[Epoch 188 Batch 960/1540] avg loss 0.000875917, throughput 2.8623K wps
[Epoch 188 Batch 990/1540] avg loss 0.000539166, throughput 2.83397K wps
[Epoch 188 Batch 1020/1540] avg loss 0.000591819, throughput 2.86473K wps
[Epoch 188 Batch 1050/1540] avg loss 0.000735548, throughput 2.82351K wps
[Epoch 188 Batch 1080/1540] avg loss 0.000829642, throughput 2.86932K wps
[Epoch 188 Batch 1110/1540] avg loss 0.000699283, throughput 2.87126K wps
[Epoch 188 Batch 1140/1540] avg loss 0.000732651, throughput 2.87102K wps
[Epoch 188 Batch 1170/1540] avg loss 0.000624339, throughput 2.85599K wps
[Epoch 188 Batch 1200/1540] avg loss 0.000768325, throughput 2.84565K wps
[Epoch 188 Batch 1230/1540] avg loss 0.000974612, throughput 2.87091K wps
[Epoch 188 Batch 1260/1540] avg loss 0.00049908, throughput 2.87192K wps
[Epoch 188 Batch 1290/1540] avg loss 0.000586398, throughput 2.86788K wps
[Epoch 188 Batch 1320/1540] avg loss 0.00057771, throughput 2.8714K wps
[Epoch 188 Batch 1350/1540] avg loss 0.000668535, throughput 2.8756K wps
[Epoch 188 Batch 1380/1540] avg loss 0.000749319, throughput 2.84365K wps
[Epoch 188 Batch 1410/1540] avg loss 0.000547973, throughput 2.83881K wps
[Epoch 188 Batch 1440/1540] avg loss 0.000684443, throughput 2.85304K wps
[Epoch 188 Batch 1470/1540] avg loss 0.000668806, throughput 2.86589K wps
[Epoch 188 Batch 1500/1540] avg loss 0.000649647, throughput 2.86883K wps
[Epoch 188 Batch 1530/1540] avg loss 0.000737079, throughput 2.85546K wps
Begin Testing...
[Epoch 188] train avg loss 0.000652752, dev acc 0.7959, dev avg loss 0.995531, throughput 2.86072K wps
[Epoch 189 Batch 30/1540] avg loss 0.000591449, throughput 2.92083K wps
[Epoch 189 Batch 60/1540] avg loss 0.000547212, throughput 2.84747K wps
[Epoch 189 Batch 90/1540] avg loss 0.000593156, throughput 2.86925K wps
[Epoch 189 Batch 120/1540] avg loss 0.000685042, throughput 2.86027K wps
[Epoch 189 Batch 150/1540] avg loss 0.00078066, throughput 2.81585K wps
[Epoch 189 Batch 180/1540] avg loss 0.000555206, throughput 2.81342K wps
[Epoch 189 Batch 210/1540] avg loss 0.000614035, throughput 2.82072K wps
[Epoch 189 Batch 240/1540] avg loss 0.000618002, throughput 2.88463K wps
[Epoch 189 Batch 270/1540] avg loss 0.000834284, throughput 2.88351K wps
[Epoch 189 Batch 300/1540] avg loss 0.000825581, throughput 2.83534K wps
[Epoch 189 Batch 330/1540] avg loss 0.000552239, throughput 2.79008K wps
[Epoch 189 Batch 360/1540] avg loss 0.000721435, throughput 2.84977K wps
[Epoch 189 Batch 390/1540] avg loss 0.000688903, throughput 2.86797K wps
[Epoch 189 Batch 420/1540] avg loss 0.000696471, throughput 2.87491K wps
[Epoch 189 Batch 450/1540] avg loss 0.000446722, throughput 2.86291K wps
[Epoch 189 Batch 480/1540] avg loss 0.000760965, throughput 2.87093K wps
[Epoch 189 Batch 510/1540] avg loss 0.000594056, throughput 2.82928K wps
[Epoch 189 Batch 540/1540] avg loss 0.00075807, throughput 2.7794K wps
[Epoch 189 Batch 570/1540] avg loss 0.000640375, throughput 2.85493K wps
[Epoch 189 Batch 600/1540] avg loss 0.000773011, throughput 2.84768K wps
[Epoch 189 Batch 630/1540] avg loss 0.000708856, throughput 2.85671K wps
[Epoch 189 Batch 660/1540] avg loss 0.000858393, throughput 2.86345K wps
[Epoch 189 Batch 690/1540] avg loss 0.000533619, throughput 2.87385K wps
[Epoch 189 Batch 720/1540] avg loss 0.000673382, throughput 2.85389K wps
[Epoch 189 Batch 750/1540] avg loss 0.000677714, throughput 2.8646K wps
[Epoch 189 Batch 780/1540] avg loss 0.000431165, throughput 2.82154K wps
[Epoch 189 Batch 810/1540] avg loss 0.00086284, throughput 2.87694K wps
[Epoch 189 Batch 840/1540] avg loss 0.000762929, throughput 2.80194K wps
[Epoch 189 Batch 870/1540] avg loss 0.000635535, throughput 2.83561K wps
[Epoch 189 Batch 900/1540] avg loss 0.000692742, throughput 2.83005K wps
[Epoch 189 Batch 930/1540] avg loss 0.000880458, throughput 2.87287K wps
[Epoch 189 Batch 960/1540] avg loss 0.00062545, throughput 2.8351K wps
[Epoch 189 Batch 990/1540] avg loss 0.000818634, throughput 2.82595K wps
[Epoch 189 Batch 1020/1540] avg loss 0.000784511, throughput 2.85268K wps
[Epoch 189 Batch 1050/1540] avg loss 0.0005646, throughput 2.81684K wps
[Epoch 189 Batch 1080/1540] avg loss 0.000778223, throughput 2.85588K wps
[Epoch 189 Batch 1110/1540] avg loss 0.000763282, throughput 2.83071K wps
[Epoch 189 Batch 1140/1540] avg loss 0.000689616, throughput 2.81632K wps
[Epoch 189 Batch 1170/1540] avg loss 0.000630137, throughput 2.87296K wps
[Epoch 189 Batch 1200/1540] avg loss 0.00057203, throughput 2.86339K wps
[Epoch 189 Batch 1230/1540] avg loss 0.000583092, throughput 2.8713K wps
[Epoch 189 Batch 1260/1540] avg loss 0.000644035, throughput 2.82986K wps
[Epoch 189 Batch 1290/1540] avg loss 0.000755774, throughput 2.86243K wps
[Epoch 189 Batch 1320/1540] avg loss 0.000730569, throughput 2.85244K wps
[Epoch 189 Batch 1350/1540] avg loss 0.000537819, throughput 2.88165K wps
[Epoch 189 Batch 1380/1540] avg loss 0.000762543, throughput 2.85642K wps
[Epoch 189 Batch 1410/1540] avg loss 0.000690798, throughput 2.87061K wps
[Epoch 189 Batch 1440/1540] avg loss 0.000650791, throughput 2.8736K wps
[Epoch 189 Batch 1470/1540] avg loss 0.000645676, throughput 2.87263K wps
[Epoch 189 Batch 1500/1540] avg loss 0.000578602, throughput 2.87669K wps
[Epoch 189 Batch 1530/1540] avg loss 0.000542931, throughput 2.83233K wps
Begin Testing...
[Epoch 189] train avg loss 0.000677412, dev acc 0.7947, dev avg loss 1.0002, throughput 2.85051K wps
[Epoch 190 Batch 30/1540] avg loss 0.000702231, throughput 2.92348K wps
[Epoch 190 Batch 60/1540] avg loss 0.000616229, throughput 2.82324K wps
[Epoch 190 Batch 90/1540] avg loss 0.000625238, throughput 2.86825K wps
[Epoch 190 Batch 120/1540] avg loss 0.000552566, throughput 2.8695K wps
[Epoch 190 Batch 150/1540] avg loss 0.000667372, throughput 2.86182K wps
[Epoch 190 Batch 180/1540] avg loss 0.000595615, throughput 2.87183K wps
[Epoch 190 Batch 210/1540] avg loss 0.000773504, throughput 2.81791K wps
[Epoch 190 Batch 240/1540] avg loss 0.000864667, throughput 2.82614K wps
[Epoch 190 Batch 270/1540] avg loss 0.00084669, throughput 2.87515K wps
[Epoch 190 Batch 300/1540] avg loss 0.000501262, throughput 2.86117K wps
[Epoch 190 Batch 330/1540] avg loss 0.000548737, throughput 2.82241K wps
[Epoch 190 Batch 360/1540] avg loss 0.000662546, throughput 2.87041K wps
[Epoch 190 Batch 390/1540] avg loss 0.000795411, throughput 2.87906K wps
[Epoch 190 Batch 420/1540] avg loss 0.000385198, throughput 2.87737K wps
[Epoch 190 Batch 450/1540] avg loss 0.000709367, throughput 2.87144K wps
[Epoch 190 Batch 480/1540] avg loss 0.000562146, throughput 2.86836K wps
[Epoch 190 Batch 510/1540] avg loss 0.000702764, throughput 2.85247K wps
[Epoch 190 Batch 540/1540] avg loss 0.000574396, throughput 2.86365K wps
[Epoch 190 Batch 570/1540] avg loss 0.000810525, throughput 2.87306K wps
[Epoch 190 Batch 600/1540] avg loss 0.000829259, throughput 2.84992K wps
[Epoch 190 Batch 630/1540] avg loss 0.000656647, throughput 2.87195K wps
[Epoch 190 Batch 660/1540] avg loss 0.00048238, throughput 2.85824K wps
[Epoch 190 Batch 690/1540] avg loss 0.00062986, throughput 2.87915K wps
[Epoch 190 Batch 720/1540] avg loss 0.00071436, throughput 2.87312K wps
[Epoch 190 Batch 750/1540] avg loss 0.000569739, throughput 2.87246K wps
[Epoch 190 Batch 780/1540] avg loss 0.000597069, throughput 2.87332K wps
[Epoch 190 Batch 810/1540] avg loss 0.000525688, throughput 2.82011K wps
[Epoch 190 Batch 840/1540] avg loss 0.000549693, throughput 2.88333K wps
[Epoch 190 Batch 870/1540] avg loss 0.000805201, throughput 2.8716K wps
[Epoch 190 Batch 900/1540] avg loss 0.0006168, throughput 2.86599K wps
[Epoch 190 Batch 930/1540] avg loss 0.00073054, throughput 2.8644K wps
[Epoch 190 Batch 960/1540] avg loss 0.000684476, throughput 2.83762K wps
[Epoch 190 Batch 990/1540] avg loss 0.00066733, throughput 2.87045K wps
[Epoch 190 Batch 1020/1540] avg loss 0.000595376, throughput 2.8568K wps
[Epoch 190 Batch 1050/1540] avg loss 0.00053642, throughput 2.86427K wps
[Epoch 190 Batch 1080/1540] avg loss 0.000519164, throughput 2.85059K wps
[Epoch 190 Batch 1110/1540] avg loss 0.000724061, throughput 2.84713K wps
[Epoch 190 Batch 1140/1540] avg loss 0.000819733, throughput 2.84939K wps
[Epoch 190 Batch 1170/1540] avg loss 0.00075624, throughput 2.84331K wps
[Epoch 190 Batch 1200/1540] avg loss 0.00092931, throughput 2.8596K wps
[Epoch 190 Batch 1230/1540] avg loss 0.000608696, throughput 2.86333K wps
[Epoch 190 Batch 1260/1540] avg loss 0.00094916, throughput 2.87073K wps
[Epoch 190 Batch 1290/1540] avg loss 0.000740481, throughput 2.87101K wps
[Epoch 190 Batch 1320/1540] avg loss 0.00081218, throughput 2.87129K wps
[Epoch 190 Batch 1350/1540] avg loss 0.000769483, throughput 2.86997K wps
[Epoch 190 Batch 1380/1540] avg loss 0.000628792, throughput 2.86671K wps
[Epoch 190 Batch 1410/1540] avg loss 0.0006464, throughput 2.85025K wps
[Epoch 190 Batch 1440/1540] avg loss 0.000644403, throughput 2.86136K wps
[Epoch 190 Batch 1470/1540] avg loss 0.00061079, throughput 2.86382K wps
[Epoch 190 Batch 1500/1540] avg loss 0.000658746, throughput 2.85784K wps
[Epoch 190 Batch 1530/1540] avg loss 0.000785146, throughput 2.84474K wps
Begin Testing...
[Epoch 190] train avg loss 0.000673014, dev acc 0.8016, dev avg loss 0.990921, throughput 2.86122K wps
[Epoch 191 Batch 30/1540] avg loss 0.000593814, throughput 2.91431K wps
[Epoch 191 Batch 60/1540] avg loss 0.000477836, throughput 2.86246K wps
[Epoch 191 Batch 90/1540] avg loss 0.000677063, throughput 2.86947K wps
[Epoch 191 Batch 120/1540] avg loss 0.000728698, throughput 2.83073K wps
[Epoch 191 Batch 150/1540] avg loss 0.000677354, throughput 2.79096K wps
[Epoch 191 Batch 180/1540] avg loss 0.000678776, throughput 2.78298K wps
[Epoch 191 Batch 210/1540] avg loss 0.000658206, throughput 2.814K wps
[Epoch 191 Batch 240/1540] avg loss 0.000526884, throughput 2.87021K wps
[Epoch 191 Batch 270/1540] avg loss 0.000541219, throughput 2.83092K wps
[Epoch 191 Batch 300/1540] avg loss 0.000835664, throughput 2.87472K wps
[Epoch 191 Batch 330/1540] avg loss 0.000478573, throughput 2.83839K wps
[Epoch 191 Batch 360/1540] avg loss 0.000478767, throughput 2.87444K wps
[Epoch 191 Batch 390/1540] avg loss 0.000687688, throughput 2.87418K wps
[Epoch 191 Batch 420/1540] avg loss 0.000491861, throughput 2.84511K wps
[Epoch 191 Batch 450/1540] avg loss 0.000552227, throughput 2.85339K wps
[Epoch 191 Batch 480/1540] avg loss 0.000481291, throughput 2.87469K wps
[Epoch 191 Batch 510/1540] avg loss 0.000802786, throughput 2.88028K wps
[Epoch 191 Batch 540/1540] avg loss 0.000601136, throughput 2.8567K wps
[Epoch 191 Batch 570/1540] avg loss 0.000772759, throughput 2.80527K wps
[Epoch 191 Batch 600/1540] avg loss 0.000591905, throughput 2.80827K wps
[Epoch 191 Batch 630/1540] avg loss 0.000691125, throughput 2.87269K wps
[Epoch 191 Batch 660/1540] avg loss 0.000785156, throughput 2.84987K wps
[Epoch 191 Batch 690/1540] avg loss 0.000629511, throughput 2.85328K wps
[Epoch 191 Batch 720/1540] avg loss 0.00053858, throughput 2.87743K wps
[Epoch 191 Batch 750/1540] avg loss 0.00075129, throughput 2.87296K wps
[Epoch 191 Batch 780/1540] avg loss 0.000754935, throughput 2.81533K wps
[Epoch 191 Batch 810/1540] avg loss 0.000617959, throughput 2.85139K wps
[Epoch 191 Batch 840/1540] avg loss 0.000582653, throughput 2.86614K wps
[Epoch 191 Batch 870/1540] avg loss 0.000540761, throughput 2.82524K wps
[Epoch 191 Batch 900/1540] avg loss 0.000587937, throughput 2.85864K wps
[Epoch 191 Batch 930/1540] avg loss 0.000718786, throughput 2.87203K wps
[Epoch 191 Batch 960/1540] avg loss 0.000740826, throughput 2.87117K wps
[Epoch 191 Batch 990/1540] avg loss 0.000791456, throughput 2.82636K wps
[Epoch 191 Batch 1020/1540] avg loss 0.000713529, throughput 2.88102K wps
[Epoch 191 Batch 1050/1540] avg loss 0.000622364, throughput 2.83784K wps
[Epoch 191 Batch 1080/1540] avg loss 0.00060672, throughput 2.84589K wps
[Epoch 191 Batch 1110/1540] avg loss 0.000740216, throughput 2.85205K wps
[Epoch 191 Batch 1140/1540] avg loss 0.00059175, throughput 2.83836K wps
[Epoch 191 Batch 1170/1540] avg loss 0.000675189, throughput 2.86966K wps
[Epoch 191 Batch 1200/1540] avg loss 0.000798319, throughput 2.86976K wps
[Epoch 191 Batch 1230/1540] avg loss 0.000637933, throughput 2.87388K wps
[Epoch 191 Batch 1260/1540] avg loss 0.000687901, throughput 2.86318K wps
[Epoch 191 Batch 1290/1540] avg loss 0.000639621, throughput 2.86132K wps
[Epoch 191 Batch 1320/1540] avg loss 0.000739179, throughput 2.87095K wps
[Epoch 191 Batch 1350/1540] avg loss 0.000795411, throughput 2.86259K wps
[Epoch 191 Batch 1380/1540] avg loss 0.000653064, throughput 2.85939K wps
[Epoch 191 Batch 1410/1540] avg loss 0.000751712, throughput 2.86068K wps
[Epoch 191 Batch 1440/1540] avg loss 0.000719358, throughput 2.87737K wps
[Epoch 191 Batch 1470/1540] avg loss 0.000655085, throughput 2.85428K wps
[Epoch 191 Batch 1500/1540] avg loss 0.000631856, throughput 2.86937K wps
[Epoch 191 Batch 1530/1540] avg loss 0.000621013, throughput 2.82687K wps
Begin Testing...
[Epoch 191] train avg loss 0.000654138, dev acc 0.8062, dev avg loss 0.964082, throughput 2.85361K wps
[Epoch 192 Batch 30/1540] avg loss 0.000442472, throughput 2.93196K wps
[Epoch 192 Batch 60/1540] avg loss 0.000676406, throughput 2.85365K wps
[Epoch 192 Batch 90/1540] avg loss 0.00068025, throughput 2.78983K wps
[Epoch 192 Batch 120/1540] avg loss 0.000577517, throughput 2.84542K wps
[Epoch 192 Batch 150/1540] avg loss 0.000526296, throughput 2.87041K wps
[Epoch 192 Batch 180/1540] avg loss 0.000772062, throughput 2.87412K wps
[Epoch 192 Batch 210/1540] avg loss 0.000502753, throughput 2.87475K wps
[Epoch 192 Batch 240/1540] avg loss 0.000554271, throughput 2.86739K wps
[Epoch 192 Batch 270/1540] avg loss 0.000650557, throughput 2.85642K wps
[Epoch 192 Batch 300/1540] avg loss 0.000878235, throughput 2.82879K wps
[Epoch 192 Batch 330/1540] avg loss 0.000592556, throughput 2.87811K wps
[Epoch 192 Batch 360/1540] avg loss 0.000631769, throughput 2.84981K wps
[Epoch 192 Batch 390/1540] avg loss 0.00058286, throughput 2.85614K wps
[Epoch 192 Batch 420/1540] avg loss 0.000651173, throughput 2.81657K wps
[Epoch 192 Batch 450/1540] avg loss 0.000439382, throughput 2.8549K wps
[Epoch 192 Batch 480/1540] avg loss 0.000631276, throughput 2.81835K wps
[Epoch 192 Batch 510/1540] avg loss 0.000558687, throughput 2.79794K wps
[Epoch 192 Batch 540/1540] avg loss 0.000617425, throughput 2.87458K wps
[Epoch 192 Batch 570/1540] avg loss 0.000673201, throughput 2.83838K wps
[Epoch 192 Batch 600/1540] avg loss 0.000445227, throughput 2.87265K wps
[Epoch 192 Batch 630/1540] avg loss 0.000777966, throughput 2.85782K wps
[Epoch 192 Batch 660/1540] avg loss 0.000583124, throughput 2.88397K wps
[Epoch 192 Batch 690/1540] avg loss 0.000600654, throughput 2.87574K wps
[Epoch 192 Batch 720/1540] avg loss 0.000663695, throughput 2.86934K wps
[Epoch 192 Batch 750/1540] avg loss 0.000653834, throughput 2.87118K wps
[Epoch 192 Batch 780/1540] avg loss 0.000445338, throughput 2.86917K wps
[Epoch 192 Batch 810/1540] avg loss 0.000782991, throughput 2.86889K wps
[Epoch 192 Batch 840/1540] avg loss 0.000734588, throughput 2.83419K wps
[Epoch 192 Batch 870/1540] avg loss 0.00078492, throughput 2.86848K wps
[Epoch 192 Batch 900/1540] avg loss 0.000597024, throughput 2.87509K wps
[Epoch 192 Batch 930/1540] avg loss 0.000679784, throughput 2.86871K wps
[Epoch 192 Batch 960/1540] avg loss 0.000894654, throughput 2.86463K wps
[Epoch 192 Batch 990/1540] avg loss 0.000845535, throughput 2.85802K wps
[Epoch 192 Batch 1020/1540] avg loss 0.000547197, throughput 2.86447K wps
[Epoch 192 Batch 1050/1540] avg loss 0.000603279, throughput 2.86613K wps
[Epoch 192 Batch 1080/1540] avg loss 0.000776024, throughput 2.86066K wps
[Epoch 192 Batch 1110/1540] avg loss 0.000529699, throughput 2.85447K wps
[Epoch 192 Batch 1140/1540] avg loss 0.000687368, throughput 2.85703K wps
[Epoch 192 Batch 1170/1540] avg loss 0.00080646, throughput 2.86902K wps
[Epoch 192 Batch 1200/1540] avg loss 0.000706759, throughput 2.86681K wps
[Epoch 192 Batch 1230/1540] avg loss 0.000747177, throughput 2.86296K wps
[Epoch 192 Batch 1260/1540] avg loss 0.000534863, throughput 2.86526K wps
[Epoch 192 Batch 1290/1540] avg loss 0.000561417, throughput 2.84306K wps
[Epoch 192 Batch 1320/1540] avg loss 0.000895203, throughput 2.83932K wps
[Epoch 192 Batch 1350/1540] avg loss 0.000532058, throughput 2.76948K wps
[Epoch 192 Batch 1380/1540] avg loss 0.000694518, throughput 2.80185K wps
[Epoch 192 Batch 1410/1540] avg loss 0.00102063, throughput 2.85543K wps
[Epoch 192 Batch 1440/1540] avg loss 0.000826607, throughput 2.86724K wps
[Epoch 192 Batch 1470/1540] avg loss 0.000772096, throughput 2.88124K wps
[Epoch 192 Batch 1500/1540] avg loss 0.000754515, throughput 2.86975K wps
[Epoch 192 Batch 1530/1540] avg loss 0.000624232, throughput 2.8628K wps
Begin Testing...
[Epoch 192] train avg loss 0.000660734, dev acc 0.8039, dev avg loss 0.957158, throughput 2.85613K wps
[Epoch 193 Batch 30/1540] avg loss 0.00043805, throughput 2.92966K wps
[Epoch 193 Batch 60/1540] avg loss 0.000602732, throughput 2.84982K wps
[Epoch 193 Batch 90/1540] avg loss 0.000755753, throughput 2.86645K wps
[Epoch 193 Batch 120/1540] avg loss 0.000673437, throughput 2.82812K wps
[Epoch 193 Batch 150/1540] avg loss 0.000646059, throughput 2.85413K wps
[Epoch 193 Batch 180/1540] avg loss 0.000658583, throughput 2.83743K wps
[Epoch 193 Batch 210/1540] avg loss 0.000583177, throughput 2.87441K wps
[Epoch 193 Batch 240/1540] avg loss 0.000614464, throughput 2.86422K wps
[Epoch 193 Batch 270/1540] avg loss 0.000490319, throughput 2.87352K wps
[Epoch 193 Batch 300/1540] avg loss 0.000571587, throughput 2.87485K wps
[Epoch 193 Batch 330/1540] avg loss 0.000499441, throughput 2.86365K wps
[Epoch 193 Batch 360/1540] avg loss 0.000624125, throughput 2.79909K wps
[Epoch 193 Batch 390/1540] avg loss 0.000506813, throughput 2.83774K wps
[Epoch 193 Batch 420/1540] avg loss 0.000617636, throughput 2.87741K wps
[Epoch 193 Batch 450/1540] avg loss 0.000661668, throughput 2.83824K wps
[Epoch 193 Batch 480/1540] avg loss 0.000697772, throughput 2.83366K wps
[Epoch 193 Batch 510/1540] avg loss 0.000656902, throughput 2.87701K wps
[Epoch 193 Batch 540/1540] avg loss 0.000695713, throughput 2.87876K wps
[Epoch 193 Batch 570/1540] avg loss 0.000475395, throughput 2.87735K wps
[Epoch 193 Batch 600/1540] avg loss 0.000786537, throughput 2.85746K wps
[Epoch 193 Batch 630/1540] avg loss 0.000517794, throughput 2.82531K wps
[Epoch 193 Batch 660/1540] avg loss 0.000931813, throughput 2.8481K wps
[Epoch 193 Batch 690/1540] avg loss 0.000503241, throughput 2.88052K wps
[Epoch 193 Batch 720/1540] avg loss 0.000545615, throughput 2.87495K wps
[Epoch 193 Batch 750/1540] avg loss 0.000510163, throughput 2.81899K wps
[Epoch 193 Batch 780/1540] avg loss 0.000781254, throughput 2.85717K wps
[Epoch 193 Batch 810/1540] avg loss 0.000476365, throughput 2.83848K wps
[Epoch 193 Batch 840/1540] avg loss 0.000664849, throughput 2.84747K wps
[Epoch 193 Batch 870/1540] avg loss 0.000709669, throughput 2.8643K wps
[Epoch 193 Batch 900/1540] avg loss 0.000654669, throughput 2.8493K wps
[Epoch 193 Batch 930/1540] avg loss 0.000553824, throughput 2.79758K wps
[Epoch 193 Batch 960/1540] avg loss 0.000595213, throughput 2.80454K wps
[Epoch 193 Batch 990/1540] avg loss 0.000475128, throughput 2.83387K wps
[Epoch 193 Batch 1020/1540] avg loss 0.000868431, throughput 2.84633K wps
[Epoch 193 Batch 1050/1540] avg loss 0.000696208, throughput 2.87722K wps
[Epoch 193 Batch 1080/1540] avg loss 0.000716999, throughput 2.87741K wps
[Epoch 193 Batch 1110/1540] avg loss 0.000719589, throughput 2.88038K wps
[Epoch 193 Batch 1140/1540] avg loss 0.000520383, throughput 2.87503K wps
[Epoch 193 Batch 1170/1540] avg loss 0.000739546, throughput 2.87694K wps
[Epoch 193 Batch 1200/1540] avg loss 0.00058114, throughput 2.86001K wps
[Epoch 193 Batch 1230/1540] avg loss 0.000720049, throughput 2.85008K wps
[Epoch 193 Batch 1260/1540] avg loss 0.000497379, throughput 2.82416K wps
[Epoch 193 Batch 1290/1540] avg loss 0.000477206, throughput 2.85254K wps
[Epoch 193 Batch 1320/1540] avg loss 0.00077006, throughput 2.87966K wps
[Epoch 193 Batch 1350/1540] avg loss 0.000841585, throughput 2.86773K wps
[Epoch 193 Batch 1380/1540] avg loss 0.000679081, throughput 2.81274K wps
[Epoch 193 Batch 1410/1540] avg loss 0.000800367, throughput 2.827K wps
[Epoch 193 Batch 1440/1540] avg loss 0.000639781, throughput 2.88163K wps
[Epoch 193 Batch 1470/1540] avg loss 0.000641124, throughput 2.83773K wps
[Epoch 193 Batch 1500/1540] avg loss 0.000744805, throughput 2.86015K wps
[Epoch 193 Batch 1530/1540] avg loss 0.000526538, throughput 2.86384K wps
Begin Testing...
[Epoch 193] train avg loss 0.000636713, dev acc 0.7982, dev avg loss 1.02123, throughput 2.85436K wps
[Epoch 194 Batch 30/1540] avg loss 0.000567106, throughput 2.91789K wps
[Epoch 194 Batch 60/1540] avg loss 0.000579597, throughput 2.86257K wps
[Epoch 194 Batch 90/1540] avg loss 0.000623983, throughput 2.78489K wps
[Epoch 194 Batch 120/1540] avg loss 0.000490812, throughput 2.83688K wps
[Epoch 194 Batch 150/1540] avg loss 0.000627262, throughput 2.87563K wps
[Epoch 194 Batch 180/1540] avg loss 0.000564625, throughput 2.8708K wps
[Epoch 194 Batch 210/1540] avg loss 0.000487865, throughput 2.87179K wps
[Epoch 194 Batch 240/1540] avg loss 0.000630162, throughput 2.88064K wps
[Epoch 194 Batch 270/1540] avg loss 0.000692417, throughput 2.8713K wps
[Epoch 194 Batch 300/1540] avg loss 0.000602568, throughput 2.86889K wps
[Epoch 194 Batch 330/1540] avg loss 0.000731244, throughput 2.82583K wps
[Epoch 194 Batch 360/1540] avg loss 0.00055875, throughput 2.84255K wps
[Epoch 194 Batch 390/1540] avg loss 0.000571489, throughput 2.83927K wps
[Epoch 194 Batch 420/1540] avg loss 0.000512289, throughput 2.87118K wps
[Epoch 194 Batch 450/1540] avg loss 0.000582127, throughput 2.86586K wps
[Epoch 194 Batch 480/1540] avg loss 0.000632154, throughput 2.88019K wps
[Epoch 194 Batch 510/1540] avg loss 0.000513321, throughput 2.86071K wps
[Epoch 194 Batch 540/1540] avg loss 0.000469984, throughput 2.83821K wps
[Epoch 194 Batch 570/1540] avg loss 0.000519524, throughput 2.87142K wps
[Epoch 194 Batch 600/1540] avg loss 0.00059375, throughput 2.84717K wps
[Epoch 194 Batch 630/1540] avg loss 0.00060693, throughput 2.8622K wps
[Epoch 194 Batch 660/1540] avg loss 0.000707175, throughput 2.8601K wps
[Epoch 194 Batch 690/1540] avg loss 0.000627373, throughput 2.84299K wps
[Epoch 194 Batch 720/1540] avg loss 0.000648276, throughput 2.87718K wps
[Epoch 194 Batch 750/1540] avg loss 0.000501858, throughput 2.83948K wps
[Epoch 194 Batch 780/1540] avg loss 0.00048862, throughput 2.84966K wps
[Epoch 194 Batch 810/1540] avg loss 0.000526937, throughput 2.85906K wps
[Epoch 194 Batch 840/1540] avg loss 0.000569785, throughput 2.85166K wps
[Epoch 194 Batch 870/1540] avg loss 0.000546547, throughput 2.84162K wps
[Epoch 194 Batch 900/1540] avg loss 0.000705912, throughput 2.85614K wps
[Epoch 194 Batch 930/1540] avg loss 0.000671157, throughput 2.85771K wps
[Epoch 194 Batch 960/1540] avg loss 0.000724241, throughput 2.80711K wps
[Epoch 194 Batch 990/1540] avg loss 0.000569837, throughput 2.86186K wps
[Epoch 194 Batch 1020/1540] avg loss 0.000845731, throughput 2.87104K wps
[Epoch 194 Batch 1050/1540] avg loss 0.000654385, throughput 2.86435K wps
[Epoch 194 Batch 1080/1540] avg loss 0.000823088, throughput 2.87894K wps
[Epoch 194 Batch 1110/1540] avg loss 0.000673552, throughput 2.87887K wps
[Epoch 194 Batch 1140/1540] avg loss 0.00063001, throughput 2.82307K wps
[Epoch 194 Batch 1170/1540] avg loss 0.000627394, throughput 2.87143K wps
[Epoch 194 Batch 1200/1540] avg loss 0.000546254, throughput 2.86128K wps
[Epoch 194 Batch 1230/1540] avg loss 0.000501958, throughput 2.86961K wps
[Epoch 194 Batch 1260/1540] avg loss 0.000813532, throughput 2.88134K wps
[Epoch 194 Batch 1290/1540] avg loss 0.000785959, throughput 2.85955K wps
[Epoch 194 Batch 1320/1540] avg loss 0.000648595, throughput 2.85185K wps
[Epoch 194 Batch 1350/1540] avg loss 0.000706256, throughput 2.8721K wps
[Epoch 194 Batch 1380/1540] avg loss 0.000678549, throughput 2.87176K wps
[Epoch 194 Batch 1410/1540] avg loss 0.000626037, throughput 2.87468K wps
[Epoch 194 Batch 1440/1540] avg loss 0.000686196, throughput 2.85683K wps
[Epoch 194 Batch 1470/1540] avg loss 0.000863946, throughput 2.87363K wps
[Epoch 194 Batch 1500/1540] avg loss 0.000706256, throughput 2.8731K wps
[Epoch 194 Batch 1530/1540] avg loss 0.000717874, throughput 2.87553K wps
Begin Testing...
[Epoch 194] train avg loss 0.000628715, dev acc 0.7913, dev avg loss 0.975734, throughput 2.85994K wps
[Epoch 195 Batch 30/1540] avg loss 0.000614223, throughput 2.93841K wps
[Epoch 195 Batch 60/1540] avg loss 0.000438866, throughput 2.88065K wps
[Epoch 195 Batch 90/1540] avg loss 0.000675976, throughput 2.87615K wps
[Epoch 195 Batch 120/1540] avg loss 0.000498327, throughput 2.84749K wps
[Epoch 195 Batch 150/1540] avg loss 0.000553308, throughput 2.81608K wps
[Epoch 195 Batch 180/1540] avg loss 0.000604808, throughput 2.80811K wps
[Epoch 195 Batch 210/1540] avg loss 0.00057829, throughput 2.81506K wps
[Epoch 195 Batch 240/1540] avg loss 0.000567634, throughput 2.85721K wps
[Epoch 195 Batch 270/1540] avg loss 0.000588614, throughput 2.83949K wps
[Epoch 195 Batch 300/1540] avg loss 0.000547582, throughput 2.84478K wps
[Epoch 195 Batch 330/1540] avg loss 0.00061955, throughput 2.85335K wps
[Epoch 195 Batch 360/1540] avg loss 0.000624802, throughput 2.85252K wps
[Epoch 195 Batch 390/1540] avg loss 0.00067335, throughput 2.83239K wps
[Epoch 195 Batch 420/1540] avg loss 0.000552618, throughput 2.87646K wps
[Epoch 195 Batch 450/1540] avg loss 0.000737124, throughput 2.85272K wps
[Epoch 195 Batch 480/1540] avg loss 0.00062383, throughput 2.85258K wps
[Epoch 195 Batch 510/1540] avg loss 0.000566376, throughput 2.86606K wps
[Epoch 195 Batch 540/1540] avg loss 0.000677943, throughput 2.86677K wps
[Epoch 195 Batch 570/1540] avg loss 0.000499008, throughput 2.86646K wps
[Epoch 195 Batch 600/1540] avg loss 0.000716463, throughput 2.86893K wps
[Epoch 195 Batch 630/1540] avg loss 0.000837479, throughput 2.82728K wps
[Epoch 195 Batch 660/1540] avg loss 0.000514655, throughput 2.86723K wps
[Epoch 195 Batch 690/1540] avg loss 0.000597094, throughput 2.8797K wps
[Epoch 195 Batch 720/1540] avg loss 0.000631821, throughput 2.8522K wps
[Epoch 195 Batch 750/1540] avg loss 0.000685967, throughput 2.87283K wps
[Epoch 195 Batch 780/1540] avg loss 0.000538628, throughput 2.87089K wps
[Epoch 195 Batch 810/1540] avg loss 0.0006208, throughput 2.80336K wps
[Epoch 195 Batch 840/1540] avg loss 0.000575734, throughput 2.86364K wps
[Epoch 195 Batch 870/1540] avg loss 0.000690856, throughput 2.88142K wps
[Epoch 195 Batch 900/1540] avg loss 0.000654071, throughput 2.87247K wps
[Epoch 195 Batch 930/1540] avg loss 0.000941355, throughput 2.82847K wps
[Epoch 195 Batch 960/1540] avg loss 0.000596275, throughput 2.84283K wps
[Epoch 195 Batch 990/1540] avg loss 0.000688857, throughput 2.87484K wps
[Epoch 195 Batch 1020/1540] avg loss 0.000590684, throughput 2.88036K wps
[Epoch 195 Batch 1050/1540] avg loss 0.000605615, throughput 2.86712K wps
[Epoch 195 Batch 1080/1540] avg loss 0.000616937, throughput 2.83611K wps
[Epoch 195 Batch 1110/1540] avg loss 0.000817683, throughput 2.79897K wps
[Epoch 195 Batch 1140/1540] avg loss 0.000819518, throughput 2.86033K wps
[Epoch 195 Batch 1170/1540] avg loss 0.000643681, throughput 2.85253K wps
[Epoch 195 Batch 1200/1540] avg loss 0.000544372, throughput 2.82932K wps
[Epoch 195 Batch 1230/1540] avg loss 0.000846836, throughput 2.79733K wps
[Epoch 195 Batch 1260/1540] avg loss 0.00073616, throughput 2.86058K wps
[Epoch 195 Batch 1290/1540] avg loss 0.000685969, throughput 2.86422K wps
[Epoch 195 Batch 1320/1540] avg loss 0.000494947, throughput 2.87201K wps
[Epoch 195 Batch 1350/1540] avg loss 0.000732511, throughput 2.87748K wps
[Epoch 195 Batch 1380/1540] avg loss 0.000502544, throughput 2.86354K wps
[Epoch 195 Batch 1410/1540] avg loss 0.000609081, throughput 2.85526K wps
[Epoch 195 Batch 1440/1540] avg loss 0.000713251, throughput 2.8564K wps
[Epoch 195 Batch 1470/1540] avg loss 0.000660261, throughput 2.87182K wps
[Epoch 195 Batch 1500/1540] avg loss 0.00079276, throughput 2.86635K wps
[Epoch 195 Batch 1530/1540] avg loss 0.000731007, throughput 2.81113K wps
Begin Testing...
[Epoch 195] train avg loss 0.000642075, dev acc 0.7982, dev avg loss 0.979175, throughput 2.85382K wps
[Epoch 196 Batch 30/1540] avg loss 0.000600976, throughput 2.92713K wps
[Epoch 196 Batch 60/1540] avg loss 0.000525931, throughput 2.86604K wps
[Epoch 196 Batch 90/1540] avg loss 0.000647933, throughput 2.87494K wps
[Epoch 196 Batch 120/1540] avg loss 0.000635922, throughput 2.8681K wps
[Epoch 196 Batch 150/1540] avg loss 0.000646509, throughput 2.82505K wps
[Epoch 196 Batch 180/1540] avg loss 0.000519901, throughput 2.8728K wps
[Epoch 196 Batch 210/1540] avg loss 0.000660325, throughput 2.8775K wps
[Epoch 196 Batch 240/1540] avg loss 0.000425039, throughput 2.86639K wps
[Epoch 196 Batch 270/1540] avg loss 0.000518574, throughput 2.86614K wps
[Epoch 196 Batch 300/1540] avg loss 0.000531557, throughput 2.86557K wps
[Epoch 196 Batch 330/1540] avg loss 0.000622606, throughput 2.82323K wps
[Epoch 196 Batch 360/1540] avg loss 0.000664189, throughput 2.87993K wps
[Epoch 196 Batch 390/1540] avg loss 0.000565527, throughput 2.84627K wps
[Epoch 196 Batch 420/1540] avg loss 0.000618324, throughput 2.85031K wps
[Epoch 196 Batch 450/1540] avg loss 0.00067383, throughput 2.87787K wps
[Epoch 196 Batch 480/1540] avg loss 0.000631176, throughput 2.87086K wps
[Epoch 196 Batch 510/1540] avg loss 0.000840977, throughput 2.87068K wps
[Epoch 196 Batch 540/1540] avg loss 0.000810903, throughput 2.85833K wps
[Epoch 196 Batch 570/1540] avg loss 0.000685101, throughput 2.86524K wps
[Epoch 196 Batch 600/1540] avg loss 0.0009336, throughput 2.86174K wps
[Epoch 196 Batch 630/1540] avg loss 0.000570667, throughput 2.8701K wps
[Epoch 196 Batch 660/1540] avg loss 0.000585234, throughput 2.8625K wps
[Epoch 196 Batch 690/1540] avg loss 0.0006493, throughput 2.87222K wps
[Epoch 196 Batch 720/1540] avg loss 0.00065765, throughput 2.86204K wps
[Epoch 196 Batch 750/1540] avg loss 0.000655494, throughput 2.81707K wps
[Epoch 196 Batch 780/1540] avg loss 0.000755422, throughput 2.87944K wps
[Epoch 196 Batch 810/1540] avg loss 0.000603788, throughput 2.85547K wps
[Epoch 196 Batch 840/1540] avg loss 0.00060056, throughput 2.83263K wps
[Epoch 196 Batch 870/1540] avg loss 0.000650086, throughput 2.78624K wps
[Epoch 196 Batch 900/1540] avg loss 0.000881313, throughput 2.85503K wps
[Epoch 196 Batch 930/1540] avg loss 0.000580002, throughput 2.87857K wps
[Epoch 196 Batch 960/1540] avg loss 0.000663542, throughput 2.86966K wps
[Epoch 196 Batch 990/1540] avg loss 0.000771775, throughput 2.81872K wps
[Epoch 196 Batch 1020/1540] avg loss 0.000817848, throughput 2.86024K wps
[Epoch 196 Batch 1050/1540] avg loss 0.000636787, throughput 2.86365K wps
[Epoch 196 Batch 1080/1540] avg loss 0.000793482, throughput 2.86629K wps
[Epoch 196 Batch 1110/1540] avg loss 0.000578791, throughput 2.87802K wps
[Epoch 196 Batch 1140/1540] avg loss 0.000808027, throughput 2.8228K wps
[Epoch 196 Batch 1170/1540] avg loss 0.000682673, throughput 2.8395K wps
[Epoch 196 Batch 1200/1540] avg loss 0.000581283, throughput 2.82009K wps
[Epoch 196 Batch 1230/1540] avg loss 0.000761005, throughput 2.82962K wps
[Epoch 196 Batch 1260/1540] avg loss 0.000499249, throughput 2.86063K wps
[Epoch 196 Batch 1290/1540] avg loss 0.000581238, throughput 2.8786K wps
[Epoch 196 Batch 1320/1540] avg loss 0.000632588, throughput 2.86789K wps
[Epoch 196 Batch 1350/1540] avg loss 0.000715069, throughput 2.82244K wps
[Epoch 196 Batch 1380/1540] avg loss 0.000627885, throughput 2.8679K wps
[Epoch 196 Batch 1410/1540] avg loss 0.000431822, throughput 2.87644K wps
[Epoch 196 Batch 1440/1540] avg loss 0.000668986, throughput 2.87333K wps
[Epoch 196 Batch 1470/1540] avg loss 0.000833367, throughput 2.88272K wps
[Epoch 196 Batch 1500/1540] avg loss 0.000786131, throughput 2.8485K wps
[Epoch 196 Batch 1530/1540] avg loss 0.000766433, throughput 2.80491K wps
Begin Testing...
[Epoch 196] train avg loss 0.000656517, dev acc 0.7959, dev avg loss 0.967111, throughput 2.85755K wps
[Epoch 197 Batch 30/1540] avg loss 0.000584539, throughput 2.88676K wps
[Epoch 197 Batch 60/1540] avg loss 0.000534277, throughput 2.86178K wps
[Epoch 197 Batch 90/1540] avg loss 0.000477615, throughput 2.84314K wps
[Epoch 197 Batch 120/1540] avg loss 0.000648331, throughput 2.8558K wps
[Epoch 197 Batch 150/1540] avg loss 0.00054816, throughput 2.87884K wps
[Epoch 197 Batch 180/1540] avg loss 0.000749221, throughput 2.86648K wps
[Epoch 197 Batch 210/1540] avg loss 0.000689289, throughput 2.85521K wps
[Epoch 197 Batch 240/1540] avg loss 0.000781105, throughput 2.83397K wps
[Epoch 197 Batch 270/1540] avg loss 0.000581913, throughput 2.83763K wps
[Epoch 197 Batch 300/1540] avg loss 0.000387619, throughput 2.87657K wps
[Epoch 197 Batch 330/1540] avg loss 0.000692621, throughput 2.87359K wps
[Epoch 197 Batch 360/1540] avg loss 0.000625505, throughput 2.8676K wps
[Epoch 197 Batch 390/1540] avg loss 0.000499988, throughput 2.85257K wps
[Epoch 197 Batch 420/1540] avg loss 0.000550022, throughput 2.86226K wps
[Epoch 197 Batch 450/1540] avg loss 0.000621074, throughput 2.86351K wps
[Epoch 197 Batch 480/1540] avg loss 0.000734531, throughput 2.85724K wps
[Epoch 197 Batch 510/1540] avg loss 0.000396249, throughput 2.87397K wps
[Epoch 197 Batch 540/1540] avg loss 0.000607494, throughput 2.87029K wps
[Epoch 197 Batch 570/1540] avg loss 0.000668758, throughput 2.82641K wps
[Epoch 197 Batch 600/1540] avg loss 0.000708676, throughput 2.80686K wps
[Epoch 197 Batch 630/1540] avg loss 0.000712367, throughput 2.8742K wps
[Epoch 197 Batch 660/1540] avg loss 0.000494062, throughput 2.86703K wps
[Epoch 197 Batch 690/1540] avg loss 0.000741592, throughput 2.87007K wps
[Epoch 197 Batch 720/1540] avg loss 0.000538892, throughput 2.81847K wps
[Epoch 197 Batch 750/1540] avg loss 0.000638645, throughput 2.8124K wps
[Epoch 197 Batch 780/1540] avg loss 0.000598061, throughput 2.86939K wps
[Epoch 197 Batch 810/1540] avg loss 0.000691394, throughput 2.86291K wps
[Epoch 197 Batch 840/1540] avg loss 0.000588806, throughput 2.86279K wps
[Epoch 197 Batch 870/1540] avg loss 0.000446985, throughput 2.86701K wps
[Epoch 197 Batch 900/1540] avg loss 0.000552745, throughput 2.87147K wps
[Epoch 197 Batch 930/1540] avg loss 0.000712643, throughput 2.87833K wps
[Epoch 197 Batch 960/1540] avg loss 0.000453682, throughput 2.87313K wps
[Epoch 197 Batch 990/1540] avg loss 0.000636505, throughput 2.81704K wps
[Epoch 197 Batch 1020/1540] avg loss 0.000601221, throughput 2.85863K wps
[Epoch 197 Batch 1050/1540] avg loss 0.000584182, throughput 2.83576K wps
[Epoch 197 Batch 1080/1540] avg loss 0.000744726, throughput 2.83529K wps
[Epoch 197 Batch 1110/1540] avg loss 0.000666685, throughput 2.83991K wps
[Epoch 197 Batch 1140/1540] avg loss 0.000506305, throughput 2.81609K wps
[Epoch 197 Batch 1170/1540] avg loss 0.000593108, throughput 2.78385K wps
[Epoch 197 Batch 1200/1540] avg loss 0.000705429, throughput 2.86824K wps
[Epoch 197 Batch 1230/1540] avg loss 0.000467947, throughput 2.87499K wps
[Epoch 197 Batch 1260/1540] avg loss 0.000659637, throughput 2.87643K wps
[Epoch 197 Batch 1290/1540] avg loss 0.000492154, throughput 2.83182K wps
[Epoch 197 Batch 1320/1540] avg loss 0.000700475, throughput 2.87675K wps
[Epoch 197 Batch 1350/1540] avg loss 0.000662927, throughput 2.87795K wps
[Epoch 197 Batch 1380/1540] avg loss 0.000798024, throughput 2.87768K wps
[Epoch 197 Batch 1410/1540] avg loss 0.000778465, throughput 2.85981K wps
[Epoch 197 Batch 1440/1540] avg loss 0.000746319, throughput 2.8627K wps
[Epoch 197 Batch 1470/1540] avg loss 0.000501605, throughput 2.86906K wps
[Epoch 197 Batch 1500/1540] avg loss 0.000809326, throughput 2.85557K wps
[Epoch 197 Batch 1530/1540] avg loss 0.000592108, throughput 2.86764K wps
Begin Testing...
[Epoch 197] train avg loss 0.000615939, dev acc 0.8073, dev avg loss 0.985709, throughput 2.85553K wps
[Epoch 198 Batch 30/1540] avg loss 0.000750078, throughput 2.85179K wps
[Epoch 198 Batch 60/1540] avg loss 0.000636566, throughput 2.81113K wps
[Epoch 198 Batch 90/1540] avg loss 0.000552605, throughput 2.861K wps
[Epoch 198 Batch 120/1540] avg loss 0.000665907, throughput 2.84348K wps
[Epoch 198 Batch 150/1540] avg loss 0.000612714, throughput 2.84112K wps
[Epoch 198 Batch 180/1540] avg loss 0.000512398, throughput 2.87504K wps
[Epoch 198 Batch 210/1540] avg loss 0.000595008, throughput 2.86642K wps
[Epoch 198 Batch 240/1540] avg loss 0.000462473, throughput 2.86532K wps
[Epoch 198 Batch 270/1540] avg loss 0.000443819, throughput 2.86726K wps
[Epoch 198 Batch 300/1540] avg loss 0.000452031, throughput 2.8728K wps
[Epoch 198 Batch 330/1540] avg loss 0.000489821, throughput 2.87434K wps
[Epoch 198 Batch 360/1540] avg loss 0.00045723, throughput 2.8703K wps
[Epoch 198 Batch 390/1540] avg loss 0.000568135, throughput 2.88002K wps
[Epoch 198 Batch 420/1540] avg loss 0.000597974, throughput 2.85104K wps
[Epoch 198 Batch 450/1540] avg loss 0.000682845, throughput 2.84069K wps
[Epoch 198 Batch 480/1540] avg loss 0.000658225, throughput 2.87038K wps
[Epoch 198 Batch 510/1540] avg loss 0.000699449, throughput 2.874K wps
[Epoch 198 Batch 540/1540] avg loss 0.000674483, throughput 2.87246K wps
[Epoch 198 Batch 570/1540] avg loss 0.000701674, throughput 2.85275K wps
[Epoch 198 Batch 600/1540] avg loss 0.000651237, throughput 2.86328K wps
[Epoch 198 Batch 630/1540] avg loss 0.000951738, throughput 2.88299K wps
[Epoch 198 Batch 660/1540] avg loss 0.000619786, throughput 2.87325K wps
[Epoch 198 Batch 690/1540] avg loss 0.000780704, throughput 2.87774K wps
[Epoch 198 Batch 720/1540] avg loss 0.000753433, throughput 2.85541K wps
[Epoch 198 Batch 750/1540] avg loss 0.000556569, throughput 2.83697K wps
[Epoch 198 Batch 780/1540] avg loss 0.000538229, throughput 2.85038K wps
[Epoch 198 Batch 810/1540] avg loss 0.000640804, throughput 2.7955K wps
[Epoch 198 Batch 840/1540] avg loss 0.000505345, throughput 2.87394K wps
[Epoch 198 Batch 870/1540] avg loss 0.000648514, throughput 2.84057K wps
[Epoch 198 Batch 900/1540] avg loss 0.000672134, throughput 2.82801K wps
[Epoch 198 Batch 930/1540] avg loss 0.000510135, throughput 2.87952K wps
[Epoch 198 Batch 960/1540] avg loss 0.000712633, throughput 2.87929K wps
[Epoch 198 Batch 990/1540] avg loss 0.000752971, throughput 2.83784K wps
[Epoch 198 Batch 1020/1540] avg loss 0.000626215, throughput 2.87881K wps
[Epoch 198 Batch 1050/1540] avg loss 0.000690276, throughput 2.88341K wps
[Epoch 198 Batch 1080/1540] avg loss 0.000746108, throughput 2.87802K wps
[Epoch 198 Batch 1110/1540] avg loss 0.000497549, throughput 2.87683K wps
[Epoch 198 Batch 1140/1540] avg loss 0.00070318, throughput 2.8737K wps
[Epoch 198 Batch 1170/1540] avg loss 0.000509679, throughput 2.85818K wps
[Epoch 198 Batch 1200/1540] avg loss 0.000806907, throughput 2.87674K wps
[Epoch 198 Batch 1230/1540] avg loss 0.000715598, throughput 2.86556K wps
[Epoch 198 Batch 1260/1540] avg loss 0.000716357, throughput 2.8419K wps
[Epoch 198 Batch 1290/1540] avg loss 0.000803851, throughput 2.85473K wps
[Epoch 198 Batch 1320/1540] avg loss 0.000567382, throughput 2.811K wps
[Epoch 198 Batch 1350/1540] avg loss 0.000879866, throughput 2.86241K wps
[Epoch 198 Batch 1380/1540] avg loss 0.000631979, throughput 2.85719K wps
[Epoch 198 Batch 1410/1540] avg loss 0.0006687, throughput 2.87737K wps
[Epoch 198 Batch 1440/1540] avg loss 0.000742812, throughput 2.8678K wps
[Epoch 198 Batch 1470/1540] avg loss 0.000722311, throughput 2.85346K wps
[Epoch 198 Batch 1500/1540] avg loss 0.000632025, throughput 2.8783K wps
[Epoch 198 Batch 1530/1540] avg loss 0.000643834, throughput 2.86928K wps
Begin Testing...
[Epoch 198] train avg loss 0.000644268, dev acc 0.7936, dev avg loss 0.981171, throughput 2.86037K wps
[Epoch 199 Batch 30/1540] avg loss 0.00059084, throughput 2.86716K wps
[Epoch 199 Batch 60/1540] avg loss 0.000680952, throughput 2.85695K wps
[Epoch 199 Batch 90/1540] avg loss 0.000607228, throughput 2.78157K wps
[Epoch 199 Batch 120/1540] avg loss 0.000423733, throughput 2.86424K wps
[Epoch 199 Batch 150/1540] avg loss 0.000458739, throughput 2.88072K wps
[Epoch 199 Batch 180/1540] avg loss 0.00057373, throughput 2.86008K wps
[Epoch 199 Batch 210/1540] avg loss 0.000686024, throughput 2.80564K wps
[Epoch 199 Batch 240/1540] avg loss 0.000605683, throughput 2.8385K wps
[Epoch 199 Batch 270/1540] avg loss 0.000578117, throughput 2.86813K wps
[Epoch 199 Batch 300/1540] avg loss 0.000524837, throughput 2.87691K wps
[Epoch 199 Batch 330/1540] avg loss 0.000580856, throughput 2.84612K wps
[Epoch 199 Batch 360/1540] avg loss 0.000743259, throughput 2.86681K wps
[Epoch 199 Batch 390/1540] avg loss 0.000708183, throughput 2.86217K wps
[Epoch 199 Batch 420/1540] avg loss 0.00060474, throughput 2.80539K wps
[Epoch 199 Batch 450/1540] avg loss 0.000545517, throughput 2.81791K wps
[Epoch 199 Batch 480/1540] avg loss 0.000827348, throughput 2.86211K wps
[Epoch 199 Batch 510/1540] avg loss 0.000765362, throughput 2.83767K wps
[Epoch 199 Batch 540/1540] avg loss 0.000505697, throughput 2.86264K wps
[Epoch 199 Batch 570/1540] avg loss 0.00051151, throughput 2.87104K wps
[Epoch 199 Batch 600/1540] avg loss 0.000556116, throughput 2.82891K wps
[Epoch 199 Batch 630/1540] avg loss 0.000609498, throughput 2.79535K wps
[Epoch 199 Batch 660/1540] avg loss 0.000693575, throughput 2.87767K wps
[Epoch 199 Batch 690/1540] avg loss 0.000622966, throughput 2.87044K wps
[Epoch 199 Batch 720/1540] avg loss 0.000650072, throughput 2.83258K wps
[Epoch 199 Batch 750/1540] avg loss 0.000620745, throughput 2.86195K wps
[Epoch 199 Batch 780/1540] avg loss 0.000499803, throughput 2.85333K wps
[Epoch 199 Batch 810/1540] avg loss 0.000616277, throughput 2.78957K wps
[Epoch 199 Batch 840/1540] avg loss 0.000782242, throughput 2.86979K wps
[Epoch 199 Batch 870/1540] avg loss 0.000498896, throughput 2.86518K wps
[Epoch 199 Batch 900/1540] avg loss 0.000651801, throughput 2.8572K wps
[Epoch 199 Batch 930/1540] avg loss 0.000643831, throughput 2.87134K wps
[Epoch 199 Batch 960/1540] avg loss 0.000504197, throughput 2.87625K wps
[Epoch 199 Batch 990/1540] avg loss 0.000546642, throughput 2.85383K wps
[Epoch 199 Batch 1020/1540] avg loss 0.000713866, throughput 2.86881K wps
[Epoch 199 Batch 1050/1540] avg loss 0.000748015, throughput 2.88168K wps
[Epoch 199 Batch 1080/1540] avg loss 0.000681437, throughput 2.86625K wps
[Epoch 199 Batch 1110/1540] avg loss 0.000760453, throughput 2.83233K wps
[Epoch 199 Batch 1140/1540] avg loss 0.000648958, throughput 2.85403K wps
[Epoch 199 Batch 1170/1540] avg loss 0.000556518, throughput 2.88353K wps
[Epoch 199 Batch 1200/1540] avg loss 0.000810013, throughput 2.8325K wps
[Epoch 199 Batch 1230/1540] avg loss 0.000807155, throughput 2.81964K wps
[Epoch 199 Batch 1260/1540] avg loss 0.000585144, throughput 2.87843K wps
[Epoch 199 Batch 1290/1540] avg loss 0.000748236, throughput 2.812K wps
[Epoch 199 Batch 1320/1540] avg loss 0.000706023, throughput 2.87753K wps
[Epoch 199 Batch 1350/1540] avg loss 0.000596913, throughput 2.88019K wps
[Epoch 199 Batch 1380/1540] avg loss 0.000723926, throughput 2.87431K wps
[Epoch 199 Batch 1410/1540] avg loss 0.000599612, throughput 2.87428K wps
[Epoch 199 Batch 1440/1540] avg loss 0.000624173, throughput 2.86124K wps
[Epoch 199 Batch 1470/1540] avg loss 0.000708421, throughput 2.83856K wps
[Epoch 199 Batch 1500/1540] avg loss 0.000712355, throughput 2.82937K wps
[Epoch 199 Batch 1530/1540] avg loss 0.000750076, throughput 2.87975K wps
Begin Testing...
[Epoch 199] train avg loss 0.000639327, dev acc 0.7959, dev avg loss 0.993742, throughput 2.85245K wps
Test loss 0.410846, test acc 0.8210
Total time cost 5744.42s