Steps: 1000	Loss: 171027.12500	PPL: 117.99371	bleu: 1.00703	LR: 1.00000000	*
Steps: 2000	Loss: 128717.92969	PPL: 36.25069	bleu: 6.03861	LR: 1.00000000	*
Steps: 3000	Loss: 104942.17188	PPL: 18.67634	bleu: 15.24201	LR: 1.00000000	*
Steps: 4000	Loss: 97685.14062	PPL: 15.25382	bleu: 18.32493	LR: 1.00000000	*
Steps: 5000	Loss: 93876.41406	PPL: 13.71636	bleu: 19.47332	LR: 1.00000000	*
Steps: 6000	Loss: 92028.30469	PPL: 13.02718	bleu: 20.37794	LR: 1.00000000	*
Steps: 7000	Loss: 91441.38281	PPL: 12.81564	bleu: 20.88522	LR: 1.00000000	*
Steps: 8000	Loss: 90023.52344	PPL: 12.31868	bleu: 21.27478	LR: 1.00000000	*
Steps: 9000	Loss: 89862.09375	PPL: 12.26333	bleu: 21.63593	LR: 1.00000000	*
Steps: 10000	Loss: 89593.67188	PPL: 12.17185	bleu: 22.11755	LR: 1.00000000	*
Steps: 11000	Loss: 89732.27344	PPL: 12.21900	bleu: 21.75389	LR: 1.00000000	
Steps: 12000	Loss: 89814.28125	PPL: 12.24699	bleu: 21.61946	LR: 0.50000000	
Steps: 13000	Loss: 87326.99219	PPL: 11.42609	bleu: 22.77902	LR: 0.50000000	*
Steps: 14000	Loss: 87408.85938	PPL: 11.45221	bleu: 22.71473	LR: 0.50000000	
Steps: 15000	Loss: 88362.66406	PPL: 11.76099	bleu: 22.54891	LR: 0.25000000	
Steps: 16000	Loss: 87531.93750	PPL: 11.49160	bleu: 23.20362	LR: 0.25000000	*
Steps: 17000	Loss: 88269.49219	PPL: 11.73047	bleu: 23.17158	LR: 0.25000000	
Steps: 18000	Loss: 88671.82812	PPL: 11.86286	bleu: 23.19707	LR: 0.12500000	
Steps: 19000	Loss: 88523.01562	PPL: 11.81371	bleu: 23.51104	LR: 0.12500000	*
Steps: 20000	Loss: 88826.87500	PPL: 11.91427	bleu: 23.56153	LR: 0.12500000	*
Steps: 21000	Loss: 88863.22656	PPL: 11.92636	bleu: 23.48886	LR: 0.12500000	
Steps: 22000	Loss: 89398.09375	PPL: 12.10563	bleu: 23.25409	LR: 0.06250000	
Steps: 23000	Loss: 89630.03125	PPL: 12.18421	bleu: 23.34235	LR: 0.06250000