Preparing directory /home/swa/swa_cifar10_VGG16BNModel/ Using model VGG16BN Loading dataset CIFAR10 from /home/swa/cifar10_data/ Files already downloaded and verified Files already downloaded and verified Preparing model SWA training ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 1 0.0500 1.7471 32.3000 1.7264 36.7100 15.3998 2 0.0500 1.2789 54.6280 12.8528 3 0.0500 0.9852 66.7120 12.8880 4 0.0500 0.8378 72.5740 12.9676 5 0.0500 0.7367 76.3800 13.0316 6 0.0500 0.6677 78.2960 13.4785 7 0.0500 0.6131 80.1120 13.8234 8 0.0500 0.5665 81.8120 13.8508 9 0.0500 0.5457 82.4640 13.9365 10 0.0500 0.5132 83.5960 0.5812 81.4300 14.7334 11 0.0500 0.4822 84.3880 14.2566 12 0.0500 0.4726 84.9260 14.1305 13 0.0500 0.4661 85.1980 14.2260 14 0.0500 0.4408 85.9000 14.1988 15 0.0500 0.4390 85.9760 14.0298 16 0.0500 0.4262 86.4300 14.4238 17 0.0500 0.4112 86.6480 14.3808 18 0.0500 0.4049 87.2400 14.3279 19 0.0500 0.4020 87.1020 14.3759 20 0.0500 0.3917 87.4960 0.5094 83.9800 15.2529 21 0.0500 0.3833 87.8940 14.4051 22 0.0500 0.3832 87.9400 14.0355 23 0.0500 0.3830 87.6620 14.4502 24 0.0500 0.3646 88.3700 14.3628 25 0.0500 0.3636 88.3440 14.2897 26 0.0500 0.3609 88.6300 14.4358 27 0.0500 0.3645 88.3940 14.3961 28 0.0500 0.3511 89.0020 14.4582 29 0.0500 0.3490 88.7400 14.4856 30 0.0500 0.3542 88.8360 0.5468 83.5800 15.6004 31 0.0500 0.3490 88.9520 14.4039 32 0.0500 0.3452 89.2780 14.4428 33 0.0500 0.3445 89.3560 14.3001 34 0.0500 0.3408 89.3140 14.4161 35 0.0500 0.3305 89.5860 14.4074 36 0.0500 0.3369 89.2840 14.4774 37 0.0500 0.3332 89.4900 14.3293 38 0.0500 0.3328 89.5320 14.4390 39 0.0500 0.3377 89.3620 14.4592 40 0.0500 0.3213 89.7580 0.4516 85.9600 15.1009 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 41 0.0500 0.3178 90.0940 14.4449 42 0.0500 0.3295 89.6840 14.4517 43 0.0500 0.3291 89.6600 14.3555 44 0.0500 0.3235 89.7060 14.4540 45 0.0500 0.3185 89.9280 14.4043 46 0.0500 0.3190 89.9340 14.3849 47 0.0500 0.3096 90.2080 14.3512 48 0.0500 0.3167 89.9540 14.4535 49 0.0500 0.3127 90.2060 14.3484 50 0.0500 0.3028 90.4640 0.4224 86.9900 15.6169 51 0.0500 0.3080 90.2920 14.4572 52 0.0500 0.3116 90.1200 14.4434 53 0.0500 0.3040 90.4300 14.3190 54 0.0500 0.3163 89.8460 14.3504 55 0.0500 0.3093 90.1220 14.3226 56 0.0500 0.3011 90.4480 14.4741 57 0.0500 0.2966 90.4720 14.3747 58 0.0500 0.2994 90.4900 14.3185 59 0.0500 0.3124 90.1420 14.4236 60 0.0500 0.2993 90.3780 0.5351 83.5000 15.5528 61 0.0500 0.2959 90.7820 14.5275 62 0.0500 0.2976 90.6300 14.4300 63 0.0500 0.2982 90.5140 14.3130 64 0.0500 0.3001 90.4700 14.0014 65 0.0500 0.3001 90.5900 14.3894 66 0.0500 0.3049 90.4820 14.4337 67 0.0500 0.2993 90.5740 14.1420 68 0.0500 0.2953 90.6900 14.3846 69 0.0500 0.3014 90.4820 14.3968 70 0.0500 0.2887 90.8220 0.4431 86.4500 15.4220 71 0.0500 0.2945 90.5800 14.2757 72 0.0500 0.2952 90.6960 14.4260 73 0.0500 0.2923 90.8520 14.0755 74 0.0500 0.2939 90.7680 14.4733 75 0.0500 0.2877 91.0160 14.3152 76 0.0500 0.2881 90.8900 14.3221 77 0.0500 0.2906 90.9100 14.2352 78 0.0500 0.2918 90.8460 17.7853 79 0.0500 0.2880 90.9520 19.4463 80 0.0500 0.2855 90.8920 0.4268 86.7200 15.3762 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 81 0.0500 0.2903 90.8460 14.4727 82 0.0497 0.2854 91.1780 14.3514 83 0.0491 0.2810 91.0600 14.3294 84 0.0484 0.2831 91.0880 14.3564 85 0.0478 0.2727 91.3720 14.2601 86 0.0472 0.2682 91.5780 14.4058 87 0.0466 0.2703 91.4560 14.3410 88 0.0460 0.2627 91.6520 14.4036 89 0.0453 0.2633 91.7300 22.3562 90 0.0447 0.2623 91.7440 0.5263 84.7000 21.3751 91 0.0441 0.2620 91.6540 19.8487 92 0.0435 0.2530 92.0020 21.9037 93 0.0429 0.2463 92.1920 17.4072 94 0.0422 0.2496 92.0060 24.1133 95 0.0416 0.2416 92.3320 19.5128 96 0.0410 0.2407 92.4820 14.1388 97 0.0404 0.2363 92.5980 19.5019 98 0.0398 0.2406 92.5220 24.0063 99 0.0391 0.2276 92.8600 21.5281 100 0.0385 0.2334 92.6840 0.4087 87.6000 20.8775 101 0.0379 0.2211 92.9960 24.5193 102 0.0373 0.2236 92.9660 22.8418 103 0.0366 0.2187 92.9420 14.6235 104 0.0360 0.2170 93.1200 15.8539 105 0.0354 0.2132 93.1880 23.3813 106 0.0348 0.2099 93.3380 23.9678 107 0.0342 0.2056 93.4980 19.7034 108 0.0335 0.2016 93.5960 20.8456 109 0.0329 0.2023 93.4820 24.2880 110 0.0323 0.1941 93.8400 0.4923 86.8000 25.5205 111 0.0317 0.1911 93.9360 15.3047 112 0.0311 0.1919 93.8420 14.2328 113 0.0304 0.1881 93.9520 22.4586 114 0.0298 0.1780 94.4340 19.4840 115 0.0292 0.1716 94.4700 19.2207 116 0.0286 0.1713 94.6220 21.4113 117 0.0280 0.1677 94.5780 17.3773 118 0.0273 0.1681 94.7220 23.6385 119 0.0267 0.1675 94.6880 19.9946 120 0.0261 0.1531 95.0700 0.3382 90.3200 14.7716 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 121 0.0255 0.1571 95.0900 18.6741 122 0.0248 0.1509 95.3220 24.4484 123 0.0242 0.1507 95.0940 21.9056 124 0.0236 0.1451 95.2540 18.5338 125 0.0230 0.1372 95.5320 24.2025 126 0.0224 0.1380 95.5760 23.5621 127 0.0217 0.1289 95.7980 15.5583 128 0.0211 0.1334 95.7040 15.2293 129 0.0205 0.1201 96.1120 24.1753 130 0.0199 0.1147 96.3460 0.3578 90.0000 26.4940 131 0.0193 0.1182 96.2040 18.1191 132 0.0186 0.1144 96.4240 22.2108 133 0.0180 0.1107 96.5140 25.5206 134 0.0174 0.1013 96.7060 23.6473 135 0.0168 0.0995 96.8160 14.0132 136 0.0161 0.0934 96.9660 13.8162 137 0.0155 0.0884 97.1540 13.7789 138 0.0149 0.0861 97.2800 13.8883 139 0.0143 0.0814 97.3360 13.9132 140 0.0137 0.0792 97.4800 0.3195 91.6100 15.0653 141 0.0130 0.0663 97.9320 13.9801 142 0.0124 0.0677 97.8700 14.0410 143 0.0118 0.0696 97.7620 13.9298 144 0.0112 0.0596 98.0180 14.1074 145 0.0106 0.0531 98.3360 14.0800 146 0.0100 0.0500 98.3780 14.1180 147 0.0100 0.0514 98.3860 14.1648 148 0.0100 0.0486 98.4460 14.1786 149 0.0100 0.0526 98.3600 14.1366 150 0.0100 0.0489 98.4920 0.3368 91.8000 15.2810 151 0.0100 0.0548 98.2380 14.0975 152 0.0100 0.0543 98.2720 14.3379 153 0.0100 0.0589 98.1540 14.2879 154 0.0100 0.0555 98.2260 14.1546 155 0.0100 0.0627 97.9840 14.1890 156 0.0100 0.0580 98.1720 13.5180 157 0.0100 0.0589 98.1320 14.4548 158 0.0100 0.0608 98.0080 14.3758 159 0.0100 0.0605 98.1400 14.2947 160 0.0100 0.0625 98.0360 0.3104 91.5900 15.1457 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 161 0.0100 0.0608 98.0820 14.2023 162 0.0100 0.0605 98.0740 14.2374 163 0.0100 0.0610 98.0200 14.2173 164 0.0100 0.0615 98.0720 14.2233 165 0.0100 0.0630 97.9840 13.9104 166 0.0100 0.0638 97.9660 14.4499 167 0.0100 0.0658 97.9300 14.2699 168 0.0100 0.0589 98.1520 14.2198 169 0.0100 0.0660 97.8580 14.0687 170 0.0100 0.0628 97.9880 0.3298 91.1900 0.2228 94.3100 20.8268 171 0.0100 0.0630 97.9980 14.4422 172 0.0100 0.0675 97.8740 14.2480 173 0.0100 0.0674 97.8380 14.2538 174 0.0100 0.0657 97.8400 14.2413 175 0.0100 0.0694 97.7860 14.3198 176 0.0100 0.0658 97.9420 14.0922 177 0.0100 0.0667 97.8560 14.4528 178 0.0100 0.0692 97.7620 14.3107 179 0.0100 0.0616 98.0400 14.3114 180 0.0100 0.0638 98.0080 0.3443 91.1400 0.2131 94.6400 20.9227 181 0.0100 0.0676 97.9040 14.1149 182 0.0100 0.0653 97.9340 13.9805 183 0.0100 0.0665 97.8880 14.4735 184 0.0100 0.0686 97.8960 14.3093 185 0.0100 0.0657 97.9020 17.2229 186 0.0100 0.0695 97.8020 22.4592 187 0.0100 0.0679 97.9520 21.8737 188 0.0100 0.0650 97.9100 17.0243 189 0.0100 0.0650 97.9660 23.1304 190 0.0100 0.0642 98.0300 0.3101 91.7400 0.2096 94.5900 28.4154 191 0.0100 0.0639 97.9460 19.7604 192 0.0100 0.0628 97.9900 24.2162 193 0.0100 0.0701 97.7860 18.8958 194 0.0100 0.0654 97.9740 14.0228 195 0.0100 0.0707 97.8440 18.6169 196 0.0100 0.0651 97.9800 23.9403 197 0.0100 0.0669 97.8700 24.5140 198 0.0100 0.0629 98.0220 19.1574 199 0.0100 0.0684 97.8100 21.2523 200 0.0100 0.0670 97.8960 0.3349 91.6400 0.2067 94.6600 34.5690 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 201 0.0100 0.0624 98.0000 24.7618 202 0.0100 0.0669 97.9360 16.0847 203 0.0100 0.0656 97.9080 14.0900 204 0.0100 0.0620 98.0860 22.8434 205 0.0100 0.0625 97.9940 23.8365 206 0.0100 0.0634 98.0420 24.8337 207 0.0100 0.0643 98.0280 19.4471 208 0.0100 0.0693 97.8720 19.7756 209 0.0100 0.0647 97.9300 24.6354 210 0.0100 0.0658 97.9540 0.3512 91.0900 0.2041 94.6700 34.7519 211 0.0100 0.0632 97.9760 21.6704 212 0.0100 0.0699 97.8220 14.2556 213 0.0100 0.0648 97.9720 15.6922 214 0.0100 0.0635 97.9780 23.0224 215 0.0100 0.0623 98.0160 21.7583 216 0.0100 0.0657 97.9060 16.1056 217 0.0100 0.0611 98.0340 22.2421 218 0.0100 0.0642 97.9700 22.7777 219 0.0100 0.0650 97.9940 16.4015 220 0.0100 0.0649 97.9780 0.3230 91.3700 0.2025 94.7600 33.7529 221 0.0100 0.0631 97.9820 20.6892 222 0.0100 0.0691 97.7840 13.9032 223 0.0100 0.0640 97.9580 17.2422 224 0.0100 0.0621 98.0300 23.9008 225 0.0100 0.0655 97.9340 23.6727 226 0.0100 0.0580 98.1360 20.8423 227 0.0100 0.0623 98.0600 19.1357 228 0.0100 0.0679 97.8440 23.6958 229 0.0100 0.0597 98.0980 25.3099 230 0.0100 0.0627 98.0020 0.3755 90.5800 0.2031 94.8200 27.7409 231 0.0100 0.0651 97.9180 14.1937 232 0.0100 0.0667 97.8020 20.9433 233 0.0100 0.0626 97.9820 24.7288 234 0.0100 0.0646 98.0020 23.8657 235 0.0100 0.0659 97.9400 21.4872 236 0.0100 0.0681 97.8900 18.8625 237 0.0100 0.0583 98.1720 24.3847 238 0.0100 0.0629 98.0480 24.5657 239 0.0100 0.0621 97.9900 24.9506 240 0.0100 0.0654 97.9580 0.3341 91.8000 0.2030 94.8000 22.9052 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 241 0.0100 0.0599 98.0980 13.9369 242 0.0100 0.0603 98.1440 13.8067 243 0.0100 0.0633 98.0180 13.9744 244 0.0100 0.0601 98.0800 13.8291 245 0.0100 0.0674 97.8200 14.0192 246 0.0100 0.0641 98.0320 13.8253 247 0.0100 0.0607 98.0740 14.0758 248 0.0100 0.0631 98.0240 13.8710 249 0.0100 0.0609 98.0920 14.0644 250 0.0100 0.0601 98.0680 0.3562 91.0800 0.2019 94.8900 20.5400 251 0.0100 0.0662 97.9600 14.1566 252 0.0100 0.0615 98.0160 14.1191 253 0.0100 0.0655 97.8940 14.1162 254 0.0100 0.0609 98.0740 14.1557 255 0.0100 0.0631 98.0200 14.1608 256 0.0100 0.0659 97.8680 13.9121 257 0.0100 0.0628 98.0280 14.4154 258 0.0100 0.0666 97.9500 14.2266 259 0.0100 0.0660 97.9160 14.2655 260 0.0100 0.0617 98.0600 0.4066 89.5200 0.2013 94.8500 20.7289 261 0.0100 0.0622 98.0940 14.4485 262 0.0100 0.0612 98.0680 14.2949 263 0.0100 0.0596 98.1480 14.2793 264 0.0100 0.0631 98.0020 14.4490 265 0.0100 0.0646 98.0040 14.3209 266 0.0100 0.0602 98.0080 14.3375 267 0.0100 0.0635 97.9560 14.3615 268 0.0100 0.0613 98.1540 13.9859 269 0.0100 0.0609 98.0540 14.4206 270 0.0100 0.0654 97.9640 0.3095 91.6800 0.2009 94.8600 21.0122 271 0.0100 0.0587 98.1820 14.3607 272 0.0100 0.0606 98.1860 14.2864 273 0.0100 0.0613 98.0520 14.4060 274 0.0100 0.0632 98.0600 14.3394 275 0.0100 0.0649 97.9340 14.3962 276 0.0100 0.0638 97.9600 14.0867 277 0.0100 0.0611 98.0600 14.3949 278 0.0100 0.0624 98.0160 14.3145 279 0.0100 0.0623 98.0420 14.2447 280 0.0100 0.0642 98.0580 0.3181 91.6800 0.2010 94.8600 21.0110 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 281 0.0100 0.0612 98.1240 14.2682 282 0.0100 0.0604 98.0520 14.1253 283 0.0100 0.0556 98.1920 14.3402 284 0.0100 0.0623 98.0160 14.3064 285 0.0100 0.0593 98.1420 14.3898 286 0.0100 0.0591 98.1760 14.3459 287 0.0100 0.0606 98.1400 14.3335 288 0.0100 0.0627 98.0320 14.2832 289 0.0100 0.0649 97.9740 14.3540 290 0.0100 0.0622 98.0260 0.3338 91.0500 0.2010 94.8500 20.5770 291 0.0100 0.0583 98.1120 14.4710 292 0.0100 0.0611 98.0440 14.2438 293 0.0100 0.0639 97.9440 14.4485 294 0.0100 0.0614 98.1280 14.3439 295 0.0100 0.0671 97.8820 14.2233 296 0.0100 0.0652 97.9340 14.3491 297 0.0100 0.0611 98.1000 14.3472 298 0.0100 0.0592 98.1720 14.3173 299 0.0100 0.0624 98.1000 14.3627 300 0.0100 0.0611 98.1000 0.3814 90.3400 0.2008 94.8200 20.8642