Preparing directory /home/swa_cifar10_VGG16BNModel_sgdBN/ Using model VGG16BN Loading dataset CIFAR10 from /home/swa_gaussian/cifar10_data/ Files already downloaded and verified Files already downloaded and verified Preparing model SWA training ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 1 0.0500 1.7565 32.4080 1.4832 44.5800 21.1101 2 0.0500 1.2726 54.9420 14.3854 3 0.0500 0.9928 66.5460 14.4281 4 0.0500 0.8321 72.7700 14.3808 5 0.0500 0.7390 75.9720 14.2957 6 0.0500 0.6643 78.4640 14.4940 7 0.0500 0.6153 80.2280 14.2676 8 0.0500 0.5801 81.3400 14.1991 9 0.0500 0.5433 82.5900 14.4678 10 0.0500 0.5120 83.6880 0.5127 83.1400 19.9530 11 0.0500 0.4975 84.1180 14.4090 12 0.0500 0.4761 84.7280 14.4949 13 0.0500 0.4627 85.1860 14.3443 14 0.0500 0.4496 85.5420 14.0506 15 0.0500 0.4266 86.3280 14.4679 16 0.0500 0.4286 86.3220 14.5050 17 0.0500 0.4193 86.6640 14.2814 18 0.0500 0.4181 86.6980 14.4150 19 0.0500 0.3995 87.1880 14.4032 20 0.0500 0.3890 87.4280 0.4345 86.1800 19.9106 21 0.0500 0.3879 87.6500 14.1563 22 0.0500 0.3820 87.7920 14.4278 23 0.0500 0.3828 87.9040 14.4671 24 0.0500 0.3748 88.1380 14.2821 25 0.0500 0.3744 88.1140 14.3460 26 0.0500 0.3633 88.4560 14.3769 27 0.0500 0.3636 88.4500 14.2148 28 0.0500 0.3604 88.6460 14.5001 29 0.0500 0.3573 88.5580 14.4068 30 0.0500 0.3525 88.8200 0.4004 87.0600 19.9395 31 0.0500 0.3501 88.9780 14.4032 32 0.0500 0.3462 88.9040 14.4235 33 0.0500 0.3417 89.2160 14.1066 34 0.0500 0.3444 89.2060 14.4932 35 0.0500 0.3409 89.3440 14.4453 36 0.0500 0.3257 89.5660 14.3447 37 0.0500 0.3343 89.3440 14.2888 38 0.0500 0.3311 89.3460 14.3416 39 0.0500 0.3267 89.7940 14.2001 40 0.0500 0.3240 89.6920 0.4382 86.5300 19.9031 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 41 0.0500 0.3296 89.5720 14.4854 42 0.0500 0.3247 89.7140 14.4001 43 0.0500 0.3238 89.9520 13.9702 44 0.0500 0.3231 89.8000 14.4901 45 0.0500 0.3135 90.2100 14.5002 46 0.0500 0.3090 90.1460 14.3551 47 0.0500 0.3141 90.1480 14.3370 48 0.0500 0.3152 90.1360 14.2645 49 0.0500 0.3121 90.1900 14.3084 50 0.0500 0.3186 89.8560 0.4000 87.1800 19.9970 51 0.0500 0.3123 90.1040 14.5047 52 0.0500 0.3161 90.0480 14.3207 53 0.0500 0.3152 90.0860 14.4070 54 0.0500 0.3106 90.2000 14.4442 55 0.0500 0.3034 90.5360 14.3604 56 0.0500 0.3017 90.4400 14.4075 57 0.0500 0.3111 90.1860 14.4353 58 0.0500 0.3005 90.5040 13.7852 59 0.0500 0.2931 90.6920 14.4984 60 0.0500 0.3069 90.4020 0.3727 88.1400 19.9798 61 0.0500 0.3064 90.2040 14.1981 62 0.0500 0.3036 90.5740 14.4688 63 0.0500 0.2978 90.5220 14.3722 64 0.0500 0.3044 90.3900 14.1629 65 0.0500 0.2981 90.5760 14.3167 66 0.0500 0.2904 90.9200 14.3841 67 0.0500 0.2944 90.8300 14.2307 68 0.0500 0.2952 90.6520 14.3296 69 0.0500 0.3038 90.3240 13.9246 70 0.0500 0.2913 90.7560 0.3706 88.2900 20.0486 71 0.0500 0.2965 90.5500 14.0335 72 0.0500 0.2894 90.8120 14.5118 73 0.0500 0.2908 90.7660 14.1744 74 0.0500 0.3044 90.4900 14.4103 75 0.0500 0.2871 90.8760 14.3503 76 0.0500 0.2952 90.7780 14.3486 77 0.0500 0.2892 90.9720 14.3104 78 0.0500 0.2946 90.7660 14.2015 79 0.0500 0.2907 90.8580 14.2794 80 0.0500 0.2905 90.8900 0.3406 88.8000 19.9574 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 81 0.0500 0.2906 90.7760 14.4539 82 0.0497 0.2896 90.8740 14.4515 83 0.0491 0.2852 90.8540 14.1601 84 0.0484 0.2757 91.3800 14.2971 85 0.0478 0.2722 91.3320 14.3485 86 0.0472 0.2851 91.1340 14.1866 87 0.0466 0.2724 91.4260 14.5381 88 0.0460 0.2599 91.7760 14.3156 89 0.0453 0.2663 91.5380 13.9639 90 0.0447 0.2628 91.6880 0.3509 89.3200 20.0570 91 0.0441 0.2526 92.0840 14.4713 92 0.0435 0.2563 91.8700 14.3165 93 0.0429 0.2525 92.0840 14.2258 94 0.0422 0.2447 92.2040 14.4495 95 0.0416 0.2506 92.1320 14.3096 96 0.0410 0.2438 92.2520 14.3126 97 0.0404 0.2395 92.3820 14.3448 98 0.0398 0.2323 92.5540 14.0785 99 0.0391 0.2347 92.6200 14.5099 100 0.0385 0.2266 92.8260 0.3594 89.0800 19.9768 101 0.0379 0.2243 92.8020 14.4917 102 0.0373 0.2215 92.8580 14.3801 103 0.0366 0.2188 93.1420 14.3192 104 0.0360 0.2117 93.2580 14.2458 105 0.0354 0.2136 93.1240 14.4634 106 0.0348 0.2083 93.3920 14.3000 107 0.0342 0.2032 93.6880 14.2220 108 0.0335 0.2057 93.4000 14.5178 109 0.0329 0.1966 93.7300 14.3700 110 0.0323 0.1943 93.7900 0.3504 89.4100 19.7055 111 0.0317 0.1989 93.6760 14.4845 112 0.0311 0.1888 94.0240 14.4260 113 0.0304 0.1871 94.0080 14.3888 114 0.0298 0.1784 94.2980 14.3442 115 0.0292 0.1747 94.3840 14.4067 116 0.0286 0.1739 94.3820 14.3101 117 0.0280 0.1669 94.6140 14.2778 118 0.0273 0.1645 94.7660 13.8397 119 0.0267 0.1618 94.7920 14.4859 120 0.0261 0.1626 94.8000 0.3018 90.5200 19.8972 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 121 0.0255 0.1571 94.8900 14.3134 122 0.0248 0.1520 95.1200 14.2926 123 0.0242 0.1460 95.3560 14.2364 124 0.0236 0.1435 95.3360 14.1327 125 0.0230 0.1433 95.5760 14.3979 126 0.0224 0.1345 95.6440 13.9373 127 0.0217 0.1337 95.7960 14.4982 128 0.0211 0.1242 96.0280 14.2673 129 0.0205 0.1256 96.0120 14.2982 130 0.0199 0.1246 95.9580 0.2855 91.4900 19.8900 131 0.0193 0.1170 96.3120 14.3932 132 0.0186 0.1091 96.5320 14.3409 133 0.0180 0.1101 96.5040 14.2132 134 0.0174 0.0988 96.7800 14.3003 135 0.0168 0.0987 96.9260 14.4243 136 0.0161 0.0912 97.0720 14.4152 137 0.0155 0.0902 97.0840 14.3415 138 0.0149 0.0884 97.1380 14.3673 139 0.0143 0.0808 97.3980 13.7313 140 0.0137 0.0773 97.5220 0.2862 92.0700 20.1131 141 0.0130 0.0671 97.8640 14.4330 142 0.0124 0.0713 97.6920 14.3874 143 0.0118 0.0620 98.0400 14.3155 144 0.0112 0.0629 98.0540 14.2814 145 0.0106 0.0531 98.3520 14.0686 146 0.0100 0.0505 98.4040 14.5090 147 0.0100 0.0516 98.3540 14.3399 148 0.0100 0.0495 98.4100 14.3497 149 0.0100 0.0530 98.2860 14.1992 150 0.0100 0.0549 98.2480 0.3217 92.1200 20.0075 151 0.0100 0.0537 98.3700 14.3438 152 0.0100 0.0548 98.2800 14.1593 153 0.0100 0.0577 98.2200 14.4983 154 0.0100 0.0602 98.1500 14.3325 155 0.0100 0.0566 98.1780 14.3411 156 0.0100 0.0625 98.0400 14.3702 157 0.0100 0.0560 98.2240 14.3039 158 0.0100 0.0575 98.2440 14.2827 159 0.0100 0.0624 98.0240 14.2817 160 0.0100 0.0619 97.9740 0.3234 91.7600 19.9518 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 161 0.0100 0.0625 98.0100 14.4700 162 0.0100 0.0641 98.0020 14.3887 163 0.0100 0.0620 98.0300 14.3870 164 0.0100 0.0641 98.0600 14.2375 165 0.0100 0.0614 98.0740 14.0525 166 0.0100 0.0666 97.8600 14.4376 167 0.0100 0.0632 98.0200 14.0398 168 0.0100 0.0679 97.8440 14.4274 169 0.0100 0.0632 97.9820 14.0875 170 0.0100 0.0616 98.0000 0.3195 91.8400 0.2058 94.4500 25.4823 171 0.0100 0.0680 97.8780 14.4504 172 0.0100 0.0631 98.0480 14.3644 173 0.0100 0.0665 97.8780 14.2738 174 0.0100 0.0638 97.9680 14.2138 175 0.0100 0.0667 97.9260 14.3629 176 0.0100 0.0648 97.9840 14.3002 177 0.0100 0.0636 97.9660 14.2608 178 0.0100 0.0668 97.9320 14.3165 179 0.0100 0.0643 97.9100 14.1161 180 0.0100 0.0656 97.9460 0.3171 91.4600 0.2010 94.6600 25.2291 181 0.0100 0.0653 97.9500 14.4761 182 0.0100 0.0651 97.8660 14.2966 183 0.0100 0.0633 98.0140 14.3197 184 0.0100 0.0669 97.8540 14.3838 185 0.0100 0.0613 98.0760 14.3077 186 0.0100 0.0668 97.8940 14.3965 187 0.0100 0.0704 97.8120 14.4146 188 0.0100 0.0678 97.9140 14.4794 189 0.0100 0.0696 97.8160 14.0039 190 0.0100 0.0683 97.8000 0.3173 91.5100 0.1975 94.9200 25.5813 191 0.0100 0.0617 97.9780 14.4886 192 0.0100 0.0650 97.9660 14.5026 193 0.0100 0.0666 97.9200 14.0592 194 0.0100 0.0643 97.9460 14.4935 195 0.0100 0.0632 98.0160 14.4683 196 0.0100 0.0686 97.8760 14.3287 197 0.0100 0.0689 97.8420 14.3516 198 0.0100 0.0625 98.0840 14.3229 199 0.0100 0.0702 97.8160 14.2132 200 0.0100 0.0680 97.8560 0.2942 92.3800 0.1948 94.9800 25.5294 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 201 0.0100 0.0632 98.0440 14.2991 202 0.0100 0.0620 98.1160 14.3780 203 0.0100 0.0660 97.9360 14.2962 204 0.0100 0.0609 98.0840 13.8839 205 0.0100 0.0615 98.1260 14.5136 206 0.0100 0.0621 98.0500 14.3488 207 0.0100 0.0641 97.9460 14.3069 208 0.0100 0.0634 98.0220 14.3447 209 0.0100 0.0663 97.8560 14.2605 210 0.0100 0.0695 97.8420 0.2985 91.9500 0.1937 95.0200 25.2419 211 0.0100 0.0674 97.8920 14.4909 212 0.0100 0.0646 98.0020 14.3508 213 0.0100 0.0630 98.0320 14.1925 214 0.0100 0.0563 98.2540 14.3503 215 0.0100 0.0659 97.9060 14.4393 216 0.0100 0.0628 97.9660 14.3256 217 0.0100 0.0638 98.0560 14.3974 218 0.0100 0.0695 97.7980 13.9259 219 0.0100 0.0647 97.9560 14.4939 220 0.0100 0.0648 97.9540 0.2937 92.2000 0.1938 95.0700 25.5389 221 0.0100 0.0619 98.0800 14.4974 222 0.0100 0.0670 97.8620 14.3273 223 0.0100 0.0652 97.8860 14.3778 224 0.0100 0.0629 97.9980 14.2583 225 0.0100 0.0657 97.9880 14.4592 226 0.0100 0.0651 97.9240 14.2907 227 0.0100 0.0631 98.0220 14.4014 228 0.0100 0.0636 98.0840 14.4086 229 0.0100 0.0629 98.0200 14.3973 230 0.0100 0.0709 97.8500 0.3057 91.7100 0.1935 95.0800 25.2953 231 0.0100 0.0634 98.0060 14.5323 232 0.0100 0.0610 98.0640 14.4621 233 0.0100 0.0637 98.0100 14.3828 234 0.0100 0.0622 98.0800 14.3540 235 0.0100 0.0621 98.0660 14.4022 236 0.0100 0.0619 98.0460 14.4375 237 0.0100 0.0666 98.0120 14.3963 238 0.0100 0.0645 97.9660 14.1732 239 0.0100 0.0634 98.0420 14.4495 240 0.0100 0.0670 97.8140 0.3286 91.8800 0.1930 95.1300 25.3285 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 241 0.0100 0.0645 97.9500 14.4827 242 0.0100 0.0645 97.9980 14.4711 243 0.0100 0.0625 98.0480 14.3314 244 0.0100 0.0617 98.1020 14.3782 245 0.0100 0.0654 97.9540 14.4524 246 0.0100 0.0670 98.0040 14.3209 247 0.0100 0.0654 97.9460 14.1624 248 0.0100 0.0628 98.0860 14.2217 249 0.0100 0.0597 98.1420 14.5172 250 0.0100 0.0661 97.9060 0.2940 92.1400 0.1922 95.1500 25.5194 251 0.0100 0.0590 98.1600 14.4657 252 0.0100 0.0616 98.0980 14.3326 253 0.0100 0.0582 98.2140 14.0538 254 0.0100 0.0651 97.9680 14.5061 255 0.0100 0.0626 98.0260 14.4119 256 0.0100 0.0646 97.9920 14.0947 257 0.0100 0.0656 97.8660 14.4533 258 0.0100 0.0660 97.9320 14.3097 259 0.0100 0.0597 98.1280 14.3727 260 0.0100 0.0633 98.0000 0.3144 91.6700 0.1912 95.2300 25.4697 261 0.0100 0.0654 97.8820 14.4717 262 0.0100 0.0634 97.9820 14.3682 263 0.0100 0.0673 97.8760 14.3535 264 0.0100 0.0618 98.0560 14.4513 265 0.0100 0.0643 97.8840 14.3997 266 0.0100 0.0633 97.9580 14.1071 267 0.0100 0.0610 98.0800 14.4759 268 0.0100 0.0590 98.1540 14.4901 269 0.0100 0.0616 98.0600 14.3293 270 0.0100 0.0639 97.9060 0.3077 91.9200 0.1915 95.1600 25.3886 271 0.0100 0.0650 97.9240 14.4995 272 0.0100 0.0669 97.8500 14.4921 273 0.0100 0.0604 98.1820 14.3146 274 0.0100 0.0623 97.9800 14.4247 275 0.0100 0.0663 97.8860 14.4394 276 0.0100 0.0611 98.0720 14.3758 277 0.0100 0.0610 98.0840 14.3832 278 0.0100 0.0593 98.1400 14.3399 279 0.0100 0.0597 98.1720 14.4053 280 0.0100 0.0624 98.0760 0.3069 92.1600 0.1924 95.2000 25.4312 ---- -------- --------- -------- --------- -------- ------------- ------------ -------- ep lr tr_loss tr_acc te_loss te_acc swa_te_loss swa_te_acc time ---- -------- --------- -------- --------- -------- ------------- ------------ -------- 281 0.0100 0.0593 98.1780 14.5181 282 0.0100 0.0590 98.1580 14.1531 283 0.0100 0.0626 98.0440 14.4975 284 0.0100 0.0618 98.0220 14.3994 285 0.0100 0.0598 98.1020 14.3803 286 0.0100 0.0628 98.0620 14.3927 287 0.0100 0.0577 98.1660 13.8897 288 0.0100 0.0630 97.9620 14.4612 289 0.0100 0.0654 97.9580 14.4597 290 0.0100 0.0601 98.1600 0.3346 91.2200 0.1927 95.2200 25.4667 291 0.0100 0.0607 98.0880 14.4995 292 0.0100 0.0620 98.1200 14.4091 293 0.0100 0.0622 98.0380 14.3256 294 0.0100 0.0630 98.0100 14.4410 295 0.0100 0.0646 97.9780 14.3591 296 0.0100 0.0609 98.1480 14.1548 297 0.0100 0.0621 98.0540 14.5074 298 0.0100 0.0607 98.1080 14.4119 299 0.0100 0.0597 98.1720 14.4039 300 0.0100 0.0596 98.1160 0.2946 91.8800 0.1928 95.1900 25.6267