[21/07/23 11:50:46] [conf.py: 208]: PyTorch Version: torch=1.8.0, cuda=11.1, cudnn=8005 [21/07/23 11:50:46] [conf.py: 210]: BN: EPS: 1e-05 MOM: 0.1 CKPT_DIR: ./ckpt CORRUPTION: DATASET: cifar10 NUM_EX: 10000 SEVERITY: [5, 4, 3, 2, 1] TYPE: ['gaussian_noise', 'shot_noise', 'impulse_noise', 'defocus_blur', 'glass_blur', 'motion_blur', 'zoom_blur', 'snow', 'frost', 'fog', 'brightness', 'contrast', 'elastic_transform', 'pixelate', 'jpeg_compression'] CUDNN: BENCHMARK: True DATA_DIR: ./data DESC: LOG_DEST: tent_210723_115046.txt LOG_TIME: 210723_115046 MODEL: ADAPTATION: tent ARCH: Standard EPISODIC: False OPTIM: BETA: 0.9 DAMPENING: 0.0 LR: 0.001 METHOD: Adam MOMENTUM: 0.9 NESTEROV: True STEPS: 1 WD: 0.0 RNG_SEED: 1 SAVE_DIR: ./output TEST: BATCH_SIZE: 200 [21/07/23 11:50:48] [cifar10c.py: 40]: test-time adaptation: TENT [21/07/23 11:50:48] [cifar10c.py: 95]: model for adaptation: ResNetCifar( (conv1): Conv2d(3, 16, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (layer1): Sequential( (0): BasicBlock( (bn1): BatchNorm2d(16, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu1): ReLU(inplace=True) (conv1): Conv2d(16, 16, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm2d(16, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu2): ReLU(inplace=True) (conv2): Conv2d(16, 16, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) ) (1): BasicBlock( (bn1): BatchNorm2d(16, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu1): ReLU(inplace=True) (conv1): Conv2d(16, 16, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm2d(16, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu2): ReLU(inplace=True) (conv2): Conv2d(16, 16, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) ) (2): BasicBlock( (bn1): BatchNorm2d(16, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu1): ReLU(inplace=True) (conv1): Conv2d(16, 16, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm2d(16, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu2): ReLU(inplace=True) (conv2): Conv2d(16, 16, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) ) (3): BasicBlock( (bn1): BatchNorm2d(16, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu1): ReLU(inplace=True) (conv1): Conv2d(16, 16, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm2d(16, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu2): ReLU(inplace=True) (conv2): Conv2d(16, 16, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) ) ) (layer2): Sequential( (0): BasicBlock( (downsample): Downsample( (avg): AvgPool2d(kernel_size=2, stride=2, padding=0) ) (bn1): BatchNorm2d(16, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu1): ReLU(inplace=True) (conv1): Conv2d(16, 32, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False) (bn2): BatchNorm2d(32, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu2): ReLU(inplace=True) (conv2): Conv2d(32, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) ) (1): BasicBlock( (bn1): BatchNorm2d(32, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu1): ReLU(inplace=True) (conv1): Conv2d(32, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm2d(32, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu2): ReLU(inplace=True) (conv2): Conv2d(32, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) ) (2): BasicBlock( (bn1): BatchNorm2d(32, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu1): ReLU(inplace=True) (conv1): Conv2d(32, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm2d(32, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu2): ReLU(inplace=True) (conv2): Conv2d(32, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) ) (3): BasicBlock( (bn1): BatchNorm2d(32, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu1): ReLU(inplace=True) (conv1): Conv2d(32, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm2d(32, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu2): ReLU(inplace=True) (conv2): Conv2d(32, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) ) ) (layer3): Sequential( (0): BasicBlock( (downsample): Downsample( (avg): AvgPool2d(kernel_size=2, stride=2, padding=0) ) (bn1): BatchNorm2d(32, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu1): ReLU(inplace=True) (conv1): Conv2d(32, 64, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False) (bn2): BatchNorm2d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu2): ReLU(inplace=True) (conv2): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) ) (1): BasicBlock( (bn1): BatchNorm2d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu1): ReLU(inplace=True) (conv1): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm2d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu2): ReLU(inplace=True) (conv2): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) ) (2): BasicBlock( (bn1): BatchNorm2d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu1): ReLU(inplace=True) (conv1): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm2d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu2): ReLU(inplace=True) (conv2): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) ) (3): BasicBlock( (bn1): BatchNorm2d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu1): ReLU(inplace=True) (conv1): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm2d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu2): ReLU(inplace=True) (conv2): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) ) ) (bn): BatchNorm2d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=False) (relu): ReLU(inplace=True) (avgpool): AvgPool2d(kernel_size=8, stride=8, padding=0) (fc): Linear(in_features=64, out_features=10, bias=True) ) [21/07/23 11:50:48] [cifar10c.py: 96]: params for adaptation: ['layer1.0.bn1.weight', 'layer1.0.bn1.bias', 'layer1.0.bn2.weight', 'layer1.0.bn2.bias', 'layer1.1.bn1.weight', 'layer1.1.bn1.bias', 'layer1.1.bn2.weight', 'layer1.1.bn2.bias', 'layer1.2.bn1.weight', 'layer1.2.bn1.bias', 'layer1.2.bn2.weight', 'layer1.2.bn2.bias', 'layer1.3.bn1.weight', 'layer1.3.bn1.bias', 'layer1.3.bn2.weight', 'layer1.3.bn2.bias', 'layer2.0.bn1.weight', 'layer2.0.bn1.bias', 'layer2.0.bn2.weight', 'layer2.0.bn2.bias', 'layer2.1.bn1.weight', 'layer2.1.bn1.bias', 'layer2.1.bn2.weight', 'layer2.1.bn2.bias', 'layer2.2.bn1.weight', 'layer2.2.bn1.bias', 'layer2.2.bn2.weight', 'layer2.2.bn2.bias', 'layer2.3.bn1.weight', 'layer2.3.bn1.bias', 'layer2.3.bn2.weight', 'layer2.3.bn2.bias', 'layer3.0.bn1.weight', 'layer3.0.bn1.bias', 'layer3.0.bn2.weight', 'layer3.0.bn2.bias', 'layer3.1.bn1.weight', 'layer3.1.bn1.bias', 'layer3.1.bn2.weight', 'layer3.1.bn2.bias', 'layer3.2.bn1.weight', 'layer3.2.bn1.bias', 'layer3.2.bn2.weight', 'layer3.2.bn2.bias', 'layer3.3.bn1.weight', 'layer3.3.bn1.bias', 'layer3.3.bn2.weight', 'layer3.3.bn2.bias', 'bn.weight', 'bn.bias'] [21/07/23 11:50:48] [cifar10c.py: 97]: optimizer for adaptation: Adam ( Parameter Group 0 amsgrad: False betas: (0.9, 0.999) eps: 1e-08 lr: 0.001 weight_decay: 0.0 ) [21/07/23 11:50:48] [cifar10c.py: 49]: resetting model [21/07/23 11:50:50] [cifar10c.py: 58]: error % [gaussian_noise5]: 53.56% [21/07/23 11:50:50] [cifar10c.py: 49]: resetting model [21/07/23 11:50:53] [cifar10c.py: 58]: error % [shot_noise5]: 52.76% [21/07/23 11:50:53] [cifar10c.py: 49]: resetting model [21/07/23 11:50:55] [cifar10c.py: 58]: error % [impulse_noise5]: 57.43% [21/07/23 11:50:55] [cifar10c.py: 49]: resetting model [21/07/23 11:50:58] [cifar10c.py: 58]: error % [defocus_blur5]: 26.57% [21/07/23 11:50:58] [cifar10c.py: 49]: resetting model [21/07/23 11:51:00] [cifar10c.py: 58]: error % [glass_blur5]: 55.38% [21/07/23 11:51:00] [cifar10c.py: 49]: resetting model [21/07/23 11:51:02] [cifar10c.py: 58]: error % [motion_blur5]: 29.81% [21/07/23 11:51:02] [cifar10c.py: 49]: resetting model [21/07/23 11:51:05] [cifar10c.py: 58]: error % [zoom_blur5]: 29.17% [21/07/23 11:51:05] [cifar10c.py: 49]: resetting model [21/07/23 11:51:07] [cifar10c.py: 58]: error % [snow5]: 35.22% [21/07/23 11:51:07] [cifar10c.py: 49]: resetting model [21/07/23 11:51:10] [cifar10c.py: 58]: error % [frost5]: 37.78% [21/07/23 11:51:10] [cifar10c.py: 49]: resetting model [21/07/23 11:51:12] [cifar10c.py: 58]: error % [fog5]: 29.30% [21/07/23 11:51:12] [cifar10c.py: 49]: resetting model [21/07/23 11:51:14] [cifar10c.py: 58]: error % [brightness5]: 19.02% [21/07/23 11:51:14] [cifar10c.py: 49]: resetting model [21/07/23 11:51:17] [cifar10c.py: 58]: error % [contrast5]: 34.22% [21/07/23 11:51:17] [cifar10c.py: 49]: resetting model [21/07/23 11:51:19] [cifar10c.py: 58]: error % [elastic_transform5]: 41.40% [21/07/23 11:51:19] [cifar10c.py: 49]: resetting model [21/07/23 11:51:22] [cifar10c.py: 58]: error % [pixelate5]: 41.11% [21/07/23 11:51:22] [cifar10c.py: 49]: resetting model [21/07/23 11:51:24] [cifar10c.py: 58]: error % [jpeg_compression5]: 50.05% [21/07/23 11:51:24] [cifar10c.py: 49]: resetting model [21/07/23 11:51:26] [cifar10c.py: 58]: error % [gaussian_noise4]: 51.31% [21/07/23 11:51:26] [cifar10c.py: 49]: resetting model [21/07/23 11:51:29] [cifar10c.py: 58]: error % [shot_noise4]: 44.76% [21/07/23 11:51:29] [cifar10c.py: 49]: resetting model [21/07/23 11:51:31] [cifar10c.py: 58]: error % [impulse_noise4]: 50.54% [21/07/23 11:51:31] [cifar10c.py: 49]: resetting model [21/07/23 11:51:34] [cifar10c.py: 58]: error % [defocus_blur4]: 20.33% [21/07/23 11:51:34] [cifar10c.py: 49]: resetting model [21/07/23 11:51:36] [cifar10c.py: 58]: error % [glass_blur4]: 55.64% [21/07/23 11:51:36] [cifar10c.py: 49]: resetting model [21/07/23 11:51:38] [cifar10c.py: 58]: error % [motion_blur4]: 24.98% [21/07/23 11:51:38] [cifar10c.py: 49]: resetting model [21/07/23 11:51:41] [cifar10c.py: 58]: error % [zoom_blur4]: 24.31% [21/07/23 11:51:41] [cifar10c.py: 49]: resetting model [21/07/23 11:51:43] [cifar10c.py: 58]: error % [snow4]: 33.22% [21/07/23 11:51:43] [cifar10c.py: 49]: resetting model [21/07/23 11:51:46] [cifar10c.py: 58]: error % [frost4]: 33.79% [21/07/23 11:51:46] [cifar10c.py: 49]: resetting model [21/07/23 11:51:48] [cifar10c.py: 58]: error % [fog4]: 20.24% [21/07/23 11:51:48] [cifar10c.py: 49]: resetting model [21/07/23 11:51:50] [cifar10c.py: 58]: error % [brightness4]: 16.95% [21/07/23 11:51:50] [cifar10c.py: 49]: resetting model [21/07/23 11:51:53] [cifar10c.py: 58]: error % [contrast4]: 23.50% [21/07/23 11:51:53] [cifar10c.py: 49]: resetting model [21/07/23 11:51:55] [cifar10c.py: 58]: error % [elastic_transform4]: 31.59% [21/07/23 11:51:55] [cifar10c.py: 49]: resetting model [21/07/23 11:51:58] [cifar10c.py: 58]: error % [pixelate4]: 32.18% [21/07/23 11:51:58] [cifar10c.py: 49]: resetting model [21/07/23 11:52:00] [cifar10c.py: 58]: error % [jpeg_compression4]: 44.41% [21/07/23 11:52:00] [cifar10c.py: 49]: resetting model [21/07/23 11:52:02] [cifar10c.py: 58]: error % [gaussian_noise3]: 45.38% [21/07/23 11:52:02] [cifar10c.py: 49]: resetting model [21/07/23 11:52:05] [cifar10c.py: 58]: error % [shot_noise3]: 41.33% [21/07/23 11:52:05] [cifar10c.py: 49]: resetting model [21/07/23 11:52:07] [cifar10c.py: 58]: error % [impulse_noise3]: 40.13% [21/07/23 11:52:07] [cifar10c.py: 49]: resetting model [21/07/23 11:52:10] [cifar10c.py: 58]: error % [defocus_blur3]: 16.63% [21/07/23 11:52:10] [cifar10c.py: 49]: resetting model [21/07/23 11:52:12] [cifar10c.py: 58]: error % [glass_blur3]: 46.49% [21/07/23 11:52:12] [cifar10c.py: 49]: resetting model [21/07/23 11:52:15] [cifar10c.py: 58]: error % [motion_blur3]: 26.76% [21/07/23 11:52:15] [cifar10c.py: 49]: resetting model [21/07/23 11:52:17] [cifar10c.py: 58]: error % [zoom_blur3]: 21.67% [21/07/23 11:52:17] [cifar10c.py: 49]: resetting model [21/07/23 11:52:19] [cifar10c.py: 58]: error % [snow3]: 30.61% [21/07/23 11:52:19] [cifar10c.py: 49]: resetting model [21/07/23 11:52:22] [cifar10c.py: 58]: error % [frost3]: 32.05% [21/07/23 11:52:22] [cifar10c.py: 49]: resetting model [21/07/23 11:52:24] [cifar10c.py: 58]: error % [fog3]: 18.53% [21/07/23 11:52:24] [cifar10c.py: 49]: resetting model [21/07/23 11:52:27] [cifar10c.py: 58]: error % [brightness3]: 16.21% [21/07/23 11:52:27] [cifar10c.py: 49]: resetting model [21/07/23 11:52:29] [cifar10c.py: 58]: error % [contrast3]: 20.56% [21/07/23 11:52:29] [cifar10c.py: 49]: resetting model [21/07/23 11:52:31] [cifar10c.py: 58]: error % [elastic_transform3]: 23.17% [21/07/23 11:52:31] [cifar10c.py: 49]: resetting model [21/07/23 11:52:34] [cifar10c.py: 58]: error % [pixelate3]: 25.11% [21/07/23 11:52:34] [cifar10c.py: 49]: resetting model [21/07/23 11:52:36] [cifar10c.py: 58]: error % [jpeg_compression3]: 42.17% [21/07/23 11:52:36] [cifar10c.py: 49]: resetting model [21/07/23 11:52:39] [cifar10c.py: 58]: error % [gaussian_noise2]: 38.33% [21/07/23 11:52:39] [cifar10c.py: 49]: resetting model [21/07/23 11:52:41] [cifar10c.py: 58]: error % [shot_noise2]: 31.23% [21/07/23 11:52:41] [cifar10c.py: 49]: resetting model [21/07/23 11:52:44] [cifar10c.py: 58]: error % [impulse_noise2]: 33.24% [21/07/23 11:52:44] [cifar10c.py: 49]: resetting model [21/07/23 11:52:46] [cifar10c.py: 58]: error % [defocus_blur2]: 15.68% [21/07/23 11:52:46] [cifar10c.py: 49]: resetting model [21/07/23 11:52:48] [cifar10c.py: 58]: error % [glass_blur2]: 47.21% [21/07/23 11:52:48] [cifar10c.py: 49]: resetting model [21/07/23 11:52:51] [cifar10c.py: 58]: error % [motion_blur2]: 21.75% [21/07/23 11:52:51] [cifar10c.py: 49]: resetting model [21/07/23 11:52:53] [cifar10c.py: 58]: error % [zoom_blur2]: 19.96% [21/07/23 11:52:53] [cifar10c.py: 49]: resetting model [21/07/23 11:52:56] [cifar10c.py: 58]: error % [snow2]: 32.61% [21/07/23 11:52:56] [cifar10c.py: 49]: resetting model [21/07/23 11:52:58] [cifar10c.py: 58]: error % [frost2]: 26.61% [21/07/23 11:52:58] [cifar10c.py: 49]: resetting model [21/07/23 11:53:01] [cifar10c.py: 58]: error % [fog2]: 16.85% [21/07/23 11:53:01] [cifar10c.py: 49]: resetting model [21/07/23 11:53:03] [cifar10c.py: 58]: error % [brightness2]: 15.78% [21/07/23 11:53:03] [cifar10c.py: 49]: resetting model [21/07/23 11:53:05] [cifar10c.py: 58]: error % [contrast2]: 19.32% [21/07/23 11:53:05] [cifar10c.py: 49]: resetting model [21/07/23 11:53:08] [cifar10c.py: 58]: error % [elastic_transform2]: 22.18% [21/07/23 11:53:08] [cifar10c.py: 49]: resetting model [21/07/23 11:53:10] [cifar10c.py: 58]: error % [pixelate2]: 23.13% [21/07/23 11:53:10] [cifar10c.py: 49]: resetting model [21/07/23 11:53:13] [cifar10c.py: 58]: error % [jpeg_compression2]: 38.27% [21/07/23 11:53:13] [cifar10c.py: 49]: resetting model [21/07/23 11:53:15] [cifar10c.py: 58]: error % [gaussian_noise1]: 27.84% [21/07/23 11:53:15] [cifar10c.py: 49]: resetting model [21/07/23 11:53:18] [cifar10c.py: 58]: error % [shot_noise1]: 24.31% [21/07/23 11:53:18] [cifar10c.py: 49]: resetting model [21/07/23 11:53:20] [cifar10c.py: 58]: error % [impulse_noise1]: 24.57% [21/07/23 11:53:20] [cifar10c.py: 49]: resetting model [21/07/23 11:53:22] [cifar10c.py: 58]: error % [defocus_blur1]: 15.63% [21/07/23 11:53:22] [cifar10c.py: 49]: resetting model [21/07/23 11:53:25] [cifar10c.py: 58]: error % [glass_blur1]: 46.73% [21/07/23 11:53:25] [cifar10c.py: 49]: resetting model [21/07/23 11:53:27] [cifar10c.py: 58]: error % [motion_blur1]: 19.21% [21/07/23 11:53:27] [cifar10c.py: 49]: resetting model [21/07/23 11:53:30] [cifar10c.py: 58]: error % [zoom_blur1]: 18.63% [21/07/23 11:53:30] [cifar10c.py: 49]: resetting model [21/07/23 11:53:32] [cifar10c.py: 58]: error % [snow1]: 23.31% [21/07/23 11:53:32] [cifar10c.py: 49]: resetting model [21/07/23 11:53:35] [cifar10c.py: 58]: error % [frost1]: 21.14% [21/07/23 11:53:35] [cifar10c.py: 49]: resetting model [21/07/23 11:53:37] [cifar10c.py: 58]: error % [fog1]: 16.69% [21/07/23 11:53:37] [cifar10c.py: 49]: resetting model [21/07/23 11:53:40] [cifar10c.py: 58]: error % [brightness1]: 15.61% [21/07/23 11:53:40] [cifar10c.py: 49]: resetting model [21/07/23 11:53:42] [cifar10c.py: 58]: error % [contrast1]: 17.21% [21/07/23 11:53:42] [cifar10c.py: 49]: resetting model [21/07/23 11:53:44] [cifar10c.py: 58]: error % [elastic_transform1]: 22.23% [21/07/23 11:53:44] [cifar10c.py: 49]: resetting model [21/07/23 11:53:47] [cifar10c.py: 58]: error % [pixelate1]: 20.09% [21/07/23 11:53:47] [cifar10c.py: 49]: resetting model [21/07/23 11:53:49] [cifar10c.py: 58]: error % [jpeg_compression1]: 30.87%