Skip to content

This repo includes the experiment codes and experiment results for the Skip Attention Module (SAM). The SAM is a parameter-free attention module using in fMRI decoding to increase the decoding performance, which can be able to stack on any architecture of convolutional neural network without any parameters that need to train, and does not increa…

Notifications You must be signed in to change notification settings

huawei-lin/fMRI_parameter-free_attention

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

41 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Parameter-free Attention in fMRI Decoding

Paper, Poster, Patent

Introduction

This repository includes the experiment codes and experiment results for the Skip Attention Module (SAM). The SAM is a parameter-free attention module using in fMRI decoding to increase the decoding performance, which can be able to stack on any architecture of convolutional neural network without any parameters that need to train, and does not increase any burden of training.

It is authored by Yong Qi, Huawei Lin, Yanping Li, and Jiashu Chen. Currently, it is being maintained by Huawei Lin and Yanping Li.

@article{qi2021parameter,
  title={Parameter-Free Attention in fMRI Decoding},
  author={Qi, Yong and Lin, Huawei and Li, Yanping and Chen, Jiashu},
  journal={IEEE Access},
  volume={9},
  pages={48704--48712},
  year={2021},
  publisher={IEEE}
}

Experiment Processing

Label

label_ID = {
    'EMOTION': 0, 
    'GAMBLING': 1, 
    'LANGUAGE': 2, 
    'MOTOR': 3,
    'RELATIONAL': 4, 
    'SOCIAL': 5, 
    'Working Memory': 6
}

Accuracy of Each Experiment

Overview

network aver acc
PlainNet 87.90%
PlainNet-SAM 88.69%
network aver acc
3DResNet 83.35%
3DResNet-SAM 86.41%
network aver acc
Inception 85.08%
Inception-SAM 86.07%

1. PlainNet

PlainNet

Network-ID BS LR Aver ACC 0 ACC 1 ACC 2 ACC 3 ACC 4 ACC 5 ACC 6 ACC
PlainNet-1 16 0.0001 91.33% 83.10% 92.86% 91.55% 98.61% 88.73% 100.00% 84.06%
PlainNet-2 16 0.0001 86.09% 78.87% 95.71% 76.06% 97.22% 87.32% 97.22% 69.57%
PlainNet-3 16 0.0001 86.69% 77.46% 100.00% 84.51% 94.44% 84.51% 100.00% 65.22%
PlainNet-4 16 0.0001 91.33% 84.51% 94.29% 97.18% 97.22% 78.87% 100.00% 86.96%
PlainNet-5 16 0.0001 88.71% 88.73% 87.14% 98.59% 97.22% 81.69% 91.67% 75.36%
PlainNet-6 16 0.0001 85.28% 95.77% 72.86% 97.18% 94.44% 81.69% 77.78% 76.81%
PlainNet-7 16 0.0001 88.51% 80.28% 90.00% 84.51% 98.61% 80.28% 100.00% 85.51%
PlainNet-8 16 0.0001 66.94% 66.20% 32.86% 100.00% 91.67% 38.03% 80.56% 57.97%
PlainNet-9 16 0.0001 81.25% 100.00% 57.14% 95.77% 98.61% 54.93% 88.89% 72.46%
PlainNet-10 16 0.0001 91.94% 98.59% 91.43% 92.96% 97.22% 83.10% 97.22% 82.61%

PlainNet-SAM

Network-ID BS LR Aver ACC 0 ACC 1 ACC 2 ACC 3 ACC 4 ACC 5 ACC 6 ACC
PlainNet-SAM-1 16 0.0001 87.70% 76.06% 97.14% 94.37% 97.22% 74.65% 100.00% 73.91%
PlainNet-SAM-2 16 0.0001 87.10% 91.55% 88.57% 98.59% 97.22% 54.93% 97.22% 81.16%
PlainNet-SAM-3 16 0.0001 90.93% 91.55% 94.29% 88.73% 100.00% 88.73% 100.00% 72.46%
PlainNet-SAM-4 16 0.0001 84.88% 73.24% 98.57% 87.32% 94.44% 77.46% 97.22% 65.22%
PlainNet-SAM-5 16 0.0001 87.90% 84.51% 84.29% 100.00% 93.06% 74.65% 91.67% 86.96%
PlainNet-SAM-6 16 0.0001 87.50% 85.92% 95.71% 85.92% 93.06% 87.32% 98.61% 65.22%
PlainNet-SAM-7 16 0.0001 89.31% 83.10% 97.14% 87.32% 100.00% 80.28% 100.00% 76.81%
PlainNet-SAM-8 16 0.0001 90.12% 95.77% 97.14% 91.55% 94.44% 88.73% 97.22% 65.22%
PlainNet-SAM-9 16 0.0001 90.73% 95.77% 90.00% 98.59% 97.22% 85.92% 97.22% 69.57%
PlainNet-SAM-10 16 0.0001 90.73% 98.59% 88.57% 91.55% 93.06% 80.28% 97.22% 85.51%

2. ResNet

ResNet

Network-ID BS LR Aver ACC 0 ACC 1 ACC 2 ACC 3 ACC 4 ACC 5 ACC 6 ACC
ResNet-1 16 0.0001 83.06% 73.24% 75.71% 97.18% 83.33% 85.92% 87.50% 78.26%
ResNet-2 16 0.0001 84.27% 78.87% 87.14% 84.51% 94.44% 91.55% 100.0% 52.17%
ResNet-3 16 0.0001 77.02% 46.48% 85.714% 61.97% 98.61% 92.958% 98.61% 53.62%
ResNet-4 16 0.0001 78.63% 83.10% 84.286% 98.59% 97.22% 57.75% 90.28% 37.68%
ResNet-5 16 0.0001 83.87% 63.39% 94.29% 88.73% 94.44% 60.56% 97.22% 88.41%
ResNet-6 16 0.0001 81.45% 70.42% 98.57% 64.79% 95.83% 88.73% 98.61% 52.17%
ResNet-7 16 0.0001 86.90% 88.73% 81.43% 98.59% 97.22% 70.42% 94.44% 76.81%
ResNet-8 16 0.0001 81.65% 85.92% 90.00% 84.51% 87.50% 92.96% 98.61% 30.43%
ResNet-9 16 0.0001 89.31% 85.92% 92.86% 95.77% 95.83% 78.87% 97.22% 78.26%
ResNet-10 16 0.0001 87.30% 85.92% 95.71% 94.37% 94.44% 87.32% 100.0% 52.17%

ResNet-SAM

Network-ID BS LR Aver ACC 0 ACC 1 ACC 2 ACC 3 ACC 4 ACC 5 ACC 6 ACC
ResNet-SAM-1 16 0.0001 90.73% 94.37% 90.00% 97.18% 98.61% 76.06% 97.22% 81.16%
ResNet-SAM-2 16 0.0001 85.08% 80.28% 94.29% 80.28% 100.0% 70.42% 100.0% 69.57%
ResNet-SAM-3 16 0.0001 83.67% 85.92% 85.71% 88.73% 100.0% 59.15% 95.83% 69.56%
ResNet-SAM-4 16 0.0001 88.10% 98.59% 94.29% 91.55% 98.61% 85.91% 97.22% 49.28%
ResNet-SAM-5 16 0.0001 88.10% 84.51% 87.14% 88.73% 100.0% 94.37% 100.0% 60.87%
ResNet-SAM-6 16 0.0001 84.88% 87.32% 81.43% 76.06% 90.28% 97.18% 88.89% 72.47%
ResNet-SAM-7 16 0.0001 87.90% 90.14% 92.86% 98.59% 98.61% 71.83% 95.83% 66.67%
ResNet-SAM-8 16 0.0001 87.90% 80.28% 95.71% 84.51% 95.83% 83.10% 97.22% 78.26%
ResNet-SAM-9 16 0.0001 86.69% 84.51% 85.71% 91.55% 98.61% 70.42% 95.83% 79.71%
ResNet-SAM-10 16 0.0001 81.048% 73.24% 78.57% 95.77% 98.61% 50.70% 95.83% 73.91%

3. InceptionNet

InceptionNet

Network-ID BS LR Aver ACC 0 ACC 1 ACC 2 ACC 3 ACC 4 ACC 5 ACC 6 ACC
Inception-1 16 0.0001 84.48% 67.61% 84.29% 91.55% 97.22% 78.87% 97.22% 73.91%
Inception-2 16 0.0001 87.90% 83.10% 88.57% 95.77% 95.83% 90.14% 91.67% 69.57%
Inception-3 16 0.0001 86.90% 87.32% 92.86% 88.73% 100.00% 85.92% 90.28% 62.32%
Inception-4 16 0.0001 87.30% 80.28% 94.29% 91.55% 97.22% 77.46% 97.22% 72.46%
Inception-5 16 0.0001 80.65% 61.97% 100.00% 84.51% 94.44% 73.24% 91.67% 57.97%
Inception-6 16 0.0001 83.27% 83.10% 88.57% 80.28% 98.61% 85.92% 91.67% 53.62%
Inception-7 16 0.0001 86.49% 92.96% 85.71% 85.92% 100.00% 69.01% 97.22% 73.91%
Inception-8 16 0.0001 83.47% 81.69% 95.71% 83.10% 100.00% 78.87% 95.83% 47.83%
Inception-9 16 0.0001 86.90% 84.51% 100.00% 91.55% 95.83% 76.06% 94.44% 65.22%
Inception-10 16 0.0001 83.47% 87.32% 97.14% 74.65% 98.61% 78.87% 91.67% 55.07%

InceptionNet-SAM

Network-ID BS LR Aver ACC 0 ACC 1 ACC 2 ACC 3 ACC 4 ACC 5 ACC 6 ACC
Inception-SAM-1 16 0.0001 88.51% 85.92% 97.14% 90.14% 100.00% 71.83% 95.83% 78.26%
Inception-SAM-2 16 0.0001 80.04% 70.42% 91.43% 64.79% 97.22% 91.55% 98.61% 44.93%
Inception-SAM-3 16 0.0001 86.09% 88.73% 92.86% 87.32% 95.83% 61.97% 95.83% 79.71%
Inception-SAM-4 16 0.0001 87.70% 83.10% 94.29% 90.14% 95.83% 84.51% 93.06% 72.46%
Inception-SAM-5 16 0.0001 85.28% 80.28% 78.57% 94.37% 95.83% 78.87% 93.06% 75.36%
Inception-SAM-6 16 0.0001 88.91% 90.14% 85.71% 88.73% 95.83% 85.92% 93.06% 82.61%
Inception-SAM-7 16 0.0001 86.90% 81.69% 80.00% 94.37% 98.61% 76.06% 97.22% 79.71%
Inception-SAM-8 16 0.0001 87.50% 84.51% 90.00% 94.37% 94.44% 87.32% 100.00% 60.87%
Inception-SAM-9 16 0.0001 85.89% 77.46% 90.00% 92.96% 95.83% 76.06% 97.22% 71.01%
Inception-SAM-10 16 0.0001 85.89% 83.10% 94.29% 94.37% 98.61% 69.01% 88.89% 72.46%

Confusion Matrix

Actual ⬇️, Prediction ➡️

1. PlainNet

PlainNet-0

- 0 1 2 3 4 5 6
0 83.10% 0.00% 1.41% 1.41% 2.82% 5.63% 5.63%
1 0.00% 92.86% 0.00% 0.00% 1.43% 1.43% 4.29%
2 1.41% 0.00% 91.55% 4.23% 0.00% 0.00% 2.82%
3 0.00% 0.00% 0.00% 98.61% 0.00% 0.00% 1.39%
4 0.00% 0.00% 0.00% 0.00% 88.73% 5.63% 5.63%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 4.35% 2.90% 0.00% 0.00% 8.70% 0.00% 84.06%

PlainNet-1

Actual\Predict 0 1 2 3 4 5 6
0 78.87% 1.41% 0.00% 1.41% 5.63% 8.45% 4.23%
1 0.00% 95.71% 0.00% 0.00% 1.43% 1.43% 1.43%
2 2.82% 0.00% 76.06% 2.82% 2.82% 0.00% 15.49%
3 2.78% 0.00% 0.00% 97.22% 0.00% 0.00% 0.00%
4 1.41% 2.82% 0.00% 0.00% 87.32% 4.23% 4.23%
5 0.00% 2.78% 0.00% 0.00% 0.00% 97.22% 0.00%
6 4.35% 2.90% 1.45% 0.00% 21.74% 0.00% 69.57%

PlainNet-2

- 0 1 2 3 4 5 6
0 77.46% 2.82% 0.00% 0.00% 8.45% 8.45% 2.82%
1 0.00% 100.00% 0.00% 0.00% 0.00% 0.00% 0.00%
2 2.82% 1.41% 84.51% 1.41% 1.41% 0.00% 8.45%
3 1.39% 1.39% 0.00% 94.44% 1.39% 1.39% 0.00%
4 0.00% 8.45% 0.00% 0.00% 84.51% 4.23% 2.82%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 2.90% 10.14% 0.00% 0.00% 21.74% 0.00% 65.22%

PlainNet-3

- 0 1 2 3 4 5 6
0 84.51% 0.00% 2.82% 1.41% 0.00% 0.00% 11.27%
1 0.00% 94.29% 0.00% 0.00% 1.43% 0.00% 4.29%
2 0.00% 0.00% 97.18% 1.41% 0.00% 0.00% 1.41%
3 0.00% 0.00% 2.78% 97.22% 0.00% 0.00% 0.00%
4 0.00% 0.00% 0.00% 0.00% 78.87% 4.23% 16.90%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 4.35% 0.00% 2.90% 1.45% 4.35% 0.00% 86.96%

PlainNet-4

- 0 1 2 3 4 5 6
0 88.73% 0.00% 2.82% 1.41% 0.00% 0.00% 7.04%
1 0.00% 87.14% 1.43% 0.00% 4.29% 0.00% 7.14%
2 0.00% 0.00% 98.59% 1.41% 0.00% 0.00% 0.00%
3 0.00% 0.00% 2.78% 97.22% 0.00% 0.00% 0.00%
4 1.41% 0.00% 1.41% 0.00% 81.69% 0.00% 15.49%
5 4.17% 2.78% 0.00% 0.00% 1.39% 91.67% 0.00%
6 4.35% 1.45% 10.14% 2.90% 5.80% 0.00% 75.36%

PlainNet-5

- 0 1 2 3 4 5 6
0 95.77% 0.00% 2.82% 0.00% 0.00% 0.00% 1.41%
1 5.71% 72.86% 0.00% 0.00% 2.86% 0.00% 18.57%
2 1.41% 0.00% 97.18% 1.41% 0.00% 0.00% 0.00%
3 1.39% 0.00% 4.17% 94.44% 0.00% 0.00% 0.00%
4 7.04% 0.00% 0.00% 0.00% 81.69% 0.00% 11.27%
5 20.83% 1.39% 0.00% 0.00% 0.00% 77.78% 0.00%
6 7.25% 0.00% 8.70% 2.90% 4.35% 0.00% 76.81%

PlainNet-6

- 0 1 2 3 4 5 6
0 80.28% 0.00% 0.00% 1.41% 4.23% 1.41% 12.68%
1 0.00% 90.00% 0.00% 0.00% 1.43% 1.43% 7.14%
2 1.41% 0.00% 84.51% 2.82% 0.00% 0.00% 11.27%
3 0.00% 0.00% 0.00% 98.61% 0.00% 0.00% 1.39%
4 0.00% 4.23% 0.00% 0.00% 80.28% 2.82% 12.68%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 1.45% 1.45% 1.45% 1.45% 8.70% 0.00% 85.51%

PlainNet-7

- 0 1 2 3 4 5 6
0 66.20% 0.00% 28.17% 4.23% 0.00% 0.00% 1.41%
1 2.86% 32.86% 4.29% 0.00% 0.00% 0.00% 60.00%
2 0.00% 0.00% 100.00% 0.00% 0.00% 0.00% 0.00%
3 0.00% 0.00% 8.33% 91.67% 0.00% 0.00% 0.00%
4 14.08% 0.00% 5.63% 2.82% 38.03% 0.00% 39.44%
5 13.89% 0.00% 1.39% 2.78% 0.00% 80.56% 1.39%
6 1.45% 0.00% 34.78% 5.80% 0.00% 0.00% 57.97%

PlainNet-8

- 0 1 2 3 4 5 6
0 100.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%
1 11.43% 57.14% 0.00% 0.00% 1.43% 0.00% 30.00%
2 1.41% 0.00% 95.77% 1.41% 0.00% 0.00% 1.41%
3 0.00% 0.00% 1.39% 98.61% 0.00% 0.00% 0.00%
4 18.31% 0.00% 0.00% 1.41% 54.93% 0.00% 25.35%
5 11.11% 0.00% 0.00% 0.00% 0.00% 88.89% 0.00%
6 18.84% 0.00% 5.80% 2.90% 0.00% 0.00% 72.46%

PlainNet-9

- 0 1 2 3 4 5 6
0 98.59% 0.00% 0.00% 0.00% 0.00% 0.00% 1.41%
1 1.43% 91.43% 0.00% 0.00% 1.43% 0.00% 5.71%
2 2.82% 0.00% 92.96% 1.41% 0.00% 0.00% 2.82%
3 2.78% 0.00% 0.00% 97.22% 0.00% 0.00% 0.00%
4 2.82% 2.82% 0.00% 0.00% 83.10% 1.41% 9.86%
5 2.78% 0.00% 0.00% 0.00% 0.00% 97.22% 0.00%
6 7.25% 2.90% 2.90% 1.45% 2.90% 0.00% 82.61%

2. PlainNet-SAM

PlainNet-SAM-0

- 0 1 2 3 4 5 6
0 76.06% 1.41% 2.82% 2.82% 1.41% 5.63% 9.86%
1 0.00% 97.14% 0.00% 0.00% 0.00% 1.43% 1.43%
2 0.00% 0.00% 94.37% 2.82% 1.41% 0.00% 1.41%
3 1.39% 0.00% 0.00% 97.22% 0.00% 0.00% 1.39%
4 0.00% 11.27% 0.00% 0.00% 74.65% 5.63% 8.45%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 2.90% 11.59% 1.45% 2.90% 7.25% 0.00% 73.91%

PlainNet-SAM-1

- 0 1 2 3 4 5 6
0 91.55% 0.00% 4.23% 1.41% 0.00% 0.00% 2.82%
1 0.00% 88.57% 2.86% 0.00% 0.00% 1.43% 7.14%
2 0.00% 0.00% 98.59% 1.41% 0.00% 0.00% 0.00%
3 1.39% 0.00% 1.39% 97.22% 0.00% 0.00% 0.00%
4 7.04% 7.04% 1.41% 0.00% 54.93% 1.41% 28.17%
5 2.78% 0.00% 0.00% 0.00% 0.00% 97.22% 0.00%
6 4.35% 1.45% 10.14% 2.90% 0.00% 0.00% 81.16%

PlainNet-SAM-2

- 0 1 2 3 4 5 6
0 91.55% 0.00% 0.00% 4.23% 1.41% 0.00% 2.82%
1 0.00% 94.29% 0.00% 0.00% 2.86% 1.43% 1.43%
2 1.41% 0.00% 88.73% 7.04% 1.41% 0.00% 1.41%
3 0.00% 0.00% 0.00% 100.00% 0.00% 0.00% 0.00%
4 0.00% 1.41% 0.00% 0.00% 88.73% 4.23% 5.63%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 5.80% 4.35% 4.35% 4.35% 8.70% 0.00% 72.46%

PlainNet-SAM-3

- 0 1 2 3 4 5 6
0 73.24% 4.23% 0.00% 1.41% 7.04% 9.86% 4.23%
1 0.00% 98.57% 0.00% 0.00% 0.00% 0.00% 1.43%
2 2.82% 0.00% 87.32% 1.41% 1.41% 0.00% 7.04%
3 1.39% 1.39% 0.00% 94.44% 2.78% 0.00% 0.00%
4 1.41% 12.68% 0.00% 0.00% 77.46% 4.23% 4.23%
5 0.00% 2.78% 0.00% 0.00% 0.00% 97.22% 0.00%
6 5.80% 14.49% 0.00% 2.90% 11.59% 0.00% 65.22%

PlainNet-SAM-4

- 0 1 2 3 4 5 6
0 84.51% 0.00% 4.23% 1.41% 0.00% 0.00% 9.86%
1 0.00% 84.29% 2.86% 0.00% 1.43% 0.00% 11.43%
2 0.00% 0.00% 100.00% 0.00% 0.00% 0.00% 0.00%
3 0.00% 0.00% 5.56% 93.06% 0.00% 0.00% 1.39%
4 4.23% 0.00% 1.41% 0.00% 74.65% 0.00% 19.72%
5 4.17% 4.17% 0.00% 0.00% 0.00% 91.67% 0.00%
6 2.90% 0.00% 8.70% 0.00% 1.45% 0.00% 86.96%

PlainNet-SAM-5

- 0 1 2 3 4 5 6
0 85.92% 1.41% 0.00% 0.00% 5.63% 5.63% 1.41%
1 0.00% 95.71% 0.00% 0.00% 1.43% 1.43% 1.43%
2 2.82% 0.00% 85.92% 1.41% 1.41% 0.00% 8.45%
3 4.17% 1.39% 1.39% 93.06% 0.00% 0.00% 0.00%
4 0.00% 5.63% 0.00% 0.00% 87.32% 4.23% 2.82%
5 0.00% 1.39% 0.00% 0.00% 0.00% 98.61% 0.00%
6 2.90% 8.70% 0.00% 0.00% 23.19% 0.00% 65.22%

PlainNet-SAM-6

- 0 1 2 3 4 5 6
0 83.10% 1.41% 0.00% 2.82% 0.00% 5.63% 7.04%
1 0.00% 97.14% 0.00% 0.00% 0.00% 1.43% 1.43%
2 0.00% 0.00% 87.32% 5.63% 1.41% 0.00% 5.63%
3 0.00% 0.00% 0.00% 100.00% 0.00% 0.00% 0.00%
4 0.00% 8.45% 0.00% 0.00% 80.28% 4.23% 7.04%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 2.90% 5.80% 1.45% 2.90% 10.14% 0.00% 76.81%

PlainNet-SAM-7

- 0 1 2 3 4 5 6
0 95.77% 0.00% 0.00% 0.00% 0.00% 1.41% 2.82%
1 0.00% 97.14% 0.00% 0.00% 1.43% 1.43% 0.00%
2 1.41% 0.00% 91.55% 2.82% 0.00% 0.00% 4.23%
3 5.56% 0.00% 0.00% 94.44% 0.00% 0.00% 0.00%
4 2.82% 1.41% 0.00% 0.00% 88.73% 1.41% 5.63%
5 0.00% 2.78% 0.00% 0.00% 0.00% 97.22% 0.00%
6 8.70% 10.14% 2.90% 1.45% 11.59% 0.00% 65.22%

PlainNet-SAM-8

- 0 1 2 3 4 5 6
0 95.77% 0.00% 4.23% 0.00% 0.00% 0.00% 0.00%
1 2.86% 90.00% 0.00% 0.00% 1.43% 1.43% 4.29%
2 0.00% 0.00% 98.59% 1.41% 0.00% 0.00% 0.00%
3 2.78% 0.00% 0.00% 97.22% 0.00% 0.00% 0.00%
4 5.63% 1.41% 1.41% 0.00% 85.92% 1.41% 4.23%
5 1.39% 1.39% 0.00% 0.00% 0.00% 97.22% 0.00%
6 5.80% 0.00% 11.59% 1.45% 11.59% 0.00% 69.57%

PlainNet-SAM-9

- 0 1 2 3 4 5 6
0 98.59% 0.00% 0.00% 0.00% 0.00% 0.00% 1.41%
1 4.29% 88.57% 0.00% 0.00% 0.00% 0.00% 7.14%
2 4.23% 0.00% 91.55% 1.41% 1.41% 0.00% 1.41%
3 5.56% 0.00% 1.39% 93.06% 0.00% 0.00% 0.00%
4 2.82% 0.00% 0.00% 0.00% 80.28% 2.82% 14.08%
5 2.78% 0.00% 0.00% 0.00% 0.00% 97.22% 0.00%
6 7.25% 1.45% 2.90% 0.00% 2.90% 0.00% 85.51%

3. ResNet

ResNet-0

- 0 1 2 3 4 5 6
0 73.24% 0.00% 14.08% 1.41% 1.41% 0.00% 9.86%
1 2.86% 75.71% 0.00% 0.00% 7.14% 0.00% 14.29%
2 0.00% 0.00% 97.18% 1.41% 0.00% 0.00% 1.41%
3 1.39% 0.00% 13.89% 83.33% 0.00% 0.00% 1.39%
4 2.82% 0.00% 0.00% 0.00% 85.92% 0.00% 11.27%
5 4.17% 1.39% 0.00% 0.00% 5.56% 87.50% 1.39%
6 1.45% 0.00% 13.04% 1.45% 5.80% 0.00% 78.26%

ResNet-1

- 0 1 2 3 4 5 6
0 78.87% 2.82% 0.00% 0.00% 5.63% 5.63% 7.04%
1 0.00% 87.14% 0.00% 0.00% 1.43% 8.57% 2.86%
2 0.00% 0.00% 84.51% 2.82% 1.41% 0.00% 11.27%
3 4.17% 0.00% 1.39% 94.44% 0.00% 0.00% 0.00%
4 0.00% 1.41% 0.00% 0.00% 91.55% 4.23% 2.82%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 2.90% 10.14% 0.00% 0.00% 31.88% 2.90% 52.17%

ResNet-2

- 0 1 2 3 4 5 6
0 46.48% 1.41% 0.00% 2.82% 21.13% 19.72% 8.45%
1 0.00% 85.71% 0.00% 0.00% 7.14% 5.71% 1.43%
2 0.00% 0.00% 61.97% 11.27% 5.63% 2.82% 18.31%
3 0.00% 0.00% 0.00% 98.61% 0.00% 0.00% 1.39%
4 0.00% 1.41% 0.00% 0.00% 92.96% 4.23% 1.41%
5 0.00% 1.39% 0.00% 0.00% 0.00% 98.61% 0.00%
6 1.45% 4.35% 0.00% 1.45% 37.68% 1.45% 53.62%

ResNet-3

- 0 1 2 3 4 5 6
0 83.10% 0.00% 12.68% 4.23% 0.00% 0.00% 0.00%
1 2.86% 84.29% 0.00% 0.00% 0.00% 1.43% 11.43%
2 0.00% 0.00% 98.59% 1.41% 0.00% 0.00% 0.00%
3 0.00% 0.00% 2.78% 97.22% 0.00% 0.00% 0.00%
4 9.86% 2.82% 1.41% 7.04% 57.75% 1.41% 19.72%
5 8.33% 1.39% 0.00% 0.00% 0.00% 90.28% 0.00%
6 11.59% 0.00% 37.68% 13.04% 0.00% 0.00% 37.68%

ResNet-4

- 0 1 2 3 4 5 6
0 63.38% 7.04% 0.00% 2.82% 0.00% 8.45% 18.31%
1 0.00% 94.29% 0.00% 0.00% 0.00% 1.43% 4.29%
2 0.00% 0.00% 88.73% 1.41% 0.00% 0.00% 9.86%
3 1.39% 1.39% 2.78% 94.44% 0.00% 0.00% 0.00%
4 0.00% 9.86% 0.00% 0.00% 60.56% 4.23% 25.35%
5 0.00% 2.78% 0.00% 0.00% 0.00% 97.22% 0.00%
6 1.45% 7.25% 1.45% 0.00% 1.45% 0.00% 88.41%

ResNet-5

- 0 1 2 3 4 5 6
0 70.42% 4.23% 0.00% 0.00% 9.86% 11.27% 4.23%
1 0.00% 98.57% 0.00% 0.00% 1.43% 0.00% 0.00%
2 4.23% 0.00% 64.79% 9.86% 1.41% 0.00% 19.72%
3 2.78% 1.39% 0.00% 95.83% 0.00% 0.00% 0.00%
4 0.00% 5.63% 0.00% 0.00% 88.73% 4.23% 1.41%
5 0.00% 1.39% 0.00% 0.00% 0.00% 98.61% 0.00%
6 2.90% 14.49% 0.00% 1.45% 27.54% 1.45% 52.17%

ResNet-6

- 0 1 2 3 4 5 6
0 88.73% 0.00% 5.63% 4.23% 0.00% 0.00% 1.41%
1 2.86% 81.43% 0.00% 0.00% 1.43% 0.00% 14.29%
2 0.00% 0.00% 98.59% 1.41% 0.00% 0.00% 0.00%
3 0.00% 0.00% 2.78% 97.22% 0.00% 0.00% 0.00%
4 5.63% 0.00% 0.00% 1.41% 70.42% 1.41% 21.13%
5 4.17% 1.39% 0.00% 0.00% 0.00% 94.44% 0.00%
6 2.90% 0.00% 13.04% 5.80% 1.45% 0.00% 76.81%

ResNet-7

- 0 1 2 3 4 5 6
0 85.92% 1.41% 0.00% 0.00% 8.45% 4.23% 0.00%
1 1.43% 90.00% 0.00% 0.00% 5.71% 2.86% 0.00%
2 2.82% 0.00% 84.51% 1.41% 1.41% 0.00% 9.86%
3 9.72% 1.39% 1.39% 87.50% 0.00% 0.00% 0.00%
4 0.00% 0.00% 0.00% 0.00% 92.96% 5.63% 1.41%
5 0.00% 1.39% 0.00% 0.00% 0.00% 98.61% 0.00%
6 11.59% 20.29% 0.00% 0.00% 37.68% 0.00% 30.43%

ResNet-8

- 0 1 2 3 4 5 6
0 85.92% 0.00% 2.82% 1.41% 0.00% 0.00% 9.86%
1 0.00% 92.86% 0.00% 0.00% 0.00% 1.43% 5.71%
2 0.00% 0.00% 95.77% 1.41% 0.00% 0.00% 2.82%
3 0.00% 0.00% 4.17% 95.83% 0.00% 0.00% 0.00%
4 1.41% 5.63% 0.00% 0.00% 78.87% 4.23% 9.86%
5 0.00% 2.78% 0.00% 0.00% 0.00% 97.22% 0.00%
6 1.45% 1.45% 7.25% 2.90% 8.70% 0.00% 78.26%

ResNet-9

- 0 1 2 3 4 5 6
0 85.92% 1.41% 0.00% 2.82% 5.63% 1.41% 2.82%
1 0.00% 95.71% 0.00% 0.00% 1.43% 2.86% 0.00%
2 1.41% 0.00% 94.37% 2.82% 0.00% 0.00% 1.41%
3 0.00% 1.39% 1.39% 94.44% 0.00% 0.00% 2.78%
4 0.00% 4.23% 0.00% 0.00% 87.32% 5.63% 2.82%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 5.80% 15.94% 4.35% 0.00% 21.74% 0.00% 52.17%

4. ResNet-SAM

ResNet-SAM-0

- 0 1 2 3 4 5 6
0 76.06% 1.41% 2.82% 2.82% 1.41% 5.63% 9.86%
1 0.00% 97.14% 0.00% 0.00% 0.00% 1.43% 1.43%
2 0.00% 0.00% 94.37% 2.82% 1.41% 0.00% 1.41%
3 1.39% 0.00% 0.00% 97.22% 0.00% 0.00% 1.39%
4 0.00% 11.27% 0.00% 0.00% 74.65% 5.63% 8.45%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 2.90% 11.59% 1.45% 2.90% 7.25% 0.00% 73.91%

ResNet-SAM-1

- 0 1 2 3 4 5 6
0 91.55% 0.00% 4.23% 1.41% 0.00% 0.00% 2.82%
1 0.00% 88.57% 2.86% 0.00% 0.00% 1.43% 7.14%
2 0.00% 0.00% 98.59% 1.41% 0.00% 0.00% 0.00%
3 1.39% 0.00% 1.39% 97.22% 0.00% 0.00% 0.00%
4 7.04% 7.04% 1.41% 0.00% 54.93% 1.41% 28.17%
5 2.78% 0.00% 0.00% 0.00% 0.00% 97.22% 0.00%
6 4.35% 1.45% 10.14% 2.90% 0.00% 0.00% 81.16%

ResNet-SAM-2

- 0 1 2 3 4 5 6
0 91.55% 0.00% 0.00% 4.23% 1.41% 0.00% 2.82%
1 0.00% 94.29% 0.00% 0.00% 2.86% 1.43% 1.43%
2 1.41% 0.00% 88.73% 7.04% 1.41% 0.00% 1.41%
3 0.00% 0.00% 0.00% 100.00% 0.00% 0.00% 0.00%
4 0.00% 1.41% 0.00% 0.00% 88.73% 4.23% 5.63%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 5.80% 4.35% 4.35% 4.35% 8.70% 0.00% 72.46%

ResNet-SAM-3

- 0 1 2 3 4 5 6
0 73.24% 4.23% 0.00% 1.41% 7.04% 9.86% 4.23%
1 0.00% 98.57% 0.00% 0.00% 0.00% 0.00% 1.43%
2 2.82% 0.00% 87.32% 1.41% 1.41% 0.00% 7.04%
3 1.39% 1.39% 0.00% 94.44% 2.78% 0.00% 0.00%
4 1.41% 12.68% 0.00% 0.00% 77.46% 4.23% 4.23%
5 0.00% 2.78% 0.00% 0.00% 0.00% 97.22% 0.00%
6 5.80% 14.49% 0.00% 2.90% 11.59% 0.00% 65.22%

ResNet-SAM-4

- 0 1 2 3 4 5 6
0 84.51% 0.00% 4.23% 1.41% 0.00% 0.00% 9.86%
1 0.00% 84.29% 2.86% 0.00% 1.43% 0.00% 11.43%
2 0.00% 0.00% 100.00% 0.00% 0.00% 0.00% 0.00%
3 0.00% 0.00% 5.56% 93.06% 0.00% 0.00% 1.39%
4 4.23% 0.00% 1.41% 0.00% 74.65% 0.00% 19.72%
5 4.17% 4.17% 0.00% 0.00% 0.00% 91.67% 0.00%
6 2.90% 0.00% 8.70% 0.00% 1.45% 0.00% 86.96%

ResNet-SAM-5

- 0 1 2 3 4 5 6
0 85.92% 1.41% 0.00% 0.00% 5.63% 5.63% 1.41%
1 0.00% 95.71% 0.00% 0.00% 1.43% 1.43% 1.43%
2 2.82% 0.00% 85.92% 1.41% 1.41% 0.00% 8.45%
3 4.17% 1.39% 1.39% 93.06% 0.00% 0.00% 0.00%
4 0.00% 5.63% 0.00% 0.00% 87.32% 4.23% 2.82%
5 0.00% 1.39% 0.00% 0.00% 0.00% 98.61% 0.00%
6 2.90% 8.70% 0.00% 0.00% 23.19% 0.00% 65.22%

ResNet-SAM-6

- 0 1 2 3 4 5 6
0 83.10% 1.41% 0.00% 2.82% 0.00% 5.63% 7.04%
1 0.00% 97.14% 0.00% 0.00% 0.00% 1.43% 1.43%
2 0.00% 0.00% 87.32% 5.63% 1.41% 0.00% 5.63%
3 0.00% 0.00% 0.00% 100.00% 0.00% 0.00% 0.00%
4 0.00% 8.45% 0.00% 0.00% 80.28% 4.23% 7.04%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 2.90% 5.80% 1.45% 2.90% 10.14% 0.00% 76.81%

ResNet-SAM-7

- 0 1 2 3 4 5 6
0 95.77% 0.00% 0.00% 0.00% 0.00% 1.41% 2.82%
1 0.00% 97.14% 0.00% 0.00% 1.43% 1.43% 0.00%
2 1.41% 0.00% 91.55% 2.82% 0.00% 0.00% 4.23%
3 5.56% 0.00% 0.00% 94.44% 0.00% 0.00% 0.00%
4 2.82% 1.41% 0.00% 0.00% 88.73% 1.41% 5.63%
5 0.00% 2.78% 0.00% 0.00% 0.00% 97.22% 0.00%
6 8.70% 10.14% 2.90% 1.45% 11.59% 0.00% 65.22%

ResNet-SAM-8

- 0 1 2 3 4 5 6
0 95.77% 0.00% 4.23% 0.00% 0.00% 0.00% 0.00%
1 2.86% 90.00% 0.00% 0.00% 1.43% 1.43% 4.29%
2 0.00% 0.00% 98.59% 1.41% 0.00% 0.00% 0.00%
3 2.78% 0.00% 0.00% 97.22% 0.00% 0.00% 0.00%
4 5.63% 1.41% 1.41% 0.00% 85.92% 1.41% 4.23%
5 1.39% 1.39% 0.00% 0.00% 0.00% 97.22% 0.00%
6 5.80% 0.00% 11.59% 1.45% 11.59% 0.00% 69.57%

ResNet-SAM-9

- 0 1 2 3 4 5 6
0 98.59% 0.00% 0.00% 0.00% 0.00% 0.00% 1.41%
1 4.29% 88.57% 0.00% 0.00% 0.00% 0.00% 7.14%
2 4.23% 0.00% 91.55% 1.41% 1.41% 0.00% 1.41%
3 5.56% 0.00% 1.39% 93.06% 0.00% 0.00% 0.00%
4 2.82% 0.00% 0.00% 0.00% 80.28% 2.82% 14.08%
5 2.78% 0.00% 0.00% 0.00% 0.00% 97.22% 0.00%
6 7.25% 1.45% 2.90% 0.00% 2.90% 0.00% 85.51%

5. InceptionNet

InceptionNet-0

- 0 1 2 3 4 5 6
0 67.61% 0.00% 7.04% 5.63% 2.82% 1.41% 15.49%
1 1.43% 84.29% 0.00% 0.00% 2.86% 2.86% 8.57%
2 0.00% 0.00% 91.55% 5.63% 0.00% 0.00% 2.82%
3 0.00% 0.00% 2.78% 97.22% 0.00% 0.00% 0.00%
4 1.41% 0.00% 0.00% 4.23% 78.87% 2.82% 12.68%
5 1.39% 0.00% 0.00% 0.00% 1.39% 97.22% 0.00%
6 4.35% 0.00% 2.90% 8.70% 8.70% 1.45% 73.91%

InceptionNet-1

- 0 1 2 3 4 5 6
0 83.10% 0.00% 8.45% 2.82% 2.82% 0.00% 2.82%
1 2.86% 88.57% 0.00% 0.00% 1.43% 0.00% 7.14%
2 1.41% 0.00% 95.77% 1.41% 0.00% 0.00% 1.41%
3 1.39% 0.00% 2.78% 95.83% 0.00% 0.00% 0.00%
4 1.41% 0.00% 1.41% 0.00% 90.14% 0.00% 7.04%
5 4.17% 4.17% 0.00% 0.00% 0.00% 91.67% 0.00%
6 1.45% 0.00% 15.94% 2.90% 10.14% 0.00% 69.57%

InceptionNet-2

- 0 1 2 3 4 5 6
0 87.32% 1.41% 0.00% 2.82% 4.23% 0.00% 4.23%
1 0.00% 92.86% 0.00% 0.00% 0.00% 0.00% 7.14%
2 0.00% 0.00% 88.73% 5.63% 0.00% 0.00% 5.63%
3 0.00% 0.00% 0.00% 100.00% 0.00% 0.00% 0.00%
4 1.41% 4.23% 0.00% 1.41% 85.92% 1.41% 5.63%
5 1.39% 5.56% 0.00% 0.00% 2.78% 90.28% 0.00%
6 4.35% 4.35% 7.25% 4.35% 17.39% 0.00% 62.32%

InceptionNet-3

- 0 1 2 3 4 5 6
0 80.28% 1.41% 2.82% 2.82% 4.23% 4.23% 4.23%
1 0.00% 94.29% 0.00% 0.00% 0.00% 2.86% 2.86%
2 1.41% 0.00% 91.55% 2.82% 1.41% 0.00% 2.82%
3 2.78% 0.00% 0.00% 97.22% 0.00% 0.00% 0.00%
4 0.00% 2.82% 0.00% 0.00% 77.46% 5.63% 14.08%
5 1.39% 1.39% 0.00% 0.00% 0.00% 97.22% 0.00%
6 4.35% 5.80% 4.35% 0.00% 13.04% 0.00% 72.46%

InceptionNet-4

- 0 1 2 3 4 5 6
0 61.97% 11.27% 0.00% 1.41% 7.04% 4.23% 14.08%
1 0.00% 100.00% 0.00% 0.00% 0.00% 0.00% 0.00%
2 0.00% 0.00% 84.51% 4.23% 0.00% 0.00% 11.27%
3 0.00% 5.56% 0.00% 94.44% 0.00% 0.00% 0.00%
4 0.00% 19.72% 0.00% 0.00% 73.24% 1.41% 5.63%
5 0.00% 8.33% 0.00% 0.00% 0.00% 91.67% 0.00%
6 0.00% 26.09% 1.45% 0.00% 14.49% 0.00% 57.97%

InceptionNet-5

- 0 1 2 3 4 5 6
0 83.10% 1.41% 0.00% 7.04% 7.04% 0.00% 1.41%
1 1.43% 88.57% 0.00% 0.00% 1.43% 2.86% 5.71%
2 0.00% 0.00% 80.28% 9.86% 1.41% 0.00% 8.45%
3 1.39% 0.00% 0.00% 98.61% 0.00% 0.00% 0.00%
4 1.41% 4.23% 0.00% 4.23% 85.92% 2.82% 1.41%
5 1.39% 2.78% 0.00% 0.00% 4.17% 91.67% 0.00%
6 5.80% 11.59% 2.90% 5.80% 18.84% 1.45% 53.62%

InceptionNet-6

- 0 1 2 3 4 5 6
0 92.96% 0.00% 2.82% 4.23% 0.00% 0.00% 0.00%
1 4.29% 85.71% 0.00% 0.00% 1.43% 2.86% 5.71%
2 4.23% 0.00% 85.92% 4.23% 0.00% 0.00% 5.63%
3 0.00% 0.00% 0.00% 100.00% 0.00% 0.00% 0.00%
4 8.45% 4.23% 0.00% 5.63% 69.01% 5.63% 7.04%
5 2.78% 0.00% 0.00% 0.00% 0.00% 97.22% 0.00%
6 13.04% 1.45% 2.90% 7.25% 1.45% 0.00% 73.91%

InceptionNet-7

- 0 1 2 3 4 5 6
0 81.69% 4.23% 1.41% 1.41% 7.04% 2.82% 1.41%
1 0.00% 95.71% 0.00% 0.00% 1.43% 1.43% 1.43%
2 2.82% 0.00% 83.10% 7.04% 1.41% 0.00% 5.63%
3 0.00% 0.00% 0.00% 100.00% 0.00% 0.00% 0.00%
4 2.82% 11.27% 0.00% 0.00% 78.87% 4.23% 2.82%
5 1.39% 2.78% 0.00% 0.00% 0.00% 95.83% 0.00%
6 7.25% 11.59% 4.35% 8.70% 20.29% 0.00% 47.83%

InceptionNet-8

- 0 1 2 3 4 5 6
0 84.51% 1.41% 0.00% 2.82% 2.82% 0.00% 8.45%
1 0.00% 100.00% 0.00% 0.00% 0.00% 0.00% 0.00%
2 0.00% 0.00% 91.55% 4.23% 0.00% 0.00% 4.23%
3 4.17% 0.00% 0.00% 95.83% 0.00% 0.00% 0.00%
4 1.41% 12.68% 0.00% 0.00% 76.06% 1.41% 8.45%
5 1.39% 4.17% 0.00% 0.00% 0.00% 94.44% 0.00%
6 7.25% 13.04% 4.35% 0.00% 10.14% 0.00% 65.22%

InceptionNet-9

- 0 1 2 3 4 5 6
0 87.32% 1.41% 0.00% 2.82% 7.04% 1.41% 0.00%
1 0.00% 97.14% 0.00% 0.00% 0.00% 1.43% 1.43%
2 7.04% 0.00% 74.65% 11.27% 0.00% 0.00% 7.04%
3 1.39% 0.00% 0.00% 98.61% 0.00% 0.00% 0.00%
4 2.82% 9.86% 0.00% 1.41% 78.87% 2.82% 4.23%
5 1.39% 5.56% 0.00% 0.00% 1.39% 91.67% 0.00%
6 8.70% 14.49% 2.90% 2.90% 14.49% 1.45% 55.07%

6. InceptionNet-SAM

InceptionNet-SAM-0

- 0 1 2 3 4 5 6
0 85.92% 0.00% 1.41% 1.41% 1.41% 1.41% 8.45%
1 0.00% 97.14% 0.00% 0.00% 0.00% 1.43% 1.43%
2 1.41% 0.00% 90.14% 5.63% 0.00% 0.00% 2.82%
3 0.00% 0.00% 0.00% 100.00% 0.00% 0.00% 0.00%
4 0.00% 12.68% 0.00% 0.00% 71.83% 4.23% 11.27%
5 0.00% 4.17% 0.00% 0.00% 0.00% 95.83% 0.00%
6 2.90% 11.59% 0.00% 1.45% 5.80% 0.00% 78.26%

InceptionNet-SAM-1

- 0 1 2 3 4 5 6
0 70.42% 1.41% 0.00% 1.41% 9.86% 2.82% 14.08%
1 0.00% 91.43% 0.00% 0.00% 5.71% 1.43% 1.43%
2 5.63% 0.00% 64.79% 7.04% 1.41% 0.00% 21.13%
3 0.00% 0.00% 0.00% 97.22% 0.00% 0.00% 2.78%
4 0.00% 2.82% 0.00% 0.00% 91.55% 4.23% 1.41%
5 0.00% 1.39% 0.00% 0.00% 0.00% 98.61% 0.00%
6 1.45% 14.49% 0.00% 0.00% 39.13% 0.00% 44.93%

InceptionNet-SAM-2

- 0 1 2 3 4 5 6
0 88.73% 0.00% 1.41% 1.41% 0.00% 1.41% 7.04%
1 0.00% 92.86% 0.00% 0.00% 0.00% 1.43% 5.71%
2 0.00% 0.00% 87.32% 1.41% 0.00% 0.00% 11.27%
3 2.78% 0.00% 1.39% 95.83% 0.00% 0.00% 0.00%
4 4.23% 9.86% 0.00% 1.41% 61.97% 1.41% 21.13%
5 2.78% 1.39% 0.00% 0.00% 0.00% 95.83% 0.00%
6 5.80% 5.80% 5.80% 0.00% 2.90% 0.00% 79.71%

InceptionNet-SAM-3

- 0 1 2 3 4 5 6
0 83.10% 4.23% 0.00% 0.00% 2.82% 1.41% 8.45%
1 0.00% 94.29% 0.00% 0.00% 0.00% 2.86% 2.86%
2 1.41% 0.00% 90.14% 4.23% 0.00% 0.00% 4.23%
3 1.39% 0.00% 2.78% 95.83% 0.00% 0.00% 0.00%
4 0.00% 7.04% 0.00% 0.00% 84.51% 2.82% 5.63%
5 0.00% 2.78% 0.00% 0.00% 2.78% 93.06% 1.39%
6 4.35% 5.80% 1.45% 1.45% 14.49% 0.00% 72.46%

InceptionNet-SAM-4

- 0 1 2 3 4 5 6
0 80.28% 0.00% 1.41% 1.41% 2.82% 0.00% 14.08%
1 2.86% 78.57% 0.00% 0.00% 2.86% 2.86% 12.86%
2 0.00% 0.00% 94.37% 2.82% 0.00% 0.00% 2.82%
3 0.00% 0.00% 2.78% 95.83% 0.00% 0.00% 1.39%
4 4.23% 0.00% 0.00% 0.00% 78.87% 1.41% 15.49%
5 2.78% 1.39% 0.00% 0.00% 2.78% 93.06% 0.00%
6 2.90% 1.45% 5.80% 4.35% 10.14% 0.00% 75.36%

InceptionNet-SAM-5

- 0 1 2 3 4 5 6
0 90.14% 0.00% 0.00% 1.41% 4.23% 0.00% 4.23%
1 1.43% 85.71% 0.00% 0.00% 0.00% 1.43% 11.43%
2 1.41% 0.00% 88.73% 4.23% 0.00% 0.00% 5.63%
3 1.39% 0.00% 1.39% 95.83% 0.00% 0.00% 1.39%
4 2.82% 0.00% 0.00% 1.41% 85.92% 2.82% 7.04%
5 2.78% 4.17% 0.00% 0.00% 0.00% 93.06% 0.00%
6 5.80% 0.00% 2.90% 2.90% 5.80% 0.00% 82.61%

InceptionNet-SAM-6

- 0 1 2 3 4 5 6
0 81.69% 0.00% 2.82% 1.41% 2.82% 0.00% 11.27%
1 0.00% 80.00% 0.00% 0.00% 1.43% 4.29% 14.29%
2 0.00% 0.00% 94.37% 4.23% 0.00% 0.00% 1.41%
3 0.00% 0.00% 0.00% 98.61% 0.00% 0.00% 1.39%
4 1.41% 0.00% 0.00% 0.00% 76.06% 2.82% 19.72%
5 1.39% 1.39% 0.00% 0.00% 0.00% 97.22% 0.00%
6 1.45% 0.00% 5.80% 5.80% 5.80% 1.45% 79.71%

InceptionNet-SAM-7

- 0 1 2 3 4 5 6
0 84.51% 0.00% 1.41% 2.82% 5.63% 5.63% 0.00%
1 1.43% 90.00% 0.00% 0.00% 0.00% 2.86% 5.71%
2 1.41% 0.00% 94.37% 2.82% 0.00% 0.00% 1.41%
3 2.78% 0.00% 2.78% 94.44% 0.00% 0.00% 0.00%
4 1.41% 2.82% 0.00% 0.00% 87.32% 4.23% 4.23%
5 0.00% 0.00% 0.00% 0.00% 0.00% 100.00% 0.00%
6 5.80% 10.14% 7.25% 2.90% 13.04% 0.00% 60.87%

InceptionNet-SAM-8

- 0 1 2 3 4 5 6
0 77.46% 0.00% 2.82% 2.82% 2.82% 1.41% 12.68%
1 0.00% 90.00% 0.00% 0.00% 2.86% 1.43% 5.71%
2 0.00% 0.00% 92.96% 4.23% 0.00% 0.00% 2.82%
3 1.39% 0.00% 2.78% 95.83% 0.00% 0.00% 0.00%
4 1.41% 9.86% 0.00% 1.41% 76.06% 1.41% 9.86%
5 1.39% 1.39% 0.00% 0.00% 0.00% 97.22% 0.00%
6 4.35% 5.80% 8.70% 2.90% 7.25% 0.00% 71.01%

InceptionNet-SAM-9

- 0 1 2 3 4 5 6
0 83.10% 0.00% 4.23% 4.23% 2.82% 0.00% 5.63%
1 0.00% 94.29% 0.00% 0.00% 0.00% 0.00% 5.71%
2 0.00% 0.00% 94.37% 5.63% 0.00% 0.00% 0.00%
3 0.00% 0.00% 1.39% 98.61% 0.00% 0.00% 0.00%
4 5.63% 7.04% 0.00% 4.23% 69.01% 1.41% 12.68%
5 2.78% 8.33% 0.00% 0.00% 0.00% 88.89% 0.00%
6 5.80% 7.25% 4.35% 7.25% 2.90% 0.00% 72.46%

About

This repo includes the experiment codes and experiment results for the Skip Attention Module (SAM). The SAM is a parameter-free attention module using in fMRI decoding to increase the decoding performance, which can be able to stack on any architecture of convolutional neural network without any parameters that need to train, and does not increa…

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages