GeneralizationEvaluate

Code implementation and example data of "Methodology for Evaluating the Generalization of ResNet"

Features

• IoU-based generalization evaluation method for CNN
• Other method
  • Spectral Norm
  • Nuclear Norm
  • EI

Installation

conda create -n generalizationEval python=3.8 -y
conda activate generalizationEval
pip install -r requirements.txt

Usage

IoU-based

cd IoU_based
python RFRM_IoUbased.py \
    --model-arch ResNet18 \
    --model-file ../dataExample/modelSet/ResNet18_example1.pth \
    --data-root ../dataExample/imageData \
    --cam gradcam # CAM method, choices=['gradcam', 'gradcampp','smoothgradcampp', 'layercam']

Spectral Norm

cd SpectralNorm
python spectral_norm.py \
    --model-arch ResNet18 \
    --model-file ../dataExample/modelSet/ResNet18_example1.pth \
    --data-root ../dataExample/imageData

Nuclear Norm

cd NuclearNorm
python nuclear_norm.py \
    --model-arch ResNet18 \
    --model-file ../dataExample/modelSet/ResNet18_example1.pth \
    --data-root ../dataExample/imageData

EI

cd EI
python EI_score_rotation.py \
    --model-arch ResNet18 \
    --model-file ../dataExample/modelSet/ResNet18_example1.pth \
    --data-root ../dataExample/imageData

Reference

@article{du2024methodology,
  title={Methodology for Evaluating the Generalization of ResNet},
  author={Du, Anan and Zhou, Qing and Dai, Yuqi},
  journal={Applied Sciences},
  volume={14},
  number={9},
  pages={3951},
  year={2024},
  publisher={MDPI}
}