Skip to content

LiYingwei/ShapeTextureDebiasedTraining

master
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Shape-Texture Debiased Neural Network Training

Code and models for the paper Shape-Texture Debiased Neural Network Training (ICLR 2021).

Introduction

Convolutional Neural Networks are often biased towards either texture or shape, depending on the training dataset (Geirhos et al. 2019). Our ablation shows that such bias degenerates model performance. Motivated by this observation, we develop a simple algorithm for shape-texture debiased learning.

Experiments show that our method successfully improves model performance on several image recognition benchmarks and adversarial robustness. For example, by training on ImageNet, it helps ResNet-152 achieve substantial improvements on ImageNet (+1.2%), ImageNet-A (+5.2%), ImageNet-C (+8.3%) and Stylized-ImageNet (+11.1%), and on defending against FGSM adversarial attacker on ImageNet (+14.4%). Our method also claims to be compatible to other advanced data augmentation strategies, eg, Mixup and CutMix.

Dependencies:

  • PyTorch = 1.4.0 with GPU support

Model Zoo:

Shape-Texture Debiased Models ImageNet (Top-1 Acc.)
ResNet-50 ⬇️ 76.9
ResNet-101 ⬇️ 78.9
ResNet-152 ⬇️ 79.8
Mixup-ResNeXt-101 ⬇️ 80.5
CutMix-ResNeXt-101 ⬇️ 81.2

We also provide the checkpoint for the Shape-Biased ResNet-50 ⬇️ and the Texture-Biased ResNet-50 ⬇️. See issue#2 for more details.

Training & Testing:

Please see the Training recipes / Testing recipes for how to train / test the models.

Acknowledgements

Part of this code comes from pytorch-classification and AdaIN.

Citation

If you use our code, models or wish to refer to our results, please use the following BibTex entry:

@article{li2020shapetexture,
  author  = {Li, Yingwei and Yu, Qihang and Tan, Mingxing and Mei, Jieru and Tang, Peng and Shen, Wei and Yuille, Alan and Xie, Cihang},
  title   = {Shape-Texture Debiased Neural Network Training},
  journal = {arXiv preprint arXiv:2010.05981},
  year    = {2020}
}

About

Code and models for the paper Shape-Texture Debiased Neural Network Training (ICLR 2021)

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages