Skip to content

Offical implementation of "Advancing Spiking Neural Networks towards Deep Residual Learning" (IEEE TNNLS 2024)

Notifications You must be signed in to change notification settings

BICLab/MS-ResNet

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Advancing Spiking Neural Networks towards Deep Residual Learning

This repo covers the implementation of the following paper:

"Advancing Spiking Neural Networks towards Deep Residual Learning". Paper.

The most straightforward way of training higher quality models is by increasing their size. In this work, we would like to see that deepening network structures could get rid of the degradation problem and always be a trustworthy way to achieve satisfying accuracy for the direct training of SNNs.

This repository contains the source code for the training of our MS-ResNet on ImageNet. The models are defined in models/MS_ResNet.py .

Running

  1. Install Python 3.7, PyTorch 1.8 and Tensorboard.

  2. Change the data paths vardir,traindir to the image folders of ImageNet dataset.

  3. To train the model, please run CUDA_VISIBLE_DEVICES=GPU_IDs python -m torch.distributed.launch --master_port=1234 --nproc_per_node=NUM_GPU_USED train_amp.py -net resnet34 -b 256 -lr 0.1 .

    -net option supports resnet18/34/104 .

Citation

If you find this repo useful for your research, please consider citing the paper

@misc{hu2023advancing,
      title={Advancing Spiking Neural Networks towards Deep Residual Learning}, 
      author={Yifan Hu and Lei Deng and Yujie Wu and Man Yao and Guoqi Li},
      year={2023},
      eprint={2112.08954},
      archivePrefix={arXiv},
      primaryClass={cs.NE}
}

About

Offical implementation of "Advancing Spiking Neural Networks towards Deep Residual Learning" (IEEE TNNLS 2024)

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%