Awesome-SNN

🔥🔥🔥 This repository lists some awesome SNN(Spiking Neural Network) projects.

Contents

• Awesome-SNN
  • Review
  • Frameworks
  • Datasets
  • Applications
    • Attention and Transformer
    • Object Detection
    • Object Recognition
    • Adversarial Attack and Defense
    • Speech and Audio Field
    • Event-Based Application
    • Hardware Deployment
  • Blogs

Review

• uzh-rpg/event-based_vision_resources : Event-based Vision Resources.

• XDUSPONGE/SNN_benchmark : Spiking Neural Network Paper List.

• amirHossein-Ebrahimi/awesome-computational-neuro-science : A curated list of awesome Go frameworks, libraries, and software + First class pure python Tutorial Series for Spiking Neural Networks 🔥.

• vvvityaaa/awesome-spiking-neural-networks : A curated list of materials for Spiking Neural Networks, 3rd generation of artificial neural networks.

• TheAwesomeAndy/Awesome_SNN_Reads : A list of little and big reads about SNN's.

• SpikingChen/SNN-Daily-Arxiv : Update arXiv papers about Spiking Neural Networks daily.

• shenhaibo123/SNN_arxiv_daily : SNN_arxiv_daily.

• "Advances in spike vision". "脉冲视觉研究进展". (中国图象图形学报 2022)

Datasets

• N-Caltech101 : The Neuromorphic-Caltech101 (N-Caltech101) dataset is a spiking version of the original frame-based Caltech101 dataset. “Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccades". (Frontiers in neuroscience, 2015)

Frameworks

• SpikingJelly | 惊蜇 : SpikingJelly is an open-source deep learning framework for Spiking Neural Network (SNN) based on PyTorch. SpikingJelly 是一个基于 PyTorch，使用脉冲神经网络(Spiking Neural Network, SNN)进行深度学习的框架。spikingjelly.readthedocs.io

• BrainCog | 智脉 : BrainCog is an open source spiking neural network based brain-inspired cognitive intelligence engine for Brain-inspired Artificial Intelligence and brain simulation. More information on braincog can be found on its homepage http://www.brain-cog.network/. "BrainCog: A Spiking Neural Network based Brain-inspired Cognitive Intelligence Engine for Brain-inspired AI and Brain Simulation". (arXiv 2022)

• NCPs : PyTorch and TensorFlow implementation of NCP, LTC, and CfC wired neural models. "Neural circuit policies enabling auditable autonomy". (Nature Machine Intelligence, 2020)

• CfC : "Closed-form continuous-time neural networks". (Nature Machine Intelligence, 2022)

• LTCs : "Liquid Time-constant Networks". (AAAI 2021)

• C. elegans : "A Transparent Window into Biology: A Primer on Caenorhabditis elegans". (Genetics, 2015)

• VOneNets : "Simulating a Primary Visual Cortex at the Front of CNNs Improves Robustness to Image Perturbations". (NeurIPS 2020)

• BindsNET : Simulation of spiking neural networks (SNNs) using PyTorch.

• Brian2 : Brian is a free, open source simulator for spiking neural networks. "Brian 2, an intuitive and efficient neural simulator". (Elife 2019)

• Brian2CUDA : A brian2 extension to simulate spiking neural networks on GPUs. "Brian2CUDA: flexible and efficient simulation of spiking neural network models on GPUs". (Frontiers in Neuroinformatics 2022)

• Spiking-Neural-Network : This is the python implementation of hardware efficient spiking neural network.

• norse : Deep learning with spiking neural networks (SNNs) in PyTorch.

• snntorch : Deep and online learning with spiking neural networks in Python. "Training Spiking Neural Networks Using Lessons From Deep Learning". (arXiv 2021)

• snn_toolbox : Toolbox for converting analog to spiking neural networks (ANN to SNN), and running them in a spiking neuron simulator.

• SpyTorch : "Surrogate gradient learning in spiking neural networks: Bringing the power of gradient-based optimization to spiking neural networks". (IEEE Signal Processing Magazine 2019)

• slayerPytorch : PyTorch implementation of SLAYER for training Spiking Neural Networks . "Slayer: Spike layer error reassignment in time". (NeurIPS 2018)

• Spiking-Neural-Network-SNN-with-PyTorch-where-Backpropagation-engenders-STDP : Spiking Neural Network (SNN) with PyTorch : towards bridging the gap between deep learning and the human brain.

• PySNN : Efficient Spiking Neural Network framework, built on top of PyTorch for GPU acceleration.

• yjwu17/STBP-for-training-SpikingNN : Spatio-temporal BP for spiking neural networks.

• thiswinex/STBP-simple : A simple direct training implement for SNNs using Spatio-Temporal Backpropagation.

• ZLkanyo009/STBP-train-and-compression : STBP is a way to train SNN with datasets by Backward propagation.Using this Repositories allows you to train SNNS with STBP and quantize SNNS with QAT to deploy to neuromorphological chips like Loihi and Tianjic.

• SPAIC : Spike-based artificial intelligence computing platform. "Darwin-S: A Reference Software Architecture for Brain-Inspired Computers". (IEEE Computer 2022)

• yhhhli/SNN_Calibration : Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021. "A free lunch from ANN: Towards efficient, accurate spiking neural networks calibration". (ICML 2021). "Converting Artificial Neural Networks to Spiking Neural Networks via Parameter Calibration". (arXiv 2022)

• gmtiddia/working_memory_spiking_network : Spiking network model and analysis scripts for the preprint "Simulations of Working Memory Spiking Networks driven by Short-Term Plasticity".

• Brain-Cog-Lab/Conversion_Burst : "Efficient and Accurate Conversion of Spiking Neural Network with Burst Spikes". (IJCAI 2022)

• Brain-Cog-Lab/BP-STA : "Backpropagation with Biologically Plausible Spatio-Temporal Adjustment For Training Deep Spiking Neural Networks". (Cell Patterns 2022)

• Borzyszkowski/SNN-CMS : Spiking Neural Networks accelerated on the Intel Loihi chips for LHC experiments, at CMS detector. Project of the European Organization for Nuclear Research (CERN) in collaboration with Intel Labs.

• TJXTT/SNN2ANN : "SNN2ANN: A Fast and Memory-Efficient Training Framework for Spiking Neural Networks". (arXiv 2022)

• sPyMem : sPyMem: spike-based bio-inspired memory models.

• romainzimmer/s2net : Supervised Spiking Network.

• combra-lab/snn-eeg : PyTorch and Loihi implementation of the Spiking Neural Network for decoding EEG on Neuromorphic Hardware. "PyTorch and Loihi implementation of the Spiking Neural Network for decoding EEG on Neuromorphic Hardware". (TMLR 2022)

• SpikingSIM : "SpikingSIM: A Bio-inspired Spiking Simulator". (ISCAS 2022)

• Mathorga/behema : Spiking neural network implementation inspired by cellular automata for efficiency.

• synsense/rockpool : A machine learning library for spiking neural networks. Supports training with both torch and jax pipelines, and deployment to neuromorphic hardware.

• Sinabs : Spiking neural network library based on PyTorch.

• MungoMeng/Spiking-Inception : A Spiking Inception architecture for unsupervised Spiking Neural Networks (SNNs). "High-parallelism Inception-like Spiking Neural Networks for Unsupervised Feature Learning". (Neurocomputing 2021). "Spiking Inception Module for Multi-layer Unsupervised Spiking Neural Networks". (IJCNN 2020).

• BioLCNet : "BioLCNet: Reward-modulated Locally Connected Spiking Neural Networks". (arXiv 2021)

• aggelen/Spayk : An open source environment for spiking neural networks.

• ANNarchy : "ANNarchy: a code generation approach to neural simulations on parallel hardware". (Frontiers in Neuroinformatics 2015)

• Real-Spike : "Real Spike: Learning Real-valued Spikes for Spiking Neural Networks". (ECCV 2022)

• Spike-Element-Wise-ResNet : "Deep residual learning in spiking neural networks". (NeurIPS 2021)

• cuSNN : Spiking Neural Networks in C++ with strong GPU acceleration through CUDA. "Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perception". (TPAMI 2020)

• nengo/pytorch-spiking : Spiking neuron integration for PyTorch. www.nengo.ai/pytorch-spiking/.

• zhouyanasd/DL-NC : spiking-neural-networks.

• ShahriarSS/Spyker : High-performance Spiking Neural Networks Library Written From Scratch with C++ and Python Interfaces.

• STSC-SNN : "STSC-SNN: Spatio-Temporal Synaptic Connection with temporal convolution and attention for spiking neural networks". (Frontiers in Neuroscience, 2022)

• michaelmelanson/spiking-neural-net : A spiking neural network simulation library.

• STSC-SNN : Multi-scale spiking network model of macaque visual cortex. "Multi-scale account of the network structure of macaque visual cortex". (Brain Structure and Function, 2018). "A multi-scale layer-resolved spiking network model of resting-state dynamics in macaque visual cortical areas". (PLOS Computational Biology, 2018).

Applications

• Attention and Transformer

  • Attention-SNN : Offical implementation of "Attention Spiking Neural Networks" (IEEE TPAMI 2023)

  • Spike-Driven-Transformer : Offical implementation of "Spike-driven Transformer" (NeurIPS 2023)

  • Spike-Driven-Transformer-V2 : Offical implementation of "Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chips" (ICLR 2024)

• Object Detection

  • EMS-YOLO : Offical implementation of "Deep Directly-Trained Spiking Neural Networks for Object Detection" (ICCV 2023)

  • Spiking-YOLOv3 : A PyTorch implementation of Spiking-YOLOv3. Two branches are provided, based on two common PyTorch implementation of YOLOv3(ultralytics/yolov3 & eriklindernoren/PyTorch-YOLOv3), with support for Spiking-YOLOv3-Tiny at present. (AAAI 2020)

  • fjcu-ee-islab/Spiking_Converted_YOLOv4 : Object Detection Based on Dynamic Vision Sensor with Spiking Neural Network.

  • Zaabon/spiking_yolo : This project is a combined neural network utilizing an spiking CNN with backpropagation and YOLOv3 for object detection.

  • Dignity-ghost/PyTorch-Spiking-YOLOv3 : A modified repository based on Spiking-YOLOv3 and YOLOv3, which makes it suitable for VOC-dataset and YOLOv2.

  • beauty-girl-cxy/spiking-yolov5 : spiking-yolov5.

  • arsalikhov/PSYCH420_final_project : Goal of the project is to train an Object-Detection model using Spiking Neural Network on COCO dataset.

  • loiccordone/object-detection-with-spiking-neural-networks : "Object Detection with Spiking Neural Networks on Automotive Event Data". (IJCNN 2022)

• Object Recognition

  • freek9807/SNN-NMNIST-Object-Recognition : An object recognition model for NMNIST larger video frame.

• Adversarial Attack and Defense

  • ssharmin/spikingNN-adversarial-attack : FGSM and PGD adversarial attack on Spiking Neural Network (SNN).

• Speech and Audio Field

  • flinkerlab/neural_speech_decoding : Neural Speech Decoding. "A neural speech decoding framework leveraging deep learning and speech synthesis". (Nature, 2024). "微信公众号「量子位」《脑电合成自然语音！LeCun转发Nature子刊新成果，代码开源》"。

  • comob-project/snn-sound-localization : Training spiking neural networks for sound localization.

  • pyNAVIS : "PyNAVIS: An open-source cross-platform software for spike-based neuromorphic audio information processing". (Neurocomputing, 2021)

• Event-Based Application

  • uzh-rpg/snn_angular_velocity : "Event-Based Angular Velocity Regression with Spiking Networks". (ICRA 2020)

• Hardware Deployment

  • metr0jw/Spiking-Neural-Network-on-FPGA : Leaky Integrate and Fire (LIF) model implementation for FPGA.

Blogs

• 微信公众号「智能的本质与未来」
  • 2022-07-20，类脑认知智能引擎“智脉”：全脉冲神经网络的新一代人工智能开源平台
  • 2022-09-06，【智脉说】类脑认知智能引擎BrainCog基础 第1期 BrainCog系统部署
  • 2022-09-07，【智脉说】类脑认知智能引擎BrainCog基础 第2期 脉冲神经元计算建模
  • 2022-09-14，【智脉说】类脑认知智能引擎BrainCog基础 第3期 高效构建脉冲神经网络
  • 2022-09-20，【智脉说】类脑认知智能引擎BrainCog基础 第4期 构建脑区的认知脉冲神经网络模型
  • 2022-09-30，【智脉说】类脑认知智能引擎BrainCog基础 第5期 BrainCog系统功能进阶
  • 2022-10-16，【智脉说】类脑认知智能引擎BrainCog基础 第6期 用BrainGog实现深度强化学习脉冲神经网络
  • 2022-10-18，【智脉说】类脑认知智能引擎BrainCog基础 第7期 用BrainGog实现受量子叠加态启发的脉冲序列时空编码
  • 2022-10-26，【智脉说】类脑认知智能引擎BrainCog基础 第8期 用BrainCog实现从人工神经网络到​脉冲神经网络的转换
  • 2022-11-03，【智脉说】类脑认知引擎Braincog基础 第9期 用Braincog实现全局反馈连接脉冲神经网络
  • 2022-11-09，【智脉说】类脑认知引擎Braincog基础 第10期 用Braincog实现多脑区协同的类脑自主决策脉冲神经网络
  • 2022-11-18，【智脉说】类脑认知引擎Braincog基础 第11期 用Braincog实现类脑脉冲神经网络高效时空调节训练
  • 2022-11-28，【智脉说】类脑认知引擎Braincog基础 第12期 用Braincog实现基于脉冲时序依赖可塑性的无监督脉冲神经网络
  • 2022-12-03，【智脉说】类脑认知引擎Braincog基础 第13期 用Braincog实现基于群体编码机制启发的符号表征与推理
  • 2022-12-12，【智脉说】类脑认知引擎Braincog基础 第14期 实现基于脉冲神经网络的多感觉融合概念学习
  • 2022-12-31，【智脉说】类脑认知智能引擎BrainCog基础 第15期 用Braincog实现基于脉冲神经网络的音乐记忆与创作模型
  • 2023-01-08，【智脉说】类脑认知智能引擎BrainCog基础 第16期 用Braincog实现基于脉冲神经网络的类脑身体自我感知模型
  • 2023-01-09，【智脉说】类脑认知智能引擎BrainCog基础 第17期 类脑心理揣测模型以及其在帮助其他智能体避免安全风险任务中的应用
  • 2023-01-18，类脑认知智能引擎“智脉BrainCog”半岁了：最新研究进展与研发社区建设
  • 2023-02-02，从认知脑的计算模拟到类脑人工智能
  • 2023-02-03，【智脉说】类脑认知智能引擎BrainCog基础 第18期 用BrainCog实现前额叶功能柱模型在工作记忆任务中的应用
  • 2023-02-09，【智脉说】类脑认知智能引擎BrainCog基础 第19期 用BrainCog实现多脑区协同的类脑情感共情脉冲神经网络
  • 2023-02-16，【智脉说】类脑认知智能引擎BrainCog基础 第20期 用BrainCog实现发育可塑性的脉冲神经网络自适应剪枝
  • 2023-02-25，【智脉说】类脑认知智能引擎BrainCog基础 第21期 用Braincog实现基于约束、剪枝和再生的脉冲神经网络动态结构发育
  • 2023-03-15，【智脉说】类脑认知智能引擎BrainCog基础 第22期 BrainCog数据引擎之时空序列数据N-Omniglot及其应用
  • 2023-03-23，【智脉说】类脑认知智能引擎BrainCog基础 第23期 用BrainCog实现用于目标检测和语义分割的脉冲神经网络
  • 2023-04-14，【智脉说】类脑认知智能引擎BrainCog基础 第24期 用BrainCog实现EventMix 针对DVS数据的增强策略
• 微信公众号「图灵人工智能」
  • 2023-05-06，神经科学的深度学习框架
• 微信公众号「蜂耘网」
  • 2024-04-19，类脑AI新时代——全球最大神经拟态系统诞生了！
• 微信公众号「量子位」
  • 2024-04-17，脑电合成自然语音！LeCun转发Nature子刊新成果，代码开源