Vision Transformer-Based Hand Gesture Recognition with HD-sEMG Signals

• This is the code for a Vision Transformer (ViT) that is designed for gesture recognition with 3D High-Desnity sEMG (HD-sEMG) signals.

• The code is written in PyTorch.

• For detailed explanation please refer to one of the following papers:

  1. Montazerin, M., Rahimian, E., Naderkhani, F. et al. Transformer-based hand gesture recognition from instantaneous to fused neural decomposition of high-density EMG signals. Sci Rep 13, 11000 (2023). Link
  2. M. Montazerin, E. Rahimian, F. Naderkhani, S. F. Atashzar, H. Alinejad-Rokny and A. Mohammadi, "HYDRA-HGR: A Hybrid Transformer-Based Architecture for Fusion of Macroscopic and Microscopic Neural Drive Information," ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1-5. Link
  3. M. Montazerin, S. Zabihi, E. Rahimian, A. Mohammadi and F. Naderkhani, "ViT-HGR: Vision Transformer-based Hand Gesture Recognition from High Density Surface EMG Signals," 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pp. 5115-5119. Link