Dynamic Convolutions - DynConv
Pytorch code for DynConv. DynConv applies convolutions on important regions of the image only, and thus reduces the computational cost while speeding up inference up to 2 times.
Dynamic Convolutions: Exploiting Spatial Sparsity for Faster Inference
Thomas Verelst and Tinne Tuytelaars
Note that our work consists of two parts:
- a mechanism to train spatial hard-attention masks using the Gumbel-Softmax trick
- a method to efficiently execute sparse operations (currently for 3x3 depthwise convolution only)
The first point is demonstrated on both classification and human pose estimation, the second point only on human pose estimation.
- ResNet on CIFAR-10 and ImageNet (only masks, no efficient CUDA implementation for simplicity)
Human Pose Estimation
- Stacked Hourglass on MPII - with fast CUDA implementation of DynConv for depthwise convolutions of the MobileNetV2 residual block
- Classification with efficient sparse MobileNetV2