Real-time network for mobile devices

Google

1. Learning Transferable Architectures for Scalable Image Recognition NASNet
2. MnasNet: Platform-Aware Neural Architecture Search for Mobile MnasNet
3. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications MobileNets
4. MobileNetV2: Inverted Residuals and Linear Bottlenecks MobileNetV2 MobileNetV2-pytorch
5. MorphNet: Fast & Simple Resource-Constrained Structure Learning of Deep Networks CVPR2018 code
6. Searching for MobileNetV3 MobileNetV3 unofficial implementation MobileNetV3-for-Segmentation
7. Efficient Net: Rethinking Model Scaling for Convolutional Neural Networks. ICML 2019 tfcode unofficial pytorch version

Microsoft Research

1. Interleaved Group Convolutions for Deep Neural Networks IGCV
2. IGCV2: Interleaved Structured Sparse Convolutional Neural Networks IGCV2
3. IGCV3: Interleaved Low-Rank Group Convolutions for Efficient Deep Neural Networks IGCV3
4. Accelerating Deep Neural Networks with Spatial Bottleneck Modules arxiv2018

Facebook

1. Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution arxiv2019 unofficial implementation OctaveConv_pytorch OctaveConv_MXNet

2. FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search arxiv2018 code

3. ChamNet: Towards Efficient Network Design through Platform-Aware Model Adaptation arxiv2018 code

Megvill

1. ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices ShuffleNet
2. ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design ShuffleNet V2 Shufflenet-v2-Pytorch

Others

1. CondenseNet: An Efficient DenseNet using Learned Group Convolutions CondenseNet
2. ANTNets: Mobile Convolutional Neural Networks for Resource Efficient Image Classification arxiv2019
3. Seesaw-Net: Convolution Neural Network With Uneven Group Convolution arxiv2019
4. ISBNet: Instance-aware Selective Branching Network arxiv2019
5. Multinomial Distribution Learning for Effective Neural Architecture Search arxiv2019 code
6. HGC: Hierarchical Group Convolution for Highly Efficient Neural Network arxiv2019
7. DiCENet: Dimension-wise Convolutions for Efficient Networks arxiv2019 code
8. Densely Connected Search Space for More Flexible Neural Architecture Search arxiv2019 code

Especially for semantic segmentation

1. ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation ENet
2. ICNet for Real-Time Semantic Segmentation on High-Resolution Images ICNet
3. Speeding up Semantic Segmentation for Autonomous Driving SQNet
4. ERFNet: Efficient Residual Factorized ConvNet for Real-time Semantic Segmentation ERFNet
5. ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation ESPNet
6. BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation ECCV2018 code
7. A Comparative Study of Real-time Semantic Segmentation for Autonomous Driving
8. Efficient Dense Modules of Asymmetric Convolution for Real-Time Semantic Segmentation EDANet
9. Light-Weight RefineNet for Real-Time Semantic Segmentation Light-Weight RefineNet
10. Searching for Efficient Multi-Scale Architectures for Dense Image Prediction
11. CGNet: A Light-weight Context Guided Network for Semantic Segmentation arxiv2018 code
12. ShelfNet for Real-time Semantic Segmentation arxiv2018 code
13. Concentrated-Comprehensive Convolutions for lightweight semantic segmentation arxiv2018
14. ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network arxiv2018 code
15. Fast-SCNN: Fast Semantic Segmentation Network arxiv2019 code blog
16. An efficient solution for semantic segmentation: ShuffleNet V2 with atrous separable convolutions arxiv2019
17. Decoders Matter for Semantic Segmentation: Data-Dependent Decoding Enables Flexible Feature Aggregation cvpr2019
18. DFANet: Deep Feature Aggregation for Real-Time Semantic Segmentation cvpr2019Megvii
19. Real time backbone for semantic segmentation arxiv2019
20. Residual Pyramid Learning for Single-Shot Semantic Segmentation arxiv2019
21. Knowledge Adaptation for Efficient Semantic Segmentation cvpr2019
22. In Defense of Pre-trained ImageNet Architectures for Real-time Semantic Segmentation of Road-driving Imagescvpr2019 code
23. Towards Real-Time Automatic Portrait Matting on Mobile Devices arxiv2019 code
24. PortraitNet: Real-time Portrait Segmentation Network for Mobile Device Computers & Graphics 2019 code
25. Design of Real-time Semantic Segmentation Decoder for Automated Driving VISAPP2019
26. ThunderNet: A Turbo Unified Network for Real-Time Semantic Segmentation WACV2019
27. LEDNet: A Lightweight Encoder-Decoder Network for Real-time Semantic Segmentation ICIP2019 code
28. Accurate Facial Image Parsing at Real-Time Speed TIP2019
29. Efficient Ladder-style DenseNets for Semantic Segmentation of Large Images arxiv2019
30. Nail Polish Try-On: Realtime Semantic Segmentation of Small Objects forNative and Browser Smartphone AR Applications CVPRW2019
31. ESNet: An Efficient Symmetric Network for Real-time Semantic Segmentation arxiv2019 code

Tricks for training neural network

1. A Recipe for Training Neural Networks (Apr 25, 2019)
2. Improving deep learning models with bag of tricks (Dec 13,2018)
3. A Bag of Tricks for Image Classification (Dec 17, 2018)
4. Bag of Tricks for Image Classification with Convolutional Neural Networks cvpr2019 code
5. Bag of Freebies for Training Object Detection Neural Networks arxiv2019 code

Some useful links

1. Awesome-model-compression-and-acceleration
2. awesome-model-compression-and-acceleration
3. Model-Compression-Papers
4. Awesome-model-compression-and-acceleration
5. awesome-AutoML-and-Lightweight-Models

Some blogs

1. Real-time Portrait Segmentation on Smartphones
2. Mobile Real-time Video Segmentation
3. Real-Time deep learning in mobile application
4. QNNPACK: Open source library for optimized mobile deep learning
5. 第十七章 模型压缩及移动端部署
6. Tips for building fast portrait segmentation network with TensorFlow Lite

Some projects

1. Real-Time Video Segmentation on Mobile Devices
2. LightNet++: Boosted Light-weighted Networks for Real-time Semantic Segmentation
3. mobile_phone_human_matting
4. Real-Time Semantic Segmentation in Mobile device

Some inference framework

1. TensorFlow Lite
2. caffe2
3. Tencent/ncnn
4. XiaoMi/mace
5. alibaba/MNN

Some researcher

1. SongHan
2. JingdongWang