dreadlord1984 / real-time-network

real-time network architecture for mobile devices and semantic segmentation

Real-time network for mobile devices

Google

1. Learning Transferable Architectures for Scalable Image Recognition NASNet
2. MnasNet: Platform-Aware Neural Architecture Search for Mobile MnasNet
3. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications MobileNets
4. MobileNetV2: Inverted Residuals and Linear Bottlenecks MobileNetV2 MobileNetV2-pytorch
5. MorphNet: Fast & Simple Resource-Constrained Structure Learning of Deep Networks CVPR2018 code
6. Searching for MobileNetV3 MobileNetV3 unofficial implementation MobileNetV3-for-Segmentation
7. Efficient Net: Rethinking Model Scaling for Convolutional Neural Networks. ICML 2019 tfcode unofficial pytorch version
8. MixNet: Mixed Depthwise Convolutional Kernels BMVC2019 Official TF Repo Unofficial pytporch

Microsoft Research

1. Interleaved Group Convolutions for Deep Neural Networks IGCV
2. IGCV2: Interleaved Structured Sparse Convolutional Neural Networks IGCV2
3. IGCV3: Interleaved Low-Rank Group Convolutions for Efficient Deep Neural Networks IGCV3
4. Accelerating Deep Neural Networks with Spatial Bottleneck Modules arxiv2018

Facebook

1. Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution arxiv2019 unofficial implementation OctaveConv_pytorch OctaveConv_MXNet

2. FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search arxiv2018 code

3. ChamNet: Towards Efficient Network Design through Platform-Aware Model Adaptation arxiv2018 code

Megvill

1. ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices ShuffleNet
2. ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design ShuffleNet V2 Shufflenet-v2-Pytorch

Others

1. CondenseNet: An Efficient DenseNet using Learned Group Convolutions CondenseNet
2. ANTNets: Mobile Convolutional Neural Networks for Resource Efficient Image Classification arxiv2019
3. Seesaw-Net: Convolution Neural Network With Uneven Group Convolution arxiv2019
4. ISBNet: Instance-aware Selective Branching Network arxiv2019
5. Multinomial Distribution Learning for Effective Neural Architecture Search arxiv2019 code
6. HGC: Hierarchical Group Convolution for Highcdly Efficient Neural Network arxiv2019
7. DiCENet: Dimension-wise Convolutions for Efficient Networks arxiv2019 code
8. Densely Connected Search Space for More Flexible Neural Architecture Search arxiv2019 code
9. VarGNet: Variable Group Convolutional Neural Network for Efficient Embedded Computing arxiv2019 Horizon Robotics

Especially for semantic segmentation

1. ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation ENet
2. ICNet for Real-Time Semantic Segmentation on High-Resolution Images ICNet
3. Speeding up Semantic Segmentation for Autonomous Driving SQNet
4. ERFNet: Efficient Residual Factorized ConvNet for Real-time Semantic Segmentation ERFNet
5. ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation ESPNet
6. BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation ECCV2018 code
7. A Comparative Study of Real-time Semantic Segmentation for Autonomous Driving
8. Efficient Dense Modules of Asymmetric Convolution for Real-Time Semantic Segmentation EDANet
9. Light-Weight RefineNet for Real-Time Semantic Segmentation Light-Weight RefineNet
10. Searching for Efficient Multi-Scale Architectures for Dense Image Prediction
11. CGNet: A Light-weight Context Guided Network for Semantic Segmentation arxiv2018 code
12. ShelfNet for Real-time Semantic Segmentation arxiv2018 code
13. Concentrated-Comprehensive Convolutions for lightweight semantic segmentation arxiv2018
14. ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network arxiv2018 code
15. Fast-SCNN: Fast Semantic Segmentation Network arxiv2019 code blog
16. An efficient solution for semantic segmentation: ShuffleNet V2 with atrous separable convolutions arxiv2019
17. Decoders Matter for Semantic Segmentation: Data-Dependent Decoding Enables Flexible Feature Aggregation cvpr2019
18. DFANet: Deep Feature Aggregation for Real-Time Semantic Segmentation cvpr2019Megvii
19. Real time backbone for semantic segmentation arxiv2019
20. Residual Pyramid Learning for Single-Shot Semantic Segmentation arxiv2019
21. Knowledge Adaptation for Efficient Semantic Segmentation cvpr2019
22. In Defense of Pre-trained ImageNet Architectures for Real-time Semantic Segmentation of Road-driving Images cvpr2019 code
23. Towards Real-Time Automatic Portrait Matting on Mobile Devices arxiv2019 code
24. PortraitNet: Real-time Portrait Segmentation Network for Mobile Device Computers & Graphics 2019 code
25. Design of Real-time Semantic Segmentation Decoder for Automated Driving VISAPP2019
26. ThunderNet: A Turbo Unified Network for Real-Time Semantic Segmentation WACV2019
27. LEDNet: A Lightweight Encoder-Decoder Network for Real-time Semantic Segmentation ICIP2019 code
28. Accurate Facial Image Parsing at Real-Time Speed TIP2019
29. Efficient Ladder-style DenseNets for Semantic Segmentation of Large Images arxiv2019
30. Nail Polish Try-On: Realtime Semantic Segmentation of Small Objects forNative and Browser Smartphone AR Applications CVPRW2019
31. ESNet: An Efficient Symmetric Network for Real-time Semantic Segmentation arxiv2019 code
32. Real-time Hair Segmentation and Recoloring on Mobile GPUs 2019CVPRW
33. Efficient Segmentation: Learning Downsampling Near Semantic Boundaries arxiv2019
34. Multi-Class Lane Semantic Segmentation using Efficient Convolutional Networks MMSP 2019
35. A Comparative Study of High-Recall Real-Time Semantic Segmentation Based on Swift Factorized Network SPIE Security + Defence 2019 code
36. Context-Integrated and Feature-Refined Network for Lightweight Urban Scene Parsing arxiv2019
37. DABNet: Depth-wise Asymmetric Bottleneck for Real-time Semantic Segmentation BMVC2019 code
38. Learning Lightweight Lane Detection CNNs by Self Attention Distillation ICCV2019 torchRepo
39. SqueezeNAS: Fast neural architecture search for faster semantic segmentation arxiv2019 submitted to ICCV Neural Architects workshop
40. ExtremeC3Net: Extreme Lightweight Portrait Segmentation Networks using Advanced C3-modules arxiv2019 Seoul National University && Clova AI, NAVER Corp

Neural Architecture Search

1. PC-DARTS: Partial Channel Connections for Memory-Efficient Differentiable Architecture Search arxiv2019 code Shanghai Jiao Tong University&&Huawei
2. Densely Connected Search Space for More Flexible Neural Architecture Search arxiv2019 code Huazhong University of Science and Technology &&Horizon Robotics
3. FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search arxiv2019 code Xiaomi AI Lab
4. XferNAS: Transfer Neural Architecture Search arxiv2019 IBM Research
5. AutoML: A Survey of the State-of-the-Art arxiv2019 Hong Kong Baptist University
6. MoGA: Searching Beyond MobileNetV3 arxiv2019 code Xiaomi AI Lab

Tricks for training neural network

1. A Recipe for Training Neural Networks (Apr 25, 2019)
2. Improving deep learning models with bag of tricks (Dec 13,2018)
3. A Bag of Tricks for Image Classification (Dec 17, 2018)
4. Bag of Tricks for Image Classification with Convolutional Neural Networks cvpr2019 code
5. Bag of Freebies for Training Object Detection Neural Networks arxiv2019 code

Some useful links

1. Awesome-model-compression-and-acceleration
2. awesome-model-compression-and-acceleration
3. Model-Compression-Papers
4. Awesome-model-compression-and-acceleration
5. awesome-AutoML-and-Lightweight-Models
6. 常用的语义分割架构结构综述以及代码复现

Some blogs

1. Real-time Portrait Segmentation on Smartphones
2. Mobile Real-time Video Segmentation
3. Real-Time deep learning in mobile application
4. QNNPACK: Open source library for optimized mobile deep learning
5. 第十七章 模型压缩及移动端部署
6. Tips for building fast portrait segmentation network with TensorFlow Lite
7. $\color{red}{*}$ Literature On Neural network architecture
8. A 2019 Guide to Semantic Segmentation

Some projects

1. Real-Time Video Segmentation on Mobile Devices
2. LightNet++: Boosted Light-weighted Networks for Real-time Semantic Segmentation
3. mobile_phone_human_matting
4. Real-Time Semantic Segmentation in Mobile device
5. Semantic Segmentation on PyTorch
6. Lightweight-Segmentation

Some inference framework

1. TensorFlow Lite
2. caffe2
3. Tencent/ncnn
4. XiaoMi/mace
5. alibaba/MNN

Some researcher

1. SongHan
2. JingdongWang