bentengma / real-time-network

real-time network architecture for mobile devices and semantic segmentation

Real-time network for mobile devices

Google

1. Learning Transferable Architectures for Scalable Image Recognition NASNet
2. MnasNet: Platform-Aware Neural Architecture Search for Mobile MnasNet
3. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications MobileNets
4. MobileNetV2: Inverted Residuals and Linear Bottlenecks MobileNetV2 MobileNetV2-pytorch
5. MorphNet: Fast & Simple Resource-Constrained Structure Learning of Deep Networks CVPR2018 code
6. Searching for MobileNetV3 MobileNetV3 unofficial implementation MobileNetV3-for-Segmentation official TF Repo
7. Efficient Net: Rethinking Model Scaling for Convolutional Neural Networks. ICML 2019 tfcode unofficial pytorch version
8. MixNet: Mixed Depthwise Convolutional Kernels BMVC2019 Official TF Repo Unofficial pytporch

Microsoft Research

1. Interleaved Group Convolutions for Deep Neural Networks IGCV
2. IGCV2: Interleaved Structured Sparse Convolutional Neural Networks IGCV2
3. IGCV3: Interleaved Low-Rank Group Convolutions for Efficient Deep Neural Networks IGCV3
4. Accelerating Deep Neural Networks with Spatial Bottleneck Modules arxiv2018

Facebook

1. Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution arxiv2019 unofficial implementation OctaveConv_pytorch OctaveConv_MXNet
2. FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search arxiv2018 code
3. ChamNet: Towards Efficient Network Design through Platform-Aware Model Adaptation arxiv2018 code
4. Hybrid Composition with IdleBlock: More Efficient Networks for Image Recognition arxiv2019

Megvill

1. ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices ShuffleNet
2. ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design ShuffleNet V2 Shufflenet-v2-Pytorch
3. ShuffleNetV2+：paper unrelease code ShuffleNet Series by Megvii Research

Others

1. CondenseNet: An Efficient DenseNet using Learned Group Convolutions CondenseNet
2. ANTNets: Mobile Convolutional Neural Networks for Resource Efficient Image Classification arxiv2019
3. Seesaw-Net: Convolution Neural Network With Uneven Group Convolution arxiv2019
4. ISBNet: Instance-aware Selective Branching Network arxiv2019
5. Multinomial Distribution Learning for Effective Neural Architecture Search arxiv2019 code
6. HGC: Hierarchical Group Convolution for Highcdly Efficient Neural Network arxiv2019
7. DiCENet: Dimension-wise Convolutions for Efficient Networks arxiv2019 code
8. Densely Connected Search Space for More Flexible Neural Architecture Search arxiv2019 code
9. VarGNet: Variable Group Convolutional Neural Network for Efficient Embedded Computing arxiv2019 Horizon Robotics
10. VarGFaceNet: An Efficient Variable Group Convolutional Neural Network for Lightweight Face Recognition VarGFaceNet code Horizon Robotics (1st place in The Lightweight Face Recognition Challenge & Workshop ICCV 2019)
11. Once for All: Train One Network and Specialize it for Efficient Deployment arxiv2019 MIT && MIT-IBM Watson AI Lab
12. LPRNet: Lightweight Deep Network by Low-rank Pointwise Residual Convolution arxiv2019
13. LeanConvNets: Low-cost Yet Effective Convolutional Neural Networks arxiv2019 Ben-Gurion University&&Emory Universit
14. DeepSquare: Boosting the Learning Power of Deep Convolutional Neural Networks with Elementwise Square Operators arxiv2019 ByteDance AI Lab
15. ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks arxiv2019 code Tianjin University

Semantic segmentation

1. ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation ENet

2. ICNet for Real-Time Semantic Segmentation on High-Resolution Images ICNet

3. Speeding up Semantic Segmentation for Autonomous Driving SQNet

4. ERFNet: Efficient Residual Factorized ConvNet for Real-time Semantic Segmentation ERFNet

5. ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation ESPNet

6. BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation ECCV2018 code

7. A Comparative Study of Real-time Semantic Segmentation for Autonomous Driving

8. Efficient Dense Modules of Asymmetric Convolution for Real-Time Semantic Segmentation EDANet

9. Light-Weight RefineNet for Real-Time Semantic Segmentation Light-Weight RefineNet

10. Searching for Efficient Multi-Scale Architectures for Dense Image Prediction

11. CGNet: A Light-weight Context Guided Network for Semantic Segmentation arxiv2018 code

12. ShelfNet for Real-time Semantic Segmentation arxiv2018 code

13. Concentrated-Comprehensive Convolutions for lightweight semantic segmentation arxiv2018

14. ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network cvpr2019 code

15. Fast-SCNN: Fast Semantic Segmentation Network arxiv2019 code blog

16. An efficient solution for semantic segmentation: ShuffleNet V2 with atrous separable convolutions arxiv2019

17. Decoders Matter for Semantic Segmentation: Data-Dependent Decoding Enables Flexible Feature Aggregation cvpr2019

18. DFANet: Deep Feature Aggregation for Real-Time Semantic Segmentation cvpr2019Megvii

19. Real time backbone for semantic segmentation arxiv2019

20. Residual Pyramid Learning for Single-Shot Semantic Segmentation arxiv2019

21. Knowledge Adaptation for Efficient Semantic Segmentation cvpr2019

22. In Defense of Pre-trained ImageNet Architectures for Real-time Semantic Segmentation of Road-driving Images cvpr2019 code

23. Towards Real-Time Automatic Portrait Matting on Mobile Devices arxiv2019 code

24. PortraitNet: Real-time Portrait Segmentation Network for Mobile Device Computers & Graphics 2019 code

25. Design of Real-time Semantic Segmentation Decoder for Automated Driving VISAPP2019

26. ThunderNet: A Turbo Unified Network for Real-Time Semantic Segmentation WACV2019

27. LEDNet: A Lightweight Encoder-Decoder Network for Real-time Semantic Segmentation ICIP2019 code

28. Accurate Facial Image Parsing at Real-Time Speed TIP2019

29. Efficient Ladder-style DenseNets for Semantic Segmentation of Large Images arxiv2019

30. Nail Polish Try-On: Realtime Semantic Segmentation of Small Objects forNative and Browser Smartphone AR Applications CVPRW2019

31. ESNet: An Efficient Symmetric Network for Real-time Semantic Segmentation arxiv2019 code

32. Real-time Hair Segmentation and Recoloring on Mobile GPUs 2019CVPRW

33. Efficient Segmentation: Learning Downsampling Near Semantic Boundaries arxiv2019

34. Multi-Class Lane Semantic Segmentation using Efficient Convolutional Networks MMSP 2019

35. A Comparative Study of High-Recall Real-Time Semantic Segmentation Based on Swift Factorized Network SPIE Security + Defence 2019 code

36. Context-Integrated and Feature-Refined Network for Lightweight Urban Scene Parsing arxiv2019

37. DABNet: Depth-wise Asymmetric Bottleneck for Real-time Semantic Segmentation BMVC2019 code

38. Learning Lightweight Lane Detection CNNs by Self Attention Distillation ICCV2019 torchRepo

39. SqueezeNAS: Fast neural architecture search for faster semantic segmentation arxiv2019 code submitted to ICCV Neural Architects workshop

40. ExtremeC3Net: Extreme Lightweight Portrait Segmentation Networks using Advanced C3-modules arxiv2019 Seoul National University && Clova AI, NAVER Corp

41. Customizable Architecture Search for Semantic Segmentation cvpr2019 University of Science and Technology of China && JD AI Research

42. See More than Once – Kernel-Sharing Atrous Convolution for Semantic Segmentation arxiv2019 University of Technology Sydney && East China Normal University

43. Feature Pyramid Encoding Network for Real-time Semantic Segmentation BMVC2019 The University of Manchester

44. Graph-guided Architecture Search for Real-time Semantic Segmentation arxiv2019 SenseTime Research && Zhejiang University

45. Eye Semantic Segmentation with a Lightweight Model ICCVW 2019 code Chonnam National University

46. FDDWNet: A Lightweight Convolutional Neural Network for Real-time Sementic Segmentation arxiv2019 Nanjing University of Posts & Telecommunications

47. Real-Time Semantic Segmentation via Multiply Spatial Fusion Network arxiv2019 Beihang University &&Megvii Technology&&Peng Cheng Laboratory

Instance Segmentation

1. YOLACT: Real-time Instance Segmentation ICCV2019 code University of California, Davis
2. CenterMask:Real-Time Anchor-Free Instance Segmentation VovnetV2 ETRI

Object detection

1. An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detection CVPR2019 CEFRL Workshop VOVNetPytorch ETRI
2. EfficientDet: Scalable and Efficient Object Detection arxiv2019 Google Research, Brain Team
3. RefineDetLite: A Lightweight One-stage Object Detection Framework for CPU-only Devices arxiv2019 Tencent Research&&HKUST
4. Learning Spatial Fusion for Single-Shot Object Detection arxiv2019 yolov3+ Beihang University
5. CSPNet: A New Backbone that can Enhance Learning Capability of CNN arxiv2019 CSPNet research teams from TaiWan

Neural Architecture Search

1. PC-DARTS: Partial Channel Connections for Memory-Efficient Differentiable Architecture Search arxiv2019 code Shanghai Jiao Tong University&&Huawei
2. Densely Connected Search Space for More Flexible Neural Architecture Search arxiv2019 code Huazhong University of Science and Technology &&Horizon Robotics
3. FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search arxiv2019 code Xiaomi AI Lab
4. XferNAS: Transfer Neural Architecture Search arxiv2019 IBM Research
5. AutoML: A Survey of the State-of-the-Art arxiv2019 Hong Kong Baptist University
6. MoGA: Searching Beyond MobileNetV3 arxiv2019 code Xiaomi AI Lab
7. ScarletNAS: Bridging the Gap Between Scalability and Fairness in Neural Architecture Search arxiv2019 code Xiaomi AI Lab && IoT
8. BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Search arxiv code blog
9. Fast and Practical Neural Architecture Search iccv2019 CUHK && YouTu Lab, Tencent
10. Fair DARTS: Eliminating Unfair Advantages in Differentiable Architecture Search arxiv2019 FairDARTS Xiaomi AI Lab &&Minzu University of China

Tricks for training neural network

1. A Recipe for Training Neural Networks (Apr 25, 2019)
2. Improving deep learning models with bag of tricks (Dec 13,2018)
3. A Bag of Tricks for Image Classification (Dec 17, 2018)
4. Bag of Tricks for Image Classification with Convolutional Neural Networks cvpr2019 code
5. Bag of Freebies for Training Object Detection Neural Networks arxiv2019 code

Some useful links

1. Awesome-model-compression-and-acceleration
2. awesome-model-compression-and-acceleration
3. Model-Compression-Papers
4. Awesome-model-compression-and-acceleration
5. awesome-AutoML-and-Lightweight-Models
6. 常用的语义分割架构结构综述以及代码复现
7. Efficient-Segmentation-Networks

Some blogs

1. Real-time Portrait Segmentation on Smartphones
2. Mobile Real-time Video Segmentation
3. Real-Time deep learning in mobile application
4. QNNPACK: Open source library for optimized mobile deep learning
5. 第十七章 模型压缩及移动端部署
6. Tips for building fast portrait segmentation network with TensorFlow Lite
7. $\color{red}{*}$ Literature On Neural network architecture
8. A 2019 Guide to Semantic Segmentation
9. Semantic Segmentation

Some projects

1. Real-Time Video Segmentation on Mobile Devices
2. LightNet++: Boosted Light-weighted Networks for Real-time Semantic Segmentation
3. mobile_phone_human_matting
4. Real-Time Semantic Segmentation in Mobile device
5. Semantic Segmentation on PyTorch
6. Lightweight-Segmentation
7. A PyTorch-Based Framework for Deep Learning in Computer Vision
8. A high performance semantic segmentation toolkit based on PaddlePaddle
9. PyTorch image models, scripts, pretrained weights