udftd / mxnet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

for Deep Learning

MXNet is a deep learning framework designed for both efficiency and flexibility. It allows you to mix the flavours of symbolic programming and imperative programming to maximize efficiency and productivity. In its core, a dynamic dependency scheduler that automatically parallelizes both symbolic and imperative operations on the fly. A graph optimization layer on top of that makes symbolic execution fast and memory efficient. The library is portable and lightweight, and it scales to multiple GPUs and multiple machines.

MXNet is also more than a deep learning project. It is also a collection of blue prints and guidelines for building deep learning system, and interesting insights of DL systems for hackers.

What's New

• MXNet Memory Monger, Training Deeper Nets with Sublinear Memory Cost
• Tutorial for NVidia GTC 2016
• Embedding Torch layers and functions in MXNet
• MXNet.js: Javascript Package for Deep Learning in Browser (without server)
• Design Note: Design Efficient Deep Learning Data Loading Module
• MXNet on Mobile Device
• Distributed Training
• Guide to Creating New Operators (Layers)
• Amalgamation and Go Binding for Predictors
• Training Deep Net on 14 Million Images on A Single Machine

Contents

• Documentation and Tutorials
• Design Notes
• Code Examples
• Installation
• Pretrained Models
• Contribute to MXNet
• Frequent Asked Questions

Features

• Design notes providing useful insights that can re-used by other DL projects
• Flexible configuration for arbitrary computation graph
• Mix and match good flavours of programming to maximize flexibility and efficiency
• Lightweight, memory efficient and portable to smart devices
• Scales up to multi GPUs and distributed setting with auto parallelism
• Support for python, R, C++ and Julia
• Cloud-friendly and directly compatible with S3, HDFS, and Azure

Ask Questions

• Please use mxnet/issues for how to use mxnet and reporting bugs

License

© Contributors, 2015. Licensed under an Apache-2.0 license.

Reference Paper

Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems. In Neural Information Processing Systems, Workshop on Machine Learning Systems, 2015

History

MXNet is initiated and designed in collaboration by the authors of cxxnet, minerva and purine2. The project reflects what we have learnt from the past projects. It combines important flavours of the existing projects for efficiency, flexibility and memory efficiency.