sandy4321 / fm_dmlc

Distributed FM and LR based on Rabit with Lbfgs

Distributed FM and LR based on Rabit

Portable, scalable and reliable distributed machine learning.

Wormhole is a place where DMLC projects works together to provide scalable and reliable machine learning toolkits that can run on various platforms

Since wormhole has been Deprecated, we retain some useful tools and keep updating

Features

• Portable:
  • Supported platforms: local machine, Apache YARN, MPI and Sungrid Engine
• Rich support of Data Source
  • All projects can read data from HDFS, S3 or local filesystem
• Scalable and Reliable

List of Tools

• Linear method: L-BFGS
• Factorization Machine based on Rabit: FM

Build & Run

• Requires a C++11 compiler (e.g.~g++ >=4.8) and git. Install them on Ubuntu >= 13.10

• cd dmlc-core; make to make dmlc core
  cd rabit; make to make rabit
  cd src/lbfgs-linear; make or cd src/lbfgs-fm; make