torrent 🌊
torrent is a code notebook for the machine learning platform h2o-3. torrent combines code execution, text, mathematics, plots and rich media to build machine learning workflows.
torrent is written in es2015 Javascript. torrent uses the Pug templating engine (formerly known as Jade) to define HTML views and lay out pages. torrent uses the KnockoutJS Model-View-View-Model library for declarative data binding.
torrent contains a veritable heap of little embedded DSLs for reactive dataflow programming, markup generation, lazy evaluation and multicast signals/slots. torrent sandboxes and evaluates user-Javascript in the browser via static analysis and tree-rewriting. torrent's storytelling environment for exploratory data analysis & machine learning, features async, re-scriptable record/replay capabilities.
torrent is a fork of the h2o-flow project
install
-
git clone [email protected]:micahstubbs/torrent.git -
cd torrent -
npm run clone-h2o -
npm run build-h2o -
npm run start-h2o - visit http://localhost:54321 in Chrome
user guide
there is a nice user guide for h2o-flow housed over in the h2o-3 repo that describes many features also found in torrent
dev setup
clone h2o-3 and torrent in the same parent directory.
it is best to run h2o-3 in the Java IDE IntelliJ IDEA. This enables you the developer to see your changes to torrent in the browser immediately after you run the npm run build command, without waiting the 90+ secods to build a new h2o.jar binary and run java -jar h2o.jar to restart h2o-3.
inside of IntelliJ IDEA:
- clean up all previous built files:
cd h2o-3 && ./gradlew clean - open the h2o-3 directory in IDEA, then build and launch
H2OApp.java - Run
cd torrent
npm install
npm run build
to install torrent's dependencies and create the torrent bundle. you can now access and debug torrent at http://localhost:54321/
- after each change you make to the torrent source code, run the command
npm run build
to copy your changes to the instance of h2o-3 running locally inside of IDEA
further instructions for setting up the h2o-3 project in IntelliJ IDEA are here
testing a new torrent feature with Sparkling Water
torrent can also be used with Sparkling Water
follow this guide develop and test new Sparkling Water features in torrent.
adapted from the comments on this PR h2oai/h2o-flow#13
copy built js files from one place to another
in the h2o-3 directory run:
cp h2o-web/src/main/resources/www/flow/js/* h2o-web/lib/h2o-flow/build/js/
build h2o-3
in the h2o-3 directory run:
./gradlew publishToMavenLocal -x test
build sparkling water
in sparkling-water directory run:
./gradlew clean build -x test -x integTest
open the Sparkling Water Shell
in sparkling-water directory run:
bin/sparkling-shell
in the sparkling water shell
at the scala> prompt run:
import org.apache.spark.h2o._
H2OContext.getOrCreate(sc)
now open torrent at the IP address specified
in the sparkling water shell
now test your changes in torrent
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent