GithubHelp home page GithubHelp logo

syberia's Introduction

Syberia is the development framework for R.

Syberia was developed at Avant to serve as the framework for developing and deploying machine learning models. The goal was to develop a modeling engine capable of solving academic, research and business problems that require use of statistical methods.

The modeling grammar, currently the main significant engine built in Syberia, is a framework for building, debugging, testing, and deploying classifiers developed in R. It provides an opinionated unified framework for fast iteration on model development and deployment. It has modularity and testability built in as a design assumption, is founded on convention-over-configuration, and aims to solve the problems of classifier-specific data preparation and classifier-specific modeling parameters.

The more general vision for Syberia is still in progress but aims to bring unity to the currently disparate realms of the R development ecosystem. In the viewpoint of the author, R is syntactic sugar around LISP, which enables arbitrary computation; Syberia is an attempt to support this conjecture by allowing the construction of arbitrary software projects within the R programming language, thereby finally outgrowing its long-overdue misconception as a statistical tool.

The timeline for future engines and information about how to contribute is listed at the Syberia roadmap.

Installation

To get started right away, try out the minimal example syberia project:

# Run this from your command line terminal.
git clone [email protected]:syberia/example.sy.git && cd example.sy && R

This will open an R console (installing dependencies for the first time may take a while; for troubleshooting see the troubleshooting guide). You can then type:

run("example1")
model$predict(iris[1:5, ]) # The first five scores from a trained classifier.
# [1] 5.005686 4.757667 4.773923 4.890092 5.055138

For more detailed instructions, see the installation guide.

Minimal syberia example

(Example generated using ttygif.)

Packages

Syberia relies on the following supplemental packages:

Name Status
Mungebits2 Build Status Coverage Status Documentation Documentation License: MIT
Stagerunner Build Status Coverage Status Documentation Documentation License: MIT
Tundra Build Status Coverage Status Documentation Documentation License: MIT
Director Build Status Coverage Status Documentation Documentation License: MIT

Additional packages used internally at Avant in conjunction with Syberia modeling projects include batchman, bettertrace, cachemeifyoucan, dokk, lockbox, microserver, objectdiff, Ramd, rocco, s3mpi, testthatsomemore, and treeskeleton.

Engines

Syberia is currently released with the following engines.

Name Status Description
Base Build Status The base engine that defines routes and controllers.
Modeling Build Status The modeling engine for deploying structured learning problems.
Example Build Status The hello world of modeling projects. Can be used for new projects.
Examples Build Status Some examples from Kaggle and other sources in Syberia.

Development

To run the tests for the Syberia package, you will have to check out its git submodules.

git submodule update --init --recursive

This will pull in inst/engines/base.sy from the base engine.

License

This project is licensed under the MIT License:

Copyright (c) 2014-2017 Robert Krzyzanowski

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Authors

Syberia was originally created at Avant by Robert Krzyzanowski, [email protected]. Additional contributors include Peter Hurford, Kirill Sevastyanenko, Tong Lu, Abel Castillo, and others.

syberia's People

Contributors

frenchja avatar kirillseva avatar peterhurford avatar robertzk avatar rylandely avatar tonglu avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

syberia's Issues

Better "syberia new"

Really a shortcut for "syberia new application". Then we can have "syberia new server", "syberia new package", "syberia new dashboard" etc for the other project types.

Issue w/ Setup & Install Deps

I'm attempting to setup syberia following the instructions in the readme and have encountered a few failures.

The first error was about not having memoise installed. I resolved this by installing the package manually install.packages("memoise").

I then restarted R to give it a chance to re-init the deps. It's now stuck at install the syberia package:

...
Using tundra 0.3.0.9000 
Installing syberia 0.6.1.9009 from github 
* installing *source* packagesyberia...
** R
** inst
** preparing package for lazy loading
** help
*** installing help indices
** building package indices
** testing if installed package can be loaded
Installing package into/Users/jmcgin83/.R/lockbox/.staging’
(aslibis unspecified)
Error : .onAttach failed in attachNamespace() for 'syberia', details:
  call: contrib.url(repos, type)
  error: trying to use CRAN without setting a mirror
Error: loading failed
Execution halted
ERROR: loading failed
* removing/Users/jmcgin83/.R/lockbox/.staging/syberia* installing *source* packagesyberia...
** R
** inst
** preparing package for lazy loading
** help
*** installing help indices
** building package indices
** testing if installed package can be loaded
Installing package into/Users/jmcgin83/.R/lockbox/.staging’
(aslibis unspecified)
Error : .onAttach failed in attachNamespace() for 'syberia', details:
  call: contrib.url(repos, type)
  error: trying to use CRAN without setting a mirror
Error: loading failed
Execution halted
ERROR: loading failed
* removing/Users/jmcgin83/.R/lockbox/.staging/syberiaError in install_locked_package(locked_package) : 
  Must have installed the package syberia of version0.6.1.9009

@robertzk @abelcastilloavant Any ideas here?

404: not found

when I try to install syberia with

devtools::install_github("syberia/syberia@install")

this is what i get

Downloading GitHub repo syberia/syberia@install
from URL https://api.github.com/repos/syberia/syberia/zipball/install
Installation failed: 404: Not Found
 (404)

Print a nice error when test config includes non-existing optional tests.

> test_project()
Error in test_environment_configuration(engine, config)[[value]] :
  subscript out of bounds
In package syberia: test_project()
In /Users/robertk/.R/.syberia/engines/github/syberia/modeling.sy/master/config/global/modeling/modeling.R:47: syberia::test_engine(...)
In package base: force(ignored_tests)
In package syberia: ignored_tests_from_config(engine, base, config)
In package base: file.path(base, value_from_config(engine, config, "ignored_tests") %||%      character(0))
In package syberia: value_from_config(engine, config, "ignored_tests") %||% character(0)
In package syberia: value_from_config(engine, config, "ignored_tests")

Error:
  subscript out of bounds

The result of running test_project() when optional_tests <- c("models") in config/environments/test.R but models does not exist.

Solve dependency management

Maybe syberia_project can auto-bootstrap a new search path altogether? Then you can global() to return to the global environment, but what happens in a syberia project stays in a syberia project! Can use "syberia console" and a simple Thor gem to load R with the special syberia project's search path.

Error in read.dcf(file.path(pkg_path, "DESCRIPTION")) :

installing via 'install.libs.R' to C:/Users/topnet/Documents/.R/lockbox/.staging/stringi
** R
** inst
** preparing package for lazy loading
** help
*** installing help indices
** building package indices
** testing if installed package can be loaded
*** arch - i386
*** arch - x64

  • DONE (stringi)
    Error in read.dcf(file.path(pkg_path, "DESCRIPTION")) :

Support .syberia file

With entry = application, package, or server. Then one can use Syberia to write all of the above.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.