GithubHelp home page GithubHelp logo

tkp-archive / paperboy Goto Github PK

View Code? Open in Web Editor NEW
249.0 8.0 26.0 12.84 MB

A web frontend for scheduling Jupyter notebook reports

License: Apache License 2.0

Python 69.32% CSS 5.48% HTML 1.59% TypeScript 21.89% Smarty 1.39% Shell 0.16% JavaScript 0.18%
jupyter jupyterlab jupyter-notebooks papermill nteract airflow apache-airflow phosphorjs dask scheduling-notebooks

paperboy's People

Contributors

beacham63 avatar blink1073 avatar timkpaine avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

paperboy's Issues

Simplify UI

  • remove search functionality
  • revamp left sidebar/omit

Airflow integration

Configuration

  • start time/date
  • interval

Integration

  • permissions
  • notifications
  • status

Notes

  • DAG corresponds to job
  • leaf node for every report
  • "collectors" should grab outputs of report runs and dump them into report db

Autocomplete issues

  • Notebook autocomplete in reports tab doesn't show datalist #6
  • clicking on the result in the datalist doesn't hide the datalist #1

Output: Run

core

  • dokku launcher operator
  • voila launcher operator
  • modifications to paperboy airflow template

later

  • reverse proxy through paperboy

Airflow enhancements

  • permission through paperboy auth (flask-login)
  • integrate failure notifications
  • integrate enable/disable through paperboy UI
  • propagate job deletion
    • rm job
    • airflow delete_dag
  • propagate report/Param editing (just rewrite DAG?)
  • add airflow-worker to remove requirement that airflow run in same location as paperboy #23
  • propagate notebook deletion to DAG deletion (cascade will delete job)

Install and setup guide

Hi,

I am looking for papermill notebook executing web front end solution.
Paperboy looks like perfect matching with my requirements.

So, I need your help for basic testing with install and setup guide.

I have clone your project and installed python and js packages, build and installed with Makefile.
Started the server with 'make run' and accessible from browser.

I have problem with below log:
CRITICAL:root:list : <class 'paperboy.storage.sqla.models.notebook.NotebookSQL'>, result : 3 - 3
CRITICAL:root:list : <class 'paperboy.storage.sqla.models.job.JobSQL'>, result : 0 - 0
CRITICAL:root:list : <class 'paperboy.storage.sqla.models.report.ReportSQL'>, result : 0 - 0
CRITICAL:root:list : <class 'paperboy.storage.sqla.models.notebook.NotebookSQL'>, result : 3 - 3
'AirflowScheduler' object has no attribute 'engine'
'AirflowScheduler' object has no attribute 'engine'
'AirflowScheduler' object has no attribute 'engine'
'AirflowScheduler' object has no attribute 'engine'

Getting Started file might not be ready at the docs directory.

Could you give me some idea what I have missed, or where I can find any introduction file ?

Thanks

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.