julianfp / project-w-runner

This is the code for the runners running the whisper jobs themselves which are managed by the project W flask backend

Welcome to project-W-runner

Installation

The Python package project_W_runner can be installed from PyPI:

python -m pip install project_W_runner

Development installation

If you want to contribute to the development of project_W_runner, we recommend the following editable installation from this repository:

git clone [email protected]:JulianFP/project-W-runner.git
cd project-W-runner
python -m pip install --editable .[tests]

Having done so, the test suite can be run using pytest:

python -m pytest

Acknowledgments

This repository was set up using the SSC Cookiecutter for Python Packages.

project-w-runner's Issues

Report the runner version to the backend

This allows the frontend to transparently display what version of the runner executes the job.

Docker setup with GPU support

The current Docker setups limits us to run on a CPU.

Add a runner mode that allows job submissions into a cluster

Most likely, this requires a refactoring that introduces an abstraction layer for "job execution". Based on this an executor that submits to e.g. a SLURM cluster can be implemented. Allows cross-use of HPC resources at facilities.