parallel job processor using multiprocessing
The example script pi_estimation.py
is an illustration of the usage of janus. Its use is shown in the video here.
Janus consists of the concepts of a job, a job group, a parallel job processor and other associated ideas. Essentially, jobs consist of a function and its arguments and a job group is a group of such jobs. The parallel job processor uses multiprocessing to run the jobs in separate, parallel processes and manages results and exceptions.
Below is a non-exhaustive illustration of janus.
Janus uses pickle for Python object serialisation. Changing to dill is under consideration.