Parallel Prediction? about docextractor

[monniert]

Hi there, sorry for the late reply and thanks for the interest in the project :)

Sadly no, there is no support for multi-processing, but it should be easy to do using standard torch/python multiprocessing routines. Launching multiple threads on a single GPU is the most straightforward way to do (see https://docs.python.org/3/library/multiprocessing.html) and you should be able to fit 3-4 forward pass simultaneously. Another (much cleaner) way is to perform the segmentation predictions by batch of images: this would require a bit more work to rewrite the for loop on images into a for loop on batchs and adapt the segmentation prediction function

Let me know if you have any trouble, thanks!
Tom