Use ConvLSTM on multiple GPUs about convlstm

[viorik]

Hi @LeonardKnuth,
Could you post a simple model that you are trying to train? I haven't used it on multi-gpu yet, but I would be interested to see what's happening.
cheers.

[LeonardKnuth]

Hi @viorik ,

My model is binding with the data, so currently it's not easy to clean it up. However, the main idea is straightforward if we use the nn.DataParallelTable (see more at https://github.com/torch/cunn/blob/master/doc/cunnmodules.md#nn.cunnmodules.dok).

I've always thought how to use LSTM or ConvLSTM in parallel, and found it seems impossible when the recurrent modules never call forget (e.g., remember('both')) because they have to run in an ordered way (i.e., the current state must depend on the previous state). Do you think so? Thanks.

[viorik]

Hi @LeonardKnuth
Apologies for the late reply. Any news?
I think I agree with what you said, and I can't think of a way to make this run. Actually, a colleague set up the training on multi-gpus, the code was running, but the network didn't seem to learn anything. And I suspect it's because of what you said.