RuntimeError (matrix and matrix expected) while training about lm-lstm-crf

[LiyuanLucasLiu]

I'm not sure what happened. But it seems that the fb_lstm_out may not be the expected shape. It could be (my guess) caused by somehow ''illegal input format''

Hope it can help you :-)

[erayyildiz]

Hi Liyuan, thanks for your reply but I don't think so the problem is about my data. I am using a samle pos tagging dataset which is in conll format you described in readme file (word tag\n).

The shape of fb_lstm_out is [13, 10, 600]. 600 is the output vector of bidirectional lstm layer and 10 is batch size I am using. I think 13 is the number of words. Is the shape of fb_lstm_out correct? Do you have any advice for me, what should I check else?

[LiyuanLucasLiu]

It seems correct. Have you tried the default dataset? i mean wsj / conll03 / conll00 #9 . I think the first thing we should do is to make sure it's not caused by runtime environments.

[erayyildiz]

I tried the default dataset and the I got the same error again. I think it is about my environment. I have an IBM PowerAI machine and its cpu architecture is powerpc64le which is quite different than intel cpu architectures. Although I install pytorch on anaconda for powerpc, it seems there are still some environmental problems with pytorch.

[LiyuanLucasLiu]

Are you using cpu for the training? If so, you should set --gpu -1.
I think the architecture would not be a big issue, but the dependent libraries may have some problems.
Besides, i would recommend you to re-install pytorch or anaconda.

[erayyildiz]

I tried both cpu and gpu for training and it did not make any changes. I will try to reinstalling pytorch and anaconda. I will inform you about the results. Thanks.