Cannot load recurrent encoder-decoder model trained with copy attention about opennmt-py

[vince62s]

yeah very few use copy_attn since the transformer. what is your use case because I was planning to drop this feature.
anyway I'll at this next week.

[colincwilson]

Thanks! I suspected that this functionality might be phasing out. The use case is morphological reinflection (for example, https://sigmorphon.github.io/sharedtasks/), for which rnn models are still fairly competitive and copy attention is conceptually motivated and empirically useful. I believe I was able to load the model after making a small addition to model.load_state_dict. Would you want a PR for that? Or maybe you have another quick fix in mind on the checkpoint save side, or want to go ahead with the plan of removing copy attention for rnns altogether.

[vince62s]

do you see thoses two in the checkpoint ?
https://github.com/OpenNMT/OpenNMT-py/blob/master/onmt/modules/copy_generator.py#L69-L70

[colincwilson]

Yes, thanks, they are both there in the checkpoint.

model = torch.load('model_step_100.pt')
model['generator'].keys()
> odict_keys(['linear.weight', 'linear.bias', 'linear_copy.weight', 'linear_copy.bias'])

[vince62s]

Can you git pull and tell me if it works for you?

[colincwilson]

Thanks! Will do later this evening.

Update: Still getting the same error, unfortunately. I believe that in your edit, near lines 143-144 of model.py, keyname should be set equal to (name.removeprefix("generator.") +"."+ param_name ...

[vince62s]

closing. Reopen if needed.