what is the frist fd?

cyberblue1

Hello, thank you for your outstanding work. Regarding the decoder, since the input fd of the later layers is the output fd of the previous layer, what is the input fd of the first decoder layer?

boringKey

Thank you for your approval of the work. In the MSTAD decoder, the input fd of the first layer comes from the output of the last layer of the encoder, as in the vanilla transformer. I hope this answer helps you.

cyberblue1

Thank you for your response. By the way, I would like to ask how long your code takes to train. I don’t have the conditions to train it right now, but I want to know the training time in advance.