Attention

Albert-Ma

1. learn the fundamental about attention 2. Transformer, google

Albert-Ma

Read Seq2Seq, read transformer paper, then read some blogs to solve what you are confused. a introduction of Attention(https://blog.csdn.net/malefactor/article/details/78767781 ) a introduction of Transformer(https://www.jianshu.com/p/ef41302edeef) But it has some mistakes in this note. a introduction to both attention and transformer.(https://zhuanlan.zhihu.com/p/38485843)

Albert-Ma

The annotated transformer (http://nlp.seas.harvard.edu/2018/04/03/attention.html)