Why is nn.Linear instead of nn. Conv2d used to compute the spatial attention？ about openlongtailrecognition-oltr

[zhmiao]

Hello @jchhuang , we actually followed this paper (https://arxiv.org/pdf/1711.07971.pdf) to build the self attention module, please check it out. They have better explanations on this.

[jchhuang]

it is easy to understand the self-attention, but the implementation of spatial attention is confusing, may you help to explain the spatial attention?

[zhmiao]

@jchhuang OK， I get what you are saying. Actually the spatial attention is just the feature map of that conv layer, we did not do anything special, we just call the feature map spatial attention. In the code, it is much more straightforward. The reason we call it spatial attention is because the feature map basically is a kind of attention spatially in the input image.