Bilinear CNN [1] can be seen as a special variation of the attention mechanism.
TBC
References
[1] Lin, Tsung-Yu, Aruni RoyChowdhury, and Subhransu Maji. “Bilinear CNN models for fine-grained visual recognition.” Proceedings of the IEEE international conference on computer vision. 2015.