Attention and Transformer Networks
摘要
Attention is a technique utilized to enhance discriminative features (channel attention) and significant regions of interest (spatial attention) within deep learning networks. Attention mechanisms have found extensive applications in areas such as fine-grained image recognition and weakly-supervised learning, demonstrating their remarkable effectiveness.