Attention Mechanism and Transformers
摘要
In deep learning, many algorithms, especially in the dominant sequence transduction models, include an encoder and a decoder, where the best performing models connect the encoder and decoder through an attention mechanism