Recent studies have demonstrated that increasing the size of the self-attention window for Transformer-based image super-resolution models can remarkably enhance model performance. However, the quadratic computational complexity of self-attention is unacceptable, particularly as the self-attention window increases. To address this problem, linear attention provides a more efficient alternative. Nevertheless, its performance is not as satisfactory compared to Softmax Attention. In this paper, we propose an efficient image super-resolution network(MASR) that combines Linear Attention and Softmax Attention. Our approach significantly reduces resource consumption while preserving or even enhancing image quality. On the whole, MASR consists of four parts: shallow feature extraction module(SFE), CNN and Linear Attention Transformer hybrid blocks (CLATs), CNN and Softmax Attention Transformer hybrid blocks(CSATs), and a high-quality image reconstruction module(IR), respectively. Extensive experiments demonstrate that our MASR outperforms existing methods.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MASR: Efficient Multi-attention Network For Single Image Super-Resolution

  • Tao Gong,
  • Zihao Jian,
  • Honghao Wu,
  • Yongxuan Lai,
  • Liang Song

摘要

Recent studies have demonstrated that increasing the size of the self-attention window for Transformer-based image super-resolution models can remarkably enhance model performance. However, the quadratic computational complexity of self-attention is unacceptable, particularly as the self-attention window increases. To address this problem, linear attention provides a more efficient alternative. Nevertheless, its performance is not as satisfactory compared to Softmax Attention. In this paper, we propose an efficient image super-resolution network(MASR) that combines Linear Attention and Softmax Attention. Our approach significantly reduces resource consumption while preserving or even enhancing image quality. On the whole, MASR consists of four parts: shallow feature extraction module(SFE), CNN and Linear Attention Transformer hybrid blocks (CLATs), CNN and Softmax Attention Transformer hybrid blocks(CSATs), and a high-quality image reconstruction module(IR), respectively. Extensive experiments demonstrate that our MASR outperforms existing methods.