Recently, remarkable progress has been achieved in single image super-resolution using methods based on CNN and Transformer architectures. However, existing approaches often construct a substantial number of network layers, leading to a significant increase in performance requirement and memory consumption, thereby limiting the practical deployment and usability of the models. To address this issue, we propose an Alternating CNN Transformer Block and an Integrative CNN Efficient Transformer for single image super-resolution. We enhance feature extraction efficiency by combining CNN within and between Transformer modules. In addition, we propose two novel structures: Multi-branch Gated CNN and Parallel Channel Attention, aiming to efficiently extract local spatial information and global channel information from images. Extensive experiments demonstrate that our model achieves high performance while maintaining low model complexity. The proposed model attains PSNR values of 32.32 and 30.78 for the Set5 and Manga109 benchmark datasets, respectively, at a scale factor of \(\times \) 4. Compared to other lightweight super-resolution models, our proposed model outperforms them at lower computational costs. The source codes are available at https://github.com/kylechuuuuu/ICTSRN .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Lightweight Single Image Super-Resolution Network Integrating CNN and Transformer

  • Kai Zhu,
  • Li Chen

摘要

Recently, remarkable progress has been achieved in single image super-resolution using methods based on CNN and Transformer architectures. However, existing approaches often construct a substantial number of network layers, leading to a significant increase in performance requirement and memory consumption, thereby limiting the practical deployment and usability of the models. To address this issue, we propose an Alternating CNN Transformer Block and an Integrative CNN Efficient Transformer for single image super-resolution. We enhance feature extraction efficiency by combining CNN within and between Transformer modules. In addition, we propose two novel structures: Multi-branch Gated CNN and Parallel Channel Attention, aiming to efficiently extract local spatial information and global channel information from images. Extensive experiments demonstrate that our model achieves high performance while maintaining low model complexity. The proposed model attains PSNR values of 32.32 and 30.78 for the Set5 and Manga109 benchmark datasets, respectively, at a scale factor of \(\times \) 4. Compared to other lightweight super-resolution models, our proposed model outperforms them at lower computational costs. The source codes are available at https://github.com/kylechuuuuu/ICTSRN .