Image super-resolution is a critical task that aims to synthesize high-resolution images from low-resolution images, addressing limitations in applications such as low-resolution object recognition and medical image enhancement. Generative adversarial network (GAN) based methods have been the state-of-the-art in image super-resolution, utilising convolutional neural networks (CNNs) for both generator and discriminator networks. However, CNNs are not optimal for exploiting global information, unlike transformers, a recent breakthrough in deep learning due to their self-attention mechanism. Inspired by the success of transformers in language and vision applications, we propose a novel image super-resolution method called SRTransGAN, which leverages a transformer-based GAN architecture. Our approach employs a transformer-based encoder-decoder network as a generator to produce 2 \(\times \) and 4 \(\times \) high-resolution images. Our proposed SRTransGAN outperforms existing methods by 4.38% on average, as measured by PSNR and SSIM scores. We also demonstrate the effectiveness of our method through saliency map analysis. Our method provides a promising new approach for image super-resolution, highlighting the potential of transformer-based architectures in addressing this critical problem. The code used in the paper is publicly available at https://github.com/nbaghel777/SRTransGAN .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

SRTransGAN: Image Super-Resolution Using Transformer Based Generative Adversarial Network

  • Neeraj Baghel,
  • Shiv Ram Dubey,
  • Satish Kumar Singh

摘要

Image super-resolution is a critical task that aims to synthesize high-resolution images from low-resolution images, addressing limitations in applications such as low-resolution object recognition and medical image enhancement. Generative adversarial network (GAN) based methods have been the state-of-the-art in image super-resolution, utilising convolutional neural networks (CNNs) for both generator and discriminator networks. However, CNNs are not optimal for exploiting global information, unlike transformers, a recent breakthrough in deep learning due to their self-attention mechanism. Inspired by the success of transformers in language and vision applications, we propose a novel image super-resolution method called SRTransGAN, which leverages a transformer-based GAN architecture. Our approach employs a transformer-based encoder-decoder network as a generator to produce 2 \(\times \) and 4 \(\times \) high-resolution images. Our proposed SRTransGAN outperforms existing methods by 4.38% on average, as measured by PSNR and SSIM scores. We also demonstrate the effectiveness of our method through saliency map analysis. Our method provides a promising new approach for image super-resolution, highlighting the potential of transformer-based architectures in addressing this critical problem. The code used in the paper is publicly available at https://github.com/nbaghel777/SRTransGAN .