Scholarlink

<p>Transformers excel in modeling long-range dependencies for computer vision, but the quadratic complexity of self-attention complicates lightweight model design. The Mamba model, with linear complexity, offers similar capabilities but underperforms compared to Transformers. Inspired by these insights, we propose TranMamba, a lightweight hybrid Transformer-Mamba network that enhances both performance and efficiency in Single Image Super-Resolution&#xa0;(SISR). Specifically, we reduce the computational cost associated with self-attention by alternating between Transformer and Mamba modules. To balance the extraction of both local and global information, we designed Transformer Aggregation Block&#xa0;(TAB) and Mamba Aggregation Block&#xa0;(MAB) to strengthen feature representation. Additionally, we developed a Reparameterized Spatial-Gate Feed-Forward Network&#xa0;(RepSGFN) to further improve the model’s feature extraction capabilities. Extensive experiments demonstrate that TranMamba achieves SOTA performance among models of comparable size.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

TranMamba: a lightweight hybrid transformer-Mamba network for single image super-resolution

  • 期刊论文

  • 发表日期：

    2025年3月6日

查看全文
  • Long Zhang,
  • Yi Wan

摘要

Transformers excel in modeling long-range dependencies for computer vision, but the quadratic complexity of self-attention complicates lightweight model design. The Mamba model, with linear complexity, offers similar capabilities but underperforms compared to Transformers. Inspired by these insights, we propose TranMamba, a lightweight hybrid Transformer-Mamba network that enhances both performance and efficiency in Single Image Super-Resolution (SISR). Specifically, we reduce the computational cost associated with self-attention by alternating between Transformer and Mamba modules. To balance the extraction of both local and global information, we designed Transformer Aggregation Block (TAB) and Mamba Aggregation Block (MAB) to strengthen feature representation. Additionally, we developed a Reparameterized Spatial-Gate Feed-Forward Network (RepSGFN) to further improve the model’s feature extraction capabilities. Extensive experiments demonstrate that TranMamba achieves SOTA performance among models of comparable size.