<p>In the field of deep learning-based image deblurring, while the single transformer architecture possesses strong global modeling capabilities, it still exhibits certain limitations in local feature extraction. To further improve the effectiveness of blind image deblurring, we present ARFF-Transformer-CNN Network (ATCNet) which integrates the local feature extraction capabilities of CNN into existing transformers, proposing a dual-branch network architecture that combines CNN and transformer. Specifically, the CNN branch effectively extracts local image features such as edges and textures through multi-layer convolutional operations, while the Transformer branch captures global image information like long-range dependencies and global contextual information through self-attention mechanisms. We also propose the adaptive rational activation feed forward(ARFF) module as the feedforward layer in the transformer. This module is a feedforward network component that combines the learnable activation functions of KAN networks with depthwise separable convolutions, aiming to enhance the nonlinear representation capability of features. Experimental results demonstrate that this dual-branch network architecture achieves excellent deblurring performance across multiple datasets, significantly improving image clarity and detail representation.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Dual-branch network with adaptive rational nonlinear function for image deblurring

  • Wenjing Guo,
  • Jieqing Tan,
  • Linsong Mao,
  • Naimang Hu,
  • Shijie Sun

摘要

In the field of deep learning-based image deblurring, while the single transformer architecture possesses strong global modeling capabilities, it still exhibits certain limitations in local feature extraction. To further improve the effectiveness of blind image deblurring, we present ARFF-Transformer-CNN Network (ATCNet) which integrates the local feature extraction capabilities of CNN into existing transformers, proposing a dual-branch network architecture that combines CNN and transformer. Specifically, the CNN branch effectively extracts local image features such as edges and textures through multi-layer convolutional operations, while the Transformer branch captures global image information like long-range dependencies and global contextual information through self-attention mechanisms. We also propose the adaptive rational activation feed forward(ARFF) module as the feedforward layer in the transformer. This module is a feedforward network component that combines the learnable activation functions of KAN networks with depthwise separable convolutions, aiming to enhance the nonlinear representation capability of features. Experimental results demonstrate that this dual-branch network architecture achieves excellent deblurring performance across multiple datasets, significantly improving image clarity and detail representation.