<p>In real-world self-supervised denoising tasks, understanding the noise distribution and its spatial correlation is crucial. Most of the existing methods employ pixel-shuffle downsampling (PD) to initially decouple the spatial connection of noise. However, an excessive PD stride will destroy the image structure when dealing with strongly correlated noise. This limitation leads to noise insufficient decorrelation, resulting in abnormal color spots and high-frequency detail loss. In this paper, we propose a Tri-Mask Feature Extraction (TMFE) module, which utilizes a parallel branch structure with predefined masks of different shapes that form blind-area to extract multi-perspective features, enabling the network to fully understand the noise distribution. Furthermore, we introduce the Multi-Pixel Information Enhancement (MPIE) module, which captures more neighborhood pixels to reconstruct blind-area and enhance local–global features, then preserve more high-frequency details. Cross-Gated Fusion Network (CGFN) uses cross-concatenation and gated weighting to eliminate redundant features and achieve complementary information fusion. Extensive experiments are conducted on SIDD and DND datasets, and our method achieves competitive performance, which improves denoising performance, preserves texture details, and mitigates aliasing artifacts. The code is available at <a href="https://github.com/worry18/EEFM-BAN">https://github.com/worry18/EEFM-BAN</a>.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Effective enhancement and fusion of multi-perspective features for self-supervised real image denoising

  • Ruiying Wang,
  • Yong Jiang

摘要

In real-world self-supervised denoising tasks, understanding the noise distribution and its spatial correlation is crucial. Most of the existing methods employ pixel-shuffle downsampling (PD) to initially decouple the spatial connection of noise. However, an excessive PD stride will destroy the image structure when dealing with strongly correlated noise. This limitation leads to noise insufficient decorrelation, resulting in abnormal color spots and high-frequency detail loss. In this paper, we propose a Tri-Mask Feature Extraction (TMFE) module, which utilizes a parallel branch structure with predefined masks of different shapes that form blind-area to extract multi-perspective features, enabling the network to fully understand the noise distribution. Furthermore, we introduce the Multi-Pixel Information Enhancement (MPIE) module, which captures more neighborhood pixels to reconstruct blind-area and enhance local–global features, then preserve more high-frequency details. Cross-Gated Fusion Network (CGFN) uses cross-concatenation and gated weighting to eliminate redundant features and achieve complementary information fusion. Extensive experiments are conducted on SIDD and DND datasets, and our method achieves competitive performance, which improves denoising performance, preserves texture details, and mitigates aliasing artifacts. The code is available at https://github.com/worry18/EEFM-BAN.