Scholarlink

<p>Image fusion is a sophisticated improvement technique aimed at integrating data from multiple sensors into a single, detailed and coherent image. This integrated representation supports and simplifies subsequent processing tasks. This article presents a well-crafted fusion method depending on Multi-Head Attention (MA) and Residual Dense Block (RDB) based Generative Adversarial Network (AIR-GANet) for infrared and visible image fusion. The framework utilizes RDB for extracting local features, Multi-Head Attention for capturing global dependencies, ensuring a comprehensive representation of both infrared and visible modalities. A dual discriminator mechanism is incorporated with separate discriminators to refine the fused image through adversarial training, preserving both thermal details and texture information. The fusion module incorporates local and global features into a unified feature map, which is then decoded into the final fused image. By applying AIR-GANet to input infrared (<InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="41598_2025_23011_Article_IEq1.gif" Format="GIF" Height="19" Rendition="HTML" Resolution="72" Type="Linedraw" Width="29" /> </InlineMediaObject> <EquationSource Format="TEX">\(\:IR)\)</EquationSource> </InlineEquation>and visible (<InlineEquation ID="IEq2"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="41598_2025_23011_Article_IEq2.gif" Format="GIF" Height="14" Rendition="HTML" Resolution="72" Type="Linedraw" Width="24" /> </InlineMediaObject> <EquationSource Format="TEX">\(\:Vi\)</EquationSource> </InlineEquation>) images, the resulting fused image maintains crucial informative data from both sources, thus improving overall image quality and enabling high-performance across multiple quantitative evaluation metrics. Extensive evaluations on the TNO, Road Scene and Multi-Spectral Road Scenarios (MSRS) datasets demonstrate that the model attains average Entropy (EN) of 7.4085 and Mutual Information (MI) of 3.1531 on TNO, corresponding values of 7.7086 and 3.6953 on Road Scene, 7.8260 and 3.8502 on MSRS confirming its superior fusion capability across diverse scenarios.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

AIR-GANet: multi-head attention integrated residual dense block based generative adversarial network for visible and infrared image fusion

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年11月11日

查看全文
  • J. Bineeshia,
  • B. Vinoth Kumar

摘要

Image fusion is a sophisticated improvement technique aimed at integrating data from multiple sensors into a single, detailed and coherent image. This integrated representation supports and simplifies subsequent processing tasks. This article presents a well-crafted fusion method depending on Multi-Head Attention (MA) and Residual Dense Block (RDB) based Generative Adversarial Network (AIR-GANet) for infrared and visible image fusion. The framework utilizes RDB for extracting local features, Multi-Head Attention for capturing global dependencies, ensuring a comprehensive representation of both infrared and visible modalities. A dual discriminator mechanism is incorporated with separate discriminators to refine the fused image through adversarial training, preserving both thermal details and texture information. The fusion module incorporates local and global features into a unified feature map, which is then decoded into the final fused image. By applying AIR-GANet to input infrared ( \(\:IR)\) and visible ( \(\:Vi\) ) images, the resulting fused image maintains crucial informative data from both sources, thus improving overall image quality and enabling high-performance across multiple quantitative evaluation metrics. Extensive evaluations on the TNO, Road Scene and Multi-Spectral Road Scenarios (MSRS) datasets demonstrate that the model attains average Entropy (EN) of 7.4085 and Mutual Information (MI) of 3.1531 on TNO, corresponding values of 7.7086 and 3.6953 on Road Scene, 7.8260 and 3.8502 on MSRS confirming its superior fusion capability across diverse scenarios.