In medical diagnostics, multi-modality medical image fusion is essential for providing comprehensive pathological information. However, traditional fusion techniques often fail to adequately combine high and low-frequency information from source images, resulting in the loss of crucial details. To address this issue, we introduce an innovative medical image fusion model, Diff-MF. Based on an explicit denoising diffusion probabilistic model (DDPM) and integrated with a feature fusion module, this model effectively utilizes the semantic features of each modality to distinguish and adaptively merge high and low-frequency information, thereby preserving rich structural and detailed information. Experimental results on public Harvard datasets (MRI-CT images) demonstrate our model’s exceptional performance in maintaining the integrity of modal structures and richness of details, highlighting its effectiveness and potential for application in the medical image fusion field.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multi-modality Medical Image Fusion Based on Diffusion Models and Cross Attention Fusion

  • Yuheng Han,
  • Xingyu Qian,
  • Junkang Wang,
  • Ping Deng,
  • Lu Zhang,
  • Hao Wu

摘要

In medical diagnostics, multi-modality medical image fusion is essential for providing comprehensive pathological information. However, traditional fusion techniques often fail to adequately combine high and low-frequency information from source images, resulting in the loss of crucial details. To address this issue, we introduce an innovative medical image fusion model, Diff-MF. Based on an explicit denoising diffusion probabilistic model (DDPM) and integrated with a feature fusion module, this model effectively utilizes the semantic features of each modality to distinguish and adaptively merge high and low-frequency information, thereby preserving rich structural and detailed information. Experimental results on public Harvard datasets (MRI-CT images) demonstrate our model’s exceptional performance in maintaining the integrity of modal structures and richness of details, highlighting its effectiveness and potential for application in the medical image fusion field.