<p>In this study, we address these challenges by introducing common multimodal image representation, a novel neural network-based model designed for multimodal image registration. Common multimodal image representation network utilizes a densely connected convolutional network architecture, inspired by the Tiramisu model, to transform diverse imaging modalities into a common latent space. This latent space, termed the common multimodal image representation, facilitates the integration and alignment of images by abstracting and preserving critical features across different modalities. We employed the publicly available multimodal biomedical dataset for evaluating registration methods, which includes magnetic resonance imaging, computed tomography, positron emission tomography, and single photon emission computed tomography images covering a variety of anatomical regions. The dataset provided a robust foundation for training and testing common multimodal image representation network, ensuring the model’s applicability across various clinical scenarios. Our experimental results demonstrate the superior performance of common multimodal image representation network in terms of accuracy and efficiency. These results outperform existing models such as modality fusion net, registration network, Fusion convolutional neural network, and MultiModNet, both in accuracy and computational efficiency. Common multimodal image representation network exhibited rapid computation times, emphasizing its suitability for clinical use.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multi-modal medical image fusion using image co-registration techniques

  • Sonia Gupta,
  • Sandesh Gupta

摘要

In this study, we address these challenges by introducing common multimodal image representation, a novel neural network-based model designed for multimodal image registration. Common multimodal image representation network utilizes a densely connected convolutional network architecture, inspired by the Tiramisu model, to transform diverse imaging modalities into a common latent space. This latent space, termed the common multimodal image representation, facilitates the integration and alignment of images by abstracting and preserving critical features across different modalities. We employed the publicly available multimodal biomedical dataset for evaluating registration methods, which includes magnetic resonance imaging, computed tomography, positron emission tomography, and single photon emission computed tomography images covering a variety of anatomical regions. The dataset provided a robust foundation for training and testing common multimodal image representation network, ensuring the model’s applicability across various clinical scenarios. Our experimental results demonstrate the superior performance of common multimodal image representation network in terms of accuracy and efficiency. These results outperform existing models such as modality fusion net, registration network, Fusion convolutional neural network, and MultiModNet, both in accuracy and computational efficiency. Common multimodal image representation network exhibited rapid computation times, emphasizing its suitability for clinical use.