<p>State Space Models (SSMs), particularly the Mamba architecture, demonstrate significant potential in medical image segmentation due to the capabilities in modeling long-range dependencies. In the realm of medical image analysis, Vision Mamba UNet (VM-UNet) employs an asymmetric encoder-decoder architecture featuring Visual State Space blocks to capture extended spatial contextual information. However, VM-UNet encounters critical limitations: 1) Its restricted multi-scale modeling capacity during feature extraction impedes the effective fusion of local and global features, ultimately diminishing segmentation accuracy and robustness; 2) When processing complex lesion morphologies, certain boundary information loss occurs. This affects the method’s applicability in precision-sensitive medical imaging scenarios. To address these limitations, we propose MVM-UNet, a multi-branch convolutional VM-UNet architecture. By extending VM-UNet, our model integrates a novel convolutional state-space module comprising parallel branches dedicated to capturing local and global features across varying receptive fields. The subsequent feature fusion operations enhance both representational capacity and generalization potential. Specifically, MVM-UNet achieves computational efficiency through depth-wise separable convolutional branches while utilizing heterogeneous depth-wise convolutions with multi-scale kernels for optimal texture characterization in complex lesion regions. Furthermore, the architecture incorporates a hybrid normalization scheme combining BatchNorm and LayerNorm with parametric ReLU activation, significantly improving training stability and feature discriminability. Comprehensive evaluations on the ISIC17 and ISIC18 skin lesion benchmarks, supplemented by a proprietary kidney tumor dataset, demonstrate the superiority of MVM-UNet over existing approaches. Quantitative analyses reveal significant improvements in DSC (increased by 0.37%) and mIoU (increased by 0.71%), statistically validating the framework’s effectiveness in medical image segmentation tasks.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MVM-UNet: multi branch convolutional vision Mamba UNet for medical image segmentation

  • Shaojia Niu,
  • Huimin Pan,
  • Quanli Gao,
  • Lianhe Shao

摘要

State Space Models (SSMs), particularly the Mamba architecture, demonstrate significant potential in medical image segmentation due to the capabilities in modeling long-range dependencies. In the realm of medical image analysis, Vision Mamba UNet (VM-UNet) employs an asymmetric encoder-decoder architecture featuring Visual State Space blocks to capture extended spatial contextual information. However, VM-UNet encounters critical limitations: 1) Its restricted multi-scale modeling capacity during feature extraction impedes the effective fusion of local and global features, ultimately diminishing segmentation accuracy and robustness; 2) When processing complex lesion morphologies, certain boundary information loss occurs. This affects the method’s applicability in precision-sensitive medical imaging scenarios. To address these limitations, we propose MVM-UNet, a multi-branch convolutional VM-UNet architecture. By extending VM-UNet, our model integrates a novel convolutional state-space module comprising parallel branches dedicated to capturing local and global features across varying receptive fields. The subsequent feature fusion operations enhance both representational capacity and generalization potential. Specifically, MVM-UNet achieves computational efficiency through depth-wise separable convolutional branches while utilizing heterogeneous depth-wise convolutions with multi-scale kernels for optimal texture characterization in complex lesion regions. Furthermore, the architecture incorporates a hybrid normalization scheme combining BatchNorm and LayerNorm with parametric ReLU activation, significantly improving training stability and feature discriminability. Comprehensive evaluations on the ISIC17 and ISIC18 skin lesion benchmarks, supplemented by a proprietary kidney tumor dataset, demonstrate the superiority of MVM-UNet over existing approaches. Quantitative analyses reveal significant improvements in DSC (increased by 0.37%) and mIoU (increased by 0.71%), statistically validating the framework’s effectiveness in medical image segmentation tasks.