Tumor grading and Isocitrate Dehydrogenase (IDH) status are key prognostic biomarkers. Transformer-based methods are widely applied in glioma segmentation and diagnosis, but challenges still exist due to the tumor’s heterogeneity and the computational burden of Transformers. We propose a multi-task network called MTamba for glioma segmentation, IDH genotyping, and grading. We design Tetra-oriented Mamba to perform global information interaction from different orientations in MRIs for segmentation. We design a T2-FLAIR mismatch feature extraction module to explore the mismatch features between T2 and FLAIR images at different depths to enhance diagnosis. We propose a channel-space Siamese Mamba fusion module to fuse T2-FLAIR mismatch features with multimodal MRI features from the segmentation encoder for diagnosis. Finally, we apply an uncertainty loss optimization method to jointly optimize glioma segmentation, IDH genotyping, and grading. We validate MTamba on the publicly available UCSF-PDGM and BraTS2020 datasets, and experimental results show that MTamba outperforms existing multi-task learning methods. The code for MTamba is available at https://github.com/xhwv/MTamba .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Tetra-Orientated Mamba with T2-FLAIR Mismatch Features for Glioma Segmentation, IDH Genotyping, and Grading

  • Xinyu Li,
  • Jin Liu,
  • Hulin Kuang,
  • Yuanzhuo Wang,
  • Jianxin Wang

摘要

Tumor grading and Isocitrate Dehydrogenase (IDH) status are key prognostic biomarkers. Transformer-based methods are widely applied in glioma segmentation and diagnosis, but challenges still exist due to the tumor’s heterogeneity and the computational burden of Transformers. We propose a multi-task network called MTamba for glioma segmentation, IDH genotyping, and grading. We design Tetra-oriented Mamba to perform global information interaction from different orientations in MRIs for segmentation. We design a T2-FLAIR mismatch feature extraction module to explore the mismatch features between T2 and FLAIR images at different depths to enhance diagnosis. We propose a channel-space Siamese Mamba fusion module to fuse T2-FLAIR mismatch features with multimodal MRI features from the segmentation encoder for diagnosis. Finally, we apply an uncertainty loss optimization method to jointly optimize glioma segmentation, IDH genotyping, and grading. We validate MTamba on the publicly available UCSF-PDGM and BraTS2020 datasets, and experimental results show that MTamba outperforms existing multi-task learning methods. The code for MTamba is available at https://github.com/xhwv/MTamba .