Longitudinal monitoring of multiple sclerosis (MS) lesions provides crucial biomarkers for assessing disease progression and treatment efficacy. However, it remains challenging to detect and segment numerous MS lesion instances accurately. One key limitation lies in the common average blending of sliding-window predictions during inference, where unreliable patch-level outputs often lead to many false-positive results. To address this issue, we propose a Calibrated Inter-patch Blending (CIB) framework for new MS lesion segmentation, leveraging patch-level segmentation performance as blending weights. Specifically, our CIB model incorporates a multi-scale design with two additional prediction heads: one estimates the overall segmentation performance of the input patch, while the other predicts the performance of smaller grids within the patch. This dual-head architecture enables the model to capture both global and local contextual information, reducing over-confident lesion predictions. During inference, the predicted segmentation scores serve as calibration weights for adaptively blending patch predictions. Extensive experiments on the MSSEG-2 dataset demonstrate that our CIB model can significantly enhance both new MS lesion detection (e.g., a 12.82% F1 gain) and segmentation (e.g., a 4.01% Dice gain) across various backbones. Our code is available at https://github.com/Yejin0111/CIB .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

New Multiple Sclerosis Lesion Segmentation via Calibrated Inter-patch Blending

  • Jin Ye,
  • Son Duy Dao,
  • Yicheng Wu,
  • Yasmeen George,
  • Thanh Nguyen-Duc,
  • Daniel F. Schmidt,
  • Hengcan Shi,
  • Winston Chong,
  • Jianfei Cai

摘要

Longitudinal monitoring of multiple sclerosis (MS) lesions provides crucial biomarkers for assessing disease progression and treatment efficacy. However, it remains challenging to detect and segment numerous MS lesion instances accurately. One key limitation lies in the common average blending of sliding-window predictions during inference, where unreliable patch-level outputs often lead to many false-positive results. To address this issue, we propose a Calibrated Inter-patch Blending (CIB) framework for new MS lesion segmentation, leveraging patch-level segmentation performance as blending weights. Specifically, our CIB model incorporates a multi-scale design with two additional prediction heads: one estimates the overall segmentation performance of the input patch, while the other predicts the performance of smaller grids within the patch. This dual-head architecture enables the model to capture both global and local contextual information, reducing over-confident lesion predictions. During inference, the predicted segmentation scores serve as calibration weights for adaptively blending patch predictions. Extensive experiments on the MSSEG-2 dataset demonstrate that our CIB model can significantly enhance both new MS lesion detection (e.g., a 12.82% F1 gain) and segmentation (e.g., a 4.01% Dice gain) across various backbones. Our code is available at https://github.com/Yejin0111/CIB .