Incision segmentation plays a crucial role in clinical surgical automation yet remains an overlooked target. In recent years, the Segment Anything Model (SAM) has demonstrated impressive prompt-based segmentation capabilities, benefiting from extensive pre-training on large datasets. However, due to the complex morphology of incisions and background interference, SAM with existing prompt modes, such as points and bounding boxes, exhibits several limitations. Firstly, point prompts cannot represent the shape information of incisions. Affected by background interference such as bloodstains and surgical instruments, points struggle to effectively guide the model. Secondly, while bounding box prompts contain some spatial information, their relatively coarse structure makes it difficult to capture the complex morphology of incisions. To address these issues, we present the Geometric Informed Polygon Prompt for Incision Segmentation (GPIS), consisting of Polygon Prompt Method (PP) and Geometric Information Enhancement Module (GIE). The PP method introduces a new polygon prompt mode, which refines the prompt structure to better capture the complex morphology of incisions and effectively reduce ambiguity. Furthermore, the GIE module incorporates distance features, mapping polygons into dense prompts enriched with SDF to compensate for missing geometric information. Extensive experiments on the incision segmentation task demonstrate the effectiveness and superiority of GPIS over other prompt modes.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

GPIS: Geometric Informed Polygon Prompt for Incision Segmentation

  • Keran Ding,
  • Peng Qiao,
  • Wenyu Li,
  • Xi Wang,
  • Zhenglun Sun,
  • Yong Dou

摘要

Incision segmentation plays a crucial role in clinical surgical automation yet remains an overlooked target. In recent years, the Segment Anything Model (SAM) has demonstrated impressive prompt-based segmentation capabilities, benefiting from extensive pre-training on large datasets. However, due to the complex morphology of incisions and background interference, SAM with existing prompt modes, such as points and bounding boxes, exhibits several limitations. Firstly, point prompts cannot represent the shape information of incisions. Affected by background interference such as bloodstains and surgical instruments, points struggle to effectively guide the model. Secondly, while bounding box prompts contain some spatial information, their relatively coarse structure makes it difficult to capture the complex morphology of incisions. To address these issues, we present the Geometric Informed Polygon Prompt for Incision Segmentation (GPIS), consisting of Polygon Prompt Method (PP) and Geometric Information Enhancement Module (GIE). The PP method introduces a new polygon prompt mode, which refines the prompt structure to better capture the complex morphology of incisions and effectively reduce ambiguity. Furthermore, the GIE module incorporates distance features, mapping polygons into dense prompts enriched with SDF to compensate for missing geometric information. Extensive experiments on the incision segmentation task demonstrate the effectiveness and superiority of GPIS over other prompt modes.