Hand-annotating medical images with segmentation masks requires an immense amount of time and effort from clinical experts. Replacing full masks with a simpler annotating gesture can mitigate annotation costs. This can come in the form of a scribble, and leads to weakly supervised training scenarios. Scribble-supervised segmentation typically utilises advanced neural architectures to compensate for the limited training data. Instead of just relying strictly on the pixels from each scribble, we also enhance each scribble by spreading, i.e. propagating, annotation labels through the image. We use a hierarchical partitioning of the image, produced with watershed/waterfall transforms, and propagate the individual pixel labels through the waterfall regions. We propose that a semantic label can be propagated to all other pixels in the same waterfall region. This increases the number of pixels that can be used for training supervision. We show experimentally that this technique greatly boosts the performance of established neural architectures on public semantic segmentation datasets like ACDC and MSCMRseg.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Semantic Segmentation with Spreading Scribbles

  • Yeva Gabrielyan,
  • Varduhi Yeghiazaryan,
  • Irina Voiculescu

摘要

Hand-annotating medical images with segmentation masks requires an immense amount of time and effort from clinical experts. Replacing full masks with a simpler annotating gesture can mitigate annotation costs. This can come in the form of a scribble, and leads to weakly supervised training scenarios. Scribble-supervised segmentation typically utilises advanced neural architectures to compensate for the limited training data. Instead of just relying strictly on the pixels from each scribble, we also enhance each scribble by spreading, i.e. propagating, annotation labels through the image. We use a hierarchical partitioning of the image, produced with watershed/waterfall transforms, and propagate the individual pixel labels through the waterfall regions. We propose that a semantic label can be propagated to all other pixels in the same waterfall region. This increases the number of pixels that can be used for training supervision. We show experimentally that this technique greatly boosts the performance of established neural architectures on public semantic segmentation datasets like ACDC and MSCMRseg.