Purpose <p>Myocardium segmentation in echocardiography videos is a challenging task due to low contrast, noise, and anatomical variability. Traditional deep learning models either process frames independently, ignoring temporal information, or rely on memory-based feature propagation, which accumulates error over time.</p> Methods <p>We propose <b>PointSeg</b>, a transformer-based segmentation framework that integrates point tracking as a temporal cue to ensure stable and consistent segmentation of myocardium across frames. Our method leverages a point-tracking module trained on a synthetic echocardiography dataset to track key anatomical landmarks across video sequences. These tracked trajectories provide an explicit motion-aware signal that guides segmentation, reducing drift and eliminating the need for memory-based feature accumulation. Additionally, we incorporate a temporal smoothing loss to further enhance temporal consistency across frames.</p> Results <p>We evaluate our approach on both public and private echocardiography datasets. Experimental results demonstrate that PointSeg has statistically similar accuracy in terms of Dice to state-of-the-art segmentation models in high-quality echo data, while it achieves better segmentation accuracy in lower-quality echo with improved temporal stability. Furthermore, PointSeg has the key advantage of pixel-level myocardium motion information as opposed to other segmentation methods. Such information is essential in the computation of other downstream tasks such as myocardial strain measurement and regional wall motion abnormality detection.</p> Conclusion <p>PointSeg demonstrates that point tracking can serve as an effective temporal cue for consistent video segmentation, offering a reliable and generalizable approach for myocardium segmentation in echocardiography videos. The code is available at <a href="https://github.com/DeepRCL/PointSeg">https://github.com/DeepRCL/PointSeg</a>.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Point tracking as a temporal Cue for robust myocardial segmentation in echocardiography videos

  • Bahar Khodabakhshian,
  • Nima Hashemi,
  • Armin Saadat,
  • Zahra Gholami,
  • In-Chang Hwang,
  • Samira Sojoudi,
  • Christina Luong,
  • Purang Abolmaesumi,
  • Teresa Tsang

摘要

Purpose

Myocardium segmentation in echocardiography videos is a challenging task due to low contrast, noise, and anatomical variability. Traditional deep learning models either process frames independently, ignoring temporal information, or rely on memory-based feature propagation, which accumulates error over time.

Methods

We propose PointSeg, a transformer-based segmentation framework that integrates point tracking as a temporal cue to ensure stable and consistent segmentation of myocardium across frames. Our method leverages a point-tracking module trained on a synthetic echocardiography dataset to track key anatomical landmarks across video sequences. These tracked trajectories provide an explicit motion-aware signal that guides segmentation, reducing drift and eliminating the need for memory-based feature accumulation. Additionally, we incorporate a temporal smoothing loss to further enhance temporal consistency across frames.

Results

We evaluate our approach on both public and private echocardiography datasets. Experimental results demonstrate that PointSeg has statistically similar accuracy in terms of Dice to state-of-the-art segmentation models in high-quality echo data, while it achieves better segmentation accuracy in lower-quality echo with improved temporal stability. Furthermore, PointSeg has the key advantage of pixel-level myocardium motion information as opposed to other segmentation methods. Such information is essential in the computation of other downstream tasks such as myocardial strain measurement and regional wall motion abnormality detection.

Conclusion

PointSeg demonstrates that point tracking can serve as an effective temporal cue for consistent video segmentation, offering a reliable and generalizable approach for myocardium segmentation in echocardiography videos. The code is available at https://github.com/DeepRCL/PointSeg.