<b>Purpose:</b> <p>Minimally invasive spine surgery (MISS) requires 3D navigation of bony anatomy, yet conventional navigation is limited by radiation or line-of-sight-dependent external trackers. This study developed a markerless augmented reality ultrasound (AR-US) system to provide radiation-free 3D visualization while eliminating tracker occlusion.</p> <b>Methods:</b> <p>An integrated pipeline was developed to track a handheld US probe using a head-mounted display (HMD). The probe pose was estimated using FoundationPose during scanning. To mitigate inherent noise in the raw estimates, an Extended Kalman Filter was implemented for refinement. Spatially tracked 2D US images were subsequently used to reconstruct a 3D volume, which was rendered on the HMD.</p> <b>Results:</b> <p>The proposed system reconstructed 3D volumes with an average representation error of <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(2.17\pm 1.57\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>2.17</mn> <mo>±</mo> <mn>1.57</mn> </mrow> </math></EquationSource> </InlineEquation>&#xa0;mm on different experimental phantoms. The 3D visualization was also successfully rendered on the HMD, qualitatively demonstrating a spatial alignment with key anatomic features on a spine phantom.</p> <b>Conclusion:</b> <p>This work demonstrates the feasibility of a markerless AR-US system for coarse navigation in MISS. The presented approach offers a streamlined and intuitive solution, providing clinicians with 3D anatomy for navigating instrumentation..</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Markerless 3D ultrasound reconstruction for augmented reality assisted minimally invasive spine surgery

  • Ruixuan Li,
  • Yuyu Cai,
  • Ayoob Davoodi,
  • Gianni Borghesan,
  • Carlos Rodriguez-Guerrero,
  • Emmanuel Vander Poorten

摘要

Purpose:

Minimally invasive spine surgery (MISS) requires 3D navigation of bony anatomy, yet conventional navigation is limited by radiation or line-of-sight-dependent external trackers. This study developed a markerless augmented reality ultrasound (AR-US) system to provide radiation-free 3D visualization while eliminating tracker occlusion.

Methods:

An integrated pipeline was developed to track a handheld US probe using a head-mounted display (HMD). The probe pose was estimated using FoundationPose during scanning. To mitigate inherent noise in the raw estimates, an Extended Kalman Filter was implemented for refinement. Spatially tracked 2D US images were subsequently used to reconstruct a 3D volume, which was rendered on the HMD.

Results:

The proposed system reconstructed 3D volumes with an average representation error of \(2.17\pm 1.57\) 2.17 ± 1.57  mm on different experimental phantoms. The 3D visualization was also successfully rendered on the HMD, qualitatively demonstrating a spatial alignment with key anatomic features on a spine phantom.

Conclusion:

This work demonstrates the feasibility of a markerless AR-US system for coarse navigation in MISS. The presented approach offers a streamlined and intuitive solution, providing clinicians with 3D anatomy for navigating instrumentation..