Purpose <p>This study proposes the fusion of hyperspectral imaging (HSI) and magnetic resonance imaging (MRI) for tumor delineation in image-guided neurosurgery, comparing three clinically inspired registration strategies and presenting a novel visualization for tumor resection guidance from both imaging modalities under controlled phantom conditions.</p> Methods <p>A multimodal brain phantom dataset acquired with a 9.4T preclinical MRI scanner and an HSI camera was used. MRI tissues were segmented using a Segment Anything Model, while HSI data were classified with supervised XGBoost, SVM, and RF models. Three registration strategies were evaluated: surface-based registration, rigid landmark-based registration, and ArUco marker-based registration. Accuracy was assessed using fiducial registration error (FRE) and target registration error (TRE), and the overlap between modalities was quantified by the Dice similarity coefficient (DICE) and average surface distance (ASD).</p> Results <p>Rigid landmark-based registration achieved the best performance (FRE of 1.7 mm, DICE of 85.4%), closely followed by the ArUco-based method, which required minimal infrastructure. Surface-based registration showed higher variability due to manual point acquisition. Overall, a high overlap between MRI and HSI tumor segmentations was observed and further enriching the information by integrating both approaches</p> Conclusions <p>The proposed framework enables a reproducible evaluation of HSI-MRI fusion strategies and highlights the complementary value of volumetric MRI and surface-based HSI. Future work will focus on multimodal tissue classification, improved phantom designs, and validation with patient data.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multimodal HSI-MRI system for tumor delineation in neurosurgical guidance

  • Manuel Villa,
  • Jaime Sancho,
  • Gonzalo Rosa-Olmeda,
  • Aure Enkaoua,
  • Miguel Chavarrías,
  • Eduardo Juarez

摘要

Purpose

This study proposes the fusion of hyperspectral imaging (HSI) and magnetic resonance imaging (MRI) for tumor delineation in image-guided neurosurgery, comparing three clinically inspired registration strategies and presenting a novel visualization for tumor resection guidance from both imaging modalities under controlled phantom conditions.

Methods

A multimodal brain phantom dataset acquired with a 9.4T preclinical MRI scanner and an HSI camera was used. MRI tissues were segmented using a Segment Anything Model, while HSI data were classified with supervised XGBoost, SVM, and RF models. Three registration strategies were evaluated: surface-based registration, rigid landmark-based registration, and ArUco marker-based registration. Accuracy was assessed using fiducial registration error (FRE) and target registration error (TRE), and the overlap between modalities was quantified by the Dice similarity coefficient (DICE) and average surface distance (ASD).

Results

Rigid landmark-based registration achieved the best performance (FRE of 1.7 mm, DICE of 85.4%), closely followed by the ArUco-based method, which required minimal infrastructure. Surface-based registration showed higher variability due to manual point acquisition. Overall, a high overlap between MRI and HSI tumor segmentations was observed and further enriching the information by integrating both approaches

Conclusions

The proposed framework enables a reproducible evaluation of HSI-MRI fusion strategies and highlights the complementary value of volumetric MRI and surface-based HSI. Future work will focus on multimodal tissue classification, improved phantom designs, and validation with patient data.