Accurately predicting post-stroke motor impairment remains a challenge due to the complexity of functional recovery and its association with neuroimaging biomarkers. This study presents a deep learning (DL) framework that integrates Magnetic Resonance Imaging (MRI)-based measures such as Diffusion Tensor Imaging (DTI) metrics—fractional anisotropy (FA), mean diffusivity (MD), radial diffusivity (RD), and axial diffusivity (AD)—along with white matter (WM) and gray matter (GM) intensities to classify upper limb motor function. Unlike previous approaches, the proposed model directly extracts whole-brain volumetric features without predefined region-of-interest constraints. Feature representation is enhanced using residual connections, attention mechanisms, and Global Average Pooling (GAP), improving classification performance while maintaining computational efficiency. The ensemble framework combines six independently trained models to optimize multi-modality integration. The results demonstrate that the WM + FA combination achieved the highest accuracy (0.97), outperforming the full ensemble model (0.96). These findings exceed the performance reported in prior studies, emphasizing the effectiveness of microstructural and structural biomarkers in motor recovery prediction. This optimized DL framework has the potential to improve post-stroke motor impairment classification, supporting early rehabilitation planning, and personalized treatment strategies.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Attention-Based Multimodal Deep Learning Model for Post-stroke Motor Impairment Prediction

  • Rukiye Karakis,
  • Kali Gurkahraman,
  • Georgios D. Mitsis,
  • Marie-Hèléne Boudrias

摘要

Accurately predicting post-stroke motor impairment remains a challenge due to the complexity of functional recovery and its association with neuroimaging biomarkers. This study presents a deep learning (DL) framework that integrates Magnetic Resonance Imaging (MRI)-based measures such as Diffusion Tensor Imaging (DTI) metrics—fractional anisotropy (FA), mean diffusivity (MD), radial diffusivity (RD), and axial diffusivity (AD)—along with white matter (WM) and gray matter (GM) intensities to classify upper limb motor function. Unlike previous approaches, the proposed model directly extracts whole-brain volumetric features without predefined region-of-interest constraints. Feature representation is enhanced using residual connections, attention mechanisms, and Global Average Pooling (GAP), improving classification performance while maintaining computational efficiency. The ensemble framework combines six independently trained models to optimize multi-modality integration. The results demonstrate that the WM + FA combination achieved the highest accuracy (0.97), outperforming the full ensemble model (0.96). These findings exceed the performance reported in prior studies, emphasizing the effectiveness of microstructural and structural biomarkers in motor recovery prediction. This optimized DL framework has the potential to improve post-stroke motor impairment classification, supporting early rehabilitation planning, and personalized treatment strategies.