<p>The integration of brain-computer interface (BCI) and virtual reality (VR) systems offers transformative potential for spatial cognition training and assessment. By leveraging artificial intelligence (AI) to analyze electroencephalogram (EEG) data, brain activity patterns during spatial tasks can be decoded with high precision. In this context, a hybrid neural network named MSFHNet is proposed, optimized for extracting spatiotemporal features from spatial cognitive EEG signals. The model employs a hierarchical architecture where its temporal module uses multi-scale dilated convolutions to capture dynamic EEG variations, while its spatial module integrates channel-spatial attention mechanisms to model inter-channel dependencies and spatial distributions. Cross-stacked modules further refine discriminative features through deep-level fusion. Evaluations demonstrate the superiority of MSFHNet in the beta2 frequency band, achieving 98.58% classification accuracy and outperforming existing models. This innovation enhances EEG signal representation, advancing AI-powered BCI-VR systems for robust spatial cognitive training.</p> Graphical Abstract <p></p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MSFHNet: a hybrid deep learning network for multi-scale spatiotemporal feature extraction of spatial cognitive EEG signals in BCI-VR systems

  • Xulong Liu,
  • Ziwei Jia,
  • Meng Xun,
  • Xianglong Wan,
  • Huibin Lu,
  • Yanhong Zhou

摘要

The integration of brain-computer interface (BCI) and virtual reality (VR) systems offers transformative potential for spatial cognition training and assessment. By leveraging artificial intelligence (AI) to analyze electroencephalogram (EEG) data, brain activity patterns during spatial tasks can be decoded with high precision. In this context, a hybrid neural network named MSFHNet is proposed, optimized for extracting spatiotemporal features from spatial cognitive EEG signals. The model employs a hierarchical architecture where its temporal module uses multi-scale dilated convolutions to capture dynamic EEG variations, while its spatial module integrates channel-spatial attention mechanisms to model inter-channel dependencies and spatial distributions. Cross-stacked modules further refine discriminative features through deep-level fusion. Evaluations demonstrate the superiority of MSFHNet in the beta2 frequency band, achieving 98.58% classification accuracy and outperforming existing models. This innovation enhances EEG signal representation, advancing AI-powered BCI-VR systems for robust spatial cognitive training.

Graphical Abstract