<p>Decoding human emotion states from intracranial neural activity is key in developing affective brain–computer interfaces and new therapies for affective disorders. However, real-world application of decoding requires high performance that integrates neural activity from both gray and white matter, stable generalization across different contexts, sufficient neural encoding explainability and robust real-time implementation, all of which remain elusive. Here we simultaneously recorded intracranial electroencephalogram (iEEG) and abundant self-rated valence and arousal scores across two emotion-eliciting tasks in 18 individuals. We then developed personalized decoding models within a deep learning framework, achieving high-performance decoding of continuous valence and arousal states and improving on the performance of prior EEG and iEEG decoding. Critically, the models substantially improved performance by integrating gray and white matter signals and demonstrated cross-task generalization. The models further revealed shared and preferred mesolimbic–thalamo–cortical subnetworks encoding valence and arousal, showing neurophysiological explainability. Finally, the models realized robust real-time decoding in four new individuals. Our results have implications for advancing emotion decoding neurotechnology toward deployable affective brain–computer interfaces and closed-loop therapeutic systems for affective disorders.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Cross-task, explainable and real-time decoding of human emotion states by integrating gray and white matter intracranial neural activity

  • Yuxiao Yang,
  • Wenjun Chen,
  • Yuyang Chen,
  • Ling Ding,
  • Chi Zhang,
  • Hongjie Jiang,
  • Zhoule Zhu,
  • Xinxia Guo,
  • Shuang Wang,
  • Gang Pan,
  • Ning Wei,
  • Shaohua Hu,
  • Junming Zhu,
  • Yueming Wang

摘要

Decoding human emotion states from intracranial neural activity is key in developing affective brain–computer interfaces and new therapies for affective disorders. However, real-world application of decoding requires high performance that integrates neural activity from both gray and white matter, stable generalization across different contexts, sufficient neural encoding explainability and robust real-time implementation, all of which remain elusive. Here we simultaneously recorded intracranial electroencephalogram (iEEG) and abundant self-rated valence and arousal scores across two emotion-eliciting tasks in 18 individuals. We then developed personalized decoding models within a deep learning framework, achieving high-performance decoding of continuous valence and arousal states and improving on the performance of prior EEG and iEEG decoding. Critically, the models substantially improved performance by integrating gray and white matter signals and demonstrated cross-task generalization. The models further revealed shared and preferred mesolimbic–thalamo–cortical subnetworks encoding valence and arousal, showing neurophysiological explainability. Finally, the models realized robust real-time decoding in four new individuals. Our results have implications for advancing emotion decoding neurotechnology toward deployable affective brain–computer interfaces and closed-loop therapeutic systems for affective disorders.