<p>Monitoring and identifying sleep postures, states or stages is a prerequisite for diagnosing sleep disorders, and provides crucial information for the treatment of sleep disorders. At present, there is no universal multimodal sleep recognition model, and most of the existing methods are limited to accurate modal sleep data. To address these challenges, we propose a dynamic saliency enhanced fusion network, which ranks the features based on data saliency and dynamically selects feature vectors with high attention and coherence, a two-block module is designed for multi-scale convolution and sequence features. We utilized datasets from three distinct sources (the Sleep Bioradiolocation Dataset, the Pressure Map Dataset, and the PSG Dataset), dataset-collecting over 100,000 training samples from dozens of healthy subjects and patients with Parkinson’s disease for our model to learn from. The experimental results show that the model has a 2% -3% improvement compared to existing algorithms, with a promising practical application prospects in sleep recognition applications such as smart healthcare and smart home.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A dynamic saliency enhanced fusion network for multimodal sleep recognition

  • Aite Zhao,
  • Huimin Wu,
  • Ming Chen,
  • Nana Wang

摘要

Monitoring and identifying sleep postures, states or stages is a prerequisite for diagnosing sleep disorders, and provides crucial information for the treatment of sleep disorders. At present, there is no universal multimodal sleep recognition model, and most of the existing methods are limited to accurate modal sleep data. To address these challenges, we propose a dynamic saliency enhanced fusion network, which ranks the features based on data saliency and dynamically selects feature vectors with high attention and coherence, a two-block module is designed for multi-scale convolution and sequence features. We utilized datasets from three distinct sources (the Sleep Bioradiolocation Dataset, the Pressure Map Dataset, and the PSG Dataset), dataset-collecting over 100,000 training samples from dozens of healthy subjects and patients with Parkinson’s disease for our model to learn from. The experimental results show that the model has a 2% -3% improvement compared to existing algorithms, with a promising practical application prospects in sleep recognition applications such as smart healthcare and smart home.