Scholarlink

Background <p>Non-communicable diseases such as diabetes, fatty liver disease and chronic kidney disease are major global health burdens that benefit from early-stage detection. However, standard diagnostic methods are often time-consuming and dependent on clinical infrastructure, limiting their applicability in routine or population-scale screening.</p> Methods <p>We develop an interactive multimodal disease risk evaluation system based on a self-service, non-invasive device that captures facial images, tongue images and pulse signals. A representation learning framework was employed to calculate cross-modal dependencies for disease prediction. Analyses were performed on a real-world cohort of 2,423 participants spanning nine common non-communicable diseases. Model performance was evaluated using 10 repeated train-test splits, and paired statistical tests were conducted to assess the significance of performance differences.</p> Results <p>Here we show that the system achieves a mean diagnostic accuracy of 92.64% across 10 repeated train-test splits. The interactive multimodal approach improves average performance by 3.39% compared with single-modality baselines, indicating that modeling cross-modal interactions enhances prediction. The importance of cross-modal patterns is analyzed, demonstrating that modalities contribute complementary diagnostic signals to improve the model’s capability.</p> Conclusions <p>Our findings demonstrate that combining non-invasive sensing with interactive multimodal framework supports accessible and scalable disease risk evaluation, and establish iMES as a deployable solution for decentralized disease prevention in community and low-resource settings.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Interactive multimodal disease risk evaluation using a self-service non-invasive device

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年4月18日

查看全文
  • Ziqing Ye,
  • Chenglong Zhang,
  • Baoyuan Wu,
  • David Zhang

摘要

Background

Non-communicable diseases such as diabetes, fatty liver disease and chronic kidney disease are major global health burdens that benefit from early-stage detection. However, standard diagnostic methods are often time-consuming and dependent on clinical infrastructure, limiting their applicability in routine or population-scale screening.

Methods

We develop an interactive multimodal disease risk evaluation system based on a self-service, non-invasive device that captures facial images, tongue images and pulse signals. A representation learning framework was employed to calculate cross-modal dependencies for disease prediction. Analyses were performed on a real-world cohort of 2,423 participants spanning nine common non-communicable diseases. Model performance was evaluated using 10 repeated train-test splits, and paired statistical tests were conducted to assess the significance of performance differences.

Results

Here we show that the system achieves a mean diagnostic accuracy of 92.64% across 10 repeated train-test splits. The interactive multimodal approach improves average performance by 3.39% compared with single-modality baselines, indicating that modeling cross-modal interactions enhances prediction. The importance of cross-modal patterns is analyzed, demonstrating that modalities contribute complementary diagnostic signals to improve the model’s capability.

Conclusions

Our findings demonstrate that combining non-invasive sensing with interactive multimodal framework supports accessible and scalable disease risk evaluation, and establish iMES as a deployable solution for decentralized disease prevention in community and low-resource settings.