Scholarlink

Introduction <p>In chronic diseases the length and redundancy of medical records can hamper the accurate interpretation of the individual clinical history, and we hypothesize that Natural Language Processing (NLP) may be used to optimize information from unstructured texts in electronic health records (EHRs). We developed an NLP-based classifier to discriminate rheumatoid (RA) and psoriatic arthritis (PsA) versus non-inflammatory rheumatic diseases (NIRD), namely osteoarthritis and fibromyalgia, from notes in the rheumatology practice.</p> Methods <p>A retrospective cross-sectional study was conducted on 1,372 anonymized EHRs from a single Italian rheumatology center, including 468 RA, 732 PsA, and 172 NIRD cases. After removing explicit diagnostic referrals, texts were embedded using five models and the resulting embeddings were used to train multiple classifiers. The best-performing embedding-classifier combination was selected, predictions were stratified into high-, moderate-, and low-certainty according to a confidence-based decision system, and explainability was assessed using LIME and SHAP.</p> Results <p>The chosen model reached an overall accuracy of 85% in distinguishing between the three diagnostic groups. In detail, 74.5% of cases were classified with high certainty, reaching 94.6% accuracy, while only 1.5% were considered uncertain. No misclassifications occurred between RA and NIRD, though some overlap was seen between PsA and the other two conditions. Attempts to interpret the model’s decisions through dedicated algorithms provided partially meaningful insights, but results were inconsistent, especially when the clinical notes included complex or negated language.</p> Conclusions <p>We developed an NLP-based classifier to detect inflammatory arthritis from unstructured rheumatology notes. The model showed high confidence and accuracy, with low risk of missing patients with inflammatory disease. Although interpretability remains a limitation, external validation in multicenter and multilingual cohorts is warranted to confirm its generalizability.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Development of a confidence-based Natural Language Processing tool to identify inflammatory arthritis from non-inflammatory conditions in Rheumatology medical notes

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年1月10日

查看全文
  • Antonio Tonutti,
  • Nicoletta Luciano,
  • Benedetta Maizza,
  • Antonio Papatolo,
  • Alessandro Bellone,
  • Sofia Svensson Di Giorgio,
  • Gaia Tettamanzi,
  • Maria Chiara Grondelli,
  • Elisa Barone,
  • Nicola Lambri,
  • Daniele Loiacono,
  • Carlo Selmi

摘要

Introduction

In chronic diseases the length and redundancy of medical records can hamper the accurate interpretation of the individual clinical history, and we hypothesize that Natural Language Processing (NLP) may be used to optimize information from unstructured texts in electronic health records (EHRs). We developed an NLP-based classifier to discriminate rheumatoid (RA) and psoriatic arthritis (PsA) versus non-inflammatory rheumatic diseases (NIRD), namely osteoarthritis and fibromyalgia, from notes in the rheumatology practice.

Methods

A retrospective cross-sectional study was conducted on 1,372 anonymized EHRs from a single Italian rheumatology center, including 468 RA, 732 PsA, and 172 NIRD cases. After removing explicit diagnostic referrals, texts were embedded using five models and the resulting embeddings were used to train multiple classifiers. The best-performing embedding-classifier combination was selected, predictions were stratified into high-, moderate-, and low-certainty according to a confidence-based decision system, and explainability was assessed using LIME and SHAP.

Results

The chosen model reached an overall accuracy of 85% in distinguishing between the three diagnostic groups. In detail, 74.5% of cases were classified with high certainty, reaching 94.6% accuracy, while only 1.5% were considered uncertain. No misclassifications occurred between RA and NIRD, though some overlap was seen between PsA and the other two conditions. Attempts to interpret the model’s decisions through dedicated algorithms provided partially meaningful insights, but results were inconsistent, especially when the clinical notes included complex or negated language.

Conclusions

We developed an NLP-based classifier to detect inflammatory arthritis from unstructured rheumatology notes. The model showed high confidence and accuracy, with low risk of missing patients with inflammatory disease. Although interpretability remains a limitation, external validation in multicenter and multilingual cohorts is warranted to confirm its generalizability.