<p>Alzheimer’s disease (AD) is a progressive neurodegenerative disorder, and early diagnosis using structural magnetic resonance imaging (sMRI) is crucial for timely intervention. Recently, the Vision Transformer (ViT) has been applied to sMRI-based AD diagnosis, but it often struggles with information redundancy when handling high-dimensional data, leading to focus loss and missed critical features. To address this, we proposed a Patch Residual Transformer (PRT)—a token-efficient vision framework designed for AD diagnosis and the prediction of mild cognitive impairment (MCI) conversion (i.e., stable MCI vs. progressive MCI). The PRT model partitions sMRI into patches and incorporates a novel Patch Residual Block (PRB), which includes two key components: Top-K patch selection and linear stitch patch token fusion (LSPTF). Top-K component meticulously assesses and ranks patches to identify the most crucial ones for AD diagnosis and MCI conversion prediction. The LSPTF employs retention and linear stitch strategies that enable ViT to concentrate on the most critical regions, thereby avoiding focus loss, achieving patch diversification, optimizing model performance, and accelerating training. We validated our method on two large-scale datasets, Alzheimer’s Disease Neuroimaging Initiative (ADNI) and Open Access Series of Imaging Studies-3 (OASIS-3). Our results demonstrate that PRT outperforms existing slice-, patch-, ROI-, and subject-level approaches in both AD diagnosis and MCI conversion prediction. Additionally, the model demonstrates strong generalization and robust salience map consistency across datasets.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A token efficient vision framework using patch residual transformer for Alzheimer’s disease diagnosis

  • Fei Huang,
  • Pengli Zhu,
  • Nanguang Chen,
  • Anqi Qiu

摘要

Alzheimer’s disease (AD) is a progressive neurodegenerative disorder, and early diagnosis using structural magnetic resonance imaging (sMRI) is crucial for timely intervention. Recently, the Vision Transformer (ViT) has been applied to sMRI-based AD diagnosis, but it often struggles with information redundancy when handling high-dimensional data, leading to focus loss and missed critical features. To address this, we proposed a Patch Residual Transformer (PRT)—a token-efficient vision framework designed for AD diagnosis and the prediction of mild cognitive impairment (MCI) conversion (i.e., stable MCI vs. progressive MCI). The PRT model partitions sMRI into patches and incorporates a novel Patch Residual Block (PRB), which includes two key components: Top-K patch selection and linear stitch patch token fusion (LSPTF). Top-K component meticulously assesses and ranks patches to identify the most crucial ones for AD diagnosis and MCI conversion prediction. The LSPTF employs retention and linear stitch strategies that enable ViT to concentrate on the most critical regions, thereby avoiding focus loss, achieving patch diversification, optimizing model performance, and accelerating training. We validated our method on two large-scale datasets, Alzheimer’s Disease Neuroimaging Initiative (ADNI) and Open Access Series of Imaging Studies-3 (OASIS-3). Our results demonstrate that PRT outperforms existing slice-, patch-, ROI-, and subject-level approaches in both AD diagnosis and MCI conversion prediction. Additionally, the model demonstrates strong generalization and robust salience map consistency across datasets.