Scholarlink

Abstract <p>In the pursuit of advancing medical artificial intelligence, this study demonstrates that a pretrained Vision Transformer paired with a linear classifier can achieve highly competitive performance in endoscopic image classification. We present a systematic, layerwise analysis that identifies the source of the most discriminative features, thereby challenging the common heuristic according to which only the final layer is used. We identify a distinct peak-before-the-end phenomenon, wherein a late-intermediate layer provides a more generalizable representation for the downstream medical task. On the standard Kvasir and HyperKvasir datasets, our parameter-efficient approach not only achieves excellent accuracy but also drastically reduces computational overhead. This work can serve as a practical guide for the efficient utilization of features from general foundation models in clinical settings.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Where Do the Best Features Lie? A Layerwise Analysis of Transformer Layers for Efficient Endoscopic Image Classification

  • 期刊论文

  • 发表日期：

    2025年12月1日

查看全文
  • A. Taha,
  • R. A. Lukmanov

摘要

Abstract

In the pursuit of advancing medical artificial intelligence, this study demonstrates that a pretrained Vision Transformer paired with a linear classifier can achieve highly competitive performance in endoscopic image classification. We present a systematic, layerwise analysis that identifies the source of the most discriminative features, thereby challenging the common heuristic according to which only the final layer is used. We identify a distinct peak-before-the-end phenomenon, wherein a late-intermediate layer provides a more generalizable representation for the downstream medical task. On the standard Kvasir and HyperKvasir datasets, our parameter-efficient approach not only achieves excellent accuracy but also drastically reduces computational overhead. This work can serve as a practical guide for the efficient utilization of features from general foundation models in clinical settings.