Scholarlink

<p>This study explored the integration of supervised, semi-supervised, and unsupervised learning strategies to classify ophthalmic images under label-scarce conditions. Given the high cost of annotations in medical imaging, the goal was to improve diagnostic performance using minimal labeled data and robust feature representations.&#xa0;A dataset of 18,767 multimodal ophthalmic images was collected — 1,877 labeled and 16,890 unlabeled. Three transformer-based architectures —ViT-Base, DeiT-Base, and MaxViT-L—were used for supervised learning. Semi-supervised learning employed pseudo-labeling with a confidence threshold ≥ 0.98. For unsupervised learning, SimCLR-based contrastive learning and K-means clustering were implemented on extracted features. Performance was evaluated using classification accuracy, AUC, F1-score, clustering indices (Silhouette Score, DBI, CH Index), and computational metrics.&#xa0;In supervised learning, ViT-Base achieved the highest accuracy (92.47%), followed by DeiT-Base (89.38%) and MaxViT-L (85.27%). After pseudo-labeling, MaxViT-L achieved the best accuracy (97.49%) and AUC (0.9982). Contrastive learning significantly improved feature clustering, with MaxViT-L reaching a Silhouette Score of 0.556 and a reduced DBI of 0.541. However, computational analysis revealed that MaxViT-L exhibited the highest computational complexity (81,713 MFLOPs) and longest inference (~ 102 ms), while ViT-Base and DeiT-Base showed considerably lower FLOPs (39,120.6 MFLOPs) and faster inference (~ 52 ms). On external validation set, MaxViT demonstrated the best overall performance.&#xa0;Although ViT-Base achieved the highest accuracy in supervised training, MaxViT-L demonstrated the most favorable trade-off between performance and model generalization in semi- and unsupervised settings, Despite its higher computational complexity and longer inference time, MaxViT-L consistently achieved strong accuracy and clustering performance. This approach minimizes dependence on expert annotations, supporting scalable and automated ophthalmic diagnosis.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Efficient Vision Transformers for Ophthalmic Images Classification: A Comparative Study of Supervised, Semi-Supervised, and Unsupervised Learning Approaches

  • 期刊论文

  • 发表日期：

    2025年11月17日

查看全文
  • Ahmed Shakir Al-Wassiti,
  • Mohammed Tareq Mutar,
  • Ahmed Sermed Al Sakini,
  • Luay Salim Rasheed,
  • Wissam Yosif,
  • Mohammad Asaad Abbas,
  • Nissar Riad Raouf,
  • Ali Saad Al-Shammari

摘要

This study explored the integration of supervised, semi-supervised, and unsupervised learning strategies to classify ophthalmic images under label-scarce conditions. Given the high cost of annotations in medical imaging, the goal was to improve diagnostic performance using minimal labeled data and robust feature representations. A dataset of 18,767 multimodal ophthalmic images was collected — 1,877 labeled and 16,890 unlabeled. Three transformer-based architectures —ViT-Base, DeiT-Base, and MaxViT-L—were used for supervised learning. Semi-supervised learning employed pseudo-labeling with a confidence threshold ≥ 0.98. For unsupervised learning, SimCLR-based contrastive learning and K-means clustering were implemented on extracted features. Performance was evaluated using classification accuracy, AUC, F1-score, clustering indices (Silhouette Score, DBI, CH Index), and computational metrics. In supervised learning, ViT-Base achieved the highest accuracy (92.47%), followed by DeiT-Base (89.38%) and MaxViT-L (85.27%). After pseudo-labeling, MaxViT-L achieved the best accuracy (97.49%) and AUC (0.9982). Contrastive learning significantly improved feature clustering, with MaxViT-L reaching a Silhouette Score of 0.556 and a reduced DBI of 0.541. However, computational analysis revealed that MaxViT-L exhibited the highest computational complexity (81,713 MFLOPs) and longest inference (~ 102 ms), while ViT-Base and DeiT-Base showed considerably lower FLOPs (39,120.6 MFLOPs) and faster inference (~ 52 ms). On external validation set, MaxViT demonstrated the best overall performance. Although ViT-Base achieved the highest accuracy in supervised training, MaxViT-L demonstrated the most favorable trade-off between performance and model generalization in semi- and unsupervised settings, Despite its higher computational complexity and longer inference time, MaxViT-L consistently achieved strong accuracy and clustering performance. This approach minimizes dependence on expert annotations, supporting scalable and automated ophthalmic diagnosis.