Gastrointestinal (GI) diseases are among the most commonly occurring diseases in the human digestive system, with a significantly higher mortality rate. Early diagnosis plays a crucial role in the effective treatment of these diseases. Accurate evaluation of endoscopic images is essential in the decision making process for patient treatment. While many deep learning models, such as Convolutional Neural Networks (CNNs), have been employed for the detection of these diseases, they struggle to handle large datasets effectively. To overcome these limitations, we propose the use of advanced Vision Transformer (ViT) model, which shown superior performance on large-scale data. The proposed model is evaluated on GastroVision dataset which consists of 8600 images, categorized into 27 different classes. Our proposed approach achieved an recall of 85.75%, precision of 86.41%, and an F1-score of 85.57%, and also outperformed the Densenet-121 model.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multi-class Classification of Gastrointestinal Disease Detection Using Vision Transformers

  • Jagadeesh Kakarla,
  • R. Usha Rani,
  • Vemakoti Krishnamurty,
  • Ruvva Pujitha

摘要

Gastrointestinal (GI) diseases are among the most commonly occurring diseases in the human digestive system, with a significantly higher mortality rate. Early diagnosis plays a crucial role in the effective treatment of these diseases. Accurate evaluation of endoscopic images is essential in the decision making process for patient treatment. While many deep learning models, such as Convolutional Neural Networks (CNNs), have been employed for the detection of these diseases, they struggle to handle large datasets effectively. To overcome these limitations, we propose the use of advanced Vision Transformer (ViT) model, which shown superior performance on large-scale data. The proposed model is evaluated on GastroVision dataset which consists of 8600 images, categorized into 27 different classes. Our proposed approach achieved an recall of 85.75%, precision of 86.41%, and an F1-score of 85.57%, and also outperformed the Densenet-121 model.