LesionAid: vision transformers-based skin lesion generation and classification – A practical review
摘要
Skin cancer is one of the most prevalent forms of human cancer. It is recognized mainly visually, beginning with clinical screening and continuing with the dermoscopic examination, histological assessment, and specimen collection. Deep convolutional neural networks (CNNs) perform highly segregated and potentially universal tasks against a classified fine-grained object. This study suggests a novel multi-class prediction framework that uses ViT and ViTGAN to categories skin lesions. To address the class disparity, GANs (Generative Adversarial Networks) based on vision transformers are used. The framework comprises four main phases: ViTGANs, Image processing, and explainable AI. Phase 1 consists of generating synthetic images using ViTGAN to balance all the classes in the dataset. To enhance the amount of the data, the second phase involves using various morphological processes and data augmentation techniques. In phases three and four, a ViT model for edge computing systems that can recognize patterns and classify skin lesions from the user's skin that is visible in the picture is developed. In phase 3, after classifying the lesions into the desired class with ViT, we will use explainable AI (XAI) that leads to more explainable results (using activation maps, etc.) while ensuring high predictive accuracy. The results demonstrate that the model used for generating synthetic images has achieved an FID score of 13.32 and the ViT model has achieved 99.2% as its training accuracy and 97.4% as its validation accuracy. The whole framework is compared with the existing frameworks for skin lesion detection. And explainable AI (XAI) is used in the proposed framework in order to increase model transparency and boost trust among users by illustrating the main factors affecting predictions. This interpretability helps physicians in making more informed decisions by providing clear insights into the model's reasoning.