Masked self-supervised dual-scale transformer for enhanced hyperspectral image classification
摘要
In recent years, Transformers have emerged as powerful tools for hyperspectral image (HSI) classification due to their ability to capture vglobal features. Howeer, Transformers tend to overlook local features, and most existing methods rely heavily on labeled data. To address these limitations, this paper proposes a Masked Self-supervised Dual-scale Transformer (MSDT) for HSI classification. MSDT introduces a dual-scale encoder network that extracts features at different scales, enabling the model to capture both global and local features. Additionally, a class token exchange operation facilitates the fusion of features across scales. A masked self-supervised pretraining approach is employed to learn rich feature representations from unlabeled HSI data, further enhancing classification performance. Experimental results on several benchmark datasets demonstrate that MSDT achieves state-of-the-art classification accuracy, outperforming baseline methods. The proposed method not only improves the utilization of unlabeled data but also provides a new perspective for HSI classification using Transformers. The full source code of the proposed MSDT can be found at “https://github.com/MSDT-main/MSDT”.