Advancing precision in breast cancer detection: a fusion of vision transformers and CNNs for calcification mammography classification

Breast cancer remains a substantial public health challenge, marked by a rising prevalence. Accurate early detection is paramount for effective treatment and improved patient outcomes in breast cancer. The diversity of breast tumors and the complexity of their microenvironment present significant challenges. Establishing a reliable breast calcification and micro-calcification detection approach is an ongoing issue that researchers must continue to investigate. The goal is to develop an effective methodology that contributes to increased patient survival. Therefore, this paper introduces a novel approach for classifying breast calcifications in mammography, aiming to distinguish between benign and malignant cases. Aiming to address these challenges, we proposed our hybrid approach for breast calcification classification in mammogram images. The proposed approach starts with an image pre-processing phase that includes noise reduction and enhancement filters. Afterward, we proposed our hybrid classification architecture. It includes two branches: First, the vision transformer (ViT++) branch for contextual features. Secondly, a CNN branch based on transfer learning techniques for visual features. Using the CBIS-DDSM dataset, the application of our proposed ViT++ architecture reached the maximum accuracy of 96.12%. Further, the application of the VGG16 as a single feature extractor had a much lower accuracy of 61.96%. Meanwhile, the combination of these techniques in the same architecture improved the accuracy to 99.22%. Three different pre-trained feature extractors were applied in the CNN branch: Xception, VGG16, and RegNetX002. However, the best-obtained outcomes were from the combination of the ViT++ and the VGG16. The experimental findings indicate that the proposed strategy for breast calcification detection has the potential to surpass the performance of currently top-ranked methods, particularly in terms of classification accuracy.