Multispectral YOLO: generic feature fusion framework for solar active region detection
摘要
Monitoring solar phenomena, such as sunspots and active regions, is crucial for ensuring astronaut safety, telecommunications reliability, and predicting terrestrial events like auroras. Traditional methods for detecting these phenomena have limitations in accuracy and baseline maintenance. This paper presents a novel deep learning object detection method that leverages multispectral image data from satellites to enhance the detection of "sunspots" and active regions. Utilizing images from the SDO satellite and annotations from the DeepSDO dataset, we constructed a new dataset composed of aligned observations from HMI Ic, AIA 211 Å, and AIA 335 Å. We adapted and developed a stock YOLOv5-based model capable of handling and fusing any number of input images. Two fusion methodologies, early and late fusion, and three different fusion modules—CatFuse (simple concatenation), CBAMC (CBAM-based module), and TransEnc (transformer encoder)—were implemented and tested. Statistically analysing the results via the Friedman test (p=0.05) revealed significant performance differences among the evaluated models, which were confirmed through pairwise Wilcoxon post-hoc tests. From the approaches tested, CatFuse with early fusion achieved significantly higher detection performance than the other models, with a mAP@0.5:0.95 of 0.52 and a mAP@0.5 of 0.94, an improvement of