To fuse or not to fuse: enhancing military operation object detection with multimodal late fusion and color space optimization
摘要
Object detection in military operations faces critical challenges, including camouflaged targets and occlusion, where traditional RGB-based systems often fail. This study proposes a systematic framework for optimizing multimodal late fusion in object detection by integrating color space transformations with depth information. We contribute three key elements: (1) the development of the “militar-VALID” dataset, a specialized, defense-oriented collection of 6,054 images curated for challenging detection scenarios; (2) a comprehensive statistical evaluation framework comparing four late-fusion algorithms across 247 unique configurations; and (3) the hyperparameter optimization of the optimal fusion configuration through Bayesian search. Leveraging the YOLOv8-small architecture trained on eight parallel color representations (RGB, BGR, Grayscale, HSV, CIELab, YUV, YCrCb, and Depth), we establish that Weighted Boxes Fusion combining RGB, Depth, and HSV modalities delivers statistically significant improvements (