<p>Salient object detection (SOD) aims to identify the most visually compelling regions in images, playing a crucial role in computer vision tasks. Traditional RGB-D/T multimodal interaction methods such as Hypersor with multiplicative operations, FasterSal via concatenation, and SACNet using equal interaction attention typically rely on equal interaction mechanisms and convolutional computations, exhibiting limitations in dynamically and adaptively capturing and representing critical discriminative features. For salient object detection, this paper introduces MC2FNet, a multi-scale cross-modal competitive fusion network for RGB and depth/thermal data, designed to achieve efficient intra-modal, cross-modal, and multi-scale competitive fusion. MC2FNet employs a hybrid attentional approach to reduce computational overhead and enhance feature extraction. Experimental results on RGB-T and RGB-D datasets demonstrate that MC2FNet achieves state-of-the-art performance, outperforming existing methods in accuracy and efficiency. This work advances the field by providing a novel framework for robust multimodal salient object detection. The code will be available at <a href="https://github.com/liangjiaxiaoqi/MC2FNet">https://github.com/liangjiaxiaoqi/MC2FNet</a>.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Competitive fusion in multimodal networks for enhanced salient object detection

  • Hanzhong Tan,
  • Shuangbing Wen,
  • Lingfeng Zhang,
  • Jun Li,
  • Tao Hu

摘要

Salient object detection (SOD) aims to identify the most visually compelling regions in images, playing a crucial role in computer vision tasks. Traditional RGB-D/T multimodal interaction methods such as Hypersor with multiplicative operations, FasterSal via concatenation, and SACNet using equal interaction attention typically rely on equal interaction mechanisms and convolutional computations, exhibiting limitations in dynamically and adaptively capturing and representing critical discriminative features. For salient object detection, this paper introduces MC2FNet, a multi-scale cross-modal competitive fusion network for RGB and depth/thermal data, designed to achieve efficient intra-modal, cross-modal, and multi-scale competitive fusion. MC2FNet employs a hybrid attentional approach to reduce computational overhead and enhance feature extraction. Experimental results on RGB-T and RGB-D datasets demonstrate that MC2FNet achieves state-of-the-art performance, outperforming existing methods in accuracy and efficiency. This work advances the field by providing a novel framework for robust multimodal salient object detection. The code will be available at https://github.com/liangjiaxiaoqi/MC2FNet.