<p>Salient object detection aims to identify visually prominent regions in RGB-D images. Recent state-space models have shown strong potential for this task, but many high-capacity or Mamba-based RGB-D methods still underexplore modality-specific capacity allocation. RGB images usually contain dense semantic and texture information, whereas depth maps provide sparse geometric structure and may include measurement noise. To improve the accuracy-efficiency trade-off, we propose HMamba, a heterogeneous gated state-space fusion network for RGB-D salient object detection. HMamba assigns a high-capacity VMamba encoder to RGB input and a lightweight EfficientVMamba encoder to depth input. This design matches model capacity to modality information density. We further introduce a gated bidirectional state-space fusion module and a hierarchical feature aggregation decoder to integrate cross-modal cues and multi-scale features. Experiments on eight RGB-D SOD benchmarks show that HMamba achieves competitive detection accuracy with favorable computational efficiency. Compared with the contemporary Mamba-based baseline, HMamba reduces model size by 51.2% and improves inference speed by 24.8%, while maintaining or improving saliency detection performance across most benchmarks.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Hmamba: heterogeneous gated state-space fusion for efficient RGB-D salient object detection

  • Yun Meng,
  • Peipei Wang,
  • Zhanshan Zhao,
  • Jiao Yin,
  • Zhiqiang Lu,
  • Chuanxing Cheng

摘要

Salient object detection aims to identify visually prominent regions in RGB-D images. Recent state-space models have shown strong potential for this task, but many high-capacity or Mamba-based RGB-D methods still underexplore modality-specific capacity allocation. RGB images usually contain dense semantic and texture information, whereas depth maps provide sparse geometric structure and may include measurement noise. To improve the accuracy-efficiency trade-off, we propose HMamba, a heterogeneous gated state-space fusion network for RGB-D salient object detection. HMamba assigns a high-capacity VMamba encoder to RGB input and a lightweight EfficientVMamba encoder to depth input. This design matches model capacity to modality information density. We further introduce a gated bidirectional state-space fusion module and a hierarchical feature aggregation decoder to integrate cross-modal cues and multi-scale features. Experiments on eight RGB-D SOD benchmarks show that HMamba achieves competitive detection accuracy with favorable computational efficiency. Compared with the contemporary Mamba-based baseline, HMamba reduces model size by 51.2% and improves inference speed by 24.8%, while maintaining or improving saliency detection performance across most benchmarks.