Dual-flow context enhancement for precise instance segmentation in remote sensing imagery
摘要
High-resolution remote sensing instance segmentation faces challenges such as scale variations, orientation ambiguities, and background clutter, which hinder accurate object localization and mask prediction. To address these issues, we propose the bidirectional attention fusion network (BiAFNet), which employs a dual-path context fusion paradigm to balance global semantics and local details through spatial-channel attention mechanisms. The dual-path framework establishes bidirectional interactions between primary and secondary paths, addressing scale variations and improving detection of small-scale/dense targets. The dual attention fusion module (DAFM) integrates direction-aware attention to model anisotropic object distributions, explicitly tackling orientation ambiguities and clustered distributions. The frequency-domain enhanced simplified hierarchical region of interest extractor (SHRoIE) suppresses background clutter by decomposing features into structural and noise components in the spectral domain. The integration of these components collaboratively optimizes multi-scale feature generalization, achieving improved performance in complex remote sensing scenarios compared to baseline approaches. Experiments on NWPU VHR-10, DIOR, and HRSID datasets demonstrate that BiAFNet achieves mean Average Precision (mAP) scores of 73.2%, 73.4%, and 57.7%, respectively, validating its effectiveness in complex remote sensing scenarios. Code is available at https://github.com/Tsing-time/BiAFNet.