CMT-UNet: enhancing remote sensing image segmentation via a hybrid CNN-Mamba-transformer architecture
摘要
High-resolution visual understanding demands models that balance fine local details, long-range context, and computational efficiency. We present CMT-UNet, a CNN-Mamba-Transformer hybrid architecture built on an architecture-level principle for efficient global–local coupling in dense prediction. The framework integrates a Cross-view State Space (CVSS) encoder for linear-complexity global modeling, a Region-aware Convolution Module (RCM) for spatially selective cross-branch fusion, and a Hybrid Attentional Convolution (HAC) decoder for parallel attention-convolution aggregation. Evaluated on UAVid, Vaihingen, Potsdam, and LoveDA, CMT-UNet achieves favorable accuracy–efficiency trade-offs against mainstream CNN-, Transformer-, and Mamba-based alternatives. Specifically, it reaches 69.1% mIoU on UAVid and yields evident gains for small-object segmentation, while enabling real-time inference on server-grade GPUs. Code and pre-trained models are available at https://github.com/XUE-YYC/CMT-UNet, Zenodo DOI: https://doi.org/10.5281/zenodo.15678911.