Real-time RGB-T semantic segmentation via hierarchical semantic guidance and detail-preserving PIDNet
摘要
PIDNet provides a favorable accuracy–speed balance for real-time semantic segmentation, but its original single-modality design is limited when directly applied to RGB-T scenes, where visible and thermal features show heterogeneous responses and require stronger detail preservation and semantic collaboration. To address this issue, this paper proposes DGHF-PIDNet, a detail-preserving and hierarchically guided PIDNet framework for real-time RGB-T semantic segmentation. The proposed method retains the original P–I–D parallel structure and redesigns branch interaction from two aspects. First, Dynamic Asymmetric Gated Re-parameterizable Convolution (DAGRConv) is inserted into the high-resolution P branch. During training, it uses asymmetric multi-branch transformation and input-dependent channel-wise gating to enhance local structures, directional boundaries, and fine-grained details; during inference, its branches are re-parameterized into a single 3