Text-based Person Search (TPS) grapples with formidable obstacles in seasonal bias generalization due to marked disparities in apparel characteristics across seasonal domains. This paper proposes a lightweight framework, TPS-SG, to address these issues. Traditional Mix-based methods suffer from poor generalization across seasons because they ignore fine-grained alignment of clothing attributes. Meanwhile, existing diffusion models such as Text2Human and Difffashion have problems with low computational efficiency and identity distortion. To try to solve these problems, we propose TPS-SG, a lightweight framework composed of the following components: Semantic-Aware Region Alignment (SARA): Textual attributes are extracted using a pretrained LLM(GPT) and mapped to corresponding body regions to guide visual-text alignment. Region-Specific Replacement Module (RSRM): Clothing regions are selectively replaced based on cosine similarity thresholds to enable controllable cross-season attribute substitution. Multi-Granularity Identity Preservation (MGIP): Identity-attribute disentanglement loss is applied to suppress irrelevant variations and maintain identity consistency. We experimentally demonstrate the effectiveness of TPS-SG on the CUHK-PEDES and ICFG-PEDES datasets. It achieves a Rank-1 accuracy of 73.5% (±0.3%), with mAP and mINP reaching 68.3% and 54.1%, respectively.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

TPS-SG: A Semantic-Generalization Model with Lightweight Mix-Augmentation for Text-Based Person Search

  • Xinpan Yuan,
  • Yuxiang Luo,
  • Qiang Liu,
  • Changhong Zhang,
  • Gan Li

摘要

Text-based Person Search (TPS) grapples with formidable obstacles in seasonal bias generalization due to marked disparities in apparel characteristics across seasonal domains. This paper proposes a lightweight framework, TPS-SG, to address these issues. Traditional Mix-based methods suffer from poor generalization across seasons because they ignore fine-grained alignment of clothing attributes. Meanwhile, existing diffusion models such as Text2Human and Difffashion have problems with low computational efficiency and identity distortion. To try to solve these problems, we propose TPS-SG, a lightweight framework composed of the following components: Semantic-Aware Region Alignment (SARA): Textual attributes are extracted using a pretrained LLM(GPT) and mapped to corresponding body regions to guide visual-text alignment. Region-Specific Replacement Module (RSRM): Clothing regions are selectively replaced based on cosine similarity thresholds to enable controllable cross-season attribute substitution. Multi-Granularity Identity Preservation (MGIP): Identity-attribute disentanglement loss is applied to suppress irrelevant variations and maintain identity consistency. We experimentally demonstrate the effectiveness of TPS-SG on the CUHK-PEDES and ICFG-PEDES datasets. It achieves a Rank-1 accuracy of 73.5% (±0.3%), with mAP and mINP reaching 68.3% and 54.1%, respectively.