Zero-shot Chinese character recognition (ZSCCR) aims to recognize unseen Chinese characters by learning the semantic knowledge of seen characters. Radical-based methods treat Chinese characters as combinations of radicals, recognizing characters by predicting the radicals in the images. Existing radical-based methods have a closed radical parsing process that cannot be intervened in mid-course, relying only on semantic labels for constraints. However, semantic embedding vectors are usually manually designed and lack alignment with visual features, making it extremely difficult for the model to learn and locate discriminative radical representations from visual features. This paper proposes a ZSCCR network called Learning Explicit Radical Representations (LERRNet). LERRNet introduces learnable attribute hint vectors to guide the model in locating discriminative radicals and learning explicit representations of images. Specifically, we introduce a Radical Relevance Enhanced Encoder (RREE) to enhance the correlation of local radicals by augmenting the relationships between grid regions in visual features. Guided by attribute hint vectors, LERRNet employs a Radical Representation Decoder (RRD) to locate the most relevant regions of each radical in the given image and learn explicit radical representations. Extensive experiments demonstrate that LERRNet outperforms state-of-the-art radical/stroke-based methods across three ZSCCR benchmarks.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Learning Explicit Radical Representations for Zero-Shot Chinese Character Recognition

  • Song-Liang Pan,
  • Da-Han Wang,
  • Nanfeng Jiang,
  • Xu-Yao Zhang,
  • Shunzhi Zhu

摘要

Zero-shot Chinese character recognition (ZSCCR) aims to recognize unseen Chinese characters by learning the semantic knowledge of seen characters. Radical-based methods treat Chinese characters as combinations of radicals, recognizing characters by predicting the radicals in the images. Existing radical-based methods have a closed radical parsing process that cannot be intervened in mid-course, relying only on semantic labels for constraints. However, semantic embedding vectors are usually manually designed and lack alignment with visual features, making it extremely difficult for the model to learn and locate discriminative radical representations from visual features. This paper proposes a ZSCCR network called Learning Explicit Radical Representations (LERRNet). LERRNet introduces learnable attribute hint vectors to guide the model in locating discriminative radicals and learning explicit representations of images. Specifically, we introduce a Radical Relevance Enhanced Encoder (RREE) to enhance the correlation of local radicals by augmenting the relationships between grid regions in visual features. Guided by attribute hint vectors, LERRNet employs a Radical Representation Decoder (RRD) to locate the most relevant regions of each radical in the given image and learn explicit radical representations. Extensive experiments demonstrate that LERRNet outperforms state-of-the-art radical/stroke-based methods across three ZSCCR benchmarks.