The irregular distribution of text is a significant challenge for current scene text recognizers. Rectification methods based on Thin-Plate Spline (TPS) are adopted by various recognizers due to their plug-and-play nature. However, since the TPS transformation parameters are determined based on text boundaries regressed, it struggles to focus on the position of text areas relative to the image and fails to suppress background interference. Although the rectified images retain the geometric structure of the text, this leads to unnatural character deformation and characters exceeding the image boundaries. To address these issues, this paper proposes a scene text recognition algorithm based on corner points and attention mechanisms. Firstly, a novel irregular text rectification algorithm named CornerTPS is introduced, which integrates corner features with image features, allowing the TPS transformation to focus on character position information and improving the rectification effect for irregular text. Then, CornerTPS is improved to a feature-level rectification, and the rectified corner feature map is integrated into the encoder, further guiding the encoder to focus on text area features and reducing the interference of non-text area corners. Experiments on public datasets demonstrate that the algorithm proposed in this paper has a significant advantage in irregular text recognition.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Scene Text Recognition Based on Corner Point and Attention Mechanism

  • Hui Wang,
  • Tao Hu,
  • Xiaoke Geng,
  • Kai Li

摘要

The irregular distribution of text is a significant challenge for current scene text recognizers. Rectification methods based on Thin-Plate Spline (TPS) are adopted by various recognizers due to their plug-and-play nature. However, since the TPS transformation parameters are determined based on text boundaries regressed, it struggles to focus on the position of text areas relative to the image and fails to suppress background interference. Although the rectified images retain the geometric structure of the text, this leads to unnatural character deformation and characters exceeding the image boundaries. To address these issues, this paper proposes a scene text recognition algorithm based on corner points and attention mechanisms. Firstly, a novel irregular text rectification algorithm named CornerTPS is introduced, which integrates corner features with image features, allowing the TPS transformation to focus on character position information and improving the rectification effect for irregular text. Then, CornerTPS is improved to a feature-level rectification, and the rectified corner feature map is integrated into the encoder, further guiding the encoder to focus on text area features and reducing the interference of non-text area corners. Experiments on public datasets demonstrate that the algorithm proposed in this paper has a significant advantage in irregular text recognition.