The ink penetration phenomenon caused by factors such as ink penetration, improper storage environment, paper quality, writing pressure and camera light seriously affects the readability and preservation quality of Tibetan document images. Although this problem has received increasing attention in the field of document processing and digitization, there is currently no publicly available dataset for the ink penetration phenomenon. To this end, we constructed a dataset of Tibetan documents with uniform illumination, Tibetan-Mulitlighting, by scanning documents and taking photos. We also supplemented the dataset by performing low-lighting and non-uniform illumination processing on some Tibetan document data images using a contrast adjustment strategy driven by prior knowledge and a method of illumination migration. A Transformer Tibetan document image enhancement method integrating Top-k selection is proposed. Using an encoder-decoder architecture, the encoder directly operates on pixel patches with position information, and selects the most relevant pixels in the process to improve the focus on global key text information. The decoder reconstructs a clean image from the encoded patches. Experiments show that compared with previous methods such as U-net, GAN, and DocEntr, the proposed model has improved FM, pFM, PSNR, and has a significant effect on reducing the DRD index. It is of great significance for constructing Tibetan document dataset and subsequent recognition of Tibetan document images.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

TibInkTrans: A Top-k Integrated Transformer for Enhancing Tibetan Document Images Affected by Ink Bleed

  • Huarui Li,
  • Qiaoqiao Li,
  • Weilan Wang,
  • Jiaxin Wang,
  • Meiling Liu,
  • Xun Bao,
  • Guanzhong Zhao

摘要

The ink penetration phenomenon caused by factors such as ink penetration, improper storage environment, paper quality, writing pressure and camera light seriously affects the readability and preservation quality of Tibetan document images. Although this problem has received increasing attention in the field of document processing and digitization, there is currently no publicly available dataset for the ink penetration phenomenon. To this end, we constructed a dataset of Tibetan documents with uniform illumination, Tibetan-Mulitlighting, by scanning documents and taking photos. We also supplemented the dataset by performing low-lighting and non-uniform illumination processing on some Tibetan document data images using a contrast adjustment strategy driven by prior knowledge and a method of illumination migration. A Transformer Tibetan document image enhancement method integrating Top-k selection is proposed. Using an encoder-decoder architecture, the encoder directly operates on pixel patches with position information, and selects the most relevant pixels in the process to improve the focus on global key text information. The decoder reconstructs a clean image from the encoded patches. Experiments show that compared with previous methods such as U-net, GAN, and DocEntr, the proposed model has improved FM, pFM, PSNR, and has a significant effect on reducing the DRD index. It is of great significance for constructing Tibetan document dataset and subsequent recognition of Tibetan document images.