Document localization is a primary step in intelligent document analysis. The document images captured by smartphones in nature scene inevitably contain multiple documents, but previous methods rarely focus on multi-document localization. In this paper, we propose a bottom-up multi-document localization model with a multi-document dataset. Specifically, we design several high-to-low resolution branches and repeat fusion across parallel multi-resolution representations to localize corners more accurately. We also introduce an enhanced feature module to improve feature representation around small or blurry document corners. Then, we adopt an associative embedding-based grouping mechanism which generates unique embedding vectors for each corner and clusters the corners automatically to generate complete document instances more efficiently compared with other top-down approaches. For evaluation, we collect a multi-document dataset, containing 24,738 document images in various unstructured environments. Our experiments demonstrate that the proposed baseline model trained on this dataset achieves high accuracy and efficiency in detecting both single and multiple documents. The code and dataset are available on GitHub at https://github.com/TanQiuman/Bottom-Up-Multi-document-Localization .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Bottom-Up Multi-document Localization Method in Unconstrained Environments

  • Qiuman Tan,
  • Kun Xu,
  • Wancheng Jing,
  • Xin Cheng,
  • WenSheng Hu

摘要

Document localization is a primary step in intelligent document analysis. The document images captured by smartphones in nature scene inevitably contain multiple documents, but previous methods rarely focus on multi-document localization. In this paper, we propose a bottom-up multi-document localization model with a multi-document dataset. Specifically, we design several high-to-low resolution branches and repeat fusion across parallel multi-resolution representations to localize corners more accurately. We also introduce an enhanced feature module to improve feature representation around small or blurry document corners. Then, we adopt an associative embedding-based grouping mechanism which generates unique embedding vectors for each corner and clusters the corners automatically to generate complete document instances more efficiently compared with other top-down approaches. For evaluation, we collect a multi-document dataset, containing 24,738 document images in various unstructured environments. Our experiments demonstrate that the proposed baseline model trained on this dataset achieves high accuracy and efficiency in detecting both single and multiple documents. The code and dataset are available on GitHub at https://github.com/TanQiuman/Bottom-Up-Multi-document-Localization .