Kuzushiji characters were used in Japan hundreds of years ago, and many valuable ancient documents are written in Kuzushiji. Research into generating Kuzushiji characters increases the training data for recognizing these characters and enhances people’s interest and knowledge of Kuzushiji, which is crucial for understanding Japan’s past. However, few studies have focused on the Kuzushiji font generation task. A significant challenge in studying Kuzushiji font generation is the increasing number of deteriorated historical documents, leading to some characters being lost or illegible. In recent years, image generation using deep learning has made remarkable progress, and various methods for generating fonts have been developed with great success. However, because Kuzushiji is different from ordinary fonts, with complex structures that have larger deformations and continuous strokes, existing font generation methods do not perform well in generating Kuzushiji font. To address this problem, we propose a Kuzushiji font generation framework based on the diffusion model. Specifically, based on FontDiffuser, we introduce a stroke style module to efficiently extract font style at the stroke level, and we utilize a content-retaining model to ensure the structural integrity of the font. We conducted extensive experiments on a large number of fonts, and the results show that our model is capable of generating high-quality Kuzushiji characters, achieving state-of-the-art performance.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

KuzushijiDiffuser: Japanese Kuzushiji Font Generation with FontDiffuser

  • Honghui Yuan,
  • Keiji Yanai

摘要

Kuzushiji characters were used in Japan hundreds of years ago, and many valuable ancient documents are written in Kuzushiji. Research into generating Kuzushiji characters increases the training data for recognizing these characters and enhances people’s interest and knowledge of Kuzushiji, which is crucial for understanding Japan’s past. However, few studies have focused on the Kuzushiji font generation task. A significant challenge in studying Kuzushiji font generation is the increasing number of deteriorated historical documents, leading to some characters being lost or illegible. In recent years, image generation using deep learning has made remarkable progress, and various methods for generating fonts have been developed with great success. However, because Kuzushiji is different from ordinary fonts, with complex structures that have larger deformations and continuous strokes, existing font generation methods do not perform well in generating Kuzushiji font. To address this problem, we propose a Kuzushiji font generation framework based on the diffusion model. Specifically, based on FontDiffuser, we introduce a stroke style module to efficiently extract font style at the stroke level, and we utilize a content-retaining model to ensure the structural integrity of the font. We conducted extensive experiments on a large number of fonts, and the results show that our model is capable of generating high-quality Kuzushiji characters, achieving state-of-the-art performance.