<p>Chinese spelling check is a task to detect and correct spelling mistakes in Chinese texts. Existing research aims to enhance the text representation and exploit multi-source information to improve the detection and correction capabilities of models, with little attention to improving the ability to distinguish confusable words. Contrastive learning, aiming to minimize the distance in the representation space between similar sample pairs, has recently become a dominant technique in natural language processing. Inspired by contrastive learning, we present a novel method for Chinese spelling checking, RCL-CSC, which consists of three modules: language representation, spelling check, and reverse contrastive learning. Specifically, we propose a reverse contrastive learning method, which explicitly forces the model to minimize the agreement between similar examples, namely, the phonetically and visually confusable characters. Experimental results show that our method is model-agnostic, and thus can be combined with existing Chinese spelling check models to achieve state-of-the-art performance.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Chinese Spelling Check Method Based on Reverse Contrastive Learning

  • Nan-Kai Lin,
  • Hong-Yan Wu,
  • Si-Hui Fu,
  • Sheng-Yi Jiang,
  • Ai-Min Yang

摘要

Chinese spelling check is a task to detect and correct spelling mistakes in Chinese texts. Existing research aims to enhance the text representation and exploit multi-source information to improve the detection and correction capabilities of models, with little attention to improving the ability to distinguish confusable words. Contrastive learning, aiming to minimize the distance in the representation space between similar sample pairs, has recently become a dominant technique in natural language processing. Inspired by contrastive learning, we present a novel method for Chinese spelling checking, RCL-CSC, which consists of three modules: language representation, spelling check, and reverse contrastive learning. Specifically, we propose a reverse contrastive learning method, which explicitly forces the model to minimize the agreement between similar examples, namely, the phonetically and visually confusable characters. Experimental results show that our method is model-agnostic, and thus can be combined with existing Chinese spelling check models to achieve state-of-the-art performance.