New word discovery is one of the basic tasks in natural language processing. Its main work is to mine existing corpora to identify new words. This chapter defines new word discovery and then details the rule-based, statistical model-based, and deep learning-based methods. It also gives the latest review on multilingual new word discovery and finally demonstrates two new word discovery experiments.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

New Word Discovery

  • Huaping Zhang,
  • Jianyun Shang

摘要

New word discovery is one of the basic tasks in natural language processing. Its main work is to mine existing corpora to identify new words. This chapter defines new word discovery and then details the rule-based, statistical model-based, and deep learning-based methods. It also gives the latest review on multilingual new word discovery and finally demonstrates two new word discovery experiments.