In Natural Language Processing, Named Entity Recognition (NER) is a critical task that aims to identify entities of interest in a given text. NER is typically solved by discerning entity tokens from non-entity ones via multi-class classifiers. However, training such models may be challenging due to the prevalence of non-entity tokens. To address this issue, in this paper, we investigated the effectiveness of an open-set recognizer, a machine learning model that, generalizing a multi-class classifier, recognizes only entity tokens and rejects non-entity ones. This paper demonstrates that open-set recognizers are an effective approach to address the token recognition problem. Indeed, we compared a traditional token recognizer based on Conditional Random Field with a state-of-the-art instance-based open-set recognizer, and our evaluation shows that the open-set recognizer outperforms the traditional token recognizer.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Open-Set Named Entity Recognition: A Preliminary Study

  • Angelo Impedovo,
  • Giuseppe Rizzo,
  • Antonio Di Mauro

摘要

In Natural Language Processing, Named Entity Recognition (NER) is a critical task that aims to identify entities of interest in a given text. NER is typically solved by discerning entity tokens from non-entity ones via multi-class classifiers. However, training such models may be challenging due to the prevalence of non-entity tokens. To address this issue, in this paper, we investigated the effectiveness of an open-set recognizer, a machine learning model that, generalizing a multi-class classifier, recognizes only entity tokens and rejects non-entity ones. This paper demonstrates that open-set recognizers are an effective approach to address the token recognition problem. Indeed, we compared a traditional token recognizer based on Conditional Random Field with a state-of-the-art instance-based open-set recognizer, and our evaluation shows that the open-set recognizer outperforms the traditional token recognizer.