This chapter deals with preprocessing technology. Text Handling must cope with the challenges provided by the external text formats, and create a basic format for further processing. Language Identification is responsible to provide the linguistic resources for the text language recognised, and Topic Identification decides to which topic a text belongs, related to a generic taxonomy used as a starting point for user specific extensions.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Text Analysis Preprocessing

  • Gregor Thurmair

摘要

This chapter deals with preprocessing technology. Text Handling must cope with the challenges provided by the external text formats, and create a basic format for further processing. Language Identification is responsible to provide the linguistic resources for the text language recognised, and Topic Identification decides to which topic a text belongs, related to a generic taxonomy used as a starting point for user specific extensions.