Text Analysis Preprocessing
摘要
This chapter deals with preprocessing technology. Text Handling must cope with the challenges provided by the external text formats, and create a basic format for further processing. Language Identification is responsible to provide the linguistic resources for the text language recognised, and Topic Identification decides to which topic a text belongs, related to a generic taxonomy used as a starting point for user specific extensions.