Text Indexing

This chapter is concerned with text indexing which is the initial step of processing texts. Text indexing is the process of converting a text or texts into a list of words. The basic steps of text indexing are tokenization, stemming, and stop word removal. Tokenization is the process of splitting a text by white space, stemming is the process of converting each token into its root form, and stop word removal is the process of removing stop words from a text. Therefore, this chapter is intended to study text indexing as the initial step.