Dense Vector Representations

In the two previous chapters, we represented the words as strings or Boolean vectors. This chapter describes techniques to convert the words into relatively small numerical vectors also called dense representations. We examine more specifically principal component analysis as well as neural network alternatives, GloVe and CBOW. The chapter contains programs to experiment with these techniques as well as a new kind of classifier using dense representations to replace the word or character input.