Building Language Models and Transformers
摘要
In this chapter, we describe language models, both how they are designed and how they can be used. There are three components supporting recent advances in language model technology: the availability of very large corpora of training data, increases in available computing power, and finally, the research-based improvements to language model designs, for example, the transformer technology.