In this chapter, we describe language models, both how they are designed and how they can be used. There are three components supporting recent advances in language model technology: the availability of very large corpora of training data, increases in available computing power, and finally, the research-based improvements to language model designs, for example, the transformer technology.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Building Language Models and Transformers

  • George F. Luger

摘要

In this chapter, we describe language models, both how they are designed and how they can be used. There are three components supporting recent advances in language model technology: the availability of very large corpora of training data, increases in available computing power, and finally, the research-based improvements to language model designs, for example, the transformer technology.