Information Theoretic Quantities and Learning
摘要
The focus in this chapter is on using information theoretic ideas and results to analyze agent learning wherein upon taking some observations of the environment, we develop an understanding of the structure of the environment, formulate models of this structure, and study any remaining apparent randomness or unpredictability.