Information Theory
摘要
This chapter introduces core concepts from information theory, such as surprise and entropy. These ideas are essential for understanding data efficiency, compression, and information loss. In addition, the chapter introduces data discretization as a key technique for transforming continuous data into discrete representations, as well as the Shannon–Nyquist theorem for signal sampling.