Shannon’s Entropy, Kullback-Leibler Divergence, and Mutual Information in Diagnostic Systems
摘要
In this chapter, we explore considerations from information theory as applied to screening systems, notably the surprisal, Shannon’s entropy, the Kullback-Leibler divergence and mutual information.