Entropy

Entropy is a physical measure of disorder and randomness with broad implications for physics, chemistry, and biology. Entropy is also a mathematical concept of considerable utility. The term entropy was coined by Clausius and intensively studied by the physicists Maxwell, Rayleigh, Gibbs, Planck, and Boltzmann. In the 1940s, Shannon emphasized the information interpretation of entropy and its relevance to communication and probability theory.