Information Theory

One of the most important advances in digital communications is obtaining high fidelity in the information transmitted. The purpose of a communication system is, in a broad sense, the transmission of information from one point in space and/or time to another. The amount of information is a measure that determines whether a message can be transmitted and is closely related to the probability of occurrence. This section illustrates this important relationship that provides the basis for information theory: the Shannon channel coding theorem. The events have been represented through symbols. Theoretically, a symbol is the discrete representation of a series of events or a simple event, such that there is evidence about its characteristics.