Information theory

(redirected from Classical information theory)
Also found in: Dictionary, Thesaurus, Medical, Encyclopedia.
Related to Classical information theory: Information theorist

Information theory

A mathematical theory first studied by Claude E. Shannon that presents a framework that measures among many things the amount of theoretical coding necessary to communicate information effectively.
References in periodicals archive ?
When we employ coding in classical information theory, we choose a code based on classical information devices, which are the input and the output of the classical channel shown in Fig.
Another important contribution of the information spectrum method the connection of simple statistical hypothesis testing to many topics in classical information theory. (31) Here, simple statistical hypothesis testing is the problem of deciding which candidate is the true distribution with an asymmetric treatment of two kinds of errors when two candidates for the true distribution are given.
It says that in classical information theory, and more generally in any theory that allows the use of self-delimiting bit strings as representations, Kraft s inequality is as tight as it could be.
Full browser ?