information theory

n. theory of the likelihood of transmission of messages with clearly described accuracy when the bits of information comprising the messages are subject to transmission failure and distortion; (Computer science) theory based on statistics that deals with the limits and effectiveness of information processing

Not to be confused with information technology, information science, or informatics.Information theory is a branch of applied mathematics and engineering involving the quantification of information to find fundamental limits on compressing and reliably communicating data. A key measure of information that comes up in the theory is known as information entropy, which is usually expressed by the average number of bits needed for storage or communication. Intuitively, entropy quantifies the uncertainty involved in a random variable. For example, a fair coin flip will have less entropy than a roll of a die.
See more at Wikipedia.org...

Theory /the·o·ry/ 1. the doctrine or the principles underlying an art as distinguished from the practice of that particular art. 2. [more]Information theory - Community and Resources

Noun
1. (computer science) a statistical theory dealing with the limits and efficiency of information processing
(hypernym) scientific theory
(classification) statistics

Synonyms and related words:
EDP, automatic electronics, autonetics, bionics, bit, channel, circuit analysis, communication engineering, communication explosion, communication technology, communication theory, communications, communications engineer, communications industry, communications medium, communications network, cybernetics, data retrieval, data storage, decoding, electrical communication, electronic communication, electronic communications, electronic data processing, encoding, entropy, information explosion, media, noise, radio control, radiocommunication, redundancy, servo engineering, servomechanics, signal, signaling, system engineering, systems analysis, systems planning, telecommunication, wire communication, wireless communication