Answers to Exercises

Table Ans.3: Probabilities and Entropies of Two Symbols. An essential tool of this theory [information] is a quantity for measuring the amount of information conveyed by a message. Suppose a message is encoded into some long number. To quantify the information content of this message, Shannon proposed to count the number of its digits. ................
................